Other

result-figure-consistencycheck

85100Total Score
Core Capability
84 / 100
Functional Suitability
11 / 12
Reliability
9 / 12
Performance & Context
7 / 8
Agent Usability
14 / 16
Human Usability
8 / 8
Security
10 / 12
Maintainability
9 / 12
Agent-Specific
16 / 20
Medical Task
20 / 20 Passed
90You converted a paper PDF to Markdown and need to verify that Results text matches figure legends (without inspecting the images)
4/4
86You want to detect missing figure references in the Results section (e.g., a legend describes an analysis not mentioned in text)
4/4
84Compares Results descriptions vs figure legend text using the PDF-to-Markdown source (including ## Page XX markers)
4/4
84Produces:
4/4
84End-to-end case for Compares Results descriptions vs figure legend text using the PDF-to-Markdown source (including ## Page XX markers)
4/4

Veto GatesRequired pass for any deployment consideration

Skill Veto✓ All 4 gates passed
✓
Operational Stability
System remains stable across varied inputs and edge cases
PASS
✓
Structural Consistency
Output structure conforms to expected skill contract format
PASS
✓
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS
✓
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASS

Core Capability84 / 100 — 8 Categories

Functional Suitability
The archived deduction in functional suitability traces back to: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
11 / 12
92%
Reliability
Reliability was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
9 / 12
75%
Performance & Context
The legacy audit deducted points for result-figure-consistencycheck in performance context.
7 / 8
88%
Agent Usability
The archived evaluation left some headroom for result-figure-consistencycheck under agent usability.
14 / 16
88%
Human Usability
Human usability reached full score in the archived evaluation.
8 / 8
100%
Security
The archived evaluation left some headroom for result-figure-consistencycheck under security.
10 / 12
83%
Maintainability
The legacy audit deducted points for result-figure-consistencycheck in maintainability.
9 / 12
75%
Agent-Specific
Agent specific was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
16 / 20
80%
Core Capability Total84 / 100

Medical TaskExecution Average: 85.6 / 100 — Assertions: 20/20 Passed

90
Canonical
You converted a paper PDF to Markdown and need to verify that Results text matches figure legends (without inspecting the images)
4/4 ✓
86
Variant A
You want to detect missing figure references in the Results section (e.g., a legend describes an analysis not mentioned in text)
4/4 ✓
84
Edge
Compares Results descriptions vs figure legend text using the PDF-to-Markdown source (including ## Page XX markers)
4/4 ✓
84
Variant B
Produces:
4/4 ✓
84
Stress
End-to-end case for Compares Results descriptions vs figure legend text using the PDF-to-Markdown source (including ## Page XX markers)
4/4 ✓
90
Canonical✅ Pass
You converted a paper PDF to Markdown and need to verify that Results text matches figure legends (without inspecting the images)

This canonical case stayed focused on extracting and normalizing evidence from the provided records instead of drifting into unsupported interpretation.

Basic 36/40|Specialized 54/60|Total 90/100
✅A1The result-figure-consistencycheck output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
86
Variant A✅ Pass
You want to detect missing figure references in the Results section (e.g., a legend describes an analysis not mentioned in text)

You want to detect missing figure references in the Results section... remained tied to the documented analysis contract even when the preserved evidence centered on instructions instead of a full rerun.

Basic 34/40|Specialized 52/60|Total 86/100
✅A1The result-figure-consistencycheck output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
84
Edge✅ Pass
Compares Results descriptions vs figure legend text using the PDF-to-Markdown source (including ## Page XX markers)

This edge case stayed focused on extracting and normalizing evidence from the provided records instead of drifting into unsupported interpretation.

Basic 33/40|Specialized 51/60|Total 84/100
✅A1The result-figure-consistencycheck output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
84
Variant B✅ Pass
Produces:

Produces: remained tied to the documented analysis contract even when the preserved evidence centered on instructions instead of a full rerun.

Basic 32/40|Specialized 52/60|Total 84/100
✅A1The result-figure-consistencycheck output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
84
Stress✅ Pass
End-to-end case for Compares Results descriptions vs figure legend text using the PDF-to-Markdown source (including ## Page XX markers)

End-to-end case for Compares Results descriptions vs figure legend... remained an analysis-style extraction path whose value came from structured data capture rather than a freeform narrative response.

Basic 29/40|Specialized 55/60|Total 84/100
✅A1The result-figure-consistencycheck output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
Medical Task Total85.6 / 100

Key Strengths

  • Primary routing is Other with execution mode A
  • Static quality score is 84/100 and dynamic average is 77.6/100
  • Assertions and command execution outcomes are recorded per input for human review
  • Execution verification summary: No script verification was applicable