Other

pdf-extract

90100Total Score
Core Capability
83 / 100
Functional Suitability
11 / 12
Reliability
10 / 12
Performance & Context
8 / 8
Agent Usability
13 / 16
Human Usability
7 / 8
Security
9 / 12
Maintainability
9 / 12
Agent-Specific
16 / 20
Medical Task
20 / 20 Passed
99Converting a PDF report/paper into Markdown while preserving page structure (## Page XX) for easy navigation
4/4
95Preparing PPT or design materials where you need both extracted text and page screenshots/blocks (tables, figures, diagrams)
4/4
93Extracts selectable PDF text and normalizes paragraphs (collapses line breaks into readable paragraphs)
4/4
93Writes Markdown with a document title and per-page sections (# <filename>, ## Page XX)
4/4
93End-to-end case for Extracts selectable PDF text and normalizes paragraphs (collapses line breaks into readable paragraphs)
4/4

Veto GatesRequired pass for any deployment consideration

Skill Veto✓ All 4 gates passed
✓
Operational Stability
System remains stable across varied inputs and edge cases
PASS
✓
Structural Consistency
Output structure conforms to expected skill contract format
PASS
✓
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS
✓
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASS

Core Capability83 / 100 — 8 Categories

Functional Suitability
Functional suitability was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
11 / 12
92%
Reliability
Related legacy finding for pdf-extract: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
10 / 12
83%
Performance & Context
Performance context reached full score in the archived evaluation.
8 / 8
100%
Agent Usability
The legacy audit deducted points for pdf-extract in agent usability.
13 / 16
81%
Human Usability
The archived evaluation left some headroom for pdf-extract under human usability.
7 / 8
88%
Security
A modest deduction remained in security for pdf-extract in the archived review.
9 / 12
75%
Maintainability
The archived evaluation left some headroom for pdf-extract under maintainability.
9 / 12
75%
Agent-Specific
Agent specific was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
16 / 20
80%
Core Capability Total83 / 100

Medical TaskExecution Average: 94.6 / 100 — Assertions: 20/20 Passed

99
Canonical
Converting a PDF report/paper into Markdown while preserving page structure (## Page XX) for easy navigation
4/4 ✓
95
Variant A
Preparing PPT or design materials where you need both extracted text and page screenshots/blocks (tables, figures, diagrams)
4/4 ✓
93
Edge
Extracts selectable PDF text and normalizes paragraphs (collapses line breaks into readable paragraphs)
4/4 ✓
93
Variant B
Writes Markdown with a document title and per-page sections (# <filename>, ## Page XX)
4/4 ✓
93
Stress
End-to-end case for Extracts selectable PDF text and normalizes paragraphs (collapses line breaks into readable paragraphs)
4/4 ✓
99
Canonical✅ Pass
Converting a PDF report/paper into Markdown while preserving page structure (## Page XX) for easy navigation

For Converting a PDF report/paper into Markdown while preserving page..., the preserved evidence is lightweight but positive: the packaged validation command behaved as expected.

Basic 38/40|Specialized 60/60|Total 99/100
✅A1The pdf-extract output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
95
Variant A✅ Pass
Preparing PPT or design materials where you need both extracted text and page screenshots/blocks (tables, figures, diagrams)

The Preparing PPT or design materials where you need both extracted... path verified the packaged helper command without exposing a deeper execution issue.

Basic 36/40|Specialized 59/60|Total 95/100
✅A1The pdf-extract output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
93
Edge✅ Pass
Extracts selectable PDF text and normalizes paragraphs (collapses line breaks into readable paragraphs)

The archived run for Extracts selectable PDF text and normalizes paragraphs (collapses... confirmed the helper entrypoint and left the workflow in a stable state.

Basic 35/40|Specialized 58/60|Total 93/100
✅A1The pdf-extract output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
93
Variant B✅ Pass
Writes Markdown with a document title and per-page sections (# <filename>, ## Page XX)

The archived run for Writes Markdown with a document title and per-page sections (#... confirmed the helper entrypoint and left the workflow in a stable state.

Basic 34/40|Specialized 59/60|Total 93/100
✅A1The pdf-extract output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
93
Stress✅ Pass
End-to-end case for Extracts selectable PDF text and normalizes paragraphs (collapses line breaks into readable paragraphs)

The End-to-end case for Extracts selectable PDF text and normalizes... path verified the packaged helper command without exposing a deeper execution issue.

Basic 31/40|Specialized 60/60|Total 93/100
✅A1The pdf-extract output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
Medical Task Total94.6 / 100

Key Strengths

  • Primary routing is Other with execution mode B
  • Static quality score is 83/100 and dynamic average is 81.6/100
  • Assertions and command execution outcomes are recorded per input for human review
  • Execution verification summary: Script verification 2/2; adjustment=5. extract_pdf.py: OK; validate_skill.py: OK