Other

academic-cv-generator

89100Total Score
Core Capability
82 / 100
Functional Suitability
11 / 12
Reliability
10 / 12
Performance & Context
8 / 8
Agent Usability
13 / 16
Human Usability
7 / 8
Security
8 / 12
Maintainability
9 / 12
Agent-Specific
16 / 20
Medical Task
20 / 20 Passed
98You receive a messy, free-form CV draft (Chinese or English) and need it reorganized into a standard academic structure
4/4
94You are asked to compile and format Publications from raw citation strings without changing their original citation format
4/4
92Classifies free-form input into: Personal Information, Educational Background, Project Experience, Publications, Awards (optional), Skills
4/4
92Normalizes content into a required intermediate Markdown outline before rendering
4/4
92End-to-end case for Classifies free-form input into: Personal Information, Educational Background, Project Experience, Publications, Awards (optional), Skills
4/4

Veto GatesRequired pass for any deployment consideration

Skill Veto✓ All 4 gates passed
✓
Operational Stability
System remains stable across varied inputs and edge cases
PASS
✓
Structural Consistency
Output structure conforms to expected skill contract format
PASS
✓
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS
✓
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASS

Core Capability82 / 100 — 8 Categories

Functional Suitability
The archived deduction in functional suitability traces back to: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
11 / 12
92%
Reliability
The archived deduction in reliability traces back to: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
10 / 12
83%
Performance & Context
No point loss was recorded for performance context in the legacy audit.
8 / 8
100%
Agent Usability
The archived evaluation left some headroom for academic-cv-generator under agent usability.
13 / 16
81%
Human Usability
The legacy audit deducted points for academic-cv-generator in human usability.
7 / 8
88%
Security
A modest deduction remained in security for academic-cv-generator in the archived review.
8 / 12
67%
Maintainability
The legacy audit deducted points for academic-cv-generator in maintainability.
9 / 12
75%
Agent-Specific
Agent specific was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
16 / 20
80%
Core Capability Total82 / 100

Medical TaskExecution Average: 93.6 / 100 — Assertions: 20/20 Passed

98
Canonical
You receive a messy, free-form CV draft (Chinese or English) and need it reorganized into a standard academic structure
4/4 ✓
94
Variant A
You are asked to compile and format Publications from raw citation strings without changing their original citation format
4/4 ✓
92
Edge
Classifies free-form input into: Personal Information, Educational Background, Project Experience, Publications, Awards (optional), Skills
4/4 ✓
92
Variant B
Normalizes content into a required intermediate Markdown outline before rendering
4/4 ✓
92
Stress
End-to-end case for Classifies free-form input into: Personal Information, Educational Background, Project Experience, Publications, Awards (optional), Skills
4/4 ✓
98
Canonical✅ Pass
You receive a messy, free-form CV draft (Chinese or English) and need it reorganized into a standard academic structure

The archived evaluation treated You receive a messy, free-form CV draft (Chinese or English) and... as a clean in-scope run.

Basic 37/40|Specialized 60/60|Total 98/100
✅A1The academic-cv-generator output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
94
Variant A✅ Pass
You are asked to compile and format Publications from raw citation strings without changing their original citation format

The archived evaluation treated You are asked to compile and format Publications from raw citation... as a clean in-scope run.

Basic 35/40|Specialized 59/60|Total 94/100
✅A1The academic-cv-generator output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
92
Edge✅ Pass
Classifies free-form input into: Personal Information, Educational Background, Project Experience, Publications, Awards (optional), Skills

Classifies free-form input into: Personal Information, Educational... remained well-aligned with the documented contract in the preserved audit.

Basic 34/40|Specialized 58/60|Total 92/100
✅A1The academic-cv-generator output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
92
Variant B✅ Pass
Normalizes content into a required intermediate Markdown outline before rendering

Normalizes content into a required intermediate Markdown outline... remained well-aligned with the documented contract in the preserved audit.

Basic 33/40|Specialized 59/60|Total 92/100
✅A1The academic-cv-generator output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
92
Stress✅ Pass
End-to-end case for Classifies free-form input into: Personal Information, Educational Background, Project Experience, Publications, Awards (optional), Skills

The End-to-end case for Classifies free-form input into: Personal... scenario completed within the documented Generate structured academic CVs from free-form Chinese/English text and export to Word... boundary.

Basic 30/40|Specialized 60/60|Total 92/100
✅A1The academic-cv-generator output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
Medical Task Total93.6 / 100

Key Strengths

  • Primary routing is Other with execution mode B
  • Static quality score is 82/100 and dynamic average is 80.6/100
  • Assertions and command execution outcomes are recorded per input for human review
  • Execution verification summary: Script verification 1/1; adjustment=5. render_cv.py: OK