Evidence Insight
hmdb-database
90100Total Score
Core Capability
87 / 100
Functional Suitability
11 / 12
Reliability
10 / 12
Performance & Context
8 / 8
Agent Usability
14 / 16
Human Usability
8 / 8
Security
9 / 12
Maintainability
10 / 12
Agent-Specific
17 / 20
Medical Task
20 / 20 Passed
97You need to look up a metabolite by common name (e.g., “Caffeine”) and retrieve its HMDB entry data
4/4
93You have an HMDB ID (e.g., HMDB0000001) and want to extract standardized chemical/biological/clinical fields for downstream analysis
4/4
91Search metabolites by:
4/4
91Text name
4/4
91End-to-end case for Search metabolites by:
4/4
Veto GatesRequired pass for any deployment consideration
Skill Veto✓ All 4 gates passed
✓
Operational Stability
System remains stable across varied inputs and edge cases
PASS✓
Structural Consistency
Output structure conforms to expected skill contract format
PASS✓
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS✓
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASSResearch Veto✅ PASS — Applicable
| Dimension | Result | Detail |
|---|---|---|
| Scientific Integrity | PASS | The archived evaluation kept the skill tied to retrieved records or indexed source material rather than invented scientific claims. |
| Practice Boundaries | PASS | Practice boundaries held because the package remained focused on source handling, lookup, or structured evidence use. |
| Methodological Ground | PASS | The legacy audit preserved a method-grounded interpretation of the Access the Human Metabolome Database (HMDB) to search metabolites by name/structure/ID and extract chemical/biological/clinical fields when you need metabolomics research data or automated HMDB XML mining workflow. |
| Code Usability | PASS | Code usability passed because the search or lookup workflow still exposed a usable entrypoint and output expectation. |
Core Capability87 / 100 — 8 Categories
Functional Suitability
Related legacy finding for hmdb-database: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
11 / 12
92%
Reliability
The archived deduction in reliability traces back to: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
10 / 12
83%
Performance & Context
The legacy audit gave full marks to performance context for this package.
8 / 8
100%
Agent Usability
The legacy audit deducted points for hmdb-database in agent usability.
14 / 16
88%
Human Usability
Human usability reached full score in the archived evaluation.
8 / 8
100%
Security
The archived evaluation left some headroom for hmdb-database under security.
9 / 12
75%
Maintainability
The archived evaluation left some headroom for hmdb-database under maintainability.
10 / 12
83%
Agent-Specific
Related legacy finding for hmdb-database: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
17 / 20
85%
Core Capability Total87 / 100
Medical TaskExecution Average: 92.6 / 100 — Assertions: 20/20 Passed
97
Canonical
You need to look up a metabolite by common name (e.g., “Caffeine”) and retrieve its HMDB entry data
4/4 ✓
93
Variant A
You have an HMDB ID (e.g., HMDB0000001) and want to extract standardized chemical/biological/clinical fields for downstream analysis
4/4 ✓
91
Edge
Search metabolites by:
4/4 ✓
91
Variant B
Text name
4/4 ✓
91
Stress
End-to-end case for Search metabolites by:
4/4 ✓
97
Canonical✅ Pass
You need to look up a metabolite by common name (e.g., “Caffeine”) and retrieve its HMDB entry data
This canonical case stayed inside the documented workflow and remained instruction-led.
Basic 36/40|Specialized 60/60|Total 97/100
✅A1The hmdb-database output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
93
Variant A✅ Pass
You have an HMDB ID (e.g., HMDB0000001) and want to extract standardized chemical/biological/clinical fields for downstream analysis
This variant a case stayed inside the documented workflow and remained instruction-led.
Basic 34/40|Specialized 59/60|Total 93/100
✅A1The hmdb-database output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
91
Edge✅ Pass
Search metabolites by:
The archived run for Search metabolites by: remained guidance-driven rather than command-driven.
Basic 33/40|Specialized 58/60|Total 91/100
✅A1The hmdb-database output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
91
Variant B✅ Pass
Text name
The archived run for Text name remained guidance-driven rather than command-driven.
Basic 32/40|Specialized 59/60|Total 91/100
✅A1The hmdb-database output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
91
Stress✅ Pass
End-to-end case for Search metabolites by:
End-to-end case for Search metabolites by: was evaluated as a bounded documentation path, not as a runnable script workflow.
Basic 29/40|Specialized 60/60|Total 91/100
✅A1The hmdb-database output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
Medical Task Total92.6 / 100
Key Strengths
- Primary routing is Evidence Insight with execution mode B
- Static quality score is 87/100 and dynamic average is 79.6/100
- Assertions and command execution outcomes are recorded per input for human review
- Execution verification summary: Script verification 1/1; adjustment=5. hmdb_parser.py: OK