Evidence Insight
cosmic-database
87100Total Score
Core Capability
81 / 100
Functional Suitability
10 / 12
Reliability
9 / 12
Performance & Context
8 / 8
Agent Usability
13 / 16
Human Usability
7 / 8
Security
9 / 12
Maintainability
9 / 12
Agent-Specific
16 / 20
Medical Task
20 / 20 Passed
96Access COSMIC to download mutation datasets, query Cancer Gene Census, and retrieve mutational signatures when your genomic analysis requires curated somatic mutation resources
4/4
92Access COSMIC to download mutation datasets, query Cancer Gene Census, and retrieve mutational signatures when your genomic analysis requires curated somatic mutation resources
4/4
90Access COSMIC to download mutation datasets, query Cancer Gene Census, and retrieve mutational signatures when your genomic analysis requires curated somatic mutation resources
4/4
90Packaged executable path(s): scripts/download_cosmic.py
4/4
90End-to-end case for Scope-focused workflow aligned to: Access COSMIC to download mutation datasets, query Cancer Gene Census, and retrieve mutational signatures when your genomic analysis requires curated somatic mutation resources
4/4
Veto GatesRequired pass for any deployment consideration
Skill Veto✓ All 4 gates passed
✓
Operational Stability
System remains stable across varied inputs and edge cases
PASS✓
Structural Consistency
Output structure conforms to expected skill contract format
PASS✓
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS✓
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASSResearch Veto✅ PASS — Applicable
| Dimension | Result | Detail |
|---|---|---|
| Scientific Integrity | PASS | The legacy audit did not indicate that retrieval outputs were presented as unsupported findings. |
| Practice Boundaries | PASS | Practice boundaries held because the package remained focused on source handling, lookup, or structured evidence use. |
| Methodological Ground | PASS | The older review treated the package logic as methodologically aligned with its stated workflow. |
| Code Usability | PASS | Code usability passed because the search or lookup workflow still exposed a usable entrypoint and output expectation. |
Core Capability81 / 100 — 8 Categories
Functional Suitability
Related legacy finding for cosmic-database: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
10 / 12
83%
Reliability
Reliability was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
9 / 12
75%
Performance & Context
The legacy audit gave full marks to performance context for this package.
8 / 8
100%
Agent Usability
The legacy audit deducted points for cosmic-database in agent usability.
13 / 16
81%
Human Usability
The archived evaluation left some headroom for cosmic-database under human usability.
7 / 8
88%
Security
The legacy audit deducted points for cosmic-database in security.
9 / 12
75%
Maintainability
The legacy audit deducted points for cosmic-database in maintainability.
9 / 12
75%
Agent-Specific
Related legacy finding for cosmic-database: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
16 / 20
80%
Core Capability Total81 / 100
Medical TaskExecution Average: 91.6 / 100 — Assertions: 20/20 Passed
96
Canonical
Access COSMIC to download mutation datasets, query Cancer Gene Census, and retrieve mutational signatures when your genomic analysis requires curated somatic mutation resources
4/4 ✓
92
Variant A
Access COSMIC to download mutation datasets, query Cancer Gene Census, and retrieve mutational signatures when your genomic analysis requires curated somatic mutation resources
4/4 ✓
90
Edge
Access COSMIC to download mutation datasets, query Cancer Gene Census, and retrieve mutational signatures when your genomic analysis requires curated somatic mutation resources
4/4 ✓
90
Variant B
Packaged executable path(s): scripts/download_cosmic.py
4/4 ✓
90
Stress
End-to-end case for Scope-focused workflow aligned to: Access COSMIC to download mutation datasets, query Cancer Gene Census, and retrieve mutational signatures when your genomic analysis requires curated somatic mutation resources
4/4 ✓
96
Canonical✅ Pass
Access COSMIC to download mutation datasets, query Cancer Gene Census, and retrieve mutational signatures when your genomic analysis requires curated somatic mutation resources
The archived run for Access COSMIC to download mutation datasets, query Cancer Gene... remained guidance-driven rather than command-driven.
Basic 35/40|Specialized 60/60|Total 96/100
✅A1The cosmic-database output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
92
Variant A✅ Pass
Access COSMIC to download mutation datasets, query Cancer Gene Census, and retrieve mutational signatures when your genomic analysis requires curated somatic mutation resources
This variant a case stayed inside the documented workflow and remained instruction-led.
Basic 33/40|Specialized 59/60|Total 92/100
✅A1The cosmic-database output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
90
Edge✅ Pass
Access COSMIC to download mutation datasets, query Cancer Gene Census, and retrieve mutational signatures when your genomic analysis requires curated somatic mutation resources
This edge case stayed inside the documented workflow and remained instruction-led.
Basic 32/40|Specialized 58/60|Total 90/100
✅A1The cosmic-database output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
90
Variant B✅ Pass
Packaged executable path(s): scripts/download_cosmic.py
The archived run for Packaged executable path(s): scripts/download_cosmic.py remained guidance-driven rather than command-driven.
Basic 31/40|Specialized 59/60|Total 90/100
✅A1The cosmic-database output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
90
Stress✅ Pass
End-to-end case for Scope-focused workflow aligned to: Access COSMIC to download mutation datasets, query Cancer Gene Census, and retrieve mutational signatures when your genomic analysis requires curated somatic mutation resources
This stress case stayed inside the documented workflow and remained instruction-led.
Basic 28/40|Specialized 60/60|Total 90/100
✅A1The cosmic-database output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
Medical Task Total91.6 / 100
Key Strengths
- Primary routing is Evidence Insight with execution mode B
- Static quality score is 81/100 and dynamic average is 78.6/100
- Assertions and command execution outcomes are recorded per input for human review
- Execution verification summary: Script verification 1/1; adjustment=5. download_cosmic.py: OK