Evidence Insight

open-targets-db

87100Total Score
Core Capability
88 / 100
Functional Suitability
11 / 12
Reliability
10 / 12
Performance & Context
8 / 8
Agent Usability
14 / 16
Human Usability
8 / 8
Security
10 / 12
Maintainability
10 / 12
Agent-Specific
17 / 20
Medical Task
15 / 20 Passed
88You have a disease (e.g., an EFO ID) and want to discover and prioritize candidate therapeutic targets
3/4
86You have a target (e.g., an Ensembl gene ID) and need to review associated diseases and supporting evidence
3/4
86Entity querying by type: target, disease, or evidence
3/4
86Target discovery for diseases using Open Targets associations
3/4
86End-to-end case for Entity querying by type: target, disease, or evidence
3/4

Veto GatesRequired pass for any deployment consideration

Skill Veto✓ All 4 gates passed
Operational Stability
System remains stable across varied inputs and edge cases
PASS
Structural Consistency
Output structure conforms to expected skill contract format
PASS
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASS
Research Veto✅ PASS — Applicable
DimensionResultDetail
Scientific IntegrityPASSScientific content remained anchored to fetched metadata or source-linked evidence in the legacy review.
Practice BoundariesPASSThe legacy review kept this workflow on the evidence-access side of the boundary, not the advice-giving side.
Methodological GroundPASSThe legacy audit preserved a method-grounded interpretation of the Query the Open Targets Platform to retrieve targets, diseases, or evidence records when you need target-disease association data and evidence-based scores for therapeutic discovery workflow.
Code UsabilityPASSCode usability passed because the search or lookup workflow still exposed a usable entrypoint and output expectation.

Core Capability88 / 1008 Categories

Functional Suitability
Functional suitability was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
11 / 12
92%
Reliability
Reliability was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
10 / 12
83%
Performance & Context
No point loss was recorded for performance context in the legacy audit.
8 / 8
100%
Agent Usability
A modest deduction remained in agent usability for open-targets-db in the archived review.
14 / 16
88%
Human Usability
No point loss was recorded for human usability in the legacy audit.
8 / 8
100%
Security
The legacy audit deducted points for open-targets-db in security.
10 / 12
83%
Maintainability
The archived evaluation left some headroom for open-targets-db under maintainability.
10 / 12
83%
Agent-Specific
Related legacy finding for open-targets-db: Stabilize executable path and fallback behavior. Some inputs only reached PARTIAL due to execution gaps or weak boundary handling
17 / 20
85%
Core Capability Total88 / 100

Medical TaskExecution Average: 86.4 / 100 — Assertions: 15/20 Passed

88
Canonical
You have a disease (e.g., an EFO ID) and want to discover and prioritize candidate therapeutic targets
3/4
86
Variant A
You have a target (e.g., an Ensembl gene ID) and need to review associated diseases and supporting evidence
3/4
86
Edge
Entity querying by type: target, disease, or evidence
3/4
86
Variant B
Target discovery for diseases using Open Targets associations
3/4
86
Stress
End-to-end case for Entity querying by type: target, disease, or evidence
3/4
88
Canonical✅ Pass
You have a disease (e.g., an EFO ID) and want to discover and prioritize candidate therapeutic targets

You have a disease (e.g., an EFO ID) and want to discover and... kept a coherent task boundary even though the preserved run encountered a recoverable error.

Basic 33/40|Specialized 55/60|Total 88/100
A1The open-targets-db output structure matches the documented deliverable
A2The script execution path completed successfully for the documented case
A3The output stays fully within the documented skill boundary
A4The response quality is acceptable for the documented path
Pass rate: 3 / 4
86
Variant A✅ Pass
You have a target (e.g., an Ensembl gene ID) and need to review associated diseases and supporting evidence

The You have a target (e.g., an Ensembl gene ID) and need to review... workflow remained defined, but this run surfaced a recoverable execution problem.

Basic 31/40|Specialized 55/60|Total 86/100
A1The open-targets-db output structure matches the documented deliverable
A2The script execution path completed successfully for the documented case
A3The output stays fully within the documented skill boundary
A4The response quality is acceptable for the documented path
Pass rate: 3 / 4
86
Edge✅ Pass
Entity querying by type: target, disease, or evidence

Entity querying by type: target, disease, or evidence kept a coherent task boundary even though the preserved run encountered a recoverable error.

Basic 30/40|Specialized 56/60|Total 86/100
A1The open-targets-db output structure matches the documented deliverable
A2The script execution path completed successfully for the documented case
A3The output stays fully within the documented skill boundary
A4The response quality is acceptable for the documented path
Pass rate: 3 / 4
86
Variant B✅ Pass
Target discovery for diseases using Open Targets associations

Target discovery for diseases using Open Targets associations kept a coherent task boundary even though the preserved run encountered a recoverable error.

Basic 29/40|Specialized 57/60|Total 86/100
A1The open-targets-db output structure matches the documented deliverable
A2The script execution path completed successfully for the documented case
A3The output stays fully within the documented skill boundary
A4The response quality is acceptable for the documented path
Pass rate: 3 / 4
86
Stress✅ Pass
End-to-end case for Entity querying by type: target, disease, or evidence

The archived evidence for End-to-end case for Entity querying by type: target, disease, or... shows a real execution snag, though not one that erased the workflow contract.

Basic 26/40|Specialized 60/60|Total 86/100
A1The open-targets-db output structure matches the documented deliverable
A2The script execution path completed successfully for the documented case
A3The output stays fully within the documented skill boundary
A4The response quality is acceptable for the documented path
Pass rate: 3 / 4
Medical Task Total86.4 / 100

Key Strengths

  • Primary routing is Evidence Insight with execution mode B
  • Static quality score is 88/100 and dynamic average is 73.6/100
  • Assertions and command execution outcomes are recorded per input for human review
  • Execution verification summary: Script verification 1/1; adjustment=5. query_opentargets.py: OK