Evidence Insight

chembl-database

89100Total Score
Core Capability
83 / 100
Functional Suitability
10 / 12
Reliability
9 / 12
Performance & Context
8 / 8
Agent Usability
13 / 16
Human Usability
8 / 8
Security
9 / 12
Maintainability
10 / 12
Agent-Specific
16 / 20
Medical Task
20 / 20 Passed
97Find candidate compounds by name or synonym (e.g., searching for “aspirin”) and retrieve their ChEMBL records
4/4
93Filter molecules by physicochemical properties (e.g., molecular weight, LogP) to narrow down drug-like candidates
4/4
91Molecule search by preferred name and other metadata fields
4/4
91Property-based filtering (e.g., MW, LogP) using ChEMBL API filter syntax
4/4
91End-to-end case for Molecule search by preferred name and other metadata fields
4/4

Veto GatesRequired pass for any deployment consideration

Skill Veto✓ All 4 gates passed
Operational Stability
System remains stable across varied inputs and edge cases
PASS
Structural Consistency
Output structure conforms to expected skill contract format
PASS
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASS
Research Veto✅ PASS — Applicable
DimensionResultDetail
Scientific IntegrityPASSThe legacy audit did not indicate that retrieval outputs were presented as unsupported findings.
Practice BoundariesPASSThe package stayed in retrieval, extraction, or evidence-organization scope rather than drifting into unsupported interpretation.
Methodological GroundPASSThe legacy audit preserved a method-grounded interpretation of the Query the ChEMBL database for bioactive molecules, targets, bioactivities, and approved drugs; use this when you need to filter by physicochemical properties (e.g., MW, LogP), chemical structure (SMILES), or retrieve drug mechanism information workflow.
Code UsabilityPASSCode usability passed because the search or lookup workflow still exposed a usable entrypoint and output expectation.

Core Capability83 / 1008 Categories

Functional Suitability
The archived deduction in functional suitability traces back to: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
10 / 12
83%
Reliability
The archived deduction in reliability traces back to: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
9 / 12
75%
Performance & Context
The legacy audit gave full marks to performance context for this package.
8 / 8
100%
Agent Usability
The legacy audit deducted points for chembl-database in agent usability.
13 / 16
81%
Human Usability
The legacy audit gave full marks to human usability for this package.
8 / 8
100%
Security
A modest deduction remained in security for chembl-database in the archived review.
9 / 12
75%
Maintainability
A modest deduction remained in maintainability for chembl-database in the archived review.
10 / 12
83%
Agent-Specific
The archived deduction in agent specific traces back to: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
16 / 20
80%
Core Capability Total83 / 100

Medical TaskExecution Average: 92.6 / 100 — Assertions: 20/20 Passed

97
Canonical
Find candidate compounds by name or synonym (e.g., searching for “aspirin”) and retrieve their ChEMBL records
4/4
93
Variant A
Filter molecules by physicochemical properties (e.g., molecular weight, LogP) to narrow down drug-like candidates
4/4
91
Edge
Molecule search by preferred name and other metadata fields
4/4
91
Variant B
Property-based filtering (e.g., MW, LogP) using ChEMBL API filter syntax
4/4
91
Stress
End-to-end case for Molecule search by preferred name and other metadata fields
4/4
97
Canonical✅ Pass
Find candidate compounds by name or synonym (e.g., searching for “aspirin”) and retrieve their ChEMBL records

This canonical case stayed inside the documented workflow and remained instruction-led.

Basic 36/40|Specialized 60/60|Total 97/100
A1The chembl-database output structure matches the documented deliverable
A2The instruction path remains actionable for the documented case
A3The output stays fully within the documented skill boundary
A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
93
Variant A✅ Pass
Filter molecules by physicochemical properties (e.g., molecular weight, LogP) to narrow down drug-like candidates

This variant a case stayed inside the documented workflow and remained instruction-led.

Basic 34/40|Specialized 59/60|Total 93/100
A1The chembl-database output structure matches the documented deliverable
A2The instruction path remains actionable for the documented case
A3The output stays fully within the documented skill boundary
A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
91
Edge✅ Pass
Molecule search by preferred name and other metadata fields

This edge case stayed inside the documented workflow and remained instruction-led.

Basic 33/40|Specialized 58/60|Total 91/100
A1The chembl-database output structure matches the documented deliverable
A2The instruction path remains actionable for the documented case
A3The output stays fully within the documented skill boundary
A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
91
Variant B✅ Pass
Property-based filtering (e.g., MW, LogP) using ChEMBL API filter syntax

The archived run for Property-based filtering (e.g., MW, LogP) using ChEMBL API filter syntax remained guidance-driven rather than command-driven.

Basic 32/40|Specialized 59/60|Total 91/100
A1The chembl-database output structure matches the documented deliverable
A2The instruction path remains actionable for the documented case
A3The output stays fully within the documented skill boundary
A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
91
Stress✅ Pass
End-to-end case for Molecule search by preferred name and other metadata fields

The archived run for End-to-end case for Molecule search by preferred name and other... remained guidance-driven rather than command-driven.

Basic 29/40|Specialized 60/60|Total 91/100
A1The chembl-database output structure matches the documented deliverable
A2The instruction path remains actionable for the documented case
A3The output stays fully within the documented skill boundary
A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
Medical Task Total92.6 / 100

Key Strengths

  • Primary routing is Evidence Insight with execution mode B
  • Static quality score is 83/100 and dynamic average is 79.6/100
  • Assertions and command execution outcomes are recorded per input for human review
  • Execution verification summary: Script verification 1/1; adjustment=5. query_chembl.py: OK