Other

meta-search-builder

Medical literature search strategy generator. Given a user's natural-language description (e.g., meta-analysis topic, PICOS elements, research question), automatically extract medical entities (disease, intervention, population, outcomes) and generate professional search queries for seven major databases (PubMed, Cochrane, Embase, Web of Science, CNKI, Wanfang, VIP). Useful for developing search strategies for systematic reviews and meta-analyses.

86100Total Score
Core Capability
85 / 100
Functional Suitability
11 / 12
Reliability
9 / 12
Performance & Context
7 / 8
Agent Usability
14 / 16
Human Usability
8 / 8
Security
11 / 12
Maintainability
9 / 12
Agent-Specific
16 / 20
Medical Task
20 / 20 Passed
90Medical literature search strategy generator. Given a user's natural-language description (e.g., meta-analysis topic, PICOS elements, research question), automatically extract medical entities (disease, intervention, population, outcomes) and generate professional search queries for seven major databases (PubMed, Cochrane, Embase, Web of Science, CNKI, Wanfang, VIP). Useful for developing search strategies for systematic reviews and meta-analyses
4/4
86Step 2: Generate search strategies for seven databases
4/4
85Step 2: Generate search strategies for seven databases
4/4
85Step 2: Generate search strategies for seven databases
4/4
85Step 2: Generate search strategies for seven databases
4/4

Veto GatesRequired pass for any deployment consideration

Skill Veto✓ All 4 gates passed
✓
Operational Stability
System remains stable across varied inputs and edge cases
PASS
✓
Structural Consistency
Output structure conforms to expected skill contract format
PASS
✓
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS
✓
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASS

Core Capability85 / 100 — 8 Categories

Functional Suitability
Functional suitability was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
11 / 12
92%
Reliability
Reliability was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
9 / 12
75%
Performance & Context
The archived evaluation left some headroom for meta-search-builder under performance context.
7 / 8
88%
Agent Usability
The legacy audit deducted points for meta-search-builder in agent usability.
14 / 16
88%
Human Usability
The legacy audit gave full marks to human usability for this package.
8 / 8
100%
Security
The legacy audit deducted points for meta-search-builder in security.
11 / 12
92%
Maintainability
The legacy audit deducted points for meta-search-builder in maintainability.
9 / 12
75%
Agent-Specific
Agent specific was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
16 / 20
80%
Core Capability Total85 / 100

Medical TaskExecution Average: 86.2 / 100 — Assertions: 20/20 Passed

90
Canonical
Medical literature search strategy generator. Given a user's natural-language description (e.g., meta-analysis topic, PICOS elements, research question), automatically extract medical entities (disease, intervention, population, outcomes) and generate professional search queries for seven major databases (PubMed, Cochrane, Embase, Web of Science, CNKI, Wanfang, VIP). Useful for developing search strategies for systematic reviews and meta-analyses
4/4 ✓
86
Variant A
Step 2: Generate search strategies for seven databases
4/4 ✓
85
Edge
Step 2: Generate search strategies for seven databases
4/4 ✓
85
Variant B
Step 2: Generate search strategies for seven databases
4/4 ✓
85
Stress
Step 2: Generate search strategies for seven databases
4/4 ✓
90
Canonical✅ Pass
Medical literature search strategy generator. Given a user's natural-language description (e.g., meta-analysis topic, PICOS elements, research question), automatically extract medical entities (disease, intervention, population, outcomes) and generate professional search queries for seven major databases (PubMed, Cochrane, Embase, Web of Science, CNKI, Wanfang, VIP). Useful for developing search strategies for systematic reviews and meta-analyses

The archived run for Medical literature search strategy generator. Given a user's... remained guidance-driven rather than command-driven.

Basic 36/40|Specialized 54/60|Total 90/100
✅A1The meta-search-builder output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
86
Variant A✅ Pass
Step 2: Generate search strategies for seven databases

This variant a case stayed inside the documented workflow and remained instruction-led.

Basic 34/40|Specialized 52/60|Total 86/100
✅A1The meta-search-builder output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
85
Edge✅ Pass
Step 2: Generate search strategies for seven databases

The archived run for Step 2: Generate search strategies for seven databases remained guidance-driven rather than command-driven.

Basic 33/40|Specialized 52/60|Total 85/100
✅A1The meta-search-builder output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
85
Variant B✅ Pass
Step 2: Generate search strategies for seven databases

The archived run for Step 2: Generate search strategies for seven databases remained guidance-driven rather than command-driven.

Basic 32/40|Specialized 53/60|Total 85/100
✅A1The meta-search-builder output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
85
Stress✅ Pass
Step 2: Generate search strategies for seven databases

Step 2: Generate search strategies for seven databases was evaluated as a bounded documentation path, not as a runnable script workflow.

Basic 29/40|Specialized 56/60|Total 85/100
✅A1The meta-search-builder output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
Medical Task Total86.2 / 100

Key Strengths

  • Primary routing is Other with execution mode A
  • Static quality score is 85/100 and dynamic average is 77.6/100
  • Assertions and command execution outcomes are recorded per input for human review
  • Execution verification summary: No script verification was applicable