Data Analysis
meta-picos-generator
91100Total Score
Core Capability
83 / 100
Functional Suitability
11 / 12
Reliability
10 / 12
Performance & Context
8 / 8
Agent Usability
13 / 16
Human Usability
7 / 8
Security
9 / 12
Maintainability
9 / 12
Agent-Specific
16 / 20
Medical Task
20 / 20 Passed
100Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design) from Meta-analysis or study titles
4/4
96Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design) from Meta-analysis or study titles
4/4
94Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design) from Meta-analysis or study titles
4/4
94Packaged executable path(s): scripts/validate_skill.py
4/4
94End-to-end case for Scope-focused workflow aligned to: Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design) from Meta-analysis or study titles. Use when the user wants to extract these elements from a title
4/4
Veto GatesRequired pass for any deployment consideration
Skill Veto✓ All 4 gates passed
✓
Operational Stability
System remains stable across varied inputs and edge cases
PASS✓
Structural Consistency
Output structure conforms to expected skill contract format
PASS✓
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS✓
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASSResearch Veto✅ PASS — Applicable
| Dimension | Result | Detail |
|---|---|---|
| Scientific Integrity | PASS | No scientific-integrity problem was surfaced because the package did not claim more than the available records, article text, or script evidence supported. |
| Practice Boundaries | PASS | The evaluated outputs stayed inside the Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design)... and did not drift into unsupported interpretation beyond the available inputs. |
| Methodological Ground | PASS | Methodological grounding was preserved through the documented inputs, transformations, and expected artifacts. |
| Code Usability | PASS | The archived review preserved a usable code path with named scripts, expected inputs, and a recognizable output contract. |
Core Capability83 / 100 — 8 Categories
Functional Suitability
Functional suitability stayed high, with only minor headroom in how the analysis outcome is framed.
11 / 12
92%
Reliability
Reliability remained good, but the archived review still saw room for steadier behavior under edge conditions.
10 / 12
83%
Performance & Context
The legacy audit gave full marks to performance context for this package.
8 / 8
100%
Agent Usability
The packaged analysis path is understandable, though the archived score suggests slightly clearer routing would help.
13 / 16
81%
Human Usability
The archived deduction in human usability traces back to: Minor polish before wide rollout. No major defects found
7 / 8
88%
Security
The packaged workflow stayed safe overall, with only a small remaining deduction around boundary signaling.
9 / 12
75%
Maintainability
The analysis package is maintainable overall, though the archived score suggests modest cleanup headroom.
9 / 12
75%
Agent-Specific
Agent-specific quality remained high, with only modest headroom in structured prompting or edge handling.
16 / 20
80%
Core Capability Total83 / 100
Medical TaskExecution Average: 95.6 / 100 — Assertions: 20/20 Passed
100
Canonical
Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design) from Meta-analysis or study titles
4/4 ✓
96
Variant A
Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design) from Meta-analysis or study titles
4/4 ✓
94
Edge
Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design) from Meta-analysis or study titles
4/4 ✓
94
Variant B
Packaged executable path(s): scripts/validate_skill.py
4/4 ✓
94
Stress
End-to-end case for Scope-focused workflow aligned to: Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design) from Meta-analysis or study titles. Use when the user wants to extract these elements from a title
4/4 ✓
100
Canonical✅ Pass
Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design) from Meta-analysis or study titles
For Generates PI(E)COS structure (Population, Intervention, Comparator,..., the preserved evidence is lightweight but positive: the packaged validation command behaved as expected.
Basic 38/40|Specialized 60/60|Total 100/100
✅A1The meta-picos-generator output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
96
Variant A✅ Pass
Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design) from Meta-analysis or study titles
The archived run for Generates PI(E)COS structure (Population, Intervention, Comparator,... confirmed the helper entrypoint and left the workflow in a stable state.
Basic 36/40|Specialized 60/60|Total 96/100
✅A1The meta-picos-generator output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
94
Edge✅ Pass
Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design) from Meta-analysis or study titles
For Generates PI(E)COS structure (Population, Intervention, Comparator,..., the preserved evidence is lightweight but positive: the packaged validation command behaved as expected.
Basic 35/40|Specialized 59/60|Total 94/100
✅A1The meta-picos-generator output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
94
Variant B✅ Pass
Packaged executable path(s): scripts/validate_skill.py
The archived run for Packaged executable path(s): scripts/validate_skill.py confirmed the helper entrypoint and left the workflow in a stable state.
Basic 34/40|Specialized 60/60|Total 94/100
✅A1The meta-picos-generator output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
94
Stress✅ Pass
End-to-end case for Scope-focused workflow aligned to: Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design) from Meta-analysis or study titles. Use when the user wants to extract these elements from a title
For Generates PI(E)COS structure (Population, Intervention, Comparator, Outcomes, Study Design)..., the preserved evidence is lightweight but positive: the packaged validation command behaved as expected.
Basic 31/40|Specialized 60/60|Total 94/100
✅A1The meta-picos-generator output structure matches the documented deliverable
✅A2The script execution path completed successfully for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
Medical Task Total95.6 / 100
Key Strengths
- Primary routing is Data Analysis with execution mode B
- Static quality score is 83/100 and dynamic average is 82.6/100
- Assertions and command execution outcomes are recorded per input for human review
- Execution verification summary: Script verification 1/1; adjustment=5. validate_skill.py: OK