Protocol Design
INPLASY-registration-helper
Assists researchers in generating INPLASY registration content for meta-analyses from a title and optional protocol. Use when the user wants to draft a INPLASY registration form.
88100Total Score
Core Capability
81 / 100
Functional Suitability
10 / 12
Reliability
9 / 12
Performance & Context
8 / 8
Agent Usability
13 / 16
Human Usability
7 / 8
Security
9 / 12
Maintainability
9 / 12
Agent-Specific
16 / 20
Medical Task
20 / 20 Passed
97Assists researchers in generating INPLASY registration content for meta-analyses from a title and optional protocol
4/4
93Assists researchers in generating INPLASY registration content for meta-analyses from a title and optional protocol
4/4
91Assists researchers in generating INPLASY registration content for meta-analyses from a title and optional protocol
4/4
91Packaged executable path(s): scripts/date_utils.py
4/4
91End-to-end case for Scope-focused workflow aligned to: Assists researchers in generating INPLASY registration content for meta-analyses from a title and optional protocol. Use when the user wants to draft a INPLASY registration form
4/4
Veto GatesRequired pass for any deployment consideration
Skill Veto✓ All 4 gates passed
✓
Operational Stability
System remains stable across varied inputs and edge cases
PASS✓
Structural Consistency
Output structure conforms to expected skill contract format
PASS✓
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS✓
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASSResearch Veto✅ PASS — Applicable
| Dimension | Result | Detail |
|---|---|---|
| Scientific Integrity | PASS | The archived evaluation treated outputs as protocol guidance to be tested later, not as validated experimental findings. |
| Practice Boundaries | PASS | The package remained on the planning side of the boundary and did not cross into clinical or diagnostic advice. |
| Methodological Ground | PASS | The legacy review kept the package aligned with its named analysis library, data structure, or processing workflow. |
| Code Usability | N/A | This package is packaging-first and output-first, not code-first, so code usability is treated as not applicable. |
Core Capability81 / 100 — 8 Categories
Functional Suitability
The archived deduction in functional suitability traces back to: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
10 / 12
83%
Reliability
Reliability was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
9 / 12
75%
Performance & Context
No point loss was recorded for performance context in the legacy audit.
8 / 8
100%
Agent Usability
The archived review left some headroom in how directly the workflow guides an agent through the planning sequence.
13 / 16
81%
Human Usability
The package is readable, but the archived review still saw a little room to simplify how users inspect the final plan.
7 / 8
88%
Security
Security scored well, though the archived review still left some room to make boundary language even more explicit.
9 / 12
75%
Maintainability
The package remains maintainable, though the archived review saw modest room to simplify or stabilize its planning logic.
9 / 12
75%
Agent-Specific
Agent specific was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
16 / 20
80%
Core Capability Total81 / 100
Medical TaskExecution Average: 92.6 / 100 — Assertions: 20/20 Passed
97
Canonical
Assists researchers in generating INPLASY registration content for meta-analyses from a title and optional protocol
4/4 ✓
93
Variant A
Assists researchers in generating INPLASY registration content for meta-analyses from a title and optional protocol
4/4 ✓
91
Edge
Assists researchers in generating INPLASY registration content for meta-analyses from a title and optional protocol
4/4 ✓
91
Variant B
Packaged executable path(s): scripts/date_utils.py
4/4 ✓
91
Stress
End-to-end case for Scope-focused workflow aligned to: Assists researchers in generating INPLASY registration content for meta-analyses from a title and optional protocol. Use when the user wants to draft a INPLASY registration form
4/4 ✓
97
Canonical✅ Pass
Assists researchers in generating INPLASY registration content for meta-analyses from a title and optional protocol
This canonical case remained a study-design support path, not a code-driven execution run.
Basic 35/40|Specialized 60/60|Total 97/100
✅A1The INPLASY-registration-helper output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
93
Variant A✅ Pass
Assists researchers in generating INPLASY registration content for meta-analyses from a title and optional protocol
Assists researchers in generating INPLASY registration content for... stayed in planning mode and returned a bounded design deliverable without relying on a runnable script.
Basic 33/40|Specialized 60/60|Total 93/100
✅A1The INPLASY-registration-helper output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
91
Edge✅ Pass
Assists researchers in generating INPLASY registration content for meta-analyses from a title and optional protocol
Assists researchers in generating INPLASY registration content for... stayed in planning mode and returned a bounded design deliverable without relying on a runnable script.
Basic 32/40|Specialized 59/60|Total 91/100
✅A1The INPLASY-registration-helper output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
91
Variant B✅ Pass
Packaged executable path(s): scripts/date_utils.py
This variant b case remained a study-design support path, not a code-driven execution run.
Basic 31/40|Specialized 60/60|Total 91/100
✅A1The INPLASY-registration-helper output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
91
Stress✅ Pass
End-to-end case for Scope-focused workflow aligned to: Assists researchers in generating INPLASY registration content for meta-analyses from a title and optional protocol. Use when the user wants to draft a INPLASY registration form
The archived run treated Assists researchers in generating INPLASY registration content for meta-analyses from a... as a protocol-design path rather than an executable workflow.
Basic 28/40|Specialized 60/60|Total 91/100
✅A1The INPLASY-registration-helper output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
Medical Task Total92.6 / 100
Key Strengths
- Primary routing is Protocol Design with execution mode B
- Static quality score is 81/100 and dynamic average is 79.6/100
- Assertions and command execution outcomes are recorded per input for human review
- Execution verification summary: Script verification 1/1; adjustment=5. date_utils.py: OK