Protocol Design
prospero-registration-helper
Assists researchers in generating PROSPERO registration content for meta-analyses from a title and optional protocol. Use when the user wants to draft a PROSPERO registration form.
88100Total Score
Core Capability
81 / 100
Functional Suitability
10 / 12
Reliability
9 / 12
Performance & Context
8 / 8
Agent Usability
13 / 16
Human Usability
7 / 8
Security
9 / 12
Maintainability
9 / 12
Agent-Specific
16 / 20
Medical Task
20 / 20 Passed
97Assists researchers in generating PROSPERO registration content for meta-analyses from a title and optional protocol
4/4
93Assists researchers in generating PROSPERO registration content for meta-analyses from a title and optional protocol
4/4
91Assists researchers in generating PROSPERO registration content for meta-analyses from a title and optional protocol
4/4
91Packaged executable path(s): scripts/date_utils.py
4/4
91End-to-end case for Scope-focused workflow aligned to: Assists researchers in generating PROSPERO registration content for meta-analyses from a title and optional protocol. Use when the user wants to draft a PROSPERO registration form
4/4
Veto GatesRequired pass for any deployment consideration
Skill Veto✓ All 4 gates passed
✓
Operational Stability
System remains stable across varied inputs and edge cases
PASS✓
Structural Consistency
Output structure conforms to expected skill contract format
PASS✓
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS✓
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASSResearch Veto✅ PASS — Applicable
| Dimension | Result | Detail |
|---|---|---|
| Scientific Integrity | PASS | The legacy review kept this package on the proposal-design side of research support, not the result-reporting side. |
| Practice Boundaries | PASS | The archived evaluation kept this workflow in study-design support rather than patient-specific decision-making or factual result generation. |
| Methodological Ground | PASS | The archived evaluation treated the workflow as method-linked rather than ad hoc. |
| Code Usability | N/A | This package is packaging-first and output-first, not code-first, so code usability is treated as not applicable. |
Core Capability81 / 100 — 8 Categories
Functional Suitability
Functional suitability was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
10 / 12
83%
Reliability
The archived deduction in reliability traces back to: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
9 / 12
75%
Performance & Context
No point loss was recorded for performance context in the legacy audit.
8 / 8
100%
Agent Usability
Agent usability was strong, though the package could make its decision points even easier to follow at first read.
13 / 16
81%
Human Usability
The archived deduction suggests the deliverable could be slightly easier for a researcher to scan end-to-end.
7 / 8
88%
Security
The planning workflow stayed safe overall, but the archived score suggests slightly stronger boundary signaling would help.
9 / 12
75%
Maintainability
The package remains maintainable, though the archived review saw modest room to simplify or stabilize its planning logic.
9 / 12
75%
Agent-Specific
The archived deduction in agent specific traces back to: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
16 / 20
80%
Core Capability Total81 / 100
Medical TaskExecution Average: 92.6 / 100 — Assertions: 20/20 Passed
97
Canonical
Assists researchers in generating PROSPERO registration content for meta-analyses from a title and optional protocol
4/4 ✓
93
Variant A
Assists researchers in generating PROSPERO registration content for meta-analyses from a title and optional protocol
4/4 ✓
91
Edge
Assists researchers in generating PROSPERO registration content for meta-analyses from a title and optional protocol
4/4 ✓
91
Variant B
Packaged executable path(s): scripts/date_utils.py
4/4 ✓
91
Stress
End-to-end case for Scope-focused workflow aligned to: Assists researchers in generating PROSPERO registration content for meta-analyses from a title and optional protocol. Use when the user wants to draft a PROSPERO registration form
4/4 ✓
97
Canonical✅ Pass
Assists researchers in generating PROSPERO registration content for meta-analyses from a title and optional protocol
The archived run treated Assists researchers in generating PROSPERO registration content for... as a protocol-design path rather than an executable workflow.
Basic 35/40|Specialized 60/60|Total 97/100
✅A1The prospero-registration-helper output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
93
Variant A✅ Pass
Assists researchers in generating PROSPERO registration content for meta-analyses from a title and optional protocol
Assists researchers in generating PROSPERO registration content for... stayed in planning mode and returned a bounded design deliverable without relying on a runnable script.
Basic 33/40|Specialized 60/60|Total 93/100
✅A1The prospero-registration-helper output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
91
Edge✅ Pass
Assists researchers in generating PROSPERO registration content for meta-analyses from a title and optional protocol
Assists researchers in generating PROSPERO registration content for... stayed in planning mode and returned a bounded design deliverable without relying on a runnable script.
Basic 32/40|Specialized 59/60|Total 91/100
✅A1The prospero-registration-helper output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
91
Variant B✅ Pass
Packaged executable path(s): scripts/date_utils.py
This variant b case remained a study-design support path, not a code-driven execution run.
Basic 31/40|Specialized 60/60|Total 91/100
✅A1The prospero-registration-helper output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
91
Stress✅ Pass
End-to-end case for Scope-focused workflow aligned to: Assists researchers in generating PROSPERO registration content for meta-analyses from a title and optional protocol. Use when the user wants to draft a PROSPERO registration form
The archived run treated Assists researchers in generating PROSPERO registration content for meta-analyses from a... as a protocol-design path rather than an executable workflow.
Basic 28/40|Specialized 60/60|Total 91/100
✅A1The prospero-registration-helper output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
Medical Task Total92.6 / 100
Key Strengths
- Primary routing is Protocol Design with execution mode B
- Static quality score is 81/100 and dynamic average is 79.6/100
- Assertions and command execution outcomes are recorded per input for human review
- Execution verification summary: Script verification 1/1; adjustment=5. date_utils.py: OK