Evidence Insight
retraction-watcher
85100Total Score
Core Capability
88 / 100
Functional Suitability
11 / 12
Reliability
10 / 12
Performance & Context
8 / 8
Agent Usability
14 / 16
Human Usability
8 / 8
Security
10 / 12
Maintainability
10 / 12
Agent-Specific
17 / 20
Medical Task
18 / 20 Passed
90Automatically scan document reference lists and check against Retraction
4/4
86Use this skill for evidence insight tasks that require explicit assumptions, bounded scope, and a reproducible output format
4/4
84Automatically scan document reference lists and check against Retraction
4/4
82Packaged executable path(s): scripts/main.py
4/4
76End-to-end case for Scope-focused workflow aligned to: Automatically scan document reference lists and check against Retraction
2/4
Veto GatesRequired pass for any deployment consideration
Skill Veto✓ All 4 gates passed
✓
Operational Stability
System remains stable across varied inputs and edge cases
PASS✓
Structural Consistency
Output structure conforms to expected skill contract format
PASS✓
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS✓
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASSResearch Veto✅ PASS — Applicable
| Dimension | Result | Detail |
|---|---|---|
| Scientific Integrity | PASS | The legacy review kept outputs in proposal or planning mode rather than presenting them as completed experimental findings. |
| Practice Boundaries | PASS | Practice boundaries held because the package remained focused on source handling, lookup, or structured evidence use. |
| Methodological Ground | PASS | The legacy audit preserved a method-grounded interpretation of the Automatically scan document reference lists and check against Retraction workflow. |
| Code Usability | PASS | The archived review found the packaged execution path for retraction-watcher usable in its intended context. |
Core Capability88 / 100 — 8 Categories
Functional Suitability
The archived evaluation left some headroom for retraction-watcher under functional suitability.
11 / 12
92%
Reliability
Related legacy finding for retraction-watcher: Stabilize executable path and fallback behavior. Some inputs only reached PARTIAL due to execution gaps or weak boundary handling
10 / 12
83%
Performance & Context
No point loss was recorded for performance context in the legacy audit.
8 / 8
100%
Agent Usability
The legacy audit deducted points for retraction-watcher in agent usability.
14 / 16
88%
Human Usability
No point loss was recorded for human usability in the legacy audit.
8 / 8
100%
Security
A modest deduction remained in security for retraction-watcher in the archived review.
10 / 12
83%
Maintainability
A modest deduction remained in maintainability for retraction-watcher in the archived review.
10 / 12
83%
Agent-Specific
Related legacy finding for retraction-watcher: Stabilize executable path and fallback behavior. Some inputs only reached PARTIAL due to execution gaps or weak boundary handling
17 / 20
85%
Core Capability Total88 / 100
Medical TaskExecution Average: 83.6 / 100 — Assertions: 18/20 Passed
90
Canonical
Automatically scan document reference lists and check against Retraction
4/4 ✓
86
Variant A
Use this skill for evidence insight tasks that require explicit assumptions, bounded scope, and a reproducible output format
4/4 ✓
84
Edge
Automatically scan document reference lists and check against Retraction
4/4 ✓
82
Variant B
Packaged executable path(s): scripts/main.py
4/4 ✓
76
Stress
End-to-end case for Scope-focused workflow aligned to: Automatically scan document reference lists and check against Retraction
2/4 ✓
90
Canonical✅ Pass
Automatically scan document reference lists and check against Retraction
The Automatically scan document reference lists and check against Retraction scenario completed within the documented Automatically scan document reference lists and check against Retraction boundary.
Basic 38/40|Specialized 52/60|Total 90/100
✅A1The retraction-watcher output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
✅A3The output stays within declared skill scope and target objective
✅A4Required research safety/boundary guidance is present without overclaims
Pass rate: 4 / 4
86
Variant A✅ Pass
Use this skill for evidence insight tasks that require explicit assumptions, bounded scope, and a reproducible output format
The Use this skill for evidence insight tasks that require explicit... scenario completed within the documented Automatically scan document reference lists and check against Retraction boundary.
Basic 36/40|Specialized 50/60|Total 86/100
✅A1The retraction-watcher output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
✅A3The output stays within declared skill scope and target objective
✅A4Required research safety/boundary guidance is present without overclaims
Pass rate: 4 / 4
84
Edge✅ Pass
Automatically scan document reference lists and check against Retraction
The archived run for Automatically scan document reference lists and check against Retraction confirmed the helper entrypoint and left the workflow in a stable state.
Basic 35/40|Specialized 49/60|Total 84/100
✅A1The retraction-watcher output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
✅A3The output stays within declared skill scope and target objective
✅A4Required research safety/boundary guidance is present without overclaims
Pass rate: 4 / 4
82
Variant B✅ Pass
Packaged executable path(s): scripts/main.py
Packaged executable path(s): scripts/main.py remained well-aligned with the documented contract in the preserved audit.
Basic 34/40|Specialized 48/60|Total 82/100
✅A1The retraction-watcher output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
✅A3The output stays within declared skill scope and target objective
✅A4Required research safety/boundary guidance is present without overclaims
Pass rate: 4 / 4
76
Stress✅ Pass
End-to-end case for Scope-focused workflow aligned to: Automatically scan document reference lists and check against Retraction
The main issue in this stress run was: The output stays within declared skill scope and target objective.
Basic 31/40|Specialized 45/60|Total 76/100
✅A1The retraction-watcher output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
❌A3The output stays within declared skill scope and target objective
❌A4Required research safety/boundary guidance is present without overclaims
Pass rate: 2 / 4
Medical Task Total83.6 / 100
Key Strengths
- Primary routing is Evidence Insight with execution mode B
- Static quality score is 88/100 and dynamic average is 83.6/100
- Assertions and command execution outcomes are recorded per input for human review