Evidence Insight
open-access-scout
Use when finding open access journals, checking journal policies, or identifying predatory publishers. Helps researchers locate legitimate open access venues and avoid publication scams.
85100Total Score
Core Capability
88 / 100
Functional Suitability
11 / 12
Reliability
10 / 12
Performance & Context
8 / 8
Agent Usability
14 / 16
Human Usability
8 / 8
Security
10 / 12
Maintainability
10 / 12
Agent-Specific
17 / 20
Medical Task
18 / 20 Passed
90Use when finding open access journals, checking journal policies, or identifying predatory publishers. Helps researchers locate legitimate open access venues and avoid publication scams
4/4
86Use this skill for evidence insight tasks that require explicit assumptions, bounded scope, and a reproducible output format
4/4
84Use when finding open access journals, checking journal policies, or identifying predatory publishers. Helps researchers locate legitimate open access venues and avoid publication scams
4/4
82Packaged executable path(s): scripts/main.py
4/4
76End-to-end case for Scope-focused workflow aligned to: Use when finding open access journals, checking journal policies, or identifying predatory publishers. Helps researchers locate legitimate open access venues and avoid publication scams
2/4
Veto GatesRequired pass for any deployment consideration
Skill Veto✓ All 4 gates passed
✓
Operational Stability
System remains stable across varied inputs and edge cases
PASS✓
Structural Consistency
Output structure conforms to expected skill contract format
PASS✓
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS✓
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASSResearch Veto✅ PASS — Applicable
| Dimension | Result | Detail |
|---|---|---|
| Scientific Integrity | PASS | The legacy audit did not indicate that retrieval outputs were presented as unsupported findings. |
| Practice Boundaries | PASS | The package stayed in retrieval, extraction, or evidence-organization scope rather than drifting into unsupported interpretation. |
| Methodological Ground | PASS | The legacy audit preserved a method-grounded interpretation of the Use when finding open access journals, checking journal policies, or identifying predatory publishers. Helps researchers locate legitimate open access venues and avoid publication scams workflow. |
| Code Usability | PASS | The packaged retrieval surface remained understandable at the command and parameter level in the archived review. |
Core Capability88 / 100 — 8 Categories
Functional Suitability
A modest deduction remained in functional suitability for open-access-scout in the archived review.
11 / 12
92%
Reliability
The archived deduction in reliability traces back to: Stabilize executable path and fallback behavior. Some inputs only reached PARTIAL due to execution gaps or weak boundary handling
10 / 12
83%
Performance & Context
Performance context reached full score in the archived evaluation.
8 / 8
100%
Agent Usability
A modest deduction remained in agent usability for open-access-scout in the archived review.
14 / 16
88%
Human Usability
The legacy audit gave full marks to human usability for this package.
8 / 8
100%
Security
The archived evaluation left some headroom for open-access-scout under security.
10 / 12
83%
Maintainability
The legacy audit deducted points for open-access-scout in maintainability.
10 / 12
83%
Agent-Specific
Related legacy finding for open-access-scout: Stabilize executable path and fallback behavior. Some inputs only reached PARTIAL due to execution gaps or weak boundary handling
17 / 20
85%
Core Capability Total88 / 100
Medical TaskExecution Average: 83.6 / 100 — Assertions: 18/20 Passed
90
Canonical
Use when finding open access journals, checking journal policies, or identifying predatory publishers. Helps researchers locate legitimate open access venues and avoid publication scams
4/4 ✓
86
Variant A
Use this skill for evidence insight tasks that require explicit assumptions, bounded scope, and a reproducible output format
4/4 ✓
84
Edge
Use when finding open access journals, checking journal policies, or identifying predatory publishers. Helps researchers locate legitimate open access venues and avoid publication scams
4/4 ✓
82
Variant B
Packaged executable path(s): scripts/main.py
4/4 ✓
76
Stress
End-to-end case for Scope-focused workflow aligned to: Use when finding open access journals, checking journal policies, or identifying predatory publishers. Helps researchers locate legitimate open access venues and avoid publication scams
2/4 ✓
90
Canonical✅ Pass
Use when finding open access journals, checking journal policies, or identifying predatory publishers. Helps researchers locate legitimate open access venues and avoid publication scams
Use when finding open access journals, checking journal policies,... remained well-aligned with the documented contract in the preserved audit.
Basic 38/40|Specialized 52/60|Total 90/100
✅A1The open-access-scout output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
✅A3The output stays within declared skill scope and target objective
✅A4Required research safety/boundary guidance is present without overclaims
Pass rate: 4 / 4
86
Variant A✅ Pass
Use this skill for evidence insight tasks that require explicit assumptions, bounded scope, and a reproducible output format
Use this skill for evidence insight tasks that require explicit... remained well-aligned with the documented contract in the preserved audit.
Basic 36/40|Specialized 50/60|Total 86/100
✅A1The open-access-scout output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
✅A3The output stays within declared skill scope and target objective
✅A4Required research safety/boundary guidance is present without overclaims
Pass rate: 4 / 4
84
Edge✅ Pass
Use when finding open access journals, checking journal policies, or identifying predatory publishers. Helps researchers locate legitimate open access venues and avoid publication scams
For Use when finding open access journals, checking journal policies,..., the preserved evidence is lightweight but positive: the packaged validation command behaved as expected.
Basic 35/40|Specialized 49/60|Total 84/100
✅A1The open-access-scout output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
✅A3The output stays within declared skill scope and target objective
✅A4Required research safety/boundary guidance is present without overclaims
Pass rate: 4 / 4
82
Variant B✅ Pass
Packaged executable path(s): scripts/main.py
Packaged executable path(s): scripts/main.py remained well-aligned with the documented contract in the preserved audit.
Basic 34/40|Specialized 48/60|Total 82/100
✅A1The open-access-scout output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
✅A3The output stays within declared skill scope and target objective
✅A4Required research safety/boundary guidance is present without overclaims
Pass rate: 4 / 4
76
Stress✅ Pass
End-to-end case for Scope-focused workflow aligned to: Use when finding open access journals, checking journal policies, or identifying predatory publishers. Helps researchers locate legitimate open access venues and avoid publication scams
The main issue in this stress run was: The output stays within declared skill scope and target objective.
Basic 31/40|Specialized 45/60|Total 76/100
✅A1The open-access-scout output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
❌A3The output stays within declared skill scope and target objective
❌A4Required research safety/boundary guidance is present without overclaims
Pass rate: 2 / 4
Medical Task Total83.6 / 100
Key Strengths
- Primary routing is Evidence Insight with execution mode B
- Static quality score is 88/100 and dynamic average is 83.6/100
- Assertions and command execution outcomes are recorded per input for human review