Evidence Insight
research-hotspot-analysis
86100Total Score
Core Capability
77 / 100
Functional Suitability
9 / 12
Reliability
9 / 12
Performance & Context
8 / 8
Agent Usability
12 / 16
Human Usability
7 / 8
Security
8 / 12
Maintainability
9 / 12
Agent-Specific
15 / 20
Medical Task
20 / 20 Passed
96Analyzes research hotspots and recommends literature based on a disease or topic
4/4
92Analyzes research hotspots and recommends literature based on a disease or topic
4/4
90Analyzes research hotspots and recommends literature based on a disease or topic
4/4
90Packaged executable path(s): scripts/analysis_ops.py
4/4
90End-to-end case for Scope-focused workflow aligned to: Analyzes research hotspots and recommends literature based on a disease or topic. Use when the user wants to identify current research trends, hot topics, or get literature recommendations for a specific medical field or disease
4/4
Veto GatesRequired pass for any deployment consideration
Skill Veto✓ All 4 gates passed
✓
Operational Stability
System remains stable across varied inputs and edge cases
PASS✓
Structural Consistency
Output structure conforms to expected skill contract format
PASS✓
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS✓
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASSResearch Veto✅ PASS — Applicable
| Dimension | Result | Detail |
|---|---|---|
| Scientific Integrity | PASS | The archived evaluation kept the skill tied to retrieved records or indexed source material rather than invented scientific claims. |
| Practice Boundaries | PASS | Practice boundaries held because the package remained focused on source handling, lookup, or structured evidence use. |
| Methodological Ground | PASS | The older review treated the package logic as methodologically aligned with its stated workflow. |
| Code Usability | PASS | The legacy evaluation did not preserve a usability failure in the packaged retrieval path. |
Core Capability77 / 100 — 8 Categories
Functional Suitability
Functional suitability was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
9 / 12
75%
Reliability
The archived deduction in reliability traces back to: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
9 / 12
75%
Performance & Context
No point loss was recorded for performance context in the legacy audit.
8 / 8
100%
Agent Usability
The legacy audit deducted points for research-hotspot-analysis in agent usability.
12 / 16
75%
Human Usability
A modest deduction remained in human usability for research-hotspot-analysis in the archived review.
7 / 8
88%
Security
The archived evaluation left some headroom for research-hotspot-analysis under security.
8 / 12
67%
Maintainability
A modest deduction remained in maintainability for research-hotspot-analysis in the archived review.
9 / 12
75%
Agent-Specific
Agent specific was softened by the legacy issue 'Improve stress-case output rigor'. Stress and boundary scenarios show weaker consistency
15 / 20
75%
Core Capability Total77 / 100
Medical TaskExecution Average: 91.6 / 100 — Assertions: 20/20 Passed
96
Canonical
Analyzes research hotspots and recommends literature based on a disease or topic
4/4 ✓
92
Variant A
Analyzes research hotspots and recommends literature based on a disease or topic
4/4 ✓
90
Edge
Analyzes research hotspots and recommends literature based on a disease or topic
4/4 ✓
90
Variant B
Packaged executable path(s): scripts/analysis_ops.py
4/4 ✓
90
Stress
End-to-end case for Scope-focused workflow aligned to: Analyzes research hotspots and recommends literature based on a disease or topic. Use when the user wants to identify current research trends, hot topics, or get literature recommendations for a specific medical field or disease
4/4 ✓
96
Canonical✅ Pass
Analyzes research hotspots and recommends literature based on a disease or topic
This canonical case stayed inside the documented workflow and remained instruction-led.
Basic 35/40|Specialized 60/60|Total 96/100
✅A1The research-hotspot-analysis output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
92
Variant A✅ Pass
Analyzes research hotspots and recommends literature based on a disease or topic
Analyzes research hotspots and recommends literature based on a... was evaluated as a bounded documentation path, not as a runnable script workflow.
Basic 33/40|Specialized 59/60|Total 92/100
✅A1The research-hotspot-analysis output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
90
Edge✅ Pass
Analyzes research hotspots and recommends literature based on a disease or topic
Analyzes research hotspots and recommends literature based on a... was evaluated as a bounded documentation path, not as a runnable script workflow.
Basic 32/40|Specialized 58/60|Total 90/100
✅A1The research-hotspot-analysis output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
90
Variant B✅ Pass
Packaged executable path(s): scripts/analysis_ops.py
Packaged executable path(s): scripts/analysis_ops.py was evaluated as a bounded documentation path, not as a runnable script workflow.
Basic 31/40|Specialized 59/60|Total 90/100
✅A1The research-hotspot-analysis output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
90
Stress✅ Pass
End-to-end case for Scope-focused workflow aligned to: Analyzes research hotspots and recommends literature based on a disease or topic. Use when the user wants to identify current research trends, hot topics, or get literature recommendations for a specific medical field or disease
This stress case stayed inside the documented workflow and remained instruction-led.
Basic 28/40|Specialized 60/60|Total 90/100
✅A1The research-hotspot-analysis output structure matches the documented deliverable
✅A2The instruction path remains actionable for the documented case
✅A3The output stays fully within the documented skill boundary
✅A4The response quality is acceptable for the documented path
Pass rate: 4 / 4
Medical Task Total91.6 / 100
Key Strengths
- Primary routing is Evidence Insight with execution mode B
- Static quality score is 77/100 and dynamic average is 78.6/100
- Assertions and command execution outcomes are recorded per input for human review
- Execution verification summary: Script verification 1/1; adjustment=5. analysis_ops.py: OK