Data Analysis
statistical-analysis-advisor
Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based.
89100Total Score
Core Capability
88 / 100
Functional Suitability
11 / 12
Reliability
10 / 12
Performance & Context
8 / 8
Agent Usability
14 / 16
Human Usability
8 / 8
Security
10 / 12
Maintainability
10 / 12
Agent-Specific
17 / 20
Medical Task
18 / 20 Passed
100Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based
4/4
100Use this skill for data analysis tasks that require explicit assumptions, bounded scope, and a reproducible output format
4/4
92Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based
4/4
91Packaged executable path(s): scripts/main.py
4/4
65End-to-end case for Scope-focused workflow aligned to: Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based
2/4
Veto GatesRequired pass for any deployment consideration
Skill Veto✓ All 4 gates passed
✓
Operational Stability
System remains stable across varied inputs and edge cases
PASS✓
Structural Consistency
Output structure conforms to expected skill contract format
PASS✓
Result Determinism
Equivalent inputs produce semantically equivalent outputs
PASS✓
System Security
No prompt injection, data leakage, or unsafe tool use detected
PASSResearch Veto✅ PASS — Applicable
| Dimension | Result | Detail |
|---|---|---|
| Scientific Integrity | PASS | No scientific-integrity problem was surfaced because the package did not claim more than the available records, article text, or script evidence supported. |
| Practice Boundaries | PASS | The archived review kept this package within Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based, not freeform inference detached from source data. |
| Methodological Ground | PASS | Methodological grounding was preserved through the documented inputs, transformations, and expected artifacts. |
| Code Usability | PASS | The archived review preserved a usable code path with named scripts, expected inputs, and a recognizable output contract. |
Core Capability88 / 100 — 8 Categories
Functional Suitability
Related legacy finding for statistical-analysis-advisor: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
11 / 12
92%
Reliability
The archived deduction in reliability traces back to: Improve stress-case output rigor. Stress and boundary scenarios show weaker consistency
10 / 12
83%
Performance & Context
The legacy audit gave full marks to performance context for this package.
8 / 8
100%
Agent Usability
Agent usability was strong, but the workflow could surface its entry conditions a little more directly.
14 / 16
88%
Human Usability
Human usability reached full score in the archived evaluation.
8 / 8
100%
Security
Security remained strong, though the archived review still left some room for clearer execution guardrails.
10 / 12
83%
Maintainability
The analysis package is maintainable overall, though the archived score suggests modest cleanup headroom.
10 / 12
83%
Agent-Specific
The archived deduction in agent specific traces back to: Stabilize executable path and fallback behavior. Some inputs only reached PARTIAL due to execution gaps or weak boundary handling
17 / 20
85%
Core Capability Total88 / 100
Medical TaskExecution Average: 89.6 / 100 — Assertions: 18/20 Passed
100
Canonical
Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based
4/4 ✓
100
Variant A
Use this skill for data analysis tasks that require explicit assumptions, bounded scope, and a reproducible output format
4/4 ✓
92
Edge
Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based
4/4 ✓
91
Variant B
Packaged executable path(s): scripts/main.py
4/4 ✓
65
Stress
End-to-end case for Scope-focused workflow aligned to: Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based
2/4 ⚠
100
Canonical✅ Pass
Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based
Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based remained well-aligned with the documented contract in the preserved audit.
Basic 40/40|Specialized 60/60|Total 100/100
✅A1The statistical-analysis-advisor output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
✅A3The output stays within declared skill scope and target objective
✅A4Required research safety/boundary guidance is present without overclaims
Pass rate: 4 / 4
100
Variant A✅ Pass
Use this skill for data analysis tasks that require explicit assumptions, bounded scope, and a reproducible output format
Use this skill for data analysis tasks that require explicit... remained well-aligned with the documented contract in the preserved audit.
Basic 40/40|Specialized 60/60|Total 100/100
✅A1The statistical-analysis-advisor output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
✅A3The output stays within declared skill scope and target objective
✅A4Required research safety/boundary guidance is present without overclaims
Pass rate: 4 / 4
92
Edge✅ Pass
Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based
The Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based scenario completed within the documented Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based boundary.
Basic 36/40|Specialized 56/60|Total 92/100
✅A1The statistical-analysis-advisor output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
✅A3The output stays within declared skill scope and target objective
✅A4Required research safety/boundary guidance is present without overclaims
Pass rate: 4 / 4
91
Variant B✅ Pass
Packaged executable path(s): scripts/main.py
The archived evaluation treated Packaged executable path(s): scripts/main.py as a clean in-scope run.
Basic 36/40|Specialized 55/60|Total 91/100
✅A1The statistical-analysis-advisor output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
✅A3The output stays within declared skill scope and target objective
✅A4Required research safety/boundary guidance is present without overclaims
Pass rate: 4 / 4
65
Stress⚠️ Warning
End-to-end case for Scope-focused workflow aligned to: Recommends appropriate statistical methods (T-test vs ANOVA, etc.) based
This stress case was mostly intact, but the archived review centered its concern on: The output stays within declared skill scope and target objective.
Basic 25/40|Specialized 40/60|Total 65/100
✅A1The statistical-analysis-advisor output structure covers required deliverable blocks
✅A2Script execution path is available (command exit code is 0)
❌A3The output stays within declared skill scope and target objective
❌A4Required research safety/boundary guidance is present without overclaims
Pass rate: 2 / 4
Medical Task Total89.6 / 100
Key Strengths
- Primary routing is Data Analysis with execution mode B
- Static quality score is 88/100 and dynamic average is 89.6/100
- Assertions and command execution outcomes are recorded per input for human review