Evaluate and benchmark every skill you build.
Test Suite gives you automated testing, performance benchmarking, and A/B evaluation for your SKILL.md files — so you can ship with confidence.
What's coming
Built for serious skill developers.
Automated skill testing
Run parameterised test suites against any SKILL.md. Define expected outputs, edge cases, and regression checks in one place.
Performance benchmarking
Compare skill versions side-by-side. Track latency, token usage, and quality scores over time with interactive charts.
A/B prompt evaluation
Run two skill variants on the same inputs and get a structured diff of outputs — choose the better version with confidence.
Security & regression scans
Detect prompt-injection attempts, scope drift, and unexpected behaviour changes before they reach production.
CI / CD integration
Plug Test Suite into your GitHub Actions or any CI pipeline. Fail PRs that break skill quality thresholds automatically.
# Running test suite: product-manager
# 12 test cases · 3 variants
✓ prd_generation passed 142ms
✓ rice_scoring passed 98ms
✓ roadmap_output passed 203ms
⚠ edge_empty_input warn scope drift detected
✓ sprint_planning passed 176ms
─────────────────────────────────────
Tests: 11 passed, 1 warning, 0 failed
Quality score: 94 / 100