/skill-test - Claude Code Skill Validator

Validate skill installation, configuration, and execution readiness.

Overview

/skill-test is a development tool for testing Claude Code skills. It validates:

• SKILL.md format and frontmatter

• plugin.json configuration

• marketplace.json references

• Script dependencies (Python/Node.js)

• Smoke test execution

Quick Start

Test all skills in current project

/skill-test

Test specific skill

/skill-test --skill ppt-render

Verbose output

/skill-test -v

Generate report

/skill-test --report test-report.md

Test Levels

Level 1: Installation (Fast)

Validates file structure and configuration:

• SKILL.md exists with valid YAML frontmatter

• plugin.json is well-formed JSON

• marketplace.json references are valid

• Required directories exist

Level 2: Dependencies (Medium)

Checks prerequisites:

• Python packages installed (from requirements.txt)

• Node.js packages installed (from package.json)

• CLI tools available (e.g., ie , node , python )

• Environment variables configured

Level 3: Smoke Test (Full)

Executes minimal validation:

• Python scripts: syntax check + --help if supported

• Node.js scripts: syntax check + --help if supported

• Config validation commands

Usage

Command

python scripts/test_runner.py [options]

Options

Option Description Default

--root

Project root directory Current directory

--skill

Test specific skill only All skills

--level

Test level (1-3) 3

--report

Output report file None (stdout)

-v, --verbose

Verbose output False

--json

JSON output format False

Examples

Full test suite

python scripts/test_runner.py --root /path/to/origin-task

Quick installation check

python scripts/test_runner.py --level 1

Test ppt-generator skills only

python scripts/test_runner.py --skill ppt --skill ppt-outline --skill ppt-enrich --skill ppt-render

Generate markdown report

python scripts/test_runner.py --report ./test-results.md

Test Output

Console Output

=== Skill Test Suite ===

[PASS] intent-engine

• SKILL.md: valid
• Dependencies: all satisfied
• Smoke test: passed

[WARN] ppt-render

• SKILL.md: valid
• Dependencies: pptxgenjs missing
• Smoke test: skipped

[FAIL] nano-banana-image

• SKILL.md: valid
• Dependencies: all satisfied
• Smoke test: API key not configured

Summary: 1 passed, 1 warning, 1 failed

JSON Output

{ "summary": {"pass": 1, "warn": 1, "fail": 1}, "skills": [ { "name": "intent-engine", "status": "pass", "tests": { "installation": {"status": "pass"}, "dependencies": {"status": "pass"}, "smoke_test": {"status": "pass"} } } ] }

Test Cases

SKILL.md Validation

Check Required Description

File exists Yes SKILL.md in skill directory

YAML frontmatter Yes Valid --- delimited YAML

name field Yes Skill identifier

description field Yes Skill description

Markdown body Recommended Usage documentation

plugin.json Validation

Check Required Description

Valid JSON Yes Parseable JSON

name field Yes Plugin name

version field Yes Semantic version

skills array Yes Skill definitions

Dependency Checks

Language Source Check

Python requirements.txt pip list comparison

Python SKILL.md prerequisites Module import test

Node.js package.json npm ls check

CLI SKILL.md prerequisites which command

Smoke Tests

Type Command Success Criteria

Python script python -m py_compile script.py

Exit 0

Python --help python script.py --help

Exit 0

Node.js script node --check script.js

Exit 0

Node.js --help node script.js --help

Exit 0

Config check script --check

Exit 0 or config info

Integration

CI/CD

GitHub Actions example

• name: Test Skills run: | cd origin-task python skill-test/skills/skill-test/scripts/test_runner.py
  --level 2
  --report test-results.md

Pre-commit Hook

#!/bin/bash python skill-test/skills/skill-test/scripts/test_runner.py --level 1

File Structure

skill-test/ ├── .claude-plugin/ │ └── plugin.json └── skills/ └── skill-test/ ├── SKILL.md # This document └── scripts/ └── test_runner.py # Main test runner

Troubleshooting

Issue Solution

"No skills found" Check --root points to project with .claude-plugin/

Python import errors Install test requirements: pip install pyyaml

Permission denied Check script execute permissions

Timeout on smoke test Increase timeout or use --level 2

Version History

Version Date Changes

1.0.0 2026-01-12 Initial release