Skill Test Runner
Runs all tests from skill examples (unit, mocked, E2E) and outputs a JSON report.
Usage
cd .claude/skills/umbraco-skill-test-runner/scripts npm install --silent npx tsx run-tests.ts
Test Types
Type Description Runner
Unit Component tests with @open-wc/testing
Web Test Runner
Mocked Integration tests against mocked backoffice Playwright
E2E Full end-to-end against real Umbraco Playwright
Environment Variables
Variable Default Description
UMBRACO_USER_LOGIN
Admin email for E2E authentication
UMBRACO_USER_PASSWORD
Admin password for E2E authentication
UMBRACO_URL
Umbraco instance URL
Auto-Start Umbraco
If E2E tests are needed and Umbraco is not running, the script will automatically:
-
Start Umbraco from ./Umbraco-CMS.Skills/ using dotnet run
-
Wait for the instance to be ready
-
Run E2E tests
-
Stop Umbraco when done (if it was started by the script)
Output
Generates test-report.json in the project root with structure:
{ "timestamp": "2024-12-26T12:00:00Z", "umbracoStarted": true, "summary": { "total": 10, "passed": 8, "failed": 1, "skipped": 1 }, "results": [ { "example": "counter-dashboard", "path": "plugins/umbraco-testing-skills/.../counter-dashboard", "type": "unit", "status": "passed", "duration": 1234 } ] }
Integration
This skill is Phase 3 of the validate-skills command, running after:
-
Link validation (umbraco-skill-validator )
-
Code analysis (umbraco-skill-code-analyzer )