eval-systematic-optimization

Run baseline evaluation and failure clustering for foundation-suite.

Requirements

• Go toolchain available (go in PATH).

• Repo root as working directory (or pass cwd ).

Constraints

• Baseline command timeout: 600s.

• Default baseline output path: /tmp/foundation-suite-<tag>-baseline .

• analyze requires a valid JSON result file path.

• Focus is conflict-family optimization, not single-case overfitting.

Usage

Run baseline

python3 skills/eval-systematic-optimization/run.py '{"action":"baseline","tag":"r12"}'

Analyze failures

python3 skills/eval-systematic-optimization/run.py '{"action":"analyze","result_file":"/tmp/foundation-suite-r12-baseline/foundation_suite_cases.json"}'