Self-Improving Agent v2
让AI从错误中学习,越用越聪明。参考 Hermes Agent 的"做-学-改"循环,实现主动式记忆与技能生成。
Three-Layer Learning System
Layer 1: Passive Capture (Automatic)
- Command fails →
errors.jsonl - User corrects AI →
corrections.jsonl - Discover best practice →
best_practices.jsonl
Layer 2: Proactive Check (Before Execution)
- Check relevant memories before running commands
- Heartbeat scans for knowledge blind spots
Layer 3: Proactive Skill Generation (New - From Hermes)
Core insight from Hermes Agent: When a complex task succeeds, proactively propose generating a reusable Skill.
- Complex task succeeds (>10 steps) → Propose generating a Skill
- Same pattern repeats 3+ times → Auto-generalize to template
- Best practice discovered → Solidify into executable script
- New tool/skill learned → Save to
skills-generated/
Problem Statement
✅ Same command fails repeatedly, AI uses wrong method next time ✅ User corrects AI's style/preference, AI forgets next session ✅ Same pitfall hit repeatedly in the same project ✅ Better approach discovered but not systematically remembered ✅ External tool/API changes, AI still using old knowledge ✅ Complex task succeeds, no one thinks to generate reusable Skill ← NEW ✅ Repeated pattern detected, no auto-generalization mechanism ← NEW
Quick Start
# Install
mkdir -p ~/.openclaw/memory/self-improving
mkdir -p ~/.openclaw/skills-generated
# Log an error
python3 log_error.py --command "npm install xxx" --error "permission denied" --fix "use sudo"
# Log a correction
python3 log_correction.py --topic "code style" --wrong "double quotes" --correct "single quotes"
# Generate a Skill (after successful complex task)
python3 generate_skill.py \
--name "my-tool" \
--trigger "related task description" \
--desc "What this tool does" \
--files "path/to/file.py" \
--notes "Important context"
# Check before running
python3 check_memory.py --command "npm install"
File Structure
~/.openclaw/memory/self-improving/
├── errors.jsonl # Error logs
├── corrections.jsonl # User corrections
├── best_practices.jsonl # Best practices
├── skills_registry.json # Generated skills registry
└── index.json # Quick index
~/.openclaw/skills-generated/ # Auto-generated Skills
├── my-tool/
│ └── SKILL.md
└── another-tool/
└── SKILL.md
Proactive Generation Triggers
| Scenario | Action | Type |
|---|---|---|
| Command fails | Log to errors | Passive |
| User corrects | Log to corrections | Passive |
| Complex task succeeds (>10 steps) | Propose Skill generation | Proactive |
| Same task done 3+ times | Auto-generalize to template | Proactive |
| Heartbeat scan | Detect knowledge blind spots | Proactive |
| New tool/skill learned | Solidify to skills-generated | Proactive |
Skill Registry Format
{
"skills": [
{
"name": "bbu-config-tool",
"trigger": "BBU config / TR-069 parameter modification",
"description": "Modify BBU device confdb_v2.xml via SSH, supports ZTP factory reset",
"files": ["D:/tools/bbu_config_gui.py"],
"created_at": "2026-04-14",
"success_count": 5,
"last_used": "2026-04-14",
"auto_trigger": true
}
]
}
Proactive Generation Flow
Task Completed
↓
Evaluate: (>10 steps? repeat>3x? general value?)
↓ Yes
Ask: "Want me to save this as a reusable Skill?"
↓ User confirms
Generate Skill/SKILL.md
↓
Register to skills_registry.json
↓
Next similar task → Auto-recommend
Comparison with Hermes Agent
| Feature | Hermes | Ours |
|---|---|---|
| Auto-solidify | ✅ Fully automatic | ⚠️ User confirms first |
| Pattern recognition | ✅ Auto-generalize | ⚠️ Trigger-based |
| Skill quality | High | Medium (needs human review) |
| Execution environment | Self-contained sandbox | External dependencies |
Our advantage: User-controlled, transparent, no irreversible actions.
Notes
- Generated Skills need human quality review
- Sensitive info should be masked
- Periodically clean up outdated Skills
- After generating Skill, sync to memory index
v2 Updated 2026-04-14: Added proactive Skill generation layer (inspired by Hermes Agent)