Ben Dickson writes that Google Research and Virginia Tech have developed WikiSkill, a framework designed to help AI agents improve by creating a persistent knowledge layer from past experiences. Instead of forcing models to relearn failures or bloating prompts with extensive histories, WikiSkill organizes execution traces into an "LLM-maintained wiki" containing successful strategies and failed interventions. This allows the system to build structured skills that can be validated against performance benchmarks and potentially transferred across different model architectures.
- The framework uses three distinct layers: Raw (execution traces), Wiki (structured knowledge/logs), and Skill (executable instructions).
- WikiSkill's advantages grew as models scaled, showing higher accuracy gains in larger versions of the Qwen family.
- Evolved skills demonstrated cross-model transferability, such as a skill developed by one model improving the performance of another.
- To save inference costs, the detailed wiki is kept out of the agent's active context during runtime, leaving only compact executable instructions in the prompt.
- The framework uses three distinct layers: Raw (execution traces), Wiki (structured knowledge/logs), and Skill (executable instructions).
- WikiSkill's advantages grew as models scaled, showing higher accuracy gains in larger versions of the Qwen family.
- Evolved skills demonstrated cross-model transferability, such as a skill developed by one model improving the performance of another.
- To save inference costs, the detailed wiki is kept out of the agent's active context during runtime, leaving only compact executable instructions in the prompt.
Liyan Tang and colleagues write about WikiSkill, a framework that co-evolves reusable agent skills with a persistent knowledge base to systematically accumulate LLM agent experience. The system separates raw execution experience, accumulated knowledge, and executable skills, continuously consolidating experience into the wiki so subsequent skill updates can build on prior learning.
- Larger models benefit more from evolved skills, while smaller models equipped with skills can outperform substantially larger ones without them
- Skills evolved by one model can outperform self-evolved skills in another, enabling cross-model transfer
- No official code exists; a community member implemented it faithfully, catching two harmful skills via the validation gate and documenting a negative run where the proposer honestly produced no useful skills
- Ablation studies confirm that persistent knowledge accumulation in the wiki is critical for effective skill evolution
- Larger models benefit more from evolved skills, while smaller models equipped with skills can outperform substantially larger ones without them
- Skills evolved by one model can outperform self-evolved skills in another, enabling cross-model transfer
- No official code exists; a community member implemented it faithfully, catching two harmful skills via the validation gate and documenting a negative run where the proposer honestly produced no useful skills
- Ablation studies confirm that persistent knowledge accumulation in the wiki is critical for effective skill evolution
