Rulin Shao writes about Context Language Models (CLMs), which manage their own context by treating it as a file the model can edit with Bash, replacing harness-defined compaction and retrieval rules. Zero-shot applications to existing models outperform state-of-the-art context management strategies across diverse benchmarks.
- Multiple agent contexts can coexist as files, extending the design to agent swarms and subagents.
- Suffix Cache Reuse was co-designed to cut server-side compute by 35% against standard SGLang at matched performance.
- A model-editable context creates a new channel through which injected or self-written instructions can persist across turns.
- Multiple agent contexts can coexist as files, extending the design to agent swarms and subagents.
- Suffix Cache Reuse was co-designed to cut server-side compute by 35% against standard SGLang at matched performance.
- A model-editable context creates a new channel through which injected or self-written instructions can persist across turns.
