Andrej Karpathy, Google, and Garry Tan are all adopting Markdown as the primary format for agent memory and organizational context. While Karpathy focuses on personal knowledge, Google targets enterprise runbooks, and Tan defines agent roles, they all share a reliance on versioned Markdown files. This shift suggests that the strategic advantage is moving from the specific large language model used to the curated knowledge base a team accumulates.
- Karpathy's LLM Wiki for personal knowledge bases
- Google's Open Knowledge Format for enterprise context
- Garry Tan's gstack for defining agent roles
- The migration of the competitive moat from models to portable data files
- Karpathy's LLM Wiki for personal knowledge bases
- Google's Open Knowledge Format for enterprise context
- Garry Tan's gstack for defining agent roles
- The migration of the competitive moat from models to portable data files
Large Language Models (LLMs) demonstrate remarkable capabilities, yet their inability to maintain persistent memory in long contexts limits their effectiveness as autonomous agents in long-term interactions. While existing memory systems have made progress, their reliance on arbitrary granularity for defining the basic memory unit and passive, rule-based mechanisms for knowledge extraction limits their capacity for genuine learning and evolution. To address these foundational limitations, we present Nemori, a novel self-organizing memory architecture inspired by human cognitive principles. Nemori's core innovation is twofold: First, its Two-Step Alignment Principle, inspired by Event Segmentation Theory, provides a principled, top-down method for autonomously organizing the raw conversational stream into semantically coherent episodes, solving the critical issue of memory granularity. Second, its Predict-Calibrate Principle, inspired by the Free-energy Principle, enables the agent to proactively learn from prediction gaps, moving beyond pre-defined heuristics to achieve adaptive knowledge evolution. This offers a viable path toward handling the long-term, dynamic workflows of autonomous agents. Extensive experiments on the LoCoMo and LongMemEval benchmarks demonstrate that Nemori significantly outperforms prior state-of-the-art systems, with its advantage being particularly pronounced in longer contexts.
