klotz: markdown* + llm*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

  1. OpenProse is a declarative language for standing model work in which you describe desired world states in Markdown contracts and a reconciler handles execution. Rather than scripting sequential agent steps that drift over time, you declare what must stay true and the system determines how much work is needed to keep reality matching that declaration. It ships as a skill for coding agents like Claude Code or Codex CLI with no separate binary or server to run.

    - The core unit is a "Responsibility" whose Maintains section defines material fields and a content-hash fingerprint to avoid redundant re-runs
    - The dependency graph self-wires: a node's Requires section subscribes to upstream Maintains facets, so structure emerges from the contracts rather than being explicitly drawn
    - Five kinds exist: responsibility, function, gateway, pattern, and test
    - Continuity (when a node wakes) is a first-class contract section, not an afterthought
    - Optional imperative ProseScript plans are available for cases requiring exact choreography
  2. Pushpak Chhajed writes about the evolution of project rule systems for AI coding agents, explaining why Laravel Boost moved away from complex semantic search layers in favor of a simple markdown-based approach. To prevent instruction files like `CLAUDE.md` from becoming bloated and consuming excessive context, the team implemented a system using `.ai/rules` containing specific Markdown files linked by a generated two-column index. This "progressive disclosure" method allows agents to efficiently locate relevant project conventions without overwhelming their prompt window or requiring complex vector databases for small rule sets.

    - The system uses an automatically updated `index.md` file to help agents map current file paths to specific rule files.
    - Agents are encouraged to use a combination of index matching and `grep -rin` to find rules that span multiple directories.
    - This approach aligns with advice from the Anthropic Claude Code team regarding progressive disclosure in agentic workflows.
    - The solution avoids "staleness" risks associated with maintaining separate vector embeddings for small collections of files.
  3. Anubhab Banerjee writes that three Qwen2.5-Coder agents of different sizes can share pre-computed token IDs instead of re-tokenizing the same text, using a Google Open Knowledge Format-inspired Markdown+YAML hand-off with an added token_pointer field to /dev/shm, cutting median TTFT by 28% on 3B and 37.8% on 1.5B while avoiding KV-cache sharing.

    - Uses /dev/shm/qwen_tokens/ with NumPy .npy int64 arrays for zero-copy hand-off
    - Agents run as separate OS processes to release VRAM automatically between models
    - Runtime guardrail verifies full ~151,936-entry get_vocab() dict equality across models
    - OKF files add non-standard token_pointer and tokenizer_model_id fields for provenance
    - Savings apply to input side only; each agent still tokenizes its own output
  4. Firecrawl introduces pdf-inspector, a high-performance Rust library designed for rapid PDF classification, text extraction, and Markdown conversion. By sampling content streams to quickly distinguish between text-based and scanned documents, the tool enables intelligent routing that bypasses costly OCR services for standard PDFs. It delivers position-aware text extraction, automated table and column detection, and robust encoding handling while maintaining a lightweight footprint with no external ML dependencies or model training requirements.

    - Provides bindings for Python, Node.js, and browser WebAssembly environments.
    - Achieves sub-200ms processing times on large corpora while outperforming several established local parsers in reading order and table accuracy.
    - Features per-page OCR routing suggestions to optimize mixed-format document workflows.
    - Handles complex layouts including RTL text, multi-column newspapers, and CID-encoded fonts.
    - Released under the MIT license with active community contributions and CI/CD automation.
  5. fynnfluegge writes about Rocketnotes, a web-based Markdown note-taking application featuring Large Language Model integrations such as chat, text completion, and voice-to-text transcription. The software supports hierarchical document organization, semantic search, and an agentic Zettelkasten archiving system to streamline knowledge management.

    - Supports multiple LLM providers including OpenAI and Anthropic
    - Includes a Neovim plugin for seamless integration into code editors
    - Offers 100% local processing via Docker and Ollama for privacy
  6. TanStack has announced the alpha release of two new lightweight libraries, TanStack Markdown and TanStack Highlight. These tools are specifically designed to replace heavy parsing and syntax highlighting pipelines with a more modular approach optimized for technical documentation, blogs, and AI-generated text streaming. By separating content parsing from code styling, these libraries offer better performance and smaller bundle sizes compared to monolithic rendering systems.


    - A serializable Markdown AST that facilitates easy caching and data transfer across server/client boundaries.
    - Lightweight syntax highlighting built for web display rather than complex editor engines.
    - Efficient support for real-time AI text streaming via a synchronous re-parsing extension.
    - CSS variable-based theming that enables instant dark mode switching without additional rendering passes.
    - Minimal bundle sizes and zero runtime dependencies in the core packages.
  7. Andrej Karpathy, Google, and Garry Tan are all adopting Markdown as the primary format for agent memory and organizational context. While Karpathy focuses on personal knowledge, Google targets enterprise runbooks, and Tan defines agent roles, they all share a reliance on versioned Markdown files. This shift suggests that the strategic advantage is moving from the specific large language model used to the curated knowledge base a team accumulates.

    - Karpathy's LLM Wiki for personal knowledge bases
    - Google's Open Knowledge Format for enterprise context
    - Garry Tan's gstack for defining agent roles
    - The migration of the competitive moat from models to portable data files
  8. Google Cloud introduces the Open Knowledge Format (OKF), a vendor-neutral specification designed to formalize documentation patterns into a portable, interoperable standard for Large Language Models and agents. By using markdown files with YAML frontmatter, OKF provides a way to represent metadata, context, and curated knowledge that is readable by both humans and machine-parseable systems without requiring specialized SDKs or proprietary platforms.
    Key points:
    * Addresses the fragmentation of internal knowledge across disparate systems like wikis, databases, and code comments.
    * Enables "knowledge as a living wiki" where information can be managed alongside code in version control.
    * Employs a minimally opinionated design that separates content producers from consumers.
    * Provides reference implementations including an enrichment agent and a static HTML visualizer.
  9. This open-source template provides a structured framework for building an LLM-powered second brain using Markdown, Git, and coding agents like Codex or Claude Code. It utilizes a Karpathy-style architecture designed to keep raw source materials immutable while allowing AI agents to synthesize that information into a maintained wiki layer. The system is built for durability and readability, making it ideal for use with tools like Obsidian.
    Key features:
    - Dual-layer structure separating raw data from synthesized wiki content
    - Automated ingestion workflows using coding agents to update indexes and logs
    - Git-based version control for reviewing and rolling back AI-generated changes
    - Highly compatible with Obsidian and mobile capture workflows
  10. Simon Willison discusses why requesting HTML rather than Markdown as an LLM output format can significantly enhance technical explanations. While token constraints previously favored Markdown, modern models benefit from the ability of HTML to incorporate SVG diagrams, interactive widgets, and improved navigation. The article provides prompt examples for reviewing pull requests via HTML artifacts and showcases a GPT-5.5 generated explanation of a Linux security exploit that uses CSS and JavaScript to create a rich documentation experience.

Top of the page

First / Previous / Next / Last / Page 1 of 0 SemanticScuttle - klotz.me: Tags: markdown + llm

About - Propulsed by SemanticScuttle