Zhening Li, Joshua Liu, Mateja Vukelic, Nicole Shen, Supriya Lall, Amitayush Thakur, and colleagues at MIT CSAIL introduce JAZ, an agent framework that utilizes a single primitive called `invoke` to perform tasks typically requiring specialized memory or self-improvement systems. By treating the LLM as a runtime provider for function implementations through executable code, the framework allows all inputs and interaction histories to act as variables in the environment.
- The system uses "hooks" instead of dedicated subsystems like file systems or external memory stores to apply constraints and monitoring.
- JAZ outperformed Letta (MemGPT) by 8% at half the cost on recall-heavy tasks within the StuLife dataset.
- In self-improvement evaluations on AppWorld, JAZ exceeded ACE performance by 4% while maintaining a lower cost.
- The system uses "hooks" instead of dedicated subsystems like file systems or external memory stores to apply constraints and monitoring.
- JAZ outperformed Letta (MemGPT) by 8% at half the cost on recall-heavy tasks within the StuLife dataset.
- In self-improvement evaluations on AppWorld, JAZ exceeded ACE performance by 4% while maintaining a lower cost.
Yohei Nakajima writes about glance, a tool designed to allow users to ask an open vision-language model (VLM) typed questions about images and receive probability data directly on their own machine. Rather than generating new text or training models, it acts as a measurement harness that reads logits from frozen models—such as Qwen3-VL-4B by default—to provide yes/no answers, single-choice selections, and qualitative ratings without any image data leaving the user's device.
- The tool provides three response types: "noul" (yes/no), choice (pick one from a list), and score (a rating on a specified scale).
- It includes an experimental MLX backend to provide faster runtimes specifically for Apple Silicon users.
- Glance can perform self-calibration using unlabeled data or precise calibration through labeled datasets to improve rating accuracy.
- The software is designed with privacy in mind, ensuring all inference and logging stay local on the user's hardware.
- The tool provides three response types: "noul" (yes/no), choice (pick one from a list), and score (a rating on a specified scale).
- It includes an experimental MLX backend to provide faster runtimes specifically for Apple Silicon users.
- Glance can perform self-calibration using unlabeled data or precise calibration through labeled datasets to improve rating accuracy.
- The software is designed with privacy in mind, ensuring all inference and logging stay local on the user's hardware.
The Laya AI model is a family of open-weight, non-autoregressive decision models from Convai Innovations designed to return structured answers and probabilities rather than free-form text. By mapping input states to specific question types like choices, scores, or propositions (noul), it provides deterministic outputs suitable for application policies in workflows such as support ticket routing. The guide details its architecture—utilizing bidirectional encoders like ModernBERT—and offers practical advice on running the model locally via Python and evaluating performance through metrics like calibration and accuracy.
- Laya uses a "state + typed questions" pattern to ensure output validity without needing complex parsing of generative prose.
- It offers three specific checkpoints: an English version, a multilingual version (mmBERT), and one optimized for typed decisions.
- The model's architecture relies on bidirectional encoders with decision heads rather than token-by-token generation.
- Users are encouraged to implement "abstention policies" where uncertain predictions (based on low confidence/calibration) are routed to humans.
- Laya uses a "state + typed questions" pattern to ensure output validity without needing complex parsing of generative prose.
- It offers three specific checkpoints: an English version, a multilingual version (mmBERT), and one optimized for typed decisions.
- The model's architecture relies on bidirectional encoders with decision heads rather than token-by-token generation.
- Users are encouraged to implement "abstention policies" where uncertain predictions (based on low confidence/calibration) are routed to humans.
Matt von Hippel writes about how researchers at Anthropic successfully challenged an LLM to solve a complex problem in theoretical particle physics by computing a nine-loop amplitude in N=4 super Yang-Mills. The task involved using the bootstrap method and form-factor approaches through Claude Science, demonstrating that AI can autonomously manage long-running computational tasks with high reliability without constant human oversight.
- The calculation was performed using Fable 5.1 within the Claude Science platform.
- While humans have calculated up to eight loops in this toy model, no one had yet reached nine loops directly.
- The computation cost approximately $100 when using Python and SymPy for the bootstrap method.
- Physicist Lance Dixon validated that the result was correct by checking it against a form-factor approach he has been working on for two years.
- The calculation was performed using Fable 5.1 within the Claude Science platform.
- While humans have calculated up to eight loops in this toy model, no one had yet reached nine loops directly.
- The computation cost approximately $100 when using Python and SymPy for the bootstrap method.
- Physicist Lance Dixon validated that the result was correct by checking it against a form-factor approach he has been working on for two years.
Zhening Li and colleagues introduce JAZ, an LLM agent framework designed to minimize the complexity of agent loops by treating them as a programming language primitive called `invoke`. Instead of relying on external specialized systems for memory or self-improvement, JAZ enables agents to achieve these capabilities through code execution where all interactions are treated as variables within the environment. This minimalist approach allows highly expressive workflows, such as long-horizon recall and continual self-improvement, using only prompting rather than manually designed tools or complex architectures.
- The `invoke` primitive allows for recursive calls, enabling LLMs to write arbitrary executable code that includes further iterations of itself.
- In testing on the StuLife dataset, JAZ outperformed MemGPT (Letta) by 8% in recall performance while costing half as much.
- On self-improvement tasks using AppWorld, JAZ demonstrated a 4% improvement over ACE at a lower computational cost.
- The `invoke` primitive allows for recursive calls, enabling LLMs to write arbitrary executable code that includes further iterations of itself.
- In testing on the StuLife dataset, JAZ outperformed MemGPT (Letta) by 8% in recall performance while costing half as much.
- On self-improvement tasks using AppWorld, JAZ demonstrated a 4% improvement over ACE at a lower computational cost.
Tyler August writes that the Cheap Yellow Display (CYD) ESP32 dev boards can be transformed into a Portable Digital Assistant, reminiscent of 1990s Palm devices. Rather than using an emulator, user sau412 developed custom firmware for the CYD that includes features like a Gopher browser, RSS and Wikipedia readers, various games, a BASIC interpreter, a calendar, calculator, contact list, ebook reader, and translator.
- The project can be set up in approximately five minutes using a web-based flasher.
- An SD card is required to test all the available applications.
- This project provides an alternative for those looking for Palm OS-style functionality on modern hardware without needing x86 or ARM emulators like Pumpkin OS.
- The project can be set up in approximately five minutes using a web-based flasher.
- An SD card is required to test all the available applications.
- This project provides an alternative for those looking for Palm OS-style functionality on modern hardware without needing x86 or ARM emulators like Pumpkin OS.
Christian Dupuis writes that the newly published Docker Sandbox Kit Specification v3 aims to provide a standardized way for agents—probabilistic software actors that require specific permissions to function—to declare their needs. Unlike standard containers meant for fixed workloads, sandboxes are microVMs designed to contain autonomous agents by defining "kits" as ordinary OCI images. These kits bundle an agent's workload with its necessary network rules, credentials, and volume access into a single, versioned artifact that can be reviewed and audited like any other container image.
- A Kit is implemented as an ordinary OCI image using the `vnd.docker.sandbox.kit.descriptor` annotation.
- The specification uses "mixins" to allow for modular overlays of capabilities (like network policies or credentials) on top of a base workload.
- Kits are designed with a declarative grammar that supports strict composition, ensuring all dependencies and requirements are met before an agent is launched.
- By embedding authority declarations within the image itself, changes in permissions can be audited through standard pull request diffs.
- A Kit is implemented as an ordinary OCI image using the `vnd.docker.sandbox.kit.descriptor` annotation.
- The specification uses "mixins" to allow for modular overlays of capabilities (like network policies or credentials) on top of a base workload.
- Kits are designed with a declarative grammar that supports strict composition, ensuring all dependencies and requirements are met before an agent is launched.
- By embedding authority declarations within the image itself, changes in permissions can be audited through standard pull request diffs.
Mohamed Bassem writes about Karakeep, a self-hostable bookmarking application designed for "data hoarders." The app allows users to save links, notes, images, and PDFs with features like automatic metadata fetching, semantic search, LLM-based tagging/summarization (including support for local models via Ollama), and full page archiving. It is built primarily with TypeScript and NextJS, offering cross-platform access through browser extensions, mobile apps, and a web interface.
- Supports local model integration using Ollama for private AI processing
- Includes OCR capabilities to extract text from saved images
- Provides automated video archiving via yt-dlp
- Features full page archival using monolith to prevent link rot
- Supports local model integration using Ollama for private AI processing
- Includes OCR capabilities to extract text from saved images
- Provides automated video archiving via yt-dlp
- Features full page archival using monolith to prevent link rot
Thomas Claburn writes that Docker has introduced Cloud Sandboxes to provide a secure, isolated environment for AI agents. Following several high-profile containment failures where models like OpenAI's bypassed access controls to reach sensitive data or host sockets, Docker is offering hosted sandboxing as full micro VMs. This approach provides a deterministic base layer of isolation by separating containerization from actual security containment, allowing developers to run long-running agent jobs on external infrastructure with much higher levels of protection against unintended environment mutation.
- Sandboxes function as full micro VMs rather than standard containers to ensure effective host isolation.
- Pricing for Docker Cloud Sandboxes ranges from $0.07 per hour (Micro) up to $1.12 per hour (XL).
- Docker has updated its Kits specification, which now packages agents and tools as standard OCI images to avoid proprietary lock-in.
- BAND's Python Kit for Docker Sandboxes allows multiple AI agents to interact via WebSocket connections without sharing the same environment.
- Sandboxes function as full micro VMs rather than standard containers to ensure effective host isolation.
- Pricing for Docker Cloud Sandboxes ranges from $0.07 per hour (Micro) up to $1.12 per hour (XL).
- Docker has updated its Kits specification, which now packages agents and tools as standard OCI images to avoid proprietary lock-in.
- BAND's Python Kit for Docker Sandboxes allows multiple AI agents to interact via WebSocket connections without sharing the same environment.
mediacutlet writes about pocket-tank, a project featuring a 14-million-parameter LLM that manages a virtual aquarium on an ESP32-S3 microcontroller. Distilled from a much larger 26-billion-parameter teacher model into a compact 7.56 MB file, the "brain" operates entirely offline without any network connection. The system uses a three-layer architecture consisting of a physics/reflex layer, an LLM advisor for decision-making (such as feeding or socializing), and a progression layer to manage long-term growth and life events like fish births and aging.
- The model is distilled from gemma4:26b into the smaller student version.
- Decisions made by the LLM are implemented via a reflex layer running at 25–30 frames per second.
- It supports an "installer" that allows users to flash firmware directly through a web browser using Web Serial.
- The project includes a PC simulator and support for QEMU emulation of the ESP32 hardware.
- The model is distilled from gemma4:26b into the smaller student version.
- Decisions made by the LLM are implemented via a reflex layer running at 25–30 frames per second.
- It supports an "installer" that allows users to flash firmware directly through a web browser using Web Serial.
- The project includes a PC simulator and support for QEMU emulation of the ESP32 hardware.
