Pedro Cuenca writes Meta released Muse Glimmer-30B, a local, open-source multimodal model distilled from its larger Muse architecture. Designed for agentic workflows, it combines a 28B text decoder with a 2B vision encoder, supporting image, video, and multimodal tool calling out of the box. The release includes immediate compatibility with major inference frameworks like transformers, llama.cpp, and vLLM, alongside built-in speculative decoding for faster generation.
- Features a hybrid attention pattern alternating between three sliding window layers and one full attention layer.
- Incorporates a DFlash block-diffusion drafter to accelerate structured text generation like coding.
- Supports fine-tuning via TRL with practical minimums ranging from one to eight H100 GPUs depending on the method.
- Demonstrates autonomous agent capabilities such as self-quantization, self-deployment, and hardware-specific optimization.
- Features a hybrid attention pattern alternating between three sliding window layers and one full attention layer.
- Incorporates a DFlash block-diffusion drafter to accelerate structured text generation like coding.
- Supports fine-tuning via TRL with practical minimums ranging from one to eight H100 GPUs depending on the method.
- Demonstrates autonomous agent capabilities such as self-quantization, self-deployment, and hardware-specific optimization.
Asif Razzaq writes that NVIDIA Labs has open-sourced NOOA, a model-agnostic Python framework designed to streamline agentic development by consolidating prompt templates, tool schemas, and state into single class structures. By treating LLM-driven actions as standard methods with docstrings serving as prompts, the framework allows developers to build autonomous workflows that can be tested, traced, and version-controlled like ordinary software.
- Achieves 82.2% on SWE-bench Verified while using roughly half the tokens required by existing open harnesses.
- Employs a "pass by reference" mechanism for live Python objects via bounded previews to conserve context window space.
- Features an optional memory subsystem that utilizes SQLite and ACT-R activation ranking for record retrieval.
- Achieves 82.2% on SWE-bench Verified while using roughly half the tokens required by existing open harnesses.
- Employs a "pass by reference" mechanism for live Python objects via bounded previews to conserve context window space.
- Features an optional memory subsystem that utilizes SQLite and ACT-R activation ranking for record retrieval.
Microsoft’s POML offers a declarative way to manage complex instructions by using XML-like tags and CSS-style rules for prompt design. By separating content from stylistic parameters like tone and token limits, the system promotes modularity, reusability, and improved maintainability compared to manual string concatenation.
- Requires Python 3.10 or higher
- Facilitates cleaner version control through structured diffs in pull requests
- Enables non-engineers like product managers to contribute using familiar syntax styles
- Allows for model-agnostic structures that separate intent from specific API formatting quirks
- Requires Python 3.10 or higher
- Facilitates cleaner version control through structured diffs in pull requests
- Enables non-engineers like product managers to contribute using familiar syntax styles
- Allows for model-agnostic structures that separate intent from specific API formatting quirks
Dibakar Ghosh writes that Canonical has developed several open-source tools beyond Ubuntu to assist developers and infrastructure engineers at different scales of complexity. Multipass provides an easy way to launch lightweight virtual machines through simple command-line instructions, while Metal as a Service (MAAS) automates the management and provisioning of physical hardware via a web interface. Finally, MicroCloud simplifies private cloud creation by clustering multiple computers into a single pool for hosting containers and virtual machines with shared storage.
- Multipass avoids manual ISO downloads or driver configuration during VM setup.
- MAAS can deploy non-Ubuntu systems such as Fedora, Debian, or Windows using custom images.
- MicroCloud bundles LXD, MicroCeph, and MicroOVN to provide high availability for workloads across a cluster.
- Multipass avoids manual ISO downloads or driver configuration during VM setup.
- MAAS can deploy non-Ubuntu systems such as Fedora, Debian, or Windows using custom images.
- MicroCloud bundles LXD, MicroCeph, and MicroOVN to provide high availability for workloads across a cluster.
Page Assist is an open-source browser extension that provides a sidebar and web interface for interacting with local large language models from any webpage. It allows users to chat about current website content by connecting the tool to providers like Ollama or OpenAI API compatible endpoints. The software supports several browsers, including Chromium-based options and Firefox.
- Data is stored locally within browser storage to maintain privacy
- Features keyboard shortcuts such as Ctrl+Shift+Y for rapid sidebar access
- Compatible with various local model providers, including Chrome AI (Gemini Nano)
- Data is stored locally within browser storage to maintain privacy
- Features keyboard shortcuts such as Ctrl+Shift+Y for rapid sidebar access
- Compatible with various local model providers, including Chrome AI (Gemini Nano)
The community-led open-source hosting site Codeberg has announced bans on two types of projects: cryptocurrency-related projects and those whose code is substantially or entirely generated by Large Language Models (LLMs) such as Claude or OpenAI Codex. Following a community vote, the ban on LLM-generated code passed with 358 votes in favor to 144 against. The reasoning for these decisions includes concerns over "license whitewashing," the massive increase in hardware and energy costs caused by AI datacenter scaling, and the potential negative impact of generative AI tools on the Open Source Software (OSS) community.
The comments reflect a deep division within the tech community regarding this decision:
* **Supporters** argue that current LLM practices are unethical because they undermine software rights, increase environmental strain, and create massive amounts of "junk" code that is difficult to maintain or scale.
* **Critics/Skeptics** suggest the ban is a "Luddite" reaction to an unstoppable trend (comparing it to people refusing cell phones). They argue that LLMs are already integrated into most workflows ("the toothpaste is out of the tube") and that banning them might be impossible or impractical.
* **Nuanced Perspectives** emerge from users who distinguish between using LLMs as a "reasoning tool" for scientific/mathematical scaffolding versus pure "vibe coding." Some argue that while full generation creates maintenance risks, LLM tools are essential assets for hobbyists and professionals alike to solve problems efficiently.
The comments reflect a deep division within the tech community regarding this decision:
* **Supporters** argue that current LLM practices are unethical because they undermine software rights, increase environmental strain, and create massive amounts of "junk" code that is difficult to maintain or scale.
* **Critics/Skeptics** suggest the ban is a "Luddite" reaction to an unstoppable trend (comparing it to people refusing cell phones). They argue that LLMs are already integrated into most workflows ("the toothpaste is out of the tube") and that banning them might be impossible or impractical.
* **Nuanced Perspectives** emerge from users who distinguish between using LLMs as a "reasoning tool" for scientific/mathematical scaffolding versus pure "vibe coding." Some argue that while full generation creates maintenance risks, LLM tools are essential assets for hobbyists and professionals alike to solve problems efficiently.
This article introduces OpenObserve, an open-source observability platform designed to provide a cost-effective alternative to proprietary services like Datadog. By leveraging cloud object storage such as S3 for storing logs, metrics, and traces, it significantly reduces the financial burden of data retention. Built with Rust for performance, it aims to simplify the observability stack while maintaining high scalability and speed.
- Drastic reduction in costs compared to traditional SaaS monitoring tools
- Unified platform for handling logs, metrics, and traces
- High-performance architecture powered by Rust and object storage integration
- Drastic reduction in costs compared to traditional SaaS monitoring tools
- Unified platform for handling logs, metrics, and traces
- High-performance architecture powered by Rust and object storage integration
Google's release of Gemma 4 marks a major turning point for open-source AI, offering a versatile family of multimodal models under a permissive Apache 2.0 license. Built using Gemini 3 technology, these models demonstrate massive leaps in math and coding performance, rivaling much larger proprietary systems while remaining efficient enough to run on local hardware ranging from smartphones to high-end GPUs. This release positions Google as a formidable competitor in the open-weights ecosystem, prioritizing user ownership and deployment efficiency.
* Apache 2.0 license
* Multimodal intelligence
* Local hardware deployment
* Massive benchmark leaps
* Efficient MoE architecture
**Models**
* E2B: Mobile efficiency
* E4B: Edge specialist
* 26B MoE: Speed meets intelligence
* 31B Dense: Top-tier performance
* Apache 2.0 license
* Multimodal intelligence
* Local hardware deployment
* Massive benchmark leaps
* Efficient MoE architecture
**Models**
* E2B: Mobile efficiency
* E4B: Edge specialist
* 26B MoE: Speed meets intelligence
* 31B Dense: Top-tier performance
Lee Felsenstein is seeking volunteers to contribute to the development of an open-source social media system designed for public group conversations. The project requires approximately 30 examples of diverse, multi-level conversation threads to serve as placeholder text for testing branching and commenting features. Contributors will be asked to create text threads that include interesting headlines, simulated reader links, and specific tags for private dialogue acceptance or rejection. The system is designed to support complex interactions such as topic drift, journalist meta-commentary, and user voting.
Key points:
- Crowd-sourced request for conversation data to test a social media prototype.
- Guidelines for creating branching text threads with specific formatting.
- Discussion of system features like private dialogue, journals, and voting.
- Opportunity for community members to participate in the development process.
Key points:
- Crowd-sourced request for conversation data to test a social media prototype.
- Guidelines for creating branching text threads with specific formatting.
- Discussion of system features like private dialogue, journals, and voting.
- Opportunity for community members to participate in the development process.
SnapOtter is a self-hosted image manipulation tool providing over 50 tools such as resizing, cropping, and watermarking. It includes a browser-based layer editor and local AI features like background removal and upscaling that run directly on the user's hardware without an internet connection. The application supports numerous file formats, offers a REST API, and is designed for privacy by keeping all image processing within the local network via a single Docker container.
- 50+ tools including resizing, cropping, and conversion
- Browser-based layer editor with filters
- Local AI capabilities like background removal and upscaling
- Single Docker container deployment for simplicity
- Privacy focused local network processing
- 50+ tools including resizing, cropping, and conversion
- Browser-based layer editor with filters
- Local AI capabilities like background removal and upscaling
- Single Docker container deployment for simplicity
- Privacy focused local network processing
