Pedro Cuenca writes Meta released Muse Glimmer-30B, a local, open-source multimodal model distilled from its larger Muse architecture. Designed for agentic workflows, it combines a 28B text decoder with a 2B vision encoder, supporting image, video, and multimodal tool calling out of the box. The release includes immediate compatibility with major inference frameworks like transformers, llama.cpp, and vLLM, alongside built-in speculative decoding for faster generation.
- Features a hybrid attention pattern alternating between three sliding window layers and one full attention layer.
- Incorporates a DFlash block-diffusion drafter to accelerate structured text generation like coding.
- Supports fine-tuning via TRL with practical minimums ranging from one to eight H100 GPUs depending on the method.
- Demonstrates autonomous agent capabilities such as self-quantization, self-deployment, and hardware-specific optimization.
- Features a hybrid attention pattern alternating between three sliding window layers and one full attention layer.
- Incorporates a DFlash block-diffusion drafter to accelerate structured text generation like coding.
- Supports fine-tuning via TRL with practical minimums ranging from one to eight H100 GPUs depending on the method.
- Demonstrates autonomous agent capabilities such as self-quantization, self-deployment, and hardware-specific optimization.
Google's release of Gemma 4 marks a major turning point for open-source AI, offering a versatile family of multimodal models under a permissive Apache 2.0 license. Built using Gemini 3 technology, these models demonstrate massive leaps in math and coding performance, rivaling much larger proprietary systems while remaining efficient enough to run on local hardware ranging from smartphones to high-end GPUs. This release positions Google as a formidable competitor in the open-weights ecosystem, prioritizing user ownership and deployment efficiency.
* Apache 2.0 license
* Multimodal intelligence
* Local hardware deployment
* Massive benchmark leaps
* Efficient MoE architecture
**Models**
* E2B: Mobile efficiency
* E4B: Edge specialist
* 26B MoE: Speed meets intelligence
* 31B Dense: Top-tier performance
* Apache 2.0 license
* Multimodal intelligence
* Local hardware deployment
* Massive benchmark leaps
* Efficient MoE architecture
**Models**
* E2B: Mobile efficiency
* E4B: Edge specialist
* 26B MoE: Speed meets intelligence
* 31B Dense: Top-tier performance
Microsoft's Phi-4-Reasoning-Vision-15B model challenges the trend of ever-larger AI models by demonstrating strong reasoning capabilities with a comparatively compact size. Trained on curated reasoning data, it aims to achieve performance without the massive compute costs associated with frontier models. The model supports multimodal tasks, combining text and image understanding, and offers flexible reasoning modes for different workloads. This research highlights the importance of data quality and training strategy, suggesting that smarter training techniques can be as impactful as simply increasing model size, particularly for AI agents and practical deployments.
Mistral Small 3.1 is an open-source multimodal AI model optimized for consumer hardware, offering strong performance in text and image processing, multilingual capabilities, and a balance between performance and accessibility. While excelling in many areas, it has limitations in long-context tasks and Middle Eastern language support.
