Pedro Cuenca writes Meta released Muse Glimmer-30B, a local, open-source multimodal model distilled from its larger Muse architecture. Designed for agentic workflows, it combines a 28B text decoder with a 2B vision encoder, supporting image, video, and multimodal tool calling out of the box. The release includes immediate compatibility with major inference frameworks like transformers, llama.cpp, and vLLM, alongside built-in speculative decoding for faster generation.
- Features a hybrid attention pattern alternating between three sliding window layers and one full attention layer.
- Incorporates a DFlash block-diffusion drafter to accelerate structured text generation like coding.
- Supports fine-tuning via TRL with practical minimums ranging from one to eight H100 GPUs depending on the method.
- Demonstrates autonomous agent capabilities such as self-quantization, self-deployment, and hardware-specific optimization.
- Features a hybrid attention pattern alternating between three sliding window layers and one full attention layer.
- Incorporates a DFlash block-diffusion drafter to accelerate structured text generation like coding.
- Supports fine-tuning via TRL with practical minimums ranging from one to eight H100 GPUs depending on the method.
- Demonstrates autonomous agent capabilities such as self-quantization, self-deployment, and hardware-specific optimization.
This article explains how to implement function calling with Google’s Gemma 3 27B model. It covers the concept of function calling, the step‑by‑step workflow, and provides a practical example using a Python `convert` function to turn $200,000 into EUR. The post walks through prompting Gemma, parsing its `tool_code` output, executing the function with `eval`, and returning a friendly final response. It also demonstrates how to set up the Google‑GenAI SDK, create a chat session, and extract tool calls. The discussion highlights Gemma’s multilingual, multimodal, and agentic capabilities, making it suitable for real‑world AI assistants that need to interact with external APIs and tools.
