Tags: vision-language model*

0 bookmark(s) - Sort by: Date ↓ / Title /

  1. Yohei Nakajima writes about glance, a tool designed to allow users to ask an open vision-language model (VLM) typed questions about images and receive probability data directly on their own machine. Rather than generating new text or training models, it acts as a measurement harness that reads logits from frozen models—such as Qwen3-VL-4B by default—to provide yes/no answers, single-choice selections, and qualitative ratings without any image data leaving the user's device.

    - The tool provides three response types: "noul" (yes/no), choice (pick one from a list), and score (a rating on a specified scale).
    - It includes an experimental MLX backend to provide faster runtimes specifically for Apple Silicon users.
    - Glance can perform self-calibration using unlabeled data or precise calibration through labeled datasets to improve rating accuracy.
    - The software is designed with privacy in mind, ensuring all inference and logging stay local on the user's hardware.
  2. Meta Superintelligence Lab writes that Muse Glimmer-30B is a 30-billion-parameter vision-language model optimized for autonomous agentic workflows on consumer-grade hardware. The architecture combines a dense causal transformer with a dedicated ~1.8-billion-parameter vision encoder to process interleaved text and images, enabling multi-step planning, reliable tool invocation, and automatic error recovery. Designed to run locally without cloud dependency, the model employs 4-bit quantization and a novel DFlash speculative decoding drafter to achieve significant speedups on devices with 24 to 32 GB of VRAM. Evaluated against comparable 27 to 31 billion parameter systems, Muse Glimmer demonstrates strong performance across agentic, coding, and multimodal reasoning benchmarks while maintaining strict safety guardrails and supporting over 100 languages.

    - Trained on data curated from public sources, third parties, and Meta's internal products, with a knowledge cutoff of January 2026.
    - Supports controllable reasoning strength (low, medium, high, xhigh) to balance output quality and inference speed.
    - Includes a frozen ViT-G/14 perception encoder and releases both full-precision BF16 weights and two 4-bit quantized variants.
    - Recommended inference settings include a temperature of 1.0, top-p of 0.95, and top-k of 64.
    - Assessed for moderate or lower risk in cyber, loss-of-control, and chemical/biological domains, though explicit safety guardrails are still recommended for deployment.
  3. This study introduces a domain-specific Large Vision-Language Model, Human-Scene Vision-Language Model (HumanVLM), designed to provide a foundation for human-scene Vision-Language tasks. They create a large-scale human-scene multimodal image-text dataset (HumanCaption-10M), develop a captioning approach for human-centered images, and train a HumanVLM.
  4. Qwen2.5-VL is a flagship model of the Qwen vision-language series, showcasing advancements in visual recognition, object localization, document parsing, and long-video comprehension. It introduces dynamic resolution processing and absolute time encoding, allowing it to handle complex inputs and maintain native resolution. Available in three sizes, it suits various applications from edge AI to high-performance computing, matching state-of-the-art models in document and diagram understanding while preserving strong linguistic capabilities.
  5. Qwen2.5-VL, the latest vision-language model from Qwen, showcases enhanced image recognition, agentic behavior, video comprehension, document parsing, and more. It outperforms previous models in various benchmarks and tasks, offering improved efficiency and performance.

Top of the page

First / Previous / Next / Last / Page 1 of 0 SemanticScuttle - klotz.me: tagged with "vision-language model"

About - Propulsed by SemanticScuttle