Michal Sutter writes that the vLLM Semantic Router team has released Decision 3.0, a family of five open multimodal decision models ranging from 0.85B to 26.09B parameters. Fine-tuned on Qwen base models, these models accept text, JSON, and images and return calibrated probabilities for typed questions rather than generated text, making them useful for classification and routing tasks.
- All models carry a vision encoder and support multiple image inputs up to 1.6 megapixels each.
- The 9B d3-flash outperforms the previous generation's 27B model, showing significant efficiency gains.
- Benchmarks are self-reported against the Jev Decision Index, with d3 leading at 64.1 on text and 71.6 on vision.
- Median text latency ranges from 21.7 ms for d3-nano to 84 ms for d3 on a single AMD Instinct MI325X GPU.
- All models carry a vision encoder and support multiple image inputs up to 1.6 megapixels each.
- The 9B d3-flash outperforms the previous generation's 27B model, showing significant efficiency gains.
- Benchmarks are self-reported against the Jev Decision Index, with d3 leading at 64.1 on text and 71.6 on vision.
- Median text latency ranges from 21.7 ms for d3-nano to 84 ms for d3 on a single AMD Instinct MI325X GPU.
