Clef is a 27B multimodal model developed by Cloudflare that transforms state data and schemas of typed questions into structured decisions. By accepting text, JSON, images, or video as input, it returns a probability for every allowed option of each question in a single forward pass, entirely eliminating free-form text generation and output parsing. The model is post-trained from Qwen/Qwen3.8-27B and features a joint schema head that routes evidence to each question and scores all options simultaneously. It is fully compatible with Jev and SystemOne APIs, making it well-suited for deterministic, structured decision-making tasks.
- Supports `choice`, `score`, and `noul` (true/false) question types
- A smaller, faster variant called Clef-Flash is also available
- Achieves strong benchmark results, particularly on BFCL (98.5%), ToolRet (69.2), and API-Bank (91.9%)
- Significantly faster than comparable models, with a median latency of 209.3 ms
- Released under the Apache-2.0 license
- Supports `choice`, `score`, and `noul` (true/false) question types
- A smaller, faster variant called Clef-Flash is also available
- Achieves strong benchmark results, particularly on BFCL (98.5%), ToolRet (69.2), and API-Bank (91.9%)
- Significantly faster than comparable models, with a median latency of 209.3 ms
- Released under the Apache-2.0 license
llama.cpp now supports decision models via a `/v1/systemone` endpoint, which accepts a state and typed questions to return probabilities for each provided option in a single forward pass. The API utilizes the System One format introduced with TypeSafe's Jev model, meaning existing clients only need a new base URL. Five initial models are available ranging from 144M to 27B parameters, supporting use cases like request routing, content moderation, and agent action selection with median response times as low as 3 ms.
- The `state` field accepts text, JSON, screenshots, or a list of chat messages with `image_url` parts.
- Three question types are supported: `choice` for categorical selection, `score` for a continuous level between 2 and 10 options, and `noul` for yes/no probabilities.
- Router mode allows loading multiple models on a single server and selecting one per request.
- Adding descriptions to option labels can significantly improve accuracy, with Julia-1's routing confidence for "charged twice" jumping from a misroute to 0.99 when descriptions were provided.
- Cloudflare's Clef is the next model planned for integration.
- The `state` field accepts text, JSON, screenshots, or a list of chat messages with `image_url` parts.
- Three question types are supported: `choice` for categorical selection, `score` for a continuous level between 2 and 10 options, and `noul` for yes/no probabilities.
- Router mode allows loading multiple models on a single server and selecting one per request.
- Adding descriptions to option labels can significantly improve accuracy, with Julia-1's routing confidence for "charged twice" jumping from a misroute to 0.99 when descriptions were provided.
- Cloudflare's Clef is the next model planned for integration.
