Alibaba's Qwen team has open-sourced Qwen3.6-35B-A3B, a sparse mixture-of-experts (MoE) model designed for high performance with low computational costs. While the model possesses 35 billion total parameters, it only activates 3 billion during operation, allowing it to outperform larger dense models in logical reasoning and programming tasks.
Key highlights:
- Uses MoE architecture to achieve high intelligence with minimal activated parameters.
- Demonstrates exceptional multimodal capabilities, particularly in spatial intelligence and visual perception.
- Competes closely with large-scale models like Gemma4-31B and Claude Sonnet 4.5 in specific metrics.
- Integrated into Qwen Studio and available via Alibaba Cloud BaiLian as qwen3.6-flash.
- Supports advanced features like thinking chain retention and seamless integration with AI programming assistants.
Key highlights:
- Uses MoE architecture to achieve high intelligence with minimal activated parameters.
- Demonstrates exceptional multimodal capabilities, particularly in spatial intelligence and visual perception.
- Competes closely with large-scale models like Gemma4-31B and Claude Sonnet 4.5 in specific metrics.
- Integrated into Qwen Studio and available via Alibaba Cloud BaiLian as qwen3.6-flash.
- Supports advanced features like thinking chain retention and seamless integration with AI programming assistants.
The article details the release of Qwen3-Coder-Next, a new 80-billion-parameter open-source large language model (LLM) from Alibaba’s Qwen team. This model is designed for coding tasks and utilizes an ultra-sparse Mixture-of-Experts (MoE) architecture, activating only 3 billion parameters at a time for increased efficiency. It boasts a massive 262,144 token context window and innovative techniques like Gated DeltaNet and Best-Fit Packing to overcome traditional LLM limitations. Qwen3-Coder-Next was trained using an "agentic training" pipeline, learning from real-world coding scenarios and feedback. It supports 370 programming languages and demonstrates competitive performance against leading models like OpenAI’s Codex and Anthropic’s Claude, while also exhibiting strong security features. The release is positioned as a significant advancement in open-weight AI and a challenge to proprietary coding models.
