This repository provides the official implementation of the STATIC (Sparse Transition-Accelerated Trie Index for Constrained decoding) framework, as described in Su et al., 2026. STATIC is a high-performance method for enforcing outputs to stay within a prespecified set during autoregressive decoding from large language models, designed for maximum efficiency on modern hardware accelerators like GPUs and TPUs.
M5Stack has launched the AI-88502 LLM Accelerator M.2 Kit, based on the LLM-8850 M.2 card with a 24 TOPS Axera AX8850 SoC, offering an alternative to the Raspberry Pi AI HAT+ 2 for LLM and AI vision workloads.
