llamafile is a Mozilla.ai project that packages LLMs into single-file executables by combining llama.cpp with Cosmopolitan Libc, enabling local inference across most operating systems and CPU architectures with no installation required. The project also includes whisperfile (speech-to-text via whisper.cpp) and diffusionfile (image generation via stable-diffusion.cpp). Version 0.10.0 introduced a major build system overhaul to track upstream llama.cpp more closely, adding GPU support (CUDA, ROCm, Metal, Vulkan), an interactive TUI, multimodal input, tool calling, and thinking-mode support.
- The build system uses Cosmopolitan Libc (cosmocc 4.0.2) to produce truly portable binaries in a single file.
- The build system uses Cosmopolitan Libc (cosmocc 4.0.2) to produce truly portable binaries in a single file.
