AirLLM is an open-source library that allows large language models to run on consumer hardware using layer-wise inference. By loading layers sequentially, it enables 70B parameter models to operate on as little as 4GB of VRAM. Optimized for research and batch processing, it features block-wise quantization for up to 3x faster performance on Linux and Apple Silicon.
A Raspberry Pi project that displays the city and country where it is currently 5:00 p.m., updating every 15 minutes. It uses accurate timezone data and is a fun, lightweight build with potential for educational and practical applications.
Learn how to create a real-time machine learning audio noise suppression system using Python, TensorFlow Lite, and the Raspberry Pi Pico.