Koffan is a self-hosted grocery list application designed for simplicity and real-time updates, ideal for families. It's lightweight enough to run on a Raspberry Pi Zero W, offering a private and efficient alternative to subscription-based grocery list apps.
A USB stick equipped with a Raspberry Pi Zero W runs a large language model using llama.cpp. The project involves porting the model to an ARMv6 architecture and setting up the device as a composite that presents a filesystem to the host, allowing users to interact with the LLM by creating text files that are automatically filled with generated content.
