A minimalist Go system for embedded devices, such as Raspberry Pi. gokrazy uses its own minimal Go userland instead of a traditional Linux distribution base, providing advantages in terms of security, maintainability, and reliability.
This article discusses how to test small language models using 3.8B Phi-3 and 8B Llama-3 models on a PC and Raspberry Pi with LlamaCpp and ONNX. Written by Dmitrii Eliuseev.
