In the development of artificial intelligence, the application of Large Language Model (LLM) Single Board Computers (SBC) and AI sensors is becoming increasingly widespread. This article will detail the performance tests and tutorials of high-performance SBCs such as the NVIDIA Jetson AGX Orin 64GB Developer Kit, Raspberry Pi, LattePanda Alpha / Delta / Sigma Single Board Computers and explore how to deploy and run various LLMs on these platforms. In addition, we will introduce some easy-to-use AI cameras and voice recognition sensors, as well as their applications in innovative projects.
deploy and run LLM (large language models), including LLaMA, LLaMA2, Phi-2, Mixtral-MOE, and mamba-gpt, on the Raspberry Pi 5 8GB.