SemanticScuttle - klotz.me

klotz: ipt*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. ESP32-P4 3.4 / 4 inch Round Touch Display Development Board

   High-performance development board based on ESP32-P4 controller with RISC-V 32-bit dual-core and single-core processors, featuring 3.4inch/4inch round touch displays with 800x800/720x720 resolution, Wi-Fi 6/Bluetooth 5 (LE), onboard dual microphones, and support for AI voice interaction.

   2025-08-21 Tags: esp32-p4, risc-v, hardware display, ipt, waveshare, arduino by klotz
2. GPU-Accelerated LLM on a $100 Orange Pi: 2.3 tok/sec for Llama3-8b, 2.5 tok/sec for Llama2-7b, and 5 tok/sec for RedPajama-3b

   GPU-accelerated LLMs on Odrange Pi 5, which features a Mali-G610 GPU. The authors used Machine Learning Compilation (MLC) techniques to achieve speeds of 2.3 tok/sec for Llama3-8b, 2.5 tok/sec for Llama2-7b, and 5 tok/sec for RedPajama-3b. They also managed to run a Llama-2 13b model at 1.5 tok/sec on a 16GB version of the Orange Pi 5+.

   2024-05-20 Tags: llm, orange pi, gpu, mali-g610, llama3-8b, llama2-7b, redpajama-3b, ipt, raspberry pi by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0