klotz: llama2c*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

  1. mediacutlet writes about pocket-tank, a project featuring a 14-million-parameter LLM that manages a virtual aquarium on an ESP32-S3 microcontroller. Distilled from a much larger 26-billion-parameter teacher model into a compact 7.56 MB file, the "brain" operates entirely offline without any network connection. The system uses a three-layer architecture consisting of a physics/reflex layer, an LLM advisor for decision-making (such as feeding or socializing), and a progression layer to manage long-term growth and life events like fish births and aging.

    - The model is distilled from gemma4:26b into the smaller student version.
    - Decisions made by the LLM are implemented via a reflex layer running at 25–30 frames per second.
    - It supports an "installer" that allows users to flash firmware directly through a web browser using Web Serial.
    - The project includes a PC simulator and support for QEMU emulation of the ESP32 hardware.

Top of the page

First / Previous / Next / Last / Page 1 of 0 SemanticScuttle - klotz.me: Tags: llama2c

About - Propulsed by SemanticScuttle