klotz: lemonade*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

  1. Joe Rice-Jones writes that his Asus ROG Flow Z13 tablet with a Ryzen AI Max+ 395 APU and 128 GB unified memory now runs the same local LLMs as his desktop mini PCs via Lemonade, using a model router to automatically send prompts to different sized models for everyday use and agentic coding with Crush, making it his preferred device.

    - Tablet is the Kojima Productions Ludens special edition ROG Flow Z13
    - Radeon 8060S iGPU has 96 GB of memory allocated in Adrenalin software
    - Model tiers include Qwen3.5-2B to gpt-oss-120b MXFP4 ~59 GB on disk
    - 120B model loads in 27.6 s, first token in 0.86 s, ~52 tokens/s on iGPU
    - Misrouted CPU-only run dropped to 0.44 tokens/s, over 100x slower
    - Router uses Qwen3.5-0.8B classifier and logs which rule fired per response
    - Crush coding required raising Lemonade context window from 4,096 to 32,768 tokens

Top of the page

First / Previous / Next / Last / Page 1 of 0 SemanticScuttle - klotz.me: Tags: lemonade

About - Propulsed by SemanticScuttle