SemanticScuttle - klotz.me

Tags: llama.cpp* + gpu* + llm*

0 bookmark(s) - Sort by: Date ↓ / Title /

1. Gemma 3: How to Run & Fine-tune

   How to run Gemma 3 effectively with our GGUFs on llama.cpp, Ollama, Open WebUI and how to fine-tune with Unsloth! This page details running Gemma 3 on various platforms, including phones, and fine-tuning it using Unsloth, addressing potential issues with float16 precision and providing optimal configuration settings.

   2025-08-16 Tags: gemma 3, llm, fine-tuning, llama.cpp, unsloth, gguf, gpu, colab, vision, audio, oobabooga by klotz
2. exo: Run your own AI cluster at home with everyday devices

   Unify your existing devices into one powerful GPU: iPhone, iPad, Android, Mac, NVIDIA, Raspberry Pi, pretty much any device!

   2025-02-28 Tags: llm, cluster, gpu, mlx, tinygrad, pytorch, llama.cpp, distributed systems by klotz
3. Reddit LocalLlama GPU / CPU

   2023-06-09 Tags: llama, llama.cpp, llm, reddit, gpu, nvidia, 3090, 4090, machine learning by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0