SemanticScuttle - klotz.me

Tags: llama.cpp* + quantization* + llm* + howto*

0 bookmark(s) - Sort by: Date ↓ / Title /

1. TIL: Quantize and use Llama 3.1 with llama.cpp on a Mac

   A guide on how to download, convert, quantize, and use Llama 3.1 8B model with llama.cpp on a Mac.

   2024-09-28 Tags: llama.cpp, quantization, llm, howto by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0