SemanticScuttle - klotz.me

Tags: georgi gerganov*

0 bookmark(s) - Sort by: Date ↓ / Title /

1. Democratizing LLMs: 4-bit Quantization for Optimal LLM Inference

   A deep dive into model quantization with GGUF and llama.cpp and model evaluation with LlamaIndex

   2024-01-15 Tags: llm, gguf, georgi gerganov, llama.cpp, llamaindex, huggingface, rag by klotz
2. ggml.ai

   2023-06-15 Tags: ggml, georgi gerganov, llama.cpp, lmm, support by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0