SemanticScuttle - klotz.me

klotz: gguf*

Bookmarks on this page are managed by an admin user.

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. GoogleCloudPlatform/localllm: Run LLMs locally on Cloud Workstations

   - create a custom base image for a Cloud Workstation environment using a Dockerfile
   . Uses:
   
   Quantized models from

   2024-02-08 Tags: llm, google, locallama, github, foss, gguf, huggingface, llama.cpp by klotz
2. Democratizing LLMs: 4-bit Quantization for Optimal LLM Inference

   A deep dive into model quantization with GGUF and llama.cpp and model evaluation with LlamaIndex

   2024-01-15 Tags: llm, gguf, georgi gerganov, llama.cpp, llamaindex, huggingface, rag by klotz
3. Which Quantization Method is Right for You? (GPTQ vs. GGUF vs. AWQ)

   Exploring Pre-Quantized Large Language Models

   2023-11-15 Tags: llm, quantization, gguf by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0