SemanticScuttle - klotz.me

klotz: huggingface* + gguf*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. DeepSeek-R1-0528-Qwen3-8B-GGUF

   This page details the DeepSeek-R1-0528-Qwen3-8B model, a quantized version of DeepSeek-R1-0528, highlighting its improved reasoning capabilities, evaluation results, usage guidelines, and licensing information. It offers various quantization options (GGUF) for local execution.

   2025-05-30 Tags: deepseek-r1, qwen3, gguf, llm, quantization, reasoning, text generation, transformers, model card, mcp, huggingface by klotz
2. gguf-parser-web

   A web application for parsing GGUF files.

   2025-04-28 Tags: gguf, parser, huggingface, llm, gpu by klotz
3. Ollama just made it easier to use AI on your laptop — with no internet required

   Ollama now supports HuggingFace GGUF models, making it easier for users to run AI models locally without internet. The GGUF format allows for the use of AI models on modest-sized consumer hardware.

   2024-10-24 Tags: ollama, huggingface, gguf, llm, localllama by klotz
4. GoogleCloudPlatform/localllm: Run LLMs locally on Cloud Workstations

   - create a custom base image for a Cloud Workstation environment using a Dockerfile
   . Uses:
   
   Quantized models from

   2024-02-08 Tags: llm, google, locallama, github, foss, gguf, huggingface, llama.cpp by klotz
5. Democratizing LLMs: 4-bit Quantization for Optimal LLM Inference

   A deep dive into model quantization with GGUF and llama.cpp and model evaluation with LlamaIndex

   2024-01-15 Tags: llm, gguf, georgi gerganov, llama.cpp, llamaindex, huggingface, rag by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0