SemanticScuttle - klotz.me

klotz: quantization* + gguf*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. Artifacts Quantized LLM Inference Performance Results on 70b+ Models

   This document contains the quantized LLM inference performance results on 70b+ models.

   2024-06-23 Tags: artifacts, quantization, llm, gguf by klotz
2. Which Quantization Method is Right for You? (GPTQ vs. GGUF vs. AWQ)

   Exploring Pre-Quantized Large Language Models

   2023-11-15 Tags: llm, quantization, gguf by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0