SemanticScuttle - klotz.me

klotz: llm.hqq*

Bookmarks on this page are managed by an admin user.

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. mobiusml/hqq: Official implementation of Half-Quadratic Quantization (HQQ)

   HQQ is a fast and accurate model quantizer that skips the need for calibration data. It's super simple to implement (just a few lines of code for the optimizer). It can crunch through quantizing the Llama2-70B model in only 4 minutes!

   2024-02-24 Tags: llm.hqq, quantization, github by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0