HQQ is a fast and accurate model quantizer that skips the need for calibration data. It's super simple to implement (just a few lines of code for the optimizer). It can crunch through quantizing the Llama2-70B model in only 4 minutes!
0 bookmark(s) - Sort by: Date ↓ / Title /
First / Previous / Next / Last
/ Page 1 of 0 