SemanticScuttle - klotz.me

Tags: quantization* + everyone* + llm* + moe* + mixtral* + frankenmoe*

0 bookmark(s) - Sort by: Date ↓ / Title /

1. Perfecting Merge-kit MoE's - Google Docs

   Not Mixtral MoE but Merge-kit MoE
   
   - What makes a perfect MoE: The secret formula
   - Why is a proper merge considered a base model, and how do we distinguish them from a FrankenMoE?
   - Why the community working together to improve as a whole is the only way we will get Mixtral right

   2024-02-09 Tags: llm, everyone, coder, mistral, moe, frankenmoe, mixtral, quantization, lonestriker by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0