SemanticScuttle - klotz.me

klotz: gqa*

Bookmarks on this page are managed by an admin user.

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. Mistral AI vs. Meta: Comparing Top Open-source LLMs: Mistral 7B vs Llama 2 7B and Mixtral 8x7B vs Llama 2 70B

   novel concepts that Mistral AI added to traditional Transformer architectures and we perform a comparison of inference time between Mistral 7B and Llama 2 7B and a comparison of memory, inference time and response quality between Mixtral 8x7B and LLama 2 70B. RAG systems and a public Amazon dataset with customer reviews.

   2024-01-23 Tags: mistral, mixtral, llm, gqa, swa, smoe by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0