SemanticScuttle - klotz.me

klotz: linux* + llm* + llamafile* + mistral*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. Many options for running Mistral models in your terminal using LLM

   Mixtral 8x7B:
   Use llm-llama-cpp plugin.
   Download a GGUF file for Mixtral 8X7B Instruct v0.1.
   Run the model using llm -m gguf with the downloaded file.

   2024-10-29 Tags: llamafile, llm, simon willison, mistral, cli, linux by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0