SemanticScuttle - klotz.me

klotz: rust* + mistral.rs* + inference*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. mistral.rs: Running Llama Vision on Mac M2

   Simon Willison explains how to use the mistral.rs library in Rust to run the Llama Vision model on a Mac M2 laptop. He provides a detailed example and discusses the memory usage and GPU utilization.

   2024-10-19 Tags: mistral.rs, llama, vision, rust, simon willison, llm, cli, inference by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0