SemanticScuttle - klotz.me

klotz: inference* + llama*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. mistral.rs: Running Llama Vision on Mac M2

   Simon Willison explains how to use the mistral.rs library in Rust to run the Llama Vision model on a Mac M2 laptop. He provides a detailed example and discusses the memory usage and GPU utilization.

   2024-10-19 Tags: mistral.rs, llama, vision, rust, simon willison, llm, cli, inference by klotz
2. shawwn/llama: Inference code for LLaMA models

   2023-06-05 Tags: llm, llama, github, inference, python by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0