SemanticScuttle - klotz.me

Tags: docker* + llama.cpp*

0 bookmark(s) - Sort by: Date ↓ / Title /

1. Docker Model Runner Brings Local LLMs to Your Desktop

   Docker is making it easier for developers to run and test AI Large Language Models (LLMs) on their PCs with the launch of Docker Model Runner, a new beta feature in Docker Desktop 4.40 for Apple silicon-powered Macs. It also integrates the Model Context Protocol (MCP) for streamlined connections between AI agents and data sources.

   2025-04-24 Tags: docker, llm, containers, model runner, mcp, localllama, llama.cpp, docker desktop, huggingface, oobabooga, ollama by klotz
2. TIL: Building llamafiles from Llama 3.2 GGUFs

   A step-by-step guide on building llamafiles from Llama 3.2 GGUFs, including scripting and Dockerization.

   2024-09-28 Tags: llamafile, llama.cpp, llm, llama 3.2, gguf, model quantization, docker, mozilla-ocho by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0