SemanticScuttle - klotz.me

Tags: llama.cpp* + foss*

0 bookmark(s) - Sort by: Date ↓ / Title /

1. localllm/llm-tool at main · GoogleCloudPlatform/localllm

   llm-tool provides a command-line utility for running large language models locally. It includes scripts for pulling models from the internet, starting them, and managing them using various commands such as 'run', 'ps', 'kill', 'rm', and 'pull'. Additionally, it offers a Python script named 'querylocal.py' for querying these models. The repository also come

   2024-02-08 Tags: llm, localllama, self-hosted, google, gcp, foss, llama.cpp, github by klotz
2. GoogleCloudPlatform/localllm: Run LLMs locally on Cloud Workstations

   • create a custom base image for a Cloud Workstation environment using a Dockerfile . Uses:

   Quantized models from

   2024-02-08 Tags: llm, google, locallama, github, foss, gguf, huggingface, llama.cpp by klotz
3. abetlen/llama-cpp-python: Python bindings for llama.cpp

   llama-cpp-python offers a web server which aims to act as a drop-in replacement for the OpenAI API. This allows you to use llama.cpp compatible models with any OpenAI compatible client (language libraries, services, etc).

   2023-06-09 Tags: openai, llama.cpp, llama, python, api, foss, github by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0