SemanticScuttle - klotz.me

Tags: llama.cpp* + python*

0 bookmark(s) - Sort by: Date ↓ / Title /

1. Text Generation Web UI

   This document details how to run Qwen models locally using the Text Generation Web UI (oobabooga), covering installation, setup, and launching the web interface.

   2025-04-08 Tags: alibaba, qwen, text generation web ui, oobabooga, llm, inference, llama.cpp, transformers, quantization, python by klotz
2. abetlen/llama-cpp-python: Python bindings for llama.cpp

   llama-cpp-python offers a web server which aims to act as a drop-in replacement for the OpenAI API. This allows you to use llama.cpp compatible models with any OpenAI compatible client (language libraries, services, etc).

   2023-06-09 Tags: openai, llama.cpp, llama, python, api, foss, github by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0