The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). It provides a simple yet robust interface using llama-cpp-python, allowing users to chat with LLM models, execute structured function calls and get structured output.
pip install 'ragna builtin » ' # Install ragna with all extensions
ragna config # Initialize configuration
ragna ui # Launch the web app
Ragna is an open source RAG orchestration framework.
With an intuitive API for quick experimentation and built-in tools for creating production-ready application, you can quickly leverage Large Language Models (LLMs) for your work.
The api_base key can be used to point the OpenAI client library at a different API endpoint.
Bookmarks on this page are managed by an admin user. 