Arch is an intelligent gateway for agents, designed to securely handle prompts, integrate with APIs, and provide rich observability, built on Envoy Proxy.
A collection of Model Context Protocol (MCP) servers, featuring various implementations, frameworks, and integrations for AI models to interact with local and remote resources.
Simple, unified interface to multiple Generative AI providers, supporting various providers including OpenAI, Anthropic, Azure, Google, AWS, Groq, Mistral, HuggingFace, and Ollama. It aims to facilitate the use of multiple LLMs with a standardized interface similar to OpenAI’s.
All Hands AI has released OpenHands CodeAct 2.1, an open-source software development agent that can solve over 50% of real GitHub issues in SWE-Bench. The agent uses Anthropic’s Claude-3.5 model, function calling, and improved directory traversal to achieve this milestone.
A collection of Python examples demonstrating the use of Mistral.rs, a Rust library for working with mistral models.
PocketPal AI is an application that brings language models directly to your phone, offering offline AI assistance and model flexibility for both iOS and Android devices.
Open WebUI is an extensible, feature-rich, and user-friendly self-hosted WebUI designed to operate entirely offline, supporting various LLM runners like Ollama and OpenAI APIs. This document highlights its key features, such as effortless setup, Ollama/OpenAI API integration, pipelines support, responsive design, progressive web app for mobile devices, full Markdown and LaTeX support, voice/video call support, model builder, native Python function calling tool, RAG integration, web search for RAG, web browsing capability, image generation integration, many models conversations, role-based access control, multilingual support, continuous updates, and more.
code2prompt is a command-line tool (CLI) that converts your codebase into a single LLM prompt with a source tree, prompt templating, and token counting.
Improve GitHub Copilot Chat responses by indexing repositories for semantic code search, allowing better context-based answers to questions about code within a repository.
This project provides Dockerised deployment of oobabooga's text-generation-webui with pre-built images for Nvidia GPU, AMD GPU, Intel Arc, and CPU-only inference. It supports various extensions and offers easy deployment and updates.
