This is a GitHub repository for a Discord bot named discord-llm-chatbot. This bot allows you to chat with Large Language Models (LLMs) directly in your Discord server. It supports various LLMs, including those from OpenAI API, Mistral API, Anthropic API, and local models like ollama, oobabooga, Jan, LM Studio, etc. The bot offers a reply-based chat system, customizable system prompt, and seamless threading of conversations. It also supports image and text file attachments, and streamed responses.
Get models like Phi-2, Mistral, and LLaVA running locally on a Raspberry Pi with Ollama
Use large language models embedded in single-file executables from the command line to perform tasks like renaming images based on their visual content
Llamafile lets you distribute and run LLMs with a single file
