Mistral.rs is a fast LLM inference platform supporting inference on a variety of devices, quantization, and easy-to-use application with an Open-AI API compatible HTTP server and Python bindings. It supports the latest Llama and Phi models, as well as X-LoRA and LoRA support. The project aims to provide the fastest LLM inference platform possible.
sslscan version 2 has now been released with a major overhaul of the backend scanning code. The update includes TLSv1.3 support, the ability to enumerate server key exchange groups and server signature algorithms, and more...
Jemma is a GitHub repository that utilizes AI agents to build software from text-based ideas
It takes an idea in text form and assembles a team to create a web-based prototype
- Works best with Claude models, such as claude-3-haiku-20240307
- Project managers, business owners, and engineers work together to create prototypes
- Users can provide feedback to improve the prototypes
This tutorial introduces promptrefiner, a tool created by Amirarsalan Rajabi that uses the GPT-4 model to create perfect system prompts for local LLMs.
This GitHub repository contains a course on Large Language Models (LLMs) with roadmaps and Colab notebooks. The course is divided into three parts: LLM Fundamentals, The LLM Scientist, and The LLM Engineer. Each part covers various topics, including mathematics, Python, neural networks, instruction datasets, pre-training, supervised fine-tuning, reinforcement learning from human feedback, evaluation, quantization, new trends, running LLMs, building a vector storage, retrieval augmented generation, advanced RAG, inference optimization, and deployment.
gitsum is a Git interface for Emacs that allows for interactive partial commits. Users can kill unused hunks or files, navigate between hunks and files, and split patches. Once ready, users can commit the patch with a message. Users must have git.el from the git repository for adding files in the commit.
Chip Huyen analyzed 845 open source AI tool repositories on GitHub using keywords like gpt, llm, and generative ai. He categorized these into infrastructure, model development, application development, and applications layers. There was significant growth in application development and model development layers in 2023, with popular applications being coding, bots, and info aggregation. Tools like Qdrant, Pinecone, and LanceDB emerged in infrastructure layer. Notable contributors include lucidrains, ggerganov, Illyasviel, xtekky, and RNN-based models like RWKV.
This GitHub repository contains information on fine-tuning large language models (LLMs).
It includes a Jupyter Notebook file named "7 Steps to Fine-Tune LLMs.ipynb" that outlines the process.
Users can find information on setting up the environment, preparing data, fine-tuning models, evaluating performance, and saving fine-tuned models.
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
- The Open Interpreter repository provides a natural language interface for computers.
- It enables users to interact with their computer systems through a chat-like interface in the terminal.
- Open Interpreter supports various programming languages, including Python, Javascript, Shell, and more.
- The repository offers installation instructions, usage examples, and an interactive demo.
Bookmarks on this page are managed by an admin user. 