PocketPal AI is an application that brings language models directly to your phone, offering offline AI assistance and model flexibility for both iOS and Android devices.
An extension that automatically unloads and reloads your model, freeing up VRAM for other programs.
The llmsherpa project provides APIs to accelerate Large Language Model (LLM) projects. It includes features like LayoutPDFReader for PDF text parsing, smart chunking for vector search and Retrieval Augmented Generation, and table analysis. It is open-sourced under Apache 2.0 license.
This tutorial introduces promptrefiner, a tool created by Amirarsalan Rajabi that uses the GPT-4 model to create perfect system prompts for local LLMs.
Chip Huyen analyzed 845 open source AI tool repositories on GitHub using keywords like gpt, llm, and generative ai. He categorized these into infrastructure, model development, application development, and applications layers. There was significant growth in application development and model development layers in 2023, with popular applications being coding, bots, and info aggregation. Tools like Qdrant, Pinecone, and LanceDB emerged in infrastructure layer. Notable contributors include lucidrains, ggerganov, Illyasviel, xtekky, and RNN-based models like RWKV.
llm-tool provides a command-line utility for running large language models locally. It includes scripts for pulling models from the internet, starting them, and managing them using various commands such as 'run', 'ps', 'kill', 'rm', and 'pull'. Additionally, it offers a Python script named 'querylocal.py' for querying these models. The repository also come
- create a custom base image for a Cloud Workstation environment using a Dockerfile
. Uses:
Quantized models from
. Uses:
Quantized models from
