sqlite-vec is an extremely small, 'fast enough' vector search SQLite extension designed to run anywhere. It allows storing and querying of float, int8, and binary vectors using virtual tables, written in pure C with no dependencies. It supports storing non-vector data in metadata, auxiliary, or partition key columns. It is a Mozilla Builders project with additional sponsorship from companies like Fly.io, Turso, SQLite Cloud, and Shinkai.
A simple project demonstrating Retrieval Augmented Generation (RAG) using SQLite, sqlite-vec, and OpenAI. It embeds text files, stores them in a SQLite database, and retrieves relevant documents using vector search. The project features lightweight single-file SQLite databases, vector search capabilities, and OpenAI integration for embeddings and chat responses.
An exploration of why SQLite is becoming a production-ready database for modern web apps, discussing its simplicity, concurrency issues, and recent advancements.
A new plugin for sqlite-utils CLI tool called sqlite-utils-ask allows users to ask human-language questions directly of SQLite databases and CSV/JSON files, using an LLM to generate SQL queries and execute them.
Introducing sqlite-vec, a new SQLite extension for vector search written entirely in C. It's a stable release and can be installed in multiple ways. It runs on various platforms, is fast, and supports quantization techniques for efficient storage and search.
* **New Feature:** `openai-to-sqlite` tool now allows enriching data in a SQLite database using OpenAI's GPT3.5 model.
* **Sentiment Analysis Example:**
+ Update a `sentiment` column in a `messages` table using `chatgpt()` function.