sqlite-vec is an extremely small, 'fast enough' vector search SQLite extension designed to run anywhere. It allows storing and querying of float, int8, and binary vectors using virtual tables, written in pure C with no dependencies. It supports storing non-vector data in metadata, auxiliary, or partition key columns. It is a Mozilla Builders project with additional sponsorship from companies like Fly.io, Turso, SQLite Cloud, and Shinkai.
A simple project demonstrating Retrieval Augmented Generation (RAG) using SQLite, sqlite-vec, and OpenAI. It embeds text files, stores them in a SQLite database, and retrieves relevant documents using vector search. The project features lightweight single-file SQLite databases, vector search capabilities, and OpenAI integration for embeddings and chat responses.
The article explores the concept of Retrieval-Augmented Generation (RAG) using SQLite, specifically with the sqlite-vec extension and the OpenAI API. It outlines a simplified approach to RAG, moving away from complex frameworks and cloud vector databases, using SQLite's virtual tables for vector search and semantic understanding.
Introducing sqlite-vec, a new SQLite extension for vector search written entirely in C. It's a stable release and can be installed in multiple ways. It runs on various platforms, is fast, and supports quantization techniques for efficient storage and search.
