The "LLM" toolkit provides a command-line utility and Python library for interacting with large language models. It enables users to run prompts from the terminal, store responses in SQLite databases, generate embeddings, and more. This comprehensive guide includes topics such as setup, usage, OpenAI models, other models, embeddings, plugins, model aliases, Python API, prompt templates, logging, related tools, CLI reference, contributing, and changelog.
* **New Feature:** `openai-to-sqlite` tool now allows enriching data in a SQLite database using OpenAI's GPT3.5 model.
* **Sentiment Analysis Example:**
+ Update a `sentiment` column in a `messages` table using `chatgpt()` function.
The author has also automated their weeknotes by using an Observable notebook, which generates the "releases this week" and "TILs this week" sections.
The notebook fetches TILs from the author's Datasette, grabs releases from GitHub, and assembles a markdown string for the new post.
* `llm` CLI tool for running prompts against large language models
* Automation of weeknotes using an Observable notebook
* Notebook generates "releases this week" and "TILs this week" sections
* Tool stores prompts and responses in a SQLite database