Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".
Key concept: Setting mental models can help users understand how to interact with products that adapt over time. This chapter covers:
Identifying existing mental models
Onboarding in stages
Planning for co-learning
Accounting for user expectations of human-like interaction
Key concept: To build effective mental models of AI-powered products, consider what you want people to know about your product before their first use, how to explain its features, and when it will need feedback from them to improve.
Identifying existing mental models
Onboarding in stages
Planning for co-learning
Accounting for user expectations of human-like interaction
Key concept: To build effective mental models of AI-powered products, consider what you want people to know about your product before their first use, how to explain its features, and when it will need feedback from them to improve.
llm-tool provides a command-line utility for running large language models locally. It includes scripts for pulling models from the internet, starting them, and managing them using various commands such as 'run', 'ps', 'kill', 'rm', and 'pull'. Additionally, it offers a Python script named 'querylocal.py' for querying these models. The repository also come
- create a custom base image for a Cloud Workstation environment using a Dockerfile
. Uses:
Quantized models from
. Uses:
Quantized models from
The "LLM" toolkit offers a versatile command-line utility and Python library that allows users to work efficiently with large language models. Users can execute prompts directly from their terminals, store the outcomes in SQLite databases, generate embeddings, and perform various other tasks. In this extensive tutorial, topics covered include setup, usage, OpenAI models, alternative models, embeddings, plugins, model aliases, Python APIs, prompt templates, logging, related tools, CLI references, contributing, and change logs.
