Large language models (LLMs) are traditionally used online, but open-weights versions and smaller models are changing that, enabling researchers to run powerful AI tools locally for privacy, reproducibility, and cost-effectiveness.
The article provides examples of researchers using local models for various tasks, including:
- Summarizing scientific data and publications
- Generating training data for other models
- Transcribing and summarizing patient interviews
- Designing novel proteins
