SemanticScuttle - klotz.me

klotz: drift* + fine-tuning*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. Proxy Fine-Tuning LLMs

   - Proxy fine-tuning is a method to improve large pre-trained language models without directly accessing their weights.
   - It operates on top of black-box LLMs by utilizing only their predictions.
   - The approach combines elements of retrieval-based techniques, fine-tuning, and domain-specific adaptations.
   - Proxy fine-tuning can be used to achieve the performance of heavily-tuned large models by only tuning smaller models.

   2024-05-11 Tags: proxy, fine-tuning, llm, retrieval-augmented generation, domain-specific adaptations, data delivery, rag, catastrophic forgetting, drift by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0