Jeff Dean discusses the potential of merging Google Search with large language models (LLMs) using in-context learning, emphasizing enhanced information processing and contextual accuracy while addressing computational challenges.
First, using the demonstrations significantly outperforms the no demonstrations method even with small k (k = 4), and performance drop from using gold labels to using random labels is consistently small across varying k, in the range of 0.8–1.6%.7 Interestingly, model performance does not increase much as k increases when k ≥ 8, both with gold labels and with random labels.
