First, using the demonstrations significantly outperforms the no demonstrations method even with small k (k = 4), and performance drop from using gold labels to using random labels is consistently small across varying k, in the range of 0.8–1.6%.7 Interestingly, model performance does not increase much as k increases when k ≥ 8, both with gold labels and with random labels.
