Each time you run the model, the results may vary a little bit. Overall, after 5 tries, I can conclude that SBERT has a bit better performance in terms of best f1 score while Data2vec used way less memory. The average f1 scores for both models are very close.
$$logloss(theta) = - {1 over m} sum_{i=1}^m (y_i ln(hat p(y_i=1)) + (1-y_i) ln(1-hat p(y_i=1)))$$
The Self-Learning Path To Becoming A Data Scientist, AI or ML Engineer
