Add evaluation results on clinc_oos dataset #1

by autoevaluator HF staff - opened

Beep boop, I am a bot from Hugging Face's automatic model evaluator πŸ‘‹!
Your model has been evaluated on the clinc_oos dataset by @lewtun, using the predictions stored here.
Accept this pull request to see the results displayed on the Hub leaderboard.
Evaluate your model on more datasets here.

philschmid Hugging Face Optimum org

@lewtun can you check why the results are different? different split?

lewtun Hugging Face Optimum org

Yes, this is because I evaluated on the small config, while we trained these models on the plus one. We should probably add this dataset info to the Trainer at some point :)

Shall we merge this @philschmid ?

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment