Add evaluation results on banking77 dataset #1

by autoevaluator HF staff - opened

Beep boop, I am a bot from Hugging Face's automatic model evaluator πŸ‘‹!
Your model has been evaluated on the banking77 dataset by @lewtun, using the predictions stored here.
Accept this pull request to see the results displayed on the Hub leaderboard.
Evaluate your model on more datasets here.

@lewtun @abhishek this model was trained with AutoTrain, where the label mapping has changed that's why it is creating these results. So the evaluation is wrong here from autoevaluator

Thanks for pointing this out - I recall the discussion now in Slack :)

We do perform a type of label alignment in the backend to align the label mapping of a dataset with a model, so I need to take a closer look at this model to see why it still produces false results. Obviously, don't merge please :)

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment