Hugging Face's logo

philschmid
/
RoBERTa-Banking77

Text Classification Transformers PyTorch
English roberta Trained with AutoTrain Eval Results Inference Endpoints
Model card Files Community
2

Add evaluation results on banking77 dataset

#1
by autoevaluator HF staff - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+65
-12
autoevaluator

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!
Your model has been evaluated on the banking77 dataset by @lewtun , using the predictions stored here.
Accept this pull request to see the results displayed on the Hub leaderboard.
Evaluate your model on more datasets here.

Add evaluation results on banking77 datasetfdd720c0
philschmid
 Owner

@lewtun @abhishek this model was trained with AutoTrain, where the label mapping has changed that's why it is creating these results. So the evaluation is wrong here from autoevaluator

lewtun

Thanks for pointing this out - I recall the discussion now in Slack :)

We do perform a type of label alignment in the backend to align the label mapping of a dataset with a model, so I need to take a closer look at this model to see why it still produces false results. Obviously, don't merge please :)

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment