adit94/nlpcharade model
This model is based on t5-base pretrained model.
Model Recycling
Evaluation on 36 datasets using adit94/nlpcharade as a base model yields average score of 78.23 in comparison to 75.45 by t5-base.
The model is ranked 1st among all tested models for the t5-base architecture as of 21/12/2022 Results:
| 20_newsgroup | ag_news | amazon_reviews_multi | anli | boolq | cb | cola | copa | dbpedia | esnli | financial_phrasebank | imdb | isear | mnli | mrpc | multirc | poem_sentiment | qnli | qqp | rotten_tomatoes | rte | sst2 | sst_5bins | stsb | trec_coarse | trec_fine | tweet_ev_emoji | tweet_ev_emotion | tweet_ev_hate | tweet_ev_irony | tweet_ev_offensive | tweet_ev_sentiment | wic | wnli | wsc | yahoo_answers |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 56.1086 | 91.8 | 70.9459 | 48.625 | 87.5 | 66.6144 | 79.2905 | 89.4667 | 89.212 | 90.3196 | 86.6151 | 81.4919 | 97.6 | 92.4401 | 88.7255 | 72.3598 | 45.38 | 56.338 | 90.6752 | 51.8855 | 90.3196 | 83.9535 | 74.2347 | 79.3272 | 66.44 | 92.3165 | 92.4401 | 90.3196 | 74.2347 | 83.9535 | 70.9459 | 86.6151 | 71.8 | 56.338 | 77.1667 | 92.596 |
For more information, see: Model Recycling