ade Corpus v2-classification (Gurulingappa et al., 2012), ade Corpus v2-dosage (Gurulingappa et al., 2012), ag_news Gulli (link), ai2_ arc (Clark et al., 2018), amazon_polarity (McAuley and Leskovec, 2013), anli (Nie et al., 2020), art (Bhagavatula et al., 2020), biomrc (Pappas et al., 2020), blimp-anaphor_number_agreement (Warstadt et al., 2020), blimpellissn_bar_2 (Warstadt et al., 2020), blimp-sentential_negation_npi_licensor_present (Warstadt et al., 2020), blimpsentential_negation_npi_scope (Warstadt et al., 2020), boolq (Clark et al., 2019), circa (Louis et al., 2020), climate_fever (Diggelmann et al., 2020), codah (Chen et al., 2019), commonsense_qa (Talmor et al., 2019), cosmos_qa (Huang et al., 2019), crows_pairs (Nangia et al., 2020), dbpedia_14 (Lehmann et al., 2015), discovery (Sileo et al., 2019), dream (Sun et al., 2019), emo (Chatterjee et al., 2019), emotion (Saravia et al., 2018), ethos-directed_vs_generalized (Mollas et al., 2020), ethos-disability (Mollas et al., 2020), ethos-gender (Mollas et al., 2020), ethos-national_origin (Mollas et al., 2020), ethos-race (Mollas et al., 2020), ethos-religion (Mollas et al., 2020), ethos-sexual_ORIENTATION (Mollas et al., 2020), financialPhraseasebank (Malo et al., 2014), freebase_qa (Jiang et al., 2019), gigaword (Napoles et al., 2012), glue-cola (Warstadt et al., 2019), glue-mnli (Williams et al., 2018), glue-mrpc (Dolan and Brockett, 2005), glue-qnli (Rajpurkar et al., 2016), glue-qqp (data.quora.com/First-Quora-Dataset-Release-Question-Pairs), gluerte (Dagan et al., 2005; Bar-Haim et al., 2006)(Giampiccolo et al., 2007; Bentivogli et al., 2009), glue-sst2 (Socher et al., 2013), glue-wnli (Levesque et al., 2012), google_wellformed_query (Faruqui and Das, 2018), hateSpeech18 (de Gibert et al., 2018), hateSpeech Offensive (Davidson et al., 2017), hatexplain (Mathew et al., 2020), healthFact (Kotonya and Toni, 2020), hellaswag (Zellers et al., 2019), hotpot_qa (Yang et al., 2018), imdb (Maas et al., 2011), kilt_ay2 (Hoffart et al., 2011), kilt_fever (Thorne et al., 2018), kilt_hotpotqa (Yang et al., 2018), kilt_nq (Kwiatkowski et al., 2019), kilt_trex (Elsahar et al., 2018), kilt_zsre (Levy et al., 2017), lama-conceptnet (Petroni et al., 2019, 2020), lama-google_re (Petroni et al., 2019, 2020), lama-squad (Petroni et al., 2019, 2020), lama-trex (Petroni et al., 2019, 2020), liar (Wang, 2017), mc_taco (Zhou et al., 2019), medical Questions_pairs (McCreery et al., 2020), numer_sense (Lin et al., 2020), onestop_english (Vajjala and Lučić, 2018), openbookqa (Mihaylov et al., 2018), paws (Zhang et al., 2019), piqa (Bisk et al., 2020), poem_sentiment (Sheng and Uthus, 2020), proto_qa (Boratko et al., 2020), qa_srl (He et al., 2015), qasc (Khot et al., 2020), quail (Rogers et al. 2020)quarel (Tafjord et al. 2019a)quartz-no_knowledge (Tafjord et al. 2019b)quartz-with_knowledge (Tafjord et.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I})$  , quoref (Dasigi et al., 2019) race-high (Lai et al., 2017) race-middle (Lai et al., 2017) ropes Lin et al. 2019) roten_tomatoes(Pang and Lee, 2oo5) sciq Welbl et al. 2o17) scitail Khot et al. 2o18) search_qa Dunn et al. 2o17) sick Marelli et al. 2o14) sms_spam Almeida et al. 2o11) social_i_qa Sap et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{I}\mathbb{I}\mathbb{A})$  spider(Yu et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{I}\mathbb{A})$  squad-no_context (Rajpurkar et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{I}\mathbb{A})$  squad-with_context Rajaipurkar et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{I}\mathbb{A})$  superglue-cb de Marneffe et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{I}\mathbb{A})$  superglue-copa Gordon et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{I}\mathbb{A})$  superglue-multirc Khashabi et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{I}\mathbb{A})$  superglue-record Zhang et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{A})$  superglue-rt Dagan et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{A})$  Bar-Haim et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{A})$  Giampiccolo et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{A})$  Bentivogli et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{A})$  supergluewic Pilehvar and Camacho-Collados,  $^{(} = \mathbb{I}\mathbb{I}\mathbb{A})$  superglue-wsc Levesque et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{A})$  , swag Zellers et al.  $^{(} = \mathbb{I}\mathbb{I}\mathbb{A})$  tabfact Chen et al.  $^{(} = \mathbb{I}\mathbb{O},\bar{\bar{\alpha}})$  trec Li and Roth,  $^{(} = \bar{\bar{\alpha}})$  Hovy et al.  $^{(} = \bar{\bar{\alpha}})$  ,trec-finegrained Li and Roth,  $^{(} = \bar{\bar{\alpha}})$  Hovy et al.  $^{(} = \bar{\bar{\alpha}})$  , tweet_eval-emoji Barbieri et al.  $^{(} = \bar{\bar{\alpha}})$  , tweet_eval-emotion Barbieri et al.  $^{(} = \bar{\bar{\alpha}})$  , spider(Yu et al.  $^{(} = \bar{\bar{\alpha}})$  , tweet_eval-offensive Barbieri et al.  $^{(} = \bar{\bar{\alpha}})$  , tweet eval-sentiment Barbieri et al.  $^{(} = \bar{\bar{\alpha}})$  , tweet eval-stance_abortion Barbieri et al.  $^{(} = \bar{\bar{\alpha}})$  , tweet eval-stance_atheism Barbieri et al.  $^{(} = \bar{\bar{\alpha}})$  , tweet eval-stance_hillary Barbieri et al.  $^{(} = \bar{\bar{\alpha}})$  , tweet_qa(Xiong et al.  $^{(} = \bar{\bar{\alpha}})$  , unifiedqa:ai? science middle data.allenai.org/ ai? -science-questions) unifiedqa:boolq Clark et al.  $^{(} = \bar{\bar{\alpha}})$  , unifiedqa:commonsenseqa Talmor et a.l.  $^{(} = \bar{\bar{\alpha}})$  , unifiedqa:nationalQuestions Barbieri et a.l.  $^{(} = \bar{\bar{\alpha}})$  , unifiedqa:newsqa Trischler et a.l.  $^{(} = \bar{\bar{\alpha}})$  , unifiedqa:openbookqa Mi-haylovet a.l.  $^{(} = \bar{\bar{\alpha}})$  , unifiedqa:physical_iQA Bisket a.l.  $^{(} = \bar{\bar{\alpha}})$  , unifiedqa:qasc(Khot eal.  $^{(} = \bar{\bar{\alpha}})$  , unifiedqa:quoref(Dasigi e a.l.  $^{(} = \bar{\bar{\alpha}})$  , unifiedqa:social_iQA Sap e a.l.  $^{(} = \bar{\bar{\alpha}})$  , unifiedqa:winogrande_xl Sakaguchi at a.l.  $^{(} = \bar{\bar{\alpha}})$  , web Questions Berant e a.l.  $^{(} = \bar{\bar{\alpha}})$  , wiki_qa Yang e a.l.  $^{(} = \bar{\bar{\alpha}})$  , wikisql Zhong e a.l.  $^{(} = \bar{\bar{\alpha}})$  , wino_grande Sakaguchi e a.l.  $^{(} = \bar{\bar{\alpha}})$  , wipa(Tandon e a.l.  $^{(} = \bar{\bar{\alpha}})$  xsum(Narayan e a.l.  $^{(} = \bar{\bar{\alpha}})$  , yahoo_answers topics link yelp_polarity(Zhang e a.l.  $^{(} = \bar{\bar{\alpha}})$  , yelp_review_full(Zhang e a.l.  $^{(} = \bar{\bar{\alpha}})$