Before revision:  When fine-tuned on ArBench, ARBERT and MARBERT collectively achieve new SOTA with sizeable margins compared to all existing models such as mBERT, XLM-R (Base and Large), and AraBERT on 37 out of 45 classification taskson the 41 datasets(\%82.22) . Our models are publicly available for research .
After revision:  When fine-tuned on ArBench, ARBERT and MARBERT collectively achieve new SOTA with sizeable margins compared to all existing models such as mBERT, XLM-R (Base and Large), and AraBERT on 37 out of 45 classification taskson the 41 datasets(\%82.22) . Our models are publicly available at URL and ARLUE will be released through the same repository .