Before revision:  We evaluate our model on two Arabic reading comprehension tasks, and we show that AraELECTRA outperforms current state-of-the-art Arabic language representation models  given the same pretraining data and with even a smaller model size.
After revision:  We evaluate our model on two Arabic reading comprehension tasks, and we show that AraELECTRA outperforms current state-of-the-art Arabic language representation models , given the same pretraining data and with even a smaller model size.