Before revision:  To evaluate our models, we propose ArBench , a new benchmark for multi-dialectal Arabic language understanding . ArBench is built using 41 datasets targeting 5 different tasks/ task clusters, allowing us to offer a series of standardized experiments under rich conditions.
After revision:  To evaluate our models, we propose ArBench , a new benchmark for multi-dialectal Arabic language understanding evaluation. ARLUE is built using 41 datasets targeting 5 different tasks/ task clusters, allowing us to offer a series of standardized experiments under rich conditions.