Before revision:  To evaluate our models, we propose ArBench , a new benchmark for multi-dialectal Arabic language understanding . ArBench is built using 41 datasets targeting 5 different tasks/ task clusters, allowing us to offer a series of standardized experiments under rich conditions.
After revision:  To evaluate our models, we also introduce ARLUE , a new benchmark for multi-dialectal Arabic language understanding . ArBench is built using 41 datasets targeting 5 different tasks/ task clusters, allowing us to offer a series of standardized experiments under rich conditions.