Before revision: In this work  we provide a systematic empirical comparison of pretrained multilingual language models versus their monolingual counterparts with regard to their monolingual task performance.
After revision: In this work we provide a systematic and comprehensive empirical comparison of pretrained multilingual language models versus their monolingual counterparts with regard to their monolingual task performance.