Before revision: Recent studies about learning multilingual representations have achieved significant performance gains across a wide range of downstream cross-lingual tasks.
After revision: Existing work in multilingual pretraining has demonstrated the potential of cross-lingual tasks.