Before revision:  We conduct evaluations on three benchmarks: language understanding tasks(QQP, QNLI, SST-2, MRPC, STS-B and MNLI) in the GLUE benchmark, cross-lingual natural language inference (XNLI) and machine translation.
After revision:  We conduct evaluations on two challenging cross-lingual tasks, XTREME and machine translation.