Task: Question Generation
Input (English): Using a set of semantically oriented tasks that require explicit semantic cross-lingual representations, we showed that mBERT contextual embeddings do not represent similar semantic phenomena similarly and therefore they are not directly usable for zero-shot cross-lingual tasks.
Output (English): What challenges this work presents that must be solved to build better language-neutral representations?