In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
Q: Using a set of semantically oriented tasks that require explicit semantic cross-lingual representations, we showed that mBERT contextual embeddings do not represent similar semantic phenomena similarly and therefore they are not directly usable for zero-shot cross-lingual tasks.
Question: What challenges this work presents that must be solved to build better language-neutral representations?
A:
contextual embeddings do not represent similar semantic phenomena similarly and therefore they are not directly usable for zero-shot cross-lingual tasks