Question: How they show that mBERT representations can be split into a language-specific component and a language-neutral component?
Answer: We thus try to remove the language-specific information from the representations by centering the representations of sentences in each language so that their average lies at the origin of the vector space.