Before revision:  Architectural factors that contribute to multilinguality are underparameterization, shared special tokens (e.g., " CLS "), shared position embeddings and replacing masked tokens with random tokens.
After revision:  Architectural factors that contribute to multilinguality are underparameterization, shared special tokens (e.g., "  "), shared position embeddings and replacing masked tokens with random tokens.