Before revision: Coarse-grained linguistic information, such as name entities or phrases, facilitates adequately representation learning in pre-training.
After revision: Coarse-grained linguistic information, such as named entities or phrases, facilitates adequately representation learning in pre-training.