Before revision:  We carried out extensive experiments on various Chinese NLP tasks , covering sentence-level to document-level, to revisit the existing pre-trained  models as well as the proposed MacBERT.
After revision:  We carried out extensive experiments on various Chinese NLP tasks , covering sentence-level to document-level, to revisit the existing pre-trained language models as well as the proposed MacBERT.