Before revision:  Via careful data cleaning and filtering , our transformer-based pretrained model without any finetuning achieves remarkable results over various news summarization tasks.
After revision:  We collect a massive news corpus and conduct data cleaning and filtering , our transformer-based pretrained model without any finetuning achieves remarkable results over various news summarization tasks.