Before revision: Models pretrained with self-supervised objectives on large text corpora achieve state-of-the-art performance on  text summarization tasks.
After revision: Models pretrained with self-supervised objectives on large text corpora achieve state-of-the-art performance on English text summarization tasks.