Before revision: Current state-of-the-art approaches to summarization utilize large pre-trained Transformer models.
After revision: Recent state-of-the-art approaches to summarization utilize large pre-trained Transformer models.