Before revision: Autoregressive language models pretrained on large corpora have been successful at solving  downstream tasks, even with zero-shot usage.
After revision: Autoregressive language models , pretrained using large text corpora to do well on next word prediction, have been successful at solving downstream tasks, even with zero-shot usage.