Before revision: Deep, heavily overparameterized language models such as BERT, XLNet and T5 have achieved impressive success in many NLP tasks.
After revision: Heavily overparameterized language models such as BERT, XLNet and T5 have achieved impressive success in many NLP tasks.