Before revision: Much of the recent success in NLP is due to the large Transformer-based models such as BERT (Devlin et al, 2019).
After revision: Large Transformer-based models such as BERT (Devlin et al, 2019).