Before revision: Since the introduction of deep pretrained language models , most task-specific NLP models were reduced to simple lightweight layers.
After revision: Since the introduction of deep pretrained language models , most task-specific NLP models to simple lightweight layers.