Before revision: Recent works show that pre-trained masked language models , such as BERT, possess certain linguistic and commonsense knowledge.
After revision: Recent works show that pre-trained language models (PTLMs) , such as BERT, possess certain linguistic and commonsense knowledge.