Before revision:  Many methods couple pre-trained language models with knowledge graphs in order to combine the merits in language modeling and entity-based relational learning .
After revision:  Many methods couple pre-trained language models with knowledge graphs (KG) .