Before revision: While large-scale  language models have enjoyed great success recently, much remains to be understood about what is encoded in their representations.
After revision: While large-scale contextual language models have enjoyed great success recently, much remains to be understood about what is encoded in their representations.