Before revision: While large-scale contextual language models have enjoyed great success recently, much remains to be understood about what is encoded in their representations.
After revision: The success of large-scale contextual language models have enjoyed great success recently, much remains to be understood about what is encoded in their representations.