Before revision: While large-scale contextual language models have enjoyed great success recently, much remains to be understood about what is encoded in their representations.
After revision: While large-scale contextual language models has attracted great interest in probing what is encoded in their representations.