Before revision:  The internal representations also perform better on word-in-context (WiC) task.
After revision:  The internal representations also perform better on word-in-context (WiC) dataset. The performance on the word sense disambiguation task is better for BERT and unchanged for RoBERTa. We can also better induce phrase grammar from the vector space.