Before revision:  We find that nearly all the contextualized word vectors of BERT and RoBERTa have some common patterns .
After revision:  We find that nearly all the contextualized word vectors of BERT and RoBERTa have a common pattern .