Before revision:  On entity probing tasks involving recognizing entity identity, our embeddings  achieve competitive performance with ELMo and BERT without using any extra parameters .
After revision:  On entity probing tasks involving recognizing entity identity, our embeddings achieve competitive performance with ELMo- and BERT-based embeddings in trained models .