Before revision:  On entity probing tasks involving recognizing entity identity, our embeddings  achieve competitive performance with ELMo and BERT without using any extra parameters .
After revision:  On entity probing tasks involving recognizing entity identity, our embeddings used in parameter-free downstream models achieve competitive performance with ELMo and BERT without using any extra parameters .