Before revision:  We  provide evidence that the learned representations transfer  to other tasks that do not require fine-tuning the entity encoder. In an entity classification task we obtain an average improvement of 16\%  accuracy compared with baselines that also employ pre-trained models.
After revision:  We provide evidence that the learned representations transfer to other tasks that do not require fine-tuning . In the entity classification task we obtain an average improvement of 16\% accuracy compared with baselines that also employ pre-trained models.