 We  provide evidence that the learned representations transfer  to other tasks that do not require fine-tuning the entity encoder. In an entity classification task we obtain an average improvement of 16\%  accuracy compared with baselines that also employ pre-trained models.
<clarity>  We  provide evidence that the learned representations transfer  to other tasks that do not require fine-tuning the entity encoder. In an entity classification task we obtain an average improvement of 16\%  accuracy compared with baselines that also employ pre-trained models.
 We provide evidence that the learned representations transfer to other tasks that do not require fine-tuning . In the entity classification task we obtain an average improvement of 16\% accuracy compared with baselines that also employ pre-trained models.