Detailed Instructions: In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
Q: However, we found that explicitly initializing these embeddings with vectors pre-trained over a large collection of unlabeled data significantly improved performance (see Section "Effects of initialized embeddings and corrupt-sampling schemes" ).
Question: What is the new initialization method proposed in this paper?
A:
They initialize their word and entity embeddings with vectors pre-trained over a large corpus of unlabeled data.