Question: What is the new initialization method proposed in this paper?
Answer: They initialize their word and entity embeddings with vectors pre-trained over a large corpus of unlabeled data.