Question: How do their train their embeddings?
Answer: The embeddings are learned several times using the training set, then the average is taken.