Question: On which dataset(s) do they compute their word embeddings?
Answer: 10 million sentences gathered from Wikipedia