Question: How large is the dataset they used?
Answer: English wikipedia dataset has more than 18 million, a dump of 15 million English news articles