Question: what data did they use?
Answer:  Penn Treebank, WikiText2
Alternative answer: Penn Treebank (PTB) , WikiText2 (WT-2)