Question: How are the two different models trained?
Answer: They pre-train the models using 600000 articles as an unsupervised dataset and then fine-tune the models on small training set.