Question: Which pre-trained transformer do they use?
Answer: BIBREF5