Question: What pretrained LM is used?
Answer: Generative Pre-trained Transformer (GPT)
Alternative answer: Generative Pre-trained Transformer (GPT)