Question: Do they fine-tune their model on the end task?
Answer: Yes