Question: Does pre-training on general text corpus improve performance?
Answer: No