Question: Does the additional training on supervised tasks hurt performance in some tasks?
Answer: Yes