Before revision:  In this paper, we investigate whether it is still helpful to add the specific task's loss in pre-training step .
After revision:  In this paper, we investigate whether it is still helpful to add the self-training method in the pre-training step .