Before revision:  To boost the models' performance, various pre-training methods have been proposed to utilize large-scale unlabeled text and speech data .
After revision:  To boost the models' performance, various pre-training methods have been proposed to utilize large-scale unannotated speech and text .