Before revision: Self-supervised acoustic pre-training has achieved impressive results on low-resource speech recognition tasks .
After revision: Self-supervised acoustic pre-training has achieved impressive results on the task of automatic speech recognition (ASR). For low-resource ASR tasks, however, labeled data can hardly satisfy the demand of end-to-end models. Self-supervised acoustic pre-training has already shown its amazing ASR performance, while the transcription is still inadequate for language modeling in end-to-end models .