Getting more from automatic transcripts for semi-supervised language modeling ?
We analyze why semi-supervised backoff language modeling performs poorly. We motivate MAP adaptation of a log-linear language model. We use automatic transcripts as a prior for language model estimation. We show consistent reduction in WER across a range of low-resource conditions.
language modeling low-resource automatic speech recognition lvcsr