We apply sequence-to-sequence model to mitigate the impact of speech recognition errors on open domain end-to-end dialog generation. We cast the task as a domain adaptation problem where ASR transcriptions and original texts are in two different domains. In this paper, our proposed model includes two individual encoders for each domain data and make their hidden states similar to ensure the decoder predict the same dialog text. The method demonstrates that the sequence-to-sequence model can learn the ASR transcriptions and original text pair having the same meaning and eliminate the speech recognition errors. Experimental results on Cornell movie dialog dataset demonstrate that the domain adaption system help the spoken dialog system generate more similar responses with the original text answers. Index Termsspoken dialog system, neural dialog generation, ASR error modeling, encoder decoder architecture, domain adaptation
A recent study REF proposed to tackle ASR errors as a domain adaptation problem in the context of dialog systems.
Mitigating the impact of speech recognition errors on chatbot using sequence-to-sequence model
2017 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)
2017 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)
Computer Science