dialog audio feature visual feature multimodal feature extractors question : “ what is he doing ? ” qn output word sequence answer : “ he is watching tv .
Spoken dialogue technology: enabling the conversational user interface