Multimodal Interaction, Speech-based interaction
Channel: Jaakko Hakulinen
Date: 13/09/2018

Lecture on speech-based interaction on multimodal interaction course.

1:07 Lecture starts
2:34 Why to use speech in HCI
7:10 Challenges with speech
12:24 Different types of speech applications
22:14 Components of speech-based applications
36:43 Levels of spoken language
41:26 Principles of automatic speech recognition
  44:39 Acoustic model 
  46:51 Vocabulary
  48:20 Language Model
49:32 Perplexity and complexity of language, out-of-vocabulary challenge
54:23 Sources of variation in language
56:00 Properties of ASR implementations
59:59 Principles of speech synthesis
1:09:08 Dialogue Management
1:09:28 Dialogue initiative
1:17:27 Dialogue control models
1:24:27 Error management