Multimodal humancomputer interaction: A survey
In this paper, we review the major approaches to multimodal humancomputer interaction, giving an overview of the field from a computer vision perspective. In particular, we focus on body, gesture, gaze, and affective interaction (facial expression recognition and emotion in audio). We discuss user and task modeling, and multimodal fusion, highlighting challenges, open issues, and emerging applications for multimodal humancomputer interaction (MMHCI) research.
multimodal human-computer interaction gesture recognition affective computing human-centered computing