analysis environment of conversational structure with nonverbal multimodal data
This paper shows the IMADE (Interaction Measurement, Analysis, and Design Environment) project to build a recording and anlyzing environment of human conversational interactions. The IMADE room is designed to record audio/visual, human-motion, eye gazing data for building interaction corpus mainly focusing on understanding of human nonverbal behaviors. In this paper, we show the notion of interaction corpus and iCorpusStudio , software environment for browsing and analyzing the interaction corpus. We also present a preliminary experiment on multiparty conversations.
analysis environment multiparty conversation multimodal data analysis