Multimodal signal processing
Subtitle: human interactions in meetings
By: edited by Steve Renals ... [et al.].
Publisher: Cambridge University Press
Published: 2012
Place of publication: Cambridge; New York
Language: eng
ISBN-13: 9781107022294
Subjects: Technological innovations; Interactive multimedia; Signal processing; Computer conferencing; Computer input-output equipment; Digital techniques
Description: "Bringing together experts in multimodal signal processing, this book provides a detailed introduction to the area, with a focus on the analysis, recognition and interpretation of human communication. The technology described has powerful applications. For instance, automatic analysis of the outputs of cameras and microphones in a meeting can make sense of what is happening - who spoke, what they said, whether there was an active discussion and who was dominant in it. These analyses are layered to move from basic interpretations of the signals to richer semantic information. The book covers the necessary analyses in a tutorial manner, going from basic ideas to recent research results. It includes chapters on advanced speech processing and computer vision technologies, language understanding, interaction modeling and abstraction, as well as meeting support technology. This guide connects fundamental research with a wide range of prototype applications to support and analyze group interactions in meetings"--

"This book is an introduction to multimodal signal processing. In it, we use the goal of building applications that can understand meetings as a way to focus and motivate the processing we describe. Multimodal signal processing takes the outputs of capture devices running at the same time - primarily cameras and microphones, but also electronic whiteboards and pens - and automatically analyses them to make sense of what is happening in the space being recorded. For instance, these analyses might indicate who spoke, what was said, whether there was an active discussion, and who was dominant in it. These analyses require the capture of multimodal data using a range of signals,followed by a low-level automatic annotation of them, gradually layering up annotation until information that relates to user requirements is extracted"--
Notes: Includes bibliographical references and index.
Table of contents: title: Machine generated contents note: 1. Multimodal signal processing for human meetings: an introduction Andrei Popescu-Belis and Jean Carletta; 2. Data collection Jean Carletta and Mike Lincoln; 3. Microphone arrays and beamforming Iain McCowan; 4. Speaker diarization Fabio Valente and Gerald Friedland; 5. Speech recognition Thomas Hain and Philip N. Garner; 6. Sampling techniques for audio-visual tracking and head pose estimation Jean-Marc Odobez and Oswald Lanz; 7. Video processing and recognition Pavel Zemik, Sebastien Marcel and Jozef Mlich; 8. Language structure Tilman Becker and Theresa Wilson; 9. Multimodal analysis of small-group conversational dynamics Daniel Gatica-Perez, Rieks op den Akker and Dirk Heylen; 10. Summarization Thomas Kleinbauer and Gabriel Murray; 11. User requirements for meeting support technology Denis Lalanne and Andrei Popescu-Belis; 12. Meeting browsers and meeting assistants Steve Whittaker, Simon Tucker and Denis Lalanne; 13. Evaluation of meeting support technology Simon Tucker and Andrei Popescu-Belis; 14. Conclusion and perspectives Herve; Bourlard and Steve Renals.