Patent ID: 7046300
Filing Date: 2006-05-16
Classification: G10L

Abstract:
1. An apparatus for determining consistency between facial movements and at least one speech signal associated with video, said apparatus comprising: an arrangement for extracting a video signal from a video input; an arrangement for discerning facial movements in the video signal; an arrangement for obtaining at least one speech signal associated with the video input; an arrangement for producing a synchrony measure which measures consistency between the facial movements discerned and the at least one speech signal obtained; an arrangement for producing a plausibility measure which measures consistency between the facial movements discerned at the at least one speech signal obtained; a first feature extractor, associated with the video signal; a second feature extractor, associated with the at least one speech signal; said first and second feature extractors each being adapted to extract features for use in determining to the synchrony and plausibility measures; wherein said arrangement for producing a synchrony measure comprises an arrangement for segmenting the video input based on input from both of said first and second feature extractors; wherein said arrangement for producing a synchrony measure further comprises an arrangement for modeling each segment produced by said segmenting arrangement; wherein said modeling arrangement is adapted to model each segment via a multivariate Gaussian.