Massaro - Figure 10 Figure 10 . Each point in this scatter graph represents an audio-visual signal belonging to one of four syllable categories, each shown in a different color and graphed in arbitrary units. Overall, a strong correlation appears between the acoustic and the visual signals. The qualities of the video and audio signals increase together. But within a single syllable category, dots appear to be scattered randomly.
Statisticians call such a relationship class-conditional independence.
The Bayesian sensory integration described in the text yields the highest predicted accuracy for speech recognition, given the class-conditional independence illustrated here.