The Bayou was a haven away from the vendor floor indended to showcase interesting research in graphics and interaction. The Smart Spaces demonstration was built on top of a diverse set of technologies. Three-dimensional position of the head and hands is estimated from blob correspondences among multiple cameras. Position, orientation and approximate size are extracted. Blob features allow self-calibration of multiple cameras by tracking the head and hands over a short time period.
Painstaking calibration is unnecessary.
Audition Segmentation extracts speech events from background noise. Prosody analysis determines pitch, volume and timing of speech. The mouth is detected using a learned statistical model. Face orientation and mouth shape information is extracted. Facial parameters are used to control the expression and head orientation of an animated character.