Like in a real world meeting, users should be able to interact simultaneously. We are integrating smart virtual cameras whose behavior can be seen as an optimization problem. This latter stems from cognitive and perceptive aspects taken into account by orientation requirements. It enhances the understanding of a scene.
Experimental research is required to determine the best ways to associate audio and video.
While monophonic sounds cannot conflict with spatialized videos, spatialized sounds shall remain coherent with the visual scene. Audio continuity must also be assured during and after visual transitions. This is one of the features of MPEG-4 which we are following in this project.