Abstract. In this paper we present a virtual character controlled by an actor in real time, who talks with an audience through an augmented mirror. The application, which integrates video images, the avatar and other virtual objects within an Augmented Reality system, has been implemented using a mixture of technologies: two kinect systems for motion capture, depth map and real images, a gyroscope to detect head movements, and control algorithms to manage avatar emotions.
The authors of REF built an interactive augmented reality system, which uses Kinect to capture the motion, depth map and real images.
Augmented mirror: interactive augmented reality system based on kinect
INTERACT
Computer Science