a realtime mixed reality system for seamless interaction between real and virtual objects
A mixed reality system where users interact with real and virtual 3D objects in a 3D world controlled by a physics engine is presented. To build the system we propose a hand detection and tracking system that maintains information about the way multiple users move their palms and fingers in 3D space using the feed from two fixed uncalibrated cameras. The complete 3D system can process and renders more than 30 frames per second.
mixed reality systems hand tracking hand segmentation