Patent ID: 8094928

Claim:
A method for producing a video sequence comprising: receiving stereo images of a captured scene with a physical foreground object and a physical background; using a first disparity map to generate a kernel image, the kernel image comprising an array of pixel values representing a stereo disparity of an object to be located; scaling the kernel image using a second disparity map, the scaling based on at least a distance of a corresponding portion of the object relative to a stereo camera that provided the stereo images; performing, in real-time, a foreground/background separation algorithm on the stereo images, the separation algorithm configured compute differences between the received stereo images and stores the differences as a third disparity map; comparing the third disparity map to at least a portion of the scaled kernel image to identify pixels of the stereo images that represent the physical foreground object; and providing the identified pixels that represent the physical foreground object to at least one of a two dimensional and a three dimensional game.