Patent ID: 8840466

Claim:
A system enabling a game application, characterizable in at least three game-world (x v , Y v , z v ) coordinates and an implicit fourth (t v ) time coordinate, and executed by a game device coupled to a display, to respond to at least a natural gesture three-dimensional (x w , y w , z w ) input and an implicit fourth (t w ) time input generated from a player interacting with said game application to enable said game application to present player-interactable depth on said display, the system comprising: said display, coupled to said system to render images commensurate with player interaction with said game application; an optical acquisition system to acquire at least three-dimensional (x w , y w , z w , t w ) data representing player interaction with said game application; means for recognizing from sensed at least said (x w , y w , z w , t w ) data acquired by said optical acquisition system at least one player gesture; said optical acquisition system to acquire at least three-dimensional (x w , y w , z w , t w ) data and said means for recognizing from sensed at least said (x w , y w , z w , t w ) data including at least spaced-apart first and second two-dimensional cameras whose overlapping fields of view acquire images including data representing potential landmark points and data imaging at least a portion of interaction by said player with said game application; executable software, coupled to said first and second two-dimensional cameras, to represent said player from acquired said images using as least some said landmark points from which at least one user gesture is discernible; means for mapping acquired said (x w , y w , z w , t w ) and virtual game-world (x v , y v , z v , t v ) coordinates into a unified four dimensional scaled coordinate system (x u , y u , z u , t u ); means for using at least one of mapped and scaled said unified-world (x u , y u , z u , t u ) coordinates to cause said game application to react to said (x w , y w , z w ) data acquired by said optical acquisition system; and means for causing, said game application to render at least one image on said display responsive to said means for using; wherein said display and game interaction is rendered from a perception viewpoint of said player; and wherein said game application is characterized by a representation selected from a group consisting of (i) a two-dimensional virtual representation, and (ii) a three-dimensional virtual representation.