Patent Document ID: 9990029
Application ID: 15096251
Patent Status: 1

Claim One:
1. A method for interfacing with an interactive program, comprising: capturing images of an interface object and a motion controller device disposed in a gameplay environment, the motion controller device being separate from the interface object, the interface object having a tag defined on a surface of the interface object; analyzing the captured images to identify the tag on the surface of the interface object; tracking movement of the interface object by tracking the tag on the surface of the interface object; generating augmented images by replacing, in the captured images, the tag with a virtual object, wherein generating the augmented images includes processing the tracked movement of the interface object to define movement of the virtual object; analyzing the captured images to identify a pointing direction of the motion controller device in the gameplay environment; wherein generating the augmented images further includes rendering in the augmented images a selection tool that is maneuverable as controlled by the pointing direction of the motion controller device; processing the pointing direction of the motion controller device to position the selection tool so as to point towards a selectable region of the virtual object, to further identify a selection of the selectable region of the virtual object; and presenting the augmented images on a display.