Patent ID: 8456534

Claim:
A method comprising: receiving image information from a video camera, the image information capturing a scene which includes at least part of a display device, wherein: the video camera is affixed to a user-manipulated device configured for carrying by a user; and the user-manipulated device comprises a remote control device or a controller; identifying a plurality of reference fields in the image information to provide identified reference information for controlling an application displayed on the display device, wherein the plurality of reference fields are displayed as part of graphical information displayed on the screen of the display device, the user-manipulated device capable of identifying the plurality of reference fields based on colors of the plurality of reference fields, based on shapes of the plurality of reference fields, and based on patterns of elements that comprise each reference field of the plurality of reference fields; generating position information based on the identified reference information, the position information expressing a position of the user-manipulated device relative to at least one reference field associated with the display device, wherein the position of the user-manipulated device is calculated based on a position of the video camera associated with the user-manipulated device; and controlling the application based on the generated position information.