Patent ID: 6992662

Claim:
A method of enabling user interaction with computer software executed in a computer system via: an interface surface including information relating to the computer software and including a plurality of regions, each region having disposed therein or thereon coded data indicative of a plurality of reference points and an identity of the region; a sensing device comprising: (a) an image sensor adapted to capture images of at least some of the coded data when the sensing device is placed in an operative position relative to one of the regions; and (b) a processor adapted to: (i) identify at least some of the coded data from at least one of the captured images; (ii) determine an orientation and position, within the captured images, of at least some of the coded data; (iii) decode at least some of the coded data; and (iv) generate, using at least some of the decoded coded data, indicating data including an identity of the region and at least one of movement data and position data indicative of the sensing device's movement and position relative to the region; and, the method including the steps of, in the computer system: (a) receiving the indicating data from the sensing device; (b) determining, using the indicating data, an identity of the region and at least one of the movement and position data; (c) operating the computer software at least partly in accordance with at least one of the movement data and the position data, and in accordance with instructions associated with the region.