Patent ID: 7379053

Claim:
A system for interfacing with a computer having a software application running thereon, the software application having a plurality of user options, the system comprising: an extraction module in communication with the software application that extracts information from the software application and associated with one or more of the plurality of user options displayed on a window of a computer interface associated with the computer, the extracted information including extracted window coordinates and extracted labels for each of the one or more of the plurality of user options; a touch surface including an array of pads that can be touched by a user; a mapping module including: a position calculating module that calculates a relative position between the extracted window coordinates of a first one of the plurality of user options and the extracted window coordinates of at least a second one of the plurality of user options, and a matching module that associates the first one of the plurality of user options with a first pad on the array of pads based on a relative position between the first pad and a second pad on the array of pads and based on the calculated relative position between the extracted windows coordinates for the first one and the second one of the plurality of user options; and a touch module that, when the user touches the first pad in the array of pads, outputs to the user text associated with the extracted label of the first user option associated with the touched pad by the mapping module.