Patent ID: 8160564

Claim:
One or more non-transitory computer-readable media having computer-executable instructions embodied thereon for capturing, on a mobile device, an image of an application executing on a computing device and enabling the mobile device to remotely issue commands to interact with the application on the computing device, the method comprising: receiving an image of the application executing on the computing device, separate from the mobile device, by capturing the image of the application executing on the computing device with a digital camera in the mobile device; requesting, from the computing device, specification information associated with the application, wherein the specification information includes: requesting a data representation of the application within the image, wherein the data representation is a bitmap representation, a JPEG representation, or a TIFF representation; and requesting identification of one or more user-manipulative options related to the bitmap representation, wherein the one or more user-manipulative options enable a user to interact with the application; receiving the bitmap representation and the one or more user-manipulative options; associating the user-manipulative options with one or more portions of the image; and assigning at least one key on the mobile device to a user experience corresponding to at least one of the one or more user-manipulative options.