Patent ID: 8994650
Filing Date: 2015-03-31
Classification: G06F,G06K

Abstract:
1. A method for operating a mobile device, the method being performed by one or more processors of the mobile device and comprising: receiving, from an image capturing component of the mobile device, image input corresponding to a scene, the scene including at least a portion of a remote device and one or more fingers of a user of the mobile device; processing the image input on the mobile device to (i) detect, in the image input, one or more graphic objects that are displayed on a display of the remote device, and (ii) detect, in the image input, the one or more fingers of the user in relation to the one or more graphic objects; determining, from processing the image input, a command for controlling an operation of the remote device based on a position or a movement of the one or more fingers in the image input in relation to the one or more graphic objects in the image input; and communicating, from the mobile device, the command to the remote device.