Patent ID: 9201500
Filing Date: 2015-12-01
Classification: G06F

Abstract:
1. A method comprising: receiving a first image from a first front facing camera of a device having a front facing display; identifying one or more eyes of a user of the device based on the first image; determining a gaze location of the one or more eyes on the front facing display; determining a change in the gaze location; receiving a second image from a second front facing camera of the device; identifying a point of interest on the front facing display based on gaze information, wherein the gaze information includes the gaze location and the change in the gaze location; identifying a hand of the user based on the second image; identifying one or more fingertips associated with the hand of the user based on the second image; determining a movement of one or more of the hand and the one or more fingertips; identifying a hand action based on gesture information, wherein the gesture information is to include the movement and the movement is one or more of a one-dimensional (1D) movement, a two-dimensional (2D) movement and a three-dimensional (3D) movement; and initiating a device action with respect to the front facing display based on the point of interest and the hand action, wherein the device action is to emulate a multi-modal touchscreen function with respect to the front facing display that concurrently tracks and synchronizes the gaze information and the gesture information.