Patent ID: 9087056
Filing Date: 2015-07-21
Classification: G06F,G06T

Abstract:
1. A computer-implemented method for the augmentation of an electronic media file, of the type that is playable to a user on a computing device having an integrated position sensor, a processor and a non-transitory computer readable storage medium and code in the form of one or more software modules stored on the storage medium and executable in the processor, the method comprising: activating a camera mounted to the computing device and the integrated position sensor; playing an electronic media file on a display of the computing device, wherein playing the electronic media file includes displaying electronic media content on the display, wherein the electronic media content is video content and wherein playing the electronic media content also includes playing audio content through an associated audio output; monitoring, using code executing in the processor, pixel image data from the camera including at least a current position of the user's eyes while the user looks at the display playing the video content; monitoring, using code executing in the processor, position data from the integrated position sensor including at least a current orientation of the computing device; discerning, using code executing in the processor, a focal point of the user's eyes based on the current position of one or more portions of the user's eyes and the current orientation of the computing device; correlating, using code executing in the processor, coordinates on the display to the focal point of the user's eyes at a particular point in time; determining, using code executing in the processor and based on the coordinates and the electronic media content being displayed by the display, whether the coordinates correspond to an augmentable portion of the video content being displayed by the display at said particular point in time, wherein the augmentable portion is a prescribed location within the video content displayed by the display at said particular point in time; and in the event that the coordinates correspond to the augmentable portion of the video content displayed by the display at said particular point in time, causing an augmentation file associated with the augmentable portion to be played by the computing device, wherein the augmentation file is a multimedia file, and wherein playing the augmentation file includes playing video on the display and playing audio through an associated audio output, and wherein, in the event that the augmentation file is played, the playing of the electronic media content is halted pending the playing of the augmentation file; in the event that the coordinates do not correspond to the augmentable portion of the video content displayed by the display at said particular point in time and are in proximity to the augmentable portion, queuing the augmentation file; in the event that the coordinates do not correspond to the augmentable portion of the video content displayed by the display at said particular point in time, repeating the monitoring, discerning, correlating and determining steps as the user continues to interact with the computing device; and after causing the augmentation file to be played, repeating the monitoring, discerning, correlating and determining steps as the user interacts with the computing device.