Patent ID: 9258597
Filing Date: 2016-02-09
CPC Classification: G06F,G06K,H04N

Claim Text:
1. A method comprising: receiving, from a remote device, a request to receive supplemental information relating to an item of interest from a video frame in a first video; obtaining, from a memory connected to the remote device, a plurality of image data including the video frame corresponding to a time of the request, at least one preceding video frame presented before the video frame, and at least one subsequent frame presented after the video frame; comparing the plurality of image data from the video frame, the at least one preceding video frame, and the at least one subsequent frame to determine the item of interest in the received request; performing, using a hardware processor, a search query based on the determined item of interest and device information associated with the remote device to identify a second video that is related to the first video; identifying, using the hardware processor, first data relating to the determined item of interest based on the visual characteristics of the determined item of interest, wherein the first data comprises information relating to the second video; determining, using the hardware processor, a message to be displayed by the remote device based on the first data and an action to be performed on the second video by the remote device based on the first data, wherein the action comprises recording the second video; and transmitting, to the remote device, structured data that comprises a first node that includes information relating to displaying the message and a second node that includes instructions for performing the action by the remote device, wherein the transmitted structured data causes the remote device to display the message relating to the second video and perform the action on the second video.