Patent ID: 11949943
Assignee: ARRIS ENTERPRISES LLC
Field: Audio-visual technology (Electrical engineering)
Classification: CPC H  G | IPC H

Claim 5:
6. A system for creating gazed-based advertising content, the system comprising:
a multiplexer (MUX) configured to:
receive an audio input and a video input;
generate a video stream using the audio input and the video input;
transmit the video stream to an image processing module;

the image processing module including:
a receiver to receive the video stream;
an identification module to identify at least one advertisable item in a frame of the video stream and provide a list of bitmaps for the at least one advertisable item;
an advertisement library to store a list of advertisable items including the at least one advertisable item and a corresponding URL to each advertisable item, wherein the advertisable items are in a bitmap format;
an ad mapper configured to:
provide a URL associated with the at least one advertisable item by comparing the identified bitmaps of the at least one advertisable item to the bitmaps from the advertisement library;

a transmitter to output the video stream to the MUX, the video stream including gaze metadata associated with the at least one advertisable item, the gaze metadata including the URL associated with the at least one advertisable item and bitmap coordinates for the at least one advertisable item, the bitmap coordinates comprising (x,y) coordinates;

the MUX further configured to:
transmit the video stream to a display device;

the display device configured to:
receive the video stream;
continuously detect a face associated with a viewer;
extract select facial features of the face of the viewer;
use a gaze detection algorithm to determine (x,y) coordinates of the viewer attention on a display device;
receive, from a gaze meta data parser, gaze metadata comprising (x,y) coordinates representing an advertisable item;
calculate an area of interest (AOI) corresponding to the advertisable item using the (x,y) coordinates representing the advertisable item and the video stream;
compare the AOI with the (x,y) coordinates of the viewer attention;
determine the AOI matches the (x,y) coordinates of the viewer attention;
select an advertisement URL associated with the advertisable item;
send the advertisement URL to the image processing module;
receive an advertisement corresponding to the advertisement URL; and
present the advertisement associated with the advertisement URL within the video stream.