Patent Document ID: 9733713
Application ID: 13726909
Patent Status: 1

Claim One:
1. A method of controlling a visual display, comprising: receiving, by a device having an image capturing device, a plurality of video frames each comprising at least one foreground image and at least a portion of a background region, wherein the background region is visible; analyzing, by executing instructions using a processor of the device, a first video frame of the plurality of video frames to detect foreground images that are displayed on the background region in the first video frame; determining a boundary for each of the foreground images in the first video frame; mapping the boundaries for each of the foreground images to the background region in the first video frame; determining a position of a two dimensional aspect in the first video frame relative to the boundaries of the foreground images in the first video frame; recording coordinates associated with the two dimensional aspect in each of the video frames; evaluating the coordinates to determine a motion trajectory of the two dimensional aspect; determining a path traversed by the two dimensional aspect relative to the boundaries of the foreground images and the background region based on the recorded coordinates; and matching the determined path and the motion trajectory to a predetermined path and a prerecorded motion trajectory in a matching table to obtain associated control instructions for a device controlling the visual display.