Patent ID: 9443011
Filing Date: 2016-09-13
CPC Classification: G06F,G06K,G06T

Claim Text:
1. A method implemented at least partially by a processor, the method comprising: receiving a video clip to be decomposed into a frame sequence; extracting scale-invariant feature transform (SIFT) features in a frame to quantize the SIFT features into descriptive words; tracking SIFT points of the extracted SIFT features in the frame, a first set of SIFT points corresponding to a second set of SIFT points in consecutive frames to construct a sequence of points; calculating center-awareness values for each of the SIFT points based at least in part on the location of each of the SIFT points in the frame relative to a center of the frame; computing values for the SIFT points based on a number of points in the sequence of points and the center-awareness values of the SIFT points of the frame; identifying a subset of SIFT points based on the number of points in a tracking sequence and the center-awareness values of the SIFT points; using the subset of SIFT points, representing the video clip as a bag of descriptive words; retrieving candidate images from a database based at least in part on the bag of descriptive words; computing a similarity score of the candidate images versus images in the video clip; calculating gradients of functions of the candidate images and the images in the video clip; combining the similarity scores with an average of the gradients being calculated; and ranking the candidate images based at least in part on the combining.