Patent ID: 8135221

Claim:
A method for determining a classification for a video segment, comprising using a processor to perform the steps of: a) breaking the video segment into a plurality of short-term video slices, each including a plurality of video frames and an audio signal; b) analyzing the video frames for each short-term video slice to form a plurality of region tracks, wherein the region tracks provide an indication of the position of identified image regions in a plurality of video frames; c) analyzing each region track to form a corresponding visual feature vector providing an indication of visual features for the image region, and a motion feature vector providing an indication of inter-frame motion for the image region; d) analyzing the audio signal for each short-term video slice to determine an audio feature vector providing a characterization of the audio signal; e) forming a plurality of short-term audio-visual atoms for each short-term video slice by combining the visual feature vector and the motion feature vector for a particular region track with the corresponding audio feature vector; and f) using a classifier to determine a classification for the video segment responsive to the short-term audio-visual atoms.