Patent ID: 8131012

Claim:
A method for processing a stream of video frames recording events within a scene, the method comprising: receiving a first frame of the stream, wherein the first frame includes data for a plurality of pixels included in the frame; identifying one or more groups of pixels in the first frame, wherein each group depicts an object within the scene; generating a search model storing one or more features associated with each identified object; classifying each of the objects using a trained classifier; tracking, in a second frame, each of the objects identified in the first frame using the search model; supplying the first frame, the second frame, and the object classifications to a machine learning engine; and generating, by the machine learning engine, one or more semantic representations of behavior engaged in by the objects in the scene over a plurality of frames, wherein the machine learning engine is configured to learn patterns of behavior observed in the scene over the plurality of frames and to identify occurrences of the patterns of behavior engaged in by the classified objects.