Patent Document ID: 8811673
Application ID: 13865329
Patent Status: 1

Claim One:
1. A method for an intelligent user-interaction system based on object detection, comprising: receiving an input video sequence corresponding to a video program; dividing the input video sequence into a plurality of video shots, each containing one or more video frames; detecting possible object occurrences in each of the plurality of video shots; analyzing possible paths of an object in a video shot using a multimodal-cue approach; aggregating the path-based selected object occurrences across the plurality of video shots to detect objects; and generating a complete list of the object occurrences across the plurality of video shots; wherein analyzing the possible paths using a multimodal-cue approach further includes: combining an appearance cue, a spatio-temporal cue, and a topological cue to aid object detection in the plurality of video shots; dictating a usage of an object's visual features to detect possible object locations in a video frame using the appearance cue; injecting information across a sequence of frames via relational constraints between a target object class and a related object class using the spatio-temporal cue and the topological cue; fusing the multimodal cue information to create links between object occurrences across the video frames in a current video shot; and applying dynamic programming to find optimal object paths.