Patent ID: 8719687

Claim:
A computer-implementable method for creating a summary video with depth information, comprising: receiving, by a computer processor, an input original video; recognizing, by the computer processor, one or more moving objects from the input original video, wherein the moving object recognition is based on selection criteria including object shapes and forms, colors, exact appearances, and patterns of spatial movement; generating an animated moving object cutout for each of the one or more recognized moving objects, by the computer processor duplicating and stacking successive frames in the input original video containing images of the respective moving object and discarding frame image pixels surrounding the respective moving object; constructing a scene background, by the computer processor using texture of scenes in the input original video and estimating any missing portion; rendering a Dynamic 3D Scene, by the computer processor using depth information of foreground objects in the input original video and the scene background to create a three-dimensional scene and overlaying the one or more animated moving object cutouts on to the three-dimensional scene according to their respective longitude, latitude, and depth locations in the three-dimensional scene; and synthesizing, by the computer processor, the summary video using the Dynamic 3D Scene; wherein the summary video comprises two display regions: an appeared object list and a scene review section; wherein the appeared object list shows snapshots or animations of the one or more animated moving object cutouts currently appearing in the Dynamic 3D Scene; and wherein the scene review displays a virtual camera view of the Dynamic 3D Scene with the one or more animated moving object cutouts.