Patent ID: 9167232
Filing Date: 2015-10-20
Classification: G06K,G06T,H04N

Abstract:
1. A system for converting 2D video to 3D video, comprising: a video content analysis unit for analyzing a 2D video datum and extracting useful information including motion and color for depth estimation; a depth estimation unit for receiving the useful information, calculating motion cue and contrast cue for initial depth estimation, and generating an initial depth map; a depth post-processing unit for correcting the initial depth map in spatial domain and temporal domain to increase accuracy of the depth map in spatial domain and increase depth continuity between adjacent time instances and processing caption information in the video to generate a final depth map; and a stereoscopic video generation unit for synthesizing a 3D video datum based on the final depth map and the 2D video datum, wherein the depth estimation unit comprises a motion cue calculator, a contrast cue calculator, and a depth cue fusion device, the motion cue calculator is to divide the frame into a plurality of blocks for calculating the motion vector associated with each of the blocks or acquiring the motion vector decoded by a video decoder to further figure out the motion cue and then to identify whether they require correction or not based on the distribution of the motion vectors, in all directions, of the current block and its 3×3 adjacent blocks; if the number of the blocks belonging to the dominant direction is smaller than a predetermined value, it will be identified that motion vectors around the current block are somewhat random and they do not need any correction; if the number of the same is larger than said predetermined value, then correct the motion vector of the current block to be the mean vector of motion vectors belonging to the dominant direction and recalculate the motion cue; the depth cue fusion device can fuse the motion cue and the contrast cue figured out by the motion cue calculator and the contrast cue calculator to get the initial depth map, the aforesaid fusion being meant to have adjustable weights for the motion cue and the contrast cue according to four types of camera motions classified previously by a camera motion analyzer.