We describe a system for semi-automatically stylizing an input video into regions of constant color and curved strokes that are spatiotemporally coherent. To achieve this, we treat video as a space-time volume of image data and exploit a mean shift technique to segment it into multi-level attached volumes which are subsequently smoothed. A user attention model identifies the meaningful elements of the hierarchical structure of the 3D segments to select the appropriate level for each segment. Two dimensional smooth edge sheets embedded in the 3D video volume are determined. Color regions and strokes in video frames are rendered by successively slicing the volumes and edge sheets in time. The temporal coherence provided by the smoothed segments and sheets results in a consistent cartoon like appearance.
REF developed an anisotropic kernel mean shift technique to segment the video data into contiguous volumes.
Video Tooning
SIGGRAPH 2004
Computer Science