Patent ID: 8275219

Claim:
A video image synthesis method comprising the steps of: obtaining a contiguous frame group by detecting a plurality of frames that represent contiguous scenes in a video image; placing a reference patch comprising one or a plurality of rectangular areas on one of said plurality of frames included in said contiguous frame group which is used as a reference frame; respectively placing patches which are the same as said reference patch, on the others of said plurality of frames; moving and/or deforming said patches in said other frames so that an image within the patch of each of said other frames approximately coincides with an image within said reference patch; respectively acquiring correspondent relationships between pixels within the patches of said other frames and a pixel within said reference patch of said reference frame, based on the patches of said other frames after the movement and/or deformation and on said reference patch; and acquiring a synthesized frame from said plurality of frames, based on said correspondent relationships; wherein a correlation between adjacent frames, which is started from said reference frame, is acquired; said contiguous frame group that is detected comprises frames ranging from said reference frame to a frame, which is closer to said reference frame, between a pair of said adjacent frames in which said correlation is lower than a predetermined first threshold value; a histogram is computed for at least one of the Y, Cb, and Cr components of each of said adjacent frames (where the Y component is a luminance component and the Cb and Cr components are color difference components); a Euclidean distance for each component between said adjacent frames is computed by employing said histogram; the sum of the Euclidean distances for said three components is computed; and when said sum is a predetermined second threshold value or greater, the correlation between said adjacent frames is lower than said predetermined first threshold value.