Patent ID: 8805121

Claim:
A video image synthesis method comprising the steps of: sampling a predetermined number of contiguous frames, which include a reference frame and are two or more frames, from said video image; placing a reference patch comprising one or a plurality of rectangular areas on said reference frame; respectively placing patches which are the same as said reference patch, on the others of said predetermined number of frames; moving and/or deforming said patches in said other frames so that an image within the patch of each of said other frames approximately coincides with an image within said reference patch; respectively acquiring correspondent relationships between pixels within the patches of said other frames and a pixel within said reference patch of said reference frame, based on the patches of said other frames after the movement and/or deformation and on said reference patch; and acquiring a synthesized frame from said predetermined number of frames, based on said correspondent relationships; wherein said predetermined number of frames are determined based on image characteristics of said video image or synthesized frame, and said predetermined number of frames are sampled; and wherein said correspondent relationships are acquired in order of other frames closer to said reference frame, and a correlation is acquired between each of said other frames, in which said correspondent relationship is acquired, and said reference frame; and when said correlation is lower than a predetermined threshold value, acquisition of said correspondent relationships is stopped, and said synthesized frame is obtained based on said correspondent relationship by employing said other frames, in which said correspondent relationship has been acquired, and said reference frame.