Patent ID: 8243122
Filing Date: 2012-08-14
Classification: G06T

Abstract:
1. A free viewpoint video image generating method which generates a video image of an arbitrary viewpoint using video images of a object photographed by a plurality of cameras, each having a horizontal optical axis disposed to surround the object, comprising: a first step of dividing a real zone to local regions; a second step of transforming a camera coordinate system of the camera using an internal parameter of the camera within each of the local regions so that the optical axis of the camera is directed to the local region; a third step of enlarging or contracting the video image within the local region using information of distance between each of the cameras and the object, so that scales of the local regions on the video image are arranged to be identical; a fourth step of generating a free viewpoint video image only within the local region using a method of image based rendering within each of the local regions; a fifth step of enlarging or contracting the free viewpoint video image within each of the local regions so that the local region on the video image is of a prescribed scale; a sixth step in which the coordinate system of each camera is transformed using an internal parameter of the camera so that the optical axis of the camera is directed to a prescribed optical axis, so as to obtain the free viewpoint video image of the local region; and a seventh step of integrating the free viewpoint video image of each of the local region, wherein to generate a free viewpoint video image, viewed from a virtual viewpoint not located on a plane where the camera is disposed, moving a position of the virtual viewpoint video image of for each of the local regions within the free viewpoint video image for synthesis at the position of the virtual viewpoint is carried out in the seventh step or moving a position Q of information of ray to be read corresponding to the position of the virtual viewpoint is carried out in the fourth step.