Patent ID: 8928734
Filing Date: 2015-01-06
Classification: G06T

Abstract:
1. A method for free-view relighting of a dynamic scene based on photometric stereo, comprising the following steps of: (1) performing multi-view dynamic videos capturing of an object using a multi-view camera array under a predetermined controllable varying illumination, and setting a controllable lighting sequence by a controllable light source array comprising a plurality of LED light sources to provide the desired predetermined controllable varying illuminations, (2) obtaining a three-dimensional shape model and surface reflectance peculiarities of the object based on the captured multi-view dynamic videos, and obtaining surface normal information and surface reflectance peculiarities of a visible area in each single view using the obtained dynamic videos of the object for each single view, wherein the step of obtaining the normal information and surface reflectance peculiarities further includes the steps of: the step (2) further includes integrating the surface normal information and the surface reflectance peculiarities of the visible area in each view to obtain the three-dimensional shape model of the object and model surface reflectance peculiarities corresponding to the three-dimensional shape model, (3) obtaining a static relighted three-dimensional model of the object based on the obtained three-dimensional shape model and surface reflectance peculiarities thereof, and obtaining a three-dimensional trajectory of the object based on the three-dimensional shape model, the surface reflectance peculiarities and the multi-view dynamic videos; (4) obtaining a dynamic relighted three-dimensional model based on the static relighted three-dimensional model and the three-dimensional trajectory of the object; and (5) performing a free-view dependent rendering to the dynamic relighted three-dimensional model of the object, whereby a free-view relighting of the object is achieved.