Patent ID: 11962952

Abstract:
A method for retrieval of multi spectral bidirectional reflectance distribution function (BRDF) parameters by using red-green-blue-depth (RGB-D) data includes capturing, by an RGB-D camera, at least one image of one or more objects in a scene. The captured at least one image of the one or more objects includes RGB-D data including color and geometry information of the objects. A processing unit reconstructs the captured at least one image of the one or more objects to one or more 3D reconstructions by using the RGB-D data. A deep neural network classifies the BRDF of a surface of the one or more objects based on the 3D reconstructions. The deep neural network includes an input layer, an output layer, and at least one hidden layer between the input layer and the output layer. The multi spectral BRDF parameters are retrieved by approximating the classified BRDF by using an iterative optimization method.