: Left: Original captured image of the scene. Center: Augmented scene with two virtual cubes. One can notice the effect of the estimated 3D position of the light source. Right: Augmented scene with a virtual sphere where the specular occlusion is correctly rendered. The acquisition of surface material properties and lighting conditions is a fundamental step for photo-realistic Augmented Reality (AR). In this paper, we present a new method for the estimation of diffuse and specular reflectance properties of indoor real static scenes. Using an RGB-D sensor, we further estimate the 3D position of light sources responsible for specular phenomena and propose a novel photometry-based classification for all the 3D points. Our algorithm allows convincing AR results such as realistic virtual shadows as well as proper illumination and specularity occlusions.
REF addressed the problem for multiple point light sources based on the specular reflections in the scene.
Reflectance and Illumination Estimation for Realistic Augmentations of Real Scenes
2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)
2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)
Computer Science