GeometryGuided View Synthesis with Local Nonuniform PlaneSweep Volume In this paper we develop a geometryguided image generation technology for sceneindependent novel view synthesis from a stereo image pair. We employ the successful planesweep strategy to tackle the problem of 3D scene structure approximation. But instead of putting on a general configuration, we use depth information to perform a local nonuniform plane spacing. More specifically, we first explicitly estimate a depth map in the reference view and use it to guide the planes spacing in planesweep volume, resulting in a geometryguided manner for scene geometry approximation. Next we learn to predict a multiplane images (MPIs) representation, which can then be used to synthesize a range of novel views of the scene, including views that extrapolate significantly beyond the input baseline, to allow for efficient view synthesis. Our results on massive YouTube video frames dataset indicate that our approach makes it possible to synthesize higher quality images, while keeping the number of depth planes.

A Statistical Model for Disocclusions in Depthbased Novel View Synthesis The occurrence of missing regions in output images is a critical issue when rendering a scene from novel vantage points using depthbased view synthesis. These regions typically have to be filled using inpainting algorithms, which are slow and might yield unconvincing results. Understanding the likelihood of the occurrence of these missing regions can help us design better, applicationspecific data representations and camera systems by knowing which vantage points should be captured and stored to minimize disocclusion holes in the synthesized novel views. In this paper, we propose a statistical model that predicts the likelihood of missing data in synthesized images as a function of the viewpoint translation. Scenedependent model parameters are efficiently estimated using simple shift and scaling transformations on the source depth images without needing view synthesis.