PanoDreamer: 3D Panorama Synthesis from a Single Image
Authors: name: Avinash Paliwal; name: Xilong Zhou; name: Andrii Tsarov; name: Nima Khademi Kalantari
Published: 2024-12-06 07:42:48

Abstract: In this paper, we present PanoDreamer, a novel method for producing a
coherent 360^circ 3D scene from a single input image. Unlike existing
methods that generate the scene sequentially, we frame the problem as
single-image panorama and depth estimation. Once the coherent panoramic image
and its corresponding depth are obtained, the scene can be reconstructed by
inpainting the small occluded regions and projecting them into 3D space. Our
key contribution is formulating single-image panorama and depth estimation as
two optimization tasks and introducing alternating minimization strategies to
effectively solve their objectives. We demonstrate that our approach
outperforms existing techniques in single-image 360^circ scene
reconstruction in terms of consistency and overall quality.