Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training
akhaliq
Abstract
In this paper, we target the adaptive source driven 3D scene editing task by proposing a CustomNeRF model that unifies a text description or a reference image as the editing prompt. However, obtaining desired editing results conformed with the editing prompt is nontrivial since there exist two significant challenges, including accurate editing of only foreground regions and multi-view consistency given a single-view reference image. To tackle the first challenge, we propose a Local-Global Iterative Editing (LGIE) training scheme that alternates between foreground region editing and full-image editing, aimed at foreground-only manipulation while preserving the background. For the second challenge, we also design a class-guided regularization that exploits class priors within the generation model to alleviate the inconsistency problem among different views in image-driven editing. Extensive experiments show that our CustomNeRF produces precise editing results under various real scenes for both text- and image-driven settings.
Community
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Text-Guided 3D Face Synthesis -- From Generation to Editing (2023)
- ProteusNeRF: Fast Lightweight NeRF Editing using 3D-Aware Image Context (2023)
- A Unified Approach for Text- and Image-guided 4D Scene Generation (2023)
- Cut-and-Paste: Subject-Driven Video Editing with Attention Control (2023)
- Control3D: Towards Controllable Text-to-3D Generation (2023)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper