AnyBokeh: Physics-Guided Any-to-Any Bokeh Editing with Optical Fingerprint Transfer
Abstract
AnyBokeh is a physics-guided framework for bokeh editing that estimates source blur states and transfers optical characteristics between different focus and aperture settings without requiring all-in-focus reconstruction.
Depth-of-field control is a fundamental tool in photography, yet post-capture bokeh editing from a single image remains challenging. A practical editor should handle images captured under arbitrary focus and aperture settings. Existing methods typically assume an all-in-focus input, or first recover an all-in-focus image before rendering new bokeh. Such pipelines can discard useful blur cues from the source image and propagate reconstruction artifacts into the final edit. We introduce AnyBokeh, a physics-guided framework for any-to-any bokeh editing. Instead of treating source blur merely as a degradation to be removed, AnyBokeh estimates the source blur state with a signed circle-of-confusion map and a disparity map. By modeling the linear relation between signed circle of confusion and disparity difference, AnyBokeh estimates a source-specific optical fingerprint and transfers the source optical characteristics to the desired focus and aperture setting. A generative editor conditioned on both source and target circle-of-confusion maps then performs relative blur synthesis, enabling spatially adaptive deblurring, preservation, and defocus rendering. To support physically supervised learning, we further construct a high-fidelity synthetic dataset with accurate depth, focus distance, and full EXIF metadata. Experiments on real-world benchmarks show that AnyBokeh achieves faithful and controllable editing across any-to-any bokeh editing, all-in-focus-to-bokeh rendering, and defocus deblurring, while avoiding all-in-focus reconstruction and test-time bokeh-level calibration commonly required by existing approaches. The code and dataset will be available at https://github.com/itsmag11/AnyBokeh.
Community
AnyBokeh is a physics-guided framework for any-to-any bokeh editing from a single image captured under arbitrary focus and aperture settings. Instead of first reconstructing an all-in-focus image, AnyBokeh estimates the source CoC and disparity to recover a source-specific optical fingerprint, then transfers it to the user-specified target focus and aperture to compute the target CoC. A dual-CoC-conditioned editor uses both the source and target blur states to perform spatially adaptive deblurring, preservation, and defocus synthesis. To enable physically supervised learning, we also introduce UnrealBokeh, a synthetic dataset with per-pixel depth and complete camera parameters for computing ground-truth signed CoC maps.
Discussion and comments from the community are welcome!
Get this paper in your agent:
hf papers read 2606.31959 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper