Patent ID: 11908036
Assignee: ADOBE INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 9:
10. A method of refining image acquisition data through domain adaptation, the method comprising:
converting, by a cross-domain encoder, real image acquisition data into a compact real feature representation, wherein the cross-domain encoder receives inputs from at least four input channels three of the at least four input channels respectively comprise red (R), green (G), and blue (B) input channels for RGB images from a video, and a fourth input channel comprises the real image acquisition data, wherein the real image acquisition data input to the fourth input channel comprises a depth map computed from an RGB image from the video, and RGB inputs to the RGB input channels comprise a first frame and a second frame that are each adjacent to the RGB image in the video;
converting, by a real encoder, conditional real data into a conditional real depth feature; and
generating, by a synthetic decoder, a refined version of the real image acquisition data based on the conditional real data, the compact real feature representation from the cross-domain encoder passed through to the synthetic decoder to generate the refined version of the real image acquisition data, wherein the refined version of the real image acquisition data is generated by converting the compact real feature representation to the refined version of real image acquisition data conditioned on the conditional real depth feature.