Patent ID: 11908036
Assignee: ADOBE INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A cross domain supervised learning-based system for iteratively training a domain adaptive refinement agent, the system comprising:
a cross-domain encoder configured to convert synthetic and real image acquisition data derived from a video into compact synthetic and real feature representations respectively, wherein the synthetic and real feature image acquisition data comprises a frame of the video, the cross-domain encoder comprising at least four input channels, wherein three of the at least four input channels respectively comprise red (R), green (G), and blue (B) input channels for an RGB image corresponding to the frame of the video, and a fourth input channel comprises the real image acquisition data, wherein the real image acquisition data is a depth map corresponding to the RGB image;
a synthetic conditional depth prediction branch network comprising a synthetic encoder and a synthetic decoder, and configured to convert the compact synthetic feature representation to a refined version of the synthetic image acquisition data, the synthetic encoder outputting a compact synthetic conditional depth feature representation, the compact synthetic conditional depth feature representation concatenated with the compact synthetic feature representation output from the cross-domain encoder for input to the synthetic decoder to generate the refined version of the synthetic image acquisition data;
a real conditional depth prediction branch network configured to convert the compact real feature representation to a refined version of the real image acquisition data; and
a training supervision element configured to iteratively train the domain adaptive refinement agent based on the refined versions of the synthetic image acquisition data from the synthetic conditional depth prediction branch network and the real image acquisition data from the real conditional depth prediction branch network.