Patent ID: 11948281
Assignee: ADOBE INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A computer-implemented method, the method comprising:
obtaining a low-resolution inpainting result comprising valid feature patches outside of a designated portion of the inpainting result and generated feature patches inside of the designated portion, the generated feature patches determined using the low-resolution image inpainting;
performing, via a low-resolution result neural network that analyzes feature patches of low-resolution inpainting results, patch similarity analysis on feature patches of the low-resolution inpainting result, wherein the patch similarity analysis compares the valid feature patches with the generated feature patches;
determining a most similar valid feature patch for a generated feature patch of the low-resolution inpainting result based on a measure of similarity;
identifying a high-resolution feature patch in a higher-resolution input image, the higher-resolution feature patch being from outside a portion of the higher-resolution input image corresponding to the designated portion of the low-resolution inpainting result, wherein the high-resolution feature patch in the higher-resolution input image is identified by mapping, via a high-resolution input neural network, the most similar valid feature patch in the low-resolution inpainting result to the high-resolution feature patch in the higher-resolution input image, wherein the mapping is performed by scaling coordinates of the most similar valid feature patch to coordinates of the high-resolution feature patch, wherein the higher-resolution input image and the high-resolution feature patch having a higher resolution compared to the low-resolution inpainting result, the valid feature patches, and the generated feature patches;
incorporating, via the high-resolution input neural network trained to upsample images, the high-resolution feature patch, that mapped to the most similar value feature patch in the low-resolution inpainting result, into the portion of the higher-resolution input image to provide upsampling image reconstruction of the low-resolution inpainting result by constructing the portion of the higher-resolution input image using information corresponding with the high-resolution feature patch that mapped to the most similar value feature patch in the low-resolution inpainting result, wherein the information is applied to the portion of the higher-resolution input image to maintain feature information when upsampling; and
outputting a high-resolution inpainting result based on the upsampling image reconstruction, wherein the high-resolution inpainting result has a resolution higher than the inpainting result.