Patent ID: 11887219
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G  H

Claim 0:
1. A method for training an image colorization model, the method comprising:
inputting, by one or more computing devices, a training input image into a colorization model configured to receive the training input image and process the training input image to output a predicted color map that describes a predicted colorization for the training input image;
receiving, by the one or more computing devices, the predicted color map as an output of the colorization model;
calculating, by the one or more computing devices, a first color distance between a first pixel included in the predicted color map and a second pixel included in the predicted color map;
calculating, by the one or more computing devices, a second color distance between a third pixel included in a ground truth color map and a fourth pixel included in the ground truth color map, wherein the third pixel and fourth pixel included in the ground truth color map spatially correspond, respectively, with the first pixel and second pixel included in the predicted color map;
evaluating, by the one or more computing devices, a neighborhood color loss function that evaluates a difference between the first color distance and the second color distance;
iteratively evaluating, by the one or more computing devices, the neighborhood color loss function for a plurality of additional second pixels with respect to the first pixel to generate a neighborhood color loss map for the first pixel of the predicted color map; and
adjusting, by the one or more computing devices, parameters associated with the colorization model based on the neighborhood color loss function.