Patent ID: 11966839
Assignee: DEEPMIND TECHNOLOGIES LIMITED
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A neural network system implemented on one or more computers and for generating an output image, the neural network system comprising:
a causal convolutional neural network configured to generate an output image by, at each of a plurality of iterations, generating a value of a pixel of the output image conditioned upon values of pixels of the output image previously generated at previous iterations;
a support memory configured to store data representing a set of support data patches for generating the output image, wherein each support data patch in the set of support data patches corresponds to a respective example image that is different from the output image and comprises features generated by a neural network by processing at least a part of the corresponding example image that is different from the output image; and
a soft attention subsystem configured to, at each of the plurality of iterations, determine a soft attention query vector from the previously generated values of the pixels of the output image, determine a respective key for each of the support data patches, and combine (i) the soft attention query vector determined from the previously generated values of the pixels of the output image and (ii) the respective keys for each of the support data patches that correspond to respective example images that are different from the output image to determine a set of scores for the support data patches for generating the value of the pixel of the output image at the iteration; and
wherein one or more layers of the causal convolutional neural network are conditioned upon a combination of the support data patches weighted by the scores.