Patent ID: 11936866
Assignee: DEEP RENDER LTD.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC H  G | IPC H

Claim 0:
1. A method of training one or more neural networks, the one or more neural networks being for use in lossy image or video encoding, transmission and decoding, the method comprising the steps of:
receiving an input image at a first computer system;
encoding the input image using a first neural network to produce a latent representation;
performing a quantization process on the latent representation to produce a quantized latent; and
decoding the quantized latent using a second neural network to produce an output image, wherein the output image is an approximation of the input image;
evaluating a loss function based on a difference between the output image and the input image;
evaluating a gradient of the loss function;
back-propagating the gradient of the loss function through the first neural network and the second neural network to update the parameters of the first neural network and the second neural network; and
repeating the above steps using a set of input images to produce a first trained neural network and a second trained neural network;
wherein the loss function additionally comprises a term based on a difference between a pre-transformed output and a post-transformed output;
wherein the pre-transformed output is an output of an input-output pair of the method of training one or more neural networks where a transformation has been applied to the input; and
the post-transformed output is an output of the input-output pair where a corresponding transformation to the transformation applied to obtain the pre-transformed output has been applied to the output.