Patent ID: 11917188
Assignee: WAVEONE INC.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC H  G | IPC G  H

Claim 0:
1. A method of encoding a video including a set of source frames, the method comprising:
accessing a machine-learned compression model coupled to receive a frame and a parameter map for the frame, and output compressed code at a codelayer and a reconstructed version of the frame, wherein at least a portion of the compression model is configured as a neural network including the codelayer and the compression model is trained by:
obtaining a video including a set of training frames, each training frame associated with a parameter map that indicates one or more values of an encoding parameter for the training frame, and
changing weights of the compression model in conjunction with value(s) of the codelayer to reduce a loss function, the loss function including a reconstruction loss that indicates a difference between the set of training frames and reconstructed versions of the set of training frames, and a codelength loss that indicates codelength of a compressed code for the training frames, wherein the loss function changes depending on a value of the encoding parameter for the training frames, and wherein the compressed codes for at least two training frames with different values of the encoding parameter are generated at the same codelayer;

iteratively performing, for each current frame in the set of source frames:
obtaining a parameter map for the current frame, and
applying at least a portion of the machine-learned compression model including the changed weights and codelayer value(s) to the current frame and the parameter map for the current frame to generate compressed code for the current frame; and

transmitting the compressed codes generated for the set of source frames to a receiver system.