Patent ID: 11900640
Assignee: TENCENT AMERICA LLC
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 14:
15. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor for substitutional neural residual compression, cause the at least one processor to:
estimate motion vectors, based on a current image frame and a previous reconstructed image frame;
obtain a predicted image frame, based on the estimated motion vectors and the previous reconstructed image frame;
subtract the obtained predicted image frame from the current image frame to obtain a substitutional residual;
encode the obtained substitutional residual, using a first neural network, to obtain an encoded representation; and
compress the encoded representation,
wherein the first neural network is trained by updating the obtained substitutional residual to reduce a determined gradient of rate-distortion loss.