Patent ID: 11900640
Assignee: TENCENT AMERICA LLC
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 7:
8. An apparatus for substitutional neural residual compression, the apparatus comprising:
at least one memory configured to store program code; and
at least one processor configured to read the program code and operate as instructed by the program code, the program code comprising:
estimating code configured to cause the at least one processor to estimate motion vectors, based on a current image frame and a previous reconstructed image frame;
first obtaining code configured to cause the at least one processor to obtain a predicted image frame, based on the estimated motion vectors and the previous reconstructed image frame;
subtracting code configured to cause the at least one processor to subtract the obtained predicted image frame from the current image frame to obtain a substitutional residual;
encoding code configured to cause the at least one processor to encode the obtained substitutional residual, using a first neural network, to obtain an encoded representation; and
compressing code configured to cause the at least one processor to compress the encoded representation,

wherein the first neural network is trained by updating the obtained substitutional residual to reduce a determined gradient of rate-distortion loss.