Patent ID: 11956453
Assignee: TENCENT AMERICA LLC
Field: Audio-visual technology (Electrical engineering)
Classification: CPC H | IPC H

Claim 11:
12. An apparatus for neural network (NN) based cross component prediction with scaling factors during encoding or decoding, the apparatus comprising:
at least one memory configured to store program code; and
at least one processor configured to read the program code and operate as instructed by the program code, the program code comprising:
training code configured to cause the at least one processor to train a deep neural network (DNN) cross component prediction (CCP) model with at least one or more scaling factors,
wherein the at least one or more scaling factors of the DNN CCP are learned by optimizing a rate-distortion loss based on an input video sequence comprising a luma component, and
wherein the at least one or more scaling factors of the DNN CCP are learned in addition to one or more bias parameters of the DNN CCP or one or more weight parameters of the DNN CCP;
reconstructing code code configured to cause the at least one processor to reconstruct a chroma component based on the luma component using the DNN CCP model for chroma prediction;
updating code configured to cause the at least one processor to update the DNN CCP model for chroma prediction of the input video sequence using the one or more scaling factors; and
performing code configured to cause the at least one processor to perform chroma prediction of the input video sequence using the updated DNN CCP model with the one or more scaling factors.