Patent ID: 11956453
Assignee: TENCENT AMERICA LLC
Field: Audio-visual technology (Electrical engineering)
Classification: CPC H | IPC H

Claim 17:
18. A non-transitory computer readable medium storing instructions that, when executed by at least one processor for neural network (NN) based cross component prediction with scaling factors during encoding or decoding, cause the at least one processor to:
train a deep neural network (DNN) cross component prediction (CCP) model with at least one or more scaling factors,
wherein the at least one or more scaling factors of the DNN CCP are learned by optimizing a rate-distortion loss based on an input video sequence comprising a luma component, and
wherein the at least one or more scaling factors of the DNN CCP are learned in addition to one or more bias parameters of the DNN CCP or one or more weight parameters of the DNN CCP;
reconstruct a chroma component based on the luma component using the DNN CCP model with the at least one or more scaling factors for chroma prediction;
update the DNN CCP model for chroma prediction of the input video sequence using the one or more scaling factors; and
perform chroma prediction of the input video sequence using the updated DNN CCP model with the one or more scaling factors.