Patent ID: 11900260
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 11:
12. The method of claim 11, wherein:
the teacher neural network further comprises, in series prior to the first teacher sub-network, a prior teacher sub-network adapted to generate a prior intermediate feature map based on the training-mode data input;
the integrated system further comprises a prior student sub-network adapted to generate prior student inference data based on the prior intermediate feature map; and
training the integrated system further comprises:
propagating the prior intermediate feature map forward through the prior student sub-network to generate prior student inference data;
calculating a prior knowledge distillation loss based on a knowledge distillation loss function applied to the prior student inference data and the first student inference data; and
propagating the prior knowledge distillation loss backward through the prior student sub-network and the prior teacher sub-network to train the prior student sub-network and the prior teacher sub-network.