Patent ID: 11902548
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 7:
8. A computer implemented method for training an action classification model, the method comprising, iteratively, for each video clip in a plurality of video clips of a video:
receiving a plurality of video frames of the video clip;
retrieving a plurality of first input features previously extracted based on the plurality of video frames;
generating a plurality of second input features, by the action classification model, based on the plurality of video frames;
computing a classification loss of the action classification model based on the plurality of second input features;
generating an updated set of input features based on the plurality of first input features and the plurality of second input features;
generating a plurality of action localization labels using an action localization network based on the updated set of input features;
computing a localization loss of the action localization network based on the plurality of action localization labels;
computing an updated loss based on the classification loss of the action classification model and the localization loss of the action localization network; and
adjusting one or more weights of the action classification model based on the updated loss.