Patent ID: 11861886
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 16:
17. An apparatus for video processing based on natural language description information of a video, the apparatus comprising:
at least one memory configured to store program code; and
at least one processor configured to read the program code and operate as instructed by the program code, the program code comprising:
obtaining code configured to cause at least one of the at least one processor to obtain natural language description information of a video, the natural language description information of the video being obtained by:
obtaining a video feature sequence on a frame level corresponding to the video;
generating a global part-of-speech sequence feature of the video according to the video feature sequence, the global part-of-speech sequence feature being a feature of a sequence of a combination of parts of speech in the video; and
generating the natural language description information of the video according to the global part-of-speech sequence feature and the video feature sequence; and

processing code configured to cause at least one of the at least one processor to process the video based on the natural language description information,

wherein the generating the global part-of-speech sequence feature comprises:
determining a fused feature of the video according to the video feature sequence; and
generating the global part-of-speech sequence feature of the video based on the fused feature of the video by using a first neural network, and

wherein the determining the fused feature comprises:
determining weights corresponding to moments of the first neural network, the weights being weights of frame features in the video feature sequence; and
respectively fusing the frame features in the video feature sequence according to the weights corresponding to the moments, to obtain fused features of the video that correspond to the moments.