Patent ID: 11861886
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A video description information generation method, performed by an electronic device, the method comprising:
obtaining a video feature sequence on a frame level corresponding to a video;
generating a global part-of-speech sequence feature of the video according to the video feature sequence, the global part-of-speech sequence feature being a feature of a sequence of a combination of parts of speech in the video; and
generating natural language description information of the video according to the global part-of-speech sequence feature and the video feature sequence,
wherein the generating the global part-of-speech sequence feature comprises:
determining a fused feature of the video according to the video feature sequence; and
generating the global part-of-speech sequence feature of the video based on the fused feature of the video by using a first neural network, and
wherein the determining the fused feature comprises:
determining weights corresponding to moments of the first neural network, the weights being weights of frame features in the video feature sequence; and
respectively fusing the frame features in the video feature sequence according to the weights corresponding to the moments, to obtain fused features of the video that correspond to the moments.