Patent ID: 11934454
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 13:
14. A non-transitory computer-readable storage medium, storing computer-readable instructions, the computer-readable instructions, when executed by one or more processors, causing the one or more processors to perform operations associated with a video processing system, the video processing system comprising an encoder, a decoder, and a reconstructor, the operations including:
receiving a video retrieval request from a terminal, the video retrieval request carrying retrieval key information;
searching a video database for a natural sentence matching the retrieval key information, the video database including a plurality of videos, each video having a natural sentence obtained through processing frames of the video using an encoder, a decoder and a reconstructor of a neural network, wherein the natural sentence of the video is generated by:
performing encoding and decoding on the frames of the video by using the encoder and the decoder, to obtain an original video feature of the video and a hidden state of the video at a decoding stage;
reconstructing a video feature of the video by using the reconstructor according to the hidden state of the video at the decoding stage;
obtaining a difference between the reconstructed video feature and the original video feature of the video;
updating the decoder and the reconstructor to reduce the difference between the reconstructed video feature and the original video feature of the video;
determining words corresponding to the video using the updated decoder according to the hidden state of the video at the decoding stage; and
combining the words according to a time sequence of decoding moments used by the decoder to generate the natural sentence used for describing the video;

obtaining a video corresponding to the natural sentence matching the retrieval key information; and
returning the matching video to the requesting terminal.