Patent ID: 11900682
Assignee: BEIJING XIAOMI PINECONE ELECTRONICS CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 6:
7. A device for video clip extraction, comprising:
a processor; and
a memory for storing instructions executable by the processor;
wherein the processor is configured to:
obtain a video and sample the video to obtain N video frames, wherein N is a positive integer;
input the N video frames to a pre-trained frame feature extraction model to obtain a feature vector of each video frame in the N video frames;
determine scores of the N video frames based on the a pre-trained scoring model, wherein for an i-th frame in the N video frames, feature vectors of K video frames centered on the i-th frame are input to the pre-trained scoring model, to obtain a score of the i-th frame, wherein i is a positive integer less than or equal to N, and K is a positive integer; and
extract target video clips from the video based on the scores of the N video frames:,
wherein the processor is further configured to: determine training data to train the pre- trained scoring model based on data pairs composed of first clips and second clips via a multi- frame fusion layer;
wherein the data pairs are obtained by:
obtaining a sample video comprising one or more of labeled video clips and unlabeled video clips, wherein each labeled video clip is labeled with a target attribute for characterizing the target video clip, or a non-target attribute for characterizing the non-target video clip; and
obtaining the data pairs composed of first clips and second clips, based on the target attributes, the non-target attributes and the unlabeled video clips.