Patent ID: 11948359
Assignee: BOE TECHNOLOGY GROUP CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A video processing method, comprising:
obtaining a video frame sequence comprised in a video to be processed;
performing scene classification identification on the video frame sequence so as to obtain a scene classification identification result of the video frame sequence; and
performing a smoothing process to the video frame sequence based on the scene classification identification result,
wherein the performing a smoothing process to the video frame sequence based on the scene classification identification result comprises:
sliding a first preset sliding window along a time axis corresponding to the video frame sequence with a first preset sliding step until sliding to an end of the time axis, so as to obtain a plurality of current video frame sequences from the video frame sequence;
obtaining, based on the scene classification identification result, a classification probability vector of each video frame in the plurality of current video frame sequences and a preset scene to which it belongs, wherein components in the classification probability vector of each video frame respectively represent probability that the video frame belongs to a corresponding preset scene; and
for each current video frame sequence in the plurality of current video frame sequences, performing operations comprising:
determining whether the current video frame sequence comprises a first video frame sequence and a second video frame sequence adjacent to each other, wherein each video frame in the first video frame sequence belongs to a first preset scene and each video frame in the second video frame sequence belongs to a second preset scene different from the first preset scene;
in response to the current video frame sequence comprising the first video frame sequence and the second video frame sequence, determining a video frame to be processed; and
performing a fusion processing to the video frame to be processed based on the first preset scene, the second preset scene and the classification probability vector of the video frame to be processed so as to achieve a smoothing process to it,
wherein the performing a fusion processing the video frame to be processed so as to achieve a smoothing process based on the first preset scene, the second preset scene and the classification probability vector of the video frame to be processed, comprises:
obtaining, based on the classification probability vector of the video frame to be processed, a first probability that the video frame to be processed belongs to the first preset scene and a second probability that it belongs to the second preset scene; and
performing a fusion processing to the video frame to be processed by formula:

Ifusion=(w0,1(I0⊗T1))⊕(w0,2(I0⊗Tm))

wherein Ifusion represents a pixel value matrix of a fused video frame, I0 represents a pixel value matrix of the video frame to be processed, w0,1 represents the first probability, w0,2 represents the second probability, T1 represents a predetermined transformation matrix corresponding to the first preset scene, T2 represents a predetermined transformation matrix corresponding to the second preset scene,
or wherein the performing a smoothing process to the video frame sequence based on the scene classification identification result comprises:
sliding a second preset sliding window along a time axis corresponding to the video frame sequence with a second preset sliding step so as to obtain N video frame sub-sequences of the video frame sequence in chronological order comprising a first sub-sequence to a Nth video frame sub-sequence, wherein N is a positive integer greater than or equal to 2;
determining, based on the scene classification identification result, a preset scene to which each video frame sub-sequence belongs and a classification probability vector of each video frame in each video frame sub-sequence, the preset scene to which each video frame sub-sequence belongs representing a preset scene to which a last video frame in the video frame sub-sequence belongs, components in the classification probability vector of each video frame respectively representing probability that the video frame belongs to a corresponding preset scene;
for each video frame sub-sequence from a first video frame sub-sequence to an N−1th video frame sub-sequence, performing the following operations in sequence according to a sequence number:
determining whether the preset scenes to which the video frame sub-sequence and a next adjacent video frame sub-sequence belong are same;
in response to the preset scenes to which the video frame sub-sequence and the next adjacent video frame sub-sequence belong being different, determining each video frame in the next adjacent video frame sub-sequence as a video frame to be processed; and
performing a fusion processing to the video frame to be processed based on the preset scenes to which the video frame sub-sequence and the next adjacent video frame sub-sequence belong and the classification probability vector of the video frame to be processed so as to achieve a smoothing process to it.