Patent ID: 11881007
Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G

Claim 0:
1. A video cropping method, comprising:
obtaining at least one detection box of a first image frame, wherein each of the least one detection box has a size identical to a cropping size of the first image frame;
determining, based on an importance score, a coverage area, and a smoothing distance of any detection box in the at least one detection box, a cost of the detection box, wherein:
the importance score is configured to characterize an importance of the detection box in the first image frame,
the coverage area is configured to characterize an overlapping area between the detection box and a text box in the first image frame, and
the smoothing distance is configured to characterize a distance between the detection box and a cropping box of a previous image frame of the first image frame;
determining a first detection box having a minimum cost among the at least one detection box as a cropping box; and
cropping the first image frame based on the cropping box,
wherein the method further comprises:
obtaining the importance score of the detection box through saliency detection and/or face detection,
wherein said determining, based on the importance score, the coverage area, and the smoothing distance of any detection box in the at least one detection box, the cost of the detection box comprises:
determining an importance cost of the detection box based on the importance score of the detection box,
wherein the importance cost of the detection box decreases with an increase of the importance score of the detection box, and
wherein the cost of the detection box comprises the importance cost of the detection box,

wherein said determining the importance cost of the detection box based on the importance score of the detection box comprises:
determining a first ratio of the detection box, the first ratio being a ratio of the importance score of the detection box to an importance score of the first image frame; and
determining the importance cost of the detection box based on the first ratio of the detection box, the importance cost of the detection box decreasing with an increase of the first ratio of the detection box, or

said determining the importance cost of the detection box based on the importance score of the detection box comprises:
determining at least one ratio of the detection box, the at least one ratio of the detection box comprising a ratio of the importance score of the detection box to an importance score of each detection box in the previous image frame; and
determining the importance cost of the detection box based on the at least one ratio of the detection box, the importance cost of the detection box decreasing with an increase of a ratio in the at least one ratio.