Patent ID: 11948361
Assignee: GRACENOTE, INC.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 6:
7. A method for automated media segmentation carried out by a computing system, the method comprising:
receiving a sequence of media frames;
analytically constructing a media graph from the sequence of media frames, the media graph comprising nodes connected by edges, wherein each node corresponds to a different one of the respective media frames, and each edge connects a different particular pair of nodes, and is associated with both a temporal distance between the respective media frames corresponding to the particular pair of nodes, and a respective similarity metric quantifying similarity between respective features of the respective media frames corresponding to the particular pair of nodes;
applying an artificial neural network (ANN) to the media graph to compute both (i) predicted labels for the nodes of the media graph corresponding to predicted media-frame labels of the media frames, and (ii) predicted clusters of the nodes corresponding to predicted media segments of the sequence comprising respective sub-sequences of the media frames associated with respective contextually-related subject content, wherein the ANN has previously been trained to compute both predicted training labels for each training node of a training media graph constructed from a training media sequence of training media frames, and predicted training clusters of the training nodes corresponding to predicted membership among respective training media segments of the corresponding training media frames;
further applying the ANN as trained to respectively determine a predicted segment class of each predicted media segment; and
recording in memory and/or displaying information associating each media frame with one of the predicted media segments, and, for each respective predicted segment class, an identification of all predicted media segments belonging to the respective segment class.