Patent ID: 11948361
Assignee: GRACENOTE, INC.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 4:
5. The method of claim 4, further comprising:
receiving a runtime sequence of runtime media frames, the runtime media frames being unlabeled with respect to both any media segment of the runtime sequence and any segment class;
analytically constructing a runtime media graph from the runtime sequence of runtime media frames, the runtime media graph comprising runtime nodes connected by runtime edges, wherein each runtime node corresponds to a different one of the respective runtime media frames, and each runtime edge connects a different particular pair of runtime nodes, and is associated with both a temporal distance between the respective runtime media frames corresponding to the particular pair of runtime nodes, and a respective runtime similarity metric quantifying similarity between respective features of the respective runtime media frames corresponding to the particular pair of runtime nodes;
applying the trained ANN to the runtime media graph to compute both (i) a predicted runtime label for each runtime node of the runtime media graph and (ii) predicted runtime clusters of the runtime nodes;
further applying the trained ANN to respectively determine both a predicted runtime media segment associated with each predicted runtime cluster, and a predicted runtime segment class of each predicted runtime media segment; and
recording in memory and/or displaying segmentation information, the segmentation information being based on the predicted runtime labels, the predicted runtime media segments, and the predicted runtime segment classes, and including (i) an identification of the predicted runtime media segments, (ii) an association of each respective runtime media frame with one of the predicted runtime media segments, and (iii) for each respective predicted runtime segment class, an identification of all predicted runtime media segments belonging to the respective runtime segment class.