Patent ID: 11972759
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 0:
1. A computer-implemented method, the method comprising:
obtaining a textual rendering of an audio portion of a video, wherein the textual rendering is generated by a natural language speech-to-text processor;
classifying textual renderings of transcripts of other videos, previously captured from one or more channels, according to topics of the textual renderings;
selecting one or more electronically stored summaries of the transcripts of the other videos based on the classifying the textual renderings of the transcripts of other the videos, previously captured from the one or more channels, according to the topics of the textual renderings;
generating an augmented rendering for the portion of the video, the augmented rendering comprising a combination of the textual rendering for the portion of the video and contextualizing data comprising the one or more electronically stored summaries of the transcripts of the other videos previously captured from the one or more channels;
identifying a mistranscription within the textual rendering using a pretrained word embedding model that creates machine-encoded data structures based on mapping words to an embedding space derived from the contextualizing data;
selecting from among a multi-word vocabulary of the pretrained word embedding model a plurality of candidate words for replacing the mistranscription, the selecting based on similarity values determined for each vocabulary word, each similarity value indicating a closeness of a corresponding vocabulary word to the mistranscription; and
modifying the textual rendering by replacing the mistranscription with a candidate word that, based on a comparison of average semantic similarity values of each candidate word in relation to each word contained in the augmented rendering comprising at least one tag of at least one object identified in one or more frames of the video, is more similar to the mistranscription than is each of the other candidate words.