Patent ID: 11961511
Assignee: VAIL SYSTEMS, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A computer-implemented method for detecting and resolving mis-transcriptions in a transcript generated by an automatic speech recognition (ASR) system when transcribing a plurality of spoken words, the method comprising:
receiving the generated transcript of a speech signal by at least one of a first machine learning system or a second machine learning system;
receiving, at a research on artificial intelligence in linguistics and systems (RAILS) model from the ASR system, a corpus comprising the generated transcript and one or more other transcripts, wherein at least one of the first machine learning system and the second machine learning system implements the RAILS model, the RAILS model comprising a building block comprising (1) a dataset containing all unigrams, bigrams, trigrams and quadgrams present in the corpus and their respective probabilities, and (2) a phonetic encoding component for determining phonetic similarity between lexical items;
integrating a pre-trained language model, including a bidirectional encoder representation from transformers (BERT) model or a generative pre-trained transformer (GPT-3) model, to further analyze and process the transcript;
analyzing, by the at least one of the first machine learning system and the second machine learning system, the generated transcript utilizing the RAILS model to find a region of low confidence indicative of a mis-transcription;
analyzing, by the at least one of the first machine learning system and the second machine learning system, the region of low confidence utilizing the BERT model or the GPT-3 model subsequent to the analyzing utilizing the RAILS model to predict an improvement to the region of low confidence indicative of the mis-transcription, the predicted improvement comprising a homophone of the found region having substantially a same pronunciation and different meaning therefrom, wherein the same pronunciation indicates a higher level of phonetic similarity than one homophone having only a similar pronunciation;
selecting, by a word selector, a replacement word for the mis-transcription based on the predicted improvement to the region of low confidence, wherein the improvement is predicted responsive to the region of low confidence being partially caused by a degraded signal of a channel used to perform at least one of the receptions or an obtainment of the spoken words; and
replacing, by the word selector, the mis-transcription by the replacement word.