Patent ID: 11862144
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A computer system comprising:
a processor configured to:
store a set of audio training data that includes a plurality of audio segments and metadata indicating a word or phrase associated with each audio segment;
receive a set of structured text data that includes one or more target training statements that each include a plurality of text segments comprising a word or phrase;
for a target training statement of the set of structured text data, generate a plurality of concatenated audio signals, each respective concatenated audio signal being generated by:
comparing the words or phrases of the plurality of text segments of the target training statement to respective words or phrases of audio segments of the stored set of audio training data;
selecting audio segments from the set of audio training data based on a match in the words or phrases between the plurality of text segments of the target training statement and the selected audio segments; and
concatenating the selected audio segments into the concatenated audio signal; and

generate an augmented set of training data that includes the set of structured text data paired with respective concatenated audio signals;
in a training phase, train an end-to-end artificial intelligence model for automatic speech recognition using the augmented set of training data; and
in a run-time phase, execute an automatic speech recognition application using the trained end-to-end automatic speech recognition model, wherein

a same word or phrase of two or more audio segments is recorded for a plurality of speakers and/or the same word or phrase of the two or more audio segments is recorded for a plurality of acoustic environments,
the selecting includes applying a distribution parameter that biases selection of one of the same word or phrase of the two or more audio segments according to at least one target acoustic parameter, the at least one target acoustic parameter being a background noise parameter, an audio quality parameter, or a speech accent parameter, and
based on the distribution parameter, each concatenated audio signal is comprised of words or phrases recorded for two or more speakers of the plurality of speakers and/or two or more acoustic environments of the plurality of acoustic environments.