Patent ID: 11862144
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. A computer device comprising:
a processor configured to:
determine a set of structured text data for training an end-to-end artificial intelligence model that is used by an automatic speech recognition application, the set of structured text data including one or more target training statements that each include a plurality of text segments comprising a word or phrase;
send the set of structured text data to a server device to cause the server device to generate an augmented set of training data that includes the set of structured text data paired with respective concatenated audio signals, wherein a concatenated audio signal that matches a word content of a target training statement of the set of structured text data is generated by:
comparing the words or phrases of the plurality of text segments of the target training statement to respective words or phrases of audio segments of a stored set of audio training data that includes audio segments and metadata indicating a word or phrase associated with each audio segment;
selecting a plurality of audio segments from the set of audio training data based on a match in the words or phrases between the plurality of text segments of the target training statement and the selected plurality of audio segments; and
concatenating the selected plurality of audio segments into the concatenated audio signal;

receive an end-to-end artificial intelligence model that has been trained using the augmented set of training data; and
execute the automatic speech recognition application using the trained end-to-end artificial intelligence model, wherein
a same word or phrase of two or more audio segments is recorded for a plurality of speakers and/or the same word or phrase of the two or more audio segments is recorded for a plurality of acoustic environments,
the selecting includes applying a distribution parameter that biases selection of one of the same word or phrase of the two or more of the plurality of audio segments according to at least one target acoustic parameter, the at least one target acoustic parameter being a background noise parameter, an audio quality parameter, or a speech accent parameter, and
based on the distribution parameter, each concatenated audio signal is comprised of words or phrases recorded for two or more speakers of the plurality of speakers and/or two or more acoustic environments of the plurality of acoustic environments.