Patent ID: 11908458
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 5:
6. A system for customizing a recurrent neural network transducer (RNN-T), comprising:
one or more processor devices;
a memory in communication with at least one of the one or more processor devices; and
a display screen;
wherein the memory includes:
an encoder configured to receive synthesized first domain audio data generated from first domain text data from a first domain, the encoder being a trained encoder of the recurrent neural network transducer (RNN-T) having an initial condition, is configured to be undated from the initial condition by inputting both the synthesized first domain audio data and the first domain text data, receive synthesized second domain audio data generated from second domain text data from a second domain and updating a corresponding prediction network by inputting both the synthesized second domain audio data and the second domain text data, encode a sequence of labels from the first and second domain text data into a text embedding using the prediction network, combine outputs of the encoder and the prediction network with the synthesized first and second domain audio data using a joiner, and a pre-customized state by restoring weights on the encoder to the initial condition including a state trained on the first domain; and
an output sequence generator that produces output symbol sequence, y, based on an input feature sequence, x, that is a time-ordered sequence of acoustic features represented as vectors.