Patent ID: 11915686
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 18:
19. The medium of claim 15, wherein the output tokens are word/subword units, the second attention-based encoder-decoder model is initialized with an encoder, an attention network, and a decoder of the first attention-based encoder-decoder model, and
wherein training of the second attention-based encoder-decoder model comprises:
initializing an auxiliary attention-based encoder-decoder model with an encoder of the first attention-based encoder-decoder model, a character-level attention network, and a character-level decoder;
training the character-level attention network and the character-level decoder based on the input speech frames of the target speaker to minimize a character-level classification loss; and
training of the encoder of the second attention-based encoder-decoder model based on the input speech frames of the target speaker to jointly minimize a word/subword unit classification loss of the second attention-based encoder-decoder model and the character-level classification loss of the auxiliary attention-based encoder-decoder model.