Patent ID: 11972754
Assignee: TENCENT AMERICA LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 9:
10. A sequence to sequence (Seq2Seq) speech recognition training apparatus comprising:
at least one memory operable to store program code; and
at least one processor operable to read said program code and operate as instructed by said program code to:
acquire a training set comprising a plurality of pairs of input data and target data corresponding to the input data;
encode the input data into a sequence of hidden states;
perform a connectionist temporal classification (CTC) model training based on the sequence of hidden states at a first period of time;
perform an attention model training based on the sequence of hidden states at a second period of time;
generate target labels by performing the CTC model training and the attention model training;
additionally transform the sequence of hidden states using additional layers to generate the new sequence of hidden states to enable content match between query and context; and
perform the attention model training based on a new sequence of hidden states generated based on the sequence of hidden states, the new sequence of hidden states being different from the sequence of hidden states used by the CTC model training.