Patent ID: 11934930
Assignee: FRIENDLIAI INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 12:
13. The non-transitory computer-readable storage medium of claim 11, wherein the machine learning model includes a set of encoders and a set of decoders coupled to the set of encoders, and obtaining the one or more queries, the one or more keys, and the one or more values comprises:
obtaining the one or more keys and the one or more values from at least one encoder in the set of encoders, wherein the one or more keys are generated by applying the key weight tensor to one or more output representations of the encoder and the one or more values are generated by applying the value weight tensor to the one or more output representations of the encoder; and
generating the one or more queries for a decoder by applying the query weight tensor to the one or more input representations,
wherein the one or more input representations are generated from one or more output representations from a previous decoder or the one or more token sequences.