Patent ID: 11893348
Assignee: ROYAL BANK OF CANADA
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 19:
20. A non-transitory computer readable storage medium having stored therein computer executable program code, which when execited by the processor, cases the processor to:
receive a first data set comprising a plurality of source token sets, and related ground truth token sets;
extract a second data set of target vocabulary tokens from the first data set comprising a subset of source tokens and ground truth tokens of the first data set;
train an S2S machine learning model for predicting keywords, the S2S machine learning model comprising a plurality of parameters representative of a decoder, the decoder including a generation data model architecture and a copy data model architecture: by, for each source token in a first source token set:
generating a predicted keyword based on a first source token set keyword probability distribution of the copy data model architecture associated with a probability of generating the keyword from the first source token set, based on the respective source token, and a second set keyword probability distribution of the generation data model architecture, based on the respective source token, and associated with the probability of generating the keyword from the second data set;
updating the plurality of parameters by:
determining a generation loss based on comparing the predicted keyword to a first exclusion list of ground truth tokens;
determining a copy loss based on comparing the predicted keyword to a second exclusion list of source tokens and ground truth tokens;
adjusting the plurality of parameters based on the copy loss, the generation loss, and a comparison of the predicted keyword and a respective predicted keyword ground truth token to penalize the decoder for generating repetitive keywords; and

store the trained S2S machine learning model in at least one computer memory.