Patent ID: 11893348
Assignee: ROYAL BANK OF CANADA
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 1:
2. The system of claim 1, wherein the decoder further includes a plurality of parameters representative of a future sequence predictor, and the computer is configured to:
process, with the future sequence predictor the respective predicted keyword ground truth token, a second source token of the first token set, and the first source token set encoder representation to generate a future predicted keyword;
and wherein updating the plurality of parameters further includes:
updating the first exclusion list with the respective predicted keyword ground truth token;
updating the second exclusion list with the respective predicted keyword ground truth token and the first source token associated with the respective predicted keyword ground truth token;
determining a future generation loss based on comparing the predicted future keyword to the first exclusion list of ground truth tokens;
determining a future copy loss based on comparing the predicted future keyword to the second exclusion list of source tokens and ground truth tokens; and
adjusting the plurality of parameters based on the future copy loss, the future generation loss, and a comparison of the predicted future keyword and a respective predicted future keyword ground truth token to penalize the decoder for generating repetitive keywords.