Patent ID: 11893348
Assignee: ROYAL BANK OF CANADA
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 4:
5. The system of claim 2, wherein the processor is configured to:
generate, by processing a plurality of sequential source tokens of the first token set and a respective plurality of sequential ground truth tokens with the future sequence predictor, a plurality of future predicted keywords,
and wherein updating the plurality of parameters based further includes:
updating the first exclusion list with the processed plurality of sequential source tokens of the first token set and the respective the processed plurality of sequential ground truth tokens;
updating, the second exclusion list with the processed plurality of sequential source tokens of the first token set;
determining a future generation loss based on comparing the plurality of future predicted keywords to the first exclusion list of ground truth tokens and source tokens;
determining a future copy loss based on comparing the plurality of future predicted keywords to the second exclusion list of source tokens and ground truth tokens; and
adjusting the plurality of parameters based on a decay rate and the future copy loss, the future generation loss, and a comparison of the plurality of future predicted keywords and respective plurality of sequential ground truth tokens to penalize the decoder for generating repetitive keywords.