Patent ID: 11893348
Assignee: ROYAL BANK OF CANADA
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 2:
3. The system of claim 2, wherein the processor is configured to process, with the future sequence predictor the respective predicted keyword ground truth token, a second source token of the first token set, and the first source token set encoder representation to generate a future predicted keyword by:
generating a first set future keyword probability distribution of the copy mechanism based on normalizing, over the source tokens in the first source token set, a second attention mechanism interrelation value between an encoder representation of a second source token of the source token set and the hidden state;
generating a second set future keyword probability distribution of the generation data model architecture based on normalizing, over the target vocabulary tokens, the second attention mechanism interrelation value;
determining a probability of generating a future keyword from the second data set based on the vocabulary token parameter processing the hidden state, the respective predicted keyword ground truth token, and the vocabulary normalized second attention mechanism interrelation value; and
generating the predicted future keyword based on applying the probability of generating the future keyword from the second data set to the second set future keyword probability distribution and applying the probability of generating the future keyword from the first token source set to the first set future keyword probability distribution.