Patent ID: 11941346
Assignee: SALESFORCE, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 14:
15. A processor-readable non-transitory storage medium storing a plurality of processor-executable instructions for training a multi-document summarization model, the instructions being executed by at least one processor to perform operations comprising:
receiving, via a communication interface, a text document comprising a plurality of tokens;
computing, at an attention layer, a first set of token representations by attending the plurality of tokens to respective nearby tokens within a pre-defined encoding window;
generating, by a pooling layer, a set of segment representations from the computed first set of token representations from the attention layer;
updating the set of segment representations with a full self-attention layer;
generating a second set of token representations by applying cross attention upon the first set of token representations and the updated set of segment representations after the full self-attention layer; and
sending the generated second set of segment representations of the text document to a decoder for generating a summary output based on the second set of segment representations.