Patent ID: 11954435
Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. A text generation training apparatus comprising:
a memory; and
a processor configured to:
determine, based on numbers of appearances associated with each word in an input text, a score associated with the each word in the input text using a first neural network based on learned first parameters;
extract a first set of words according to the score, wherein the first set of words includes words in a descending order of a number of times of the words appearing in the input text;
generate a reference text, wherein the reference text includes a second set of words selected from the input text according to the score, and a number of words in the reference text is the same as a number of words to appear in an output text, and an order of words in the reference text is according to an order of the words appearing in the input text;
generate, based on the reference text, the output text using a second neural network based on learned second parameters, wherein the output text summarizes the input text using at least a part of words in the reference text;
learn the learned first parameters associated with the first neural network; and
learn the learned second parameters associated with the second neural network;
wherein, the second neural network includes an input text encoding and a reference text encoding as distinct text encodings cross-referencing each other in a multi-layered network, and the second neural network further includes decoding a combination of the input text encoding and a reference text encoding according to a combination of a self-attention and a content attention.