Patent ID: 11947917
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 17:
18. A computer-implemented method, the method comprising:
obtaining, by one or more computing devices, a natural language processing model that comprises an encoder model, a decoder model, and a programmer model, wherein the encoder model is configured to receive a natural language text body and, in response to receipt of the natural language text body, output a knowledge graph, wherein the decoder model is configured to receive the knowledge graph and, in response to receipt of the knowledge graph, output a reconstruction of the natural language text body based on the knowledge graph, and wherein the programmer model is trained to receive a natural language question, and, in response to receipt of the natural language question, output a program;
calculating, by the one or more computing devices, a reconstruction loss between the natural language text body and the reconstruction of the natural language text body, wherein the encoder and the decoder are trained using an autoencoder objective function which describes the reconstruction loss;
inputting, by the one or more computing devices, a training data set that comprises the natural language text body and the natural language question into the natural language processing model to receive an answer to the natural language question;
evaluating, by the one or more computing devices, a total objective function, wherein the autoencoder objective function describes a reconstruction loss between the natural language text body and the reconstruction of the natural language text body, and wherein a question answer objective function describes a reward that is based on a comparison of the answer and an expected answer; and
training, by the one or more computing devices, the natural language processing model based on the total objective function.