Patent ID: 11868381
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 20:
21. The processing system of claim 12, wherein the one or more processors are further configured to:
generate a plurality of counterfactual examples each comprising the respective table, a respective first statement, and a respective second statement; and
pre-train the language model based on the plurality of counterfactual examples, the one or more processors being further configured to:
generate a positive statement loss value based on the language model's prediction of whether the respective first statement is entailed in the respective table;
generate a negative statement loss value based on the language model's prediction of whether the respective second statement is refuted by the respective table; and
modify one or more parameters of the language model based at least on the positive statement loss value and the negative statement loss value.