Patent ID: 11893060
Assignee: NAVER CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 19:
20. A system for answering a question using a document, comprising:
(A) a plurality of components of sequential hops, wherein a first component hop is coupled in sequence with a second component hop, and wherein:
(a) the first component hop comprises a first reading module coupled to a first reformulation module,
(i) the first reading module configured to receive the question and the document and to output to the first reformulation module a first question-aware representation of the document; and
(ii) the first reformation module configured to extract elements from the first question-aware representation of the document and to compute a first updated representation of the question; and

(b) the second component hop comprises a second reading module coupled to a second reformulation module,
(i) the second reading module configured to receive the first updated representation of the question and the document and to output to the second reformulation module a second question-aware representation of the document; and
(ii) the second reformulation module configured to extract elements from the second question-aware representation of the document and to compute a second updated representation of the question;

(B) a plurality of parallel heads, each of the plurality of parallel heads including an independent instance of (A) the plurality of components of sequential hops;
(C) an answering module configured to:
receive updated representations of the document output by the plurality of parallel heads, respectively; and
based on the updated representations of the document, determine an answer to the question and facts in the document that support the answer to the question,

wherein the first reading module is configured to determine (a) first and (b) second sets of probabilities that represent (a) a probability of each word of the document being a beginning of an answer span and (b) a probability of each word of the document being an end of the answer span, respectively, the answer span being a span of words of the document that correctly answers the question; and
(D) an extractive attention module configured to, based on the first and second sets of probabilities, determine an attention vector of probabilities of entries of the second question-aware representation being part of the answer span.