Patent ID: 11972223
Assignee: CASETEXT, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method comprising:
determining a plurality of relevance prompts based on a plurality of input documents and a relevance prompt template, each of the plurality of relevance prompts including a first respective portion of text from a respective input document of the plurality of input documents and a natural language query, each of the plurality of relevance prompts and the relevance prompt template including a first set of natural language instructions to determine a relevance score based on an evaluation of relevance of the respective portion of text to the natural language query;
transmitting the plurality of relevance prompts to a large language model for completion;
receiving from the large language model a first plurality of response messages corresponding with the plurality of relevance prompts, each of the first plurality of response messages including only a respective completed relevance prompt that includes a first portion included in the corresponding relevance prompt and respective second portion that includes only a respective designated chunk relevance score corresponding to the respective portion of text;
selecting a subset of the plurality of input documents based on the respective designated chunk relevance scores;
determining a plurality of query response prompts each including a second respective portion of text, the natural language query, and a second set of natural language instructions to address the natural language query based on the second respective portion of text;
receiving from the large language model a second plurality of response messages, each of the second plurality of response messages including a respective intermediate answer to the natural language query;
determining a response to the natural language query based on the intermediate answers; and
transmitting the response to a remote computing device.