Patent ID: 11972223
Assignee: CASETEXT, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 19:
20. A text generation interface system including one or more processors, a large language model interface, and a communication interface, the text generation interface system being configured to perform a method comprising:
determining a plurality of relevance prompts via the one or more processors based on a plurality of input documents and a relevance prompt template, each of the plurality of relevance prompts including a first respective portion of text from a respective input document of the plurality of input documents and a natural language query, each of the plurality of relevance prompts and the relevance prompt template including a first set of natural language instructions to determine a relevance score based on an evaluation of relevance of the respective portion of text to the natural language query;
transmitting the plurality of relevance prompts to a large language model for completion via the large language model interface;
receiving from the large language model a first plurality of response messages corresponding with the plurality of relevance prompts, each of the first plurality of response messages including a respective designated chunk relevance score corresponding to the respective portion of text;
determining a document relevance score for a designated input document of the plurality of input documents at least in part by determining a weighted average or a sum of the subset of the plurality of chunk relevance scores corresponding to respective text portions included in the designated input document;
selecting a subset of the plurality of input documents based on the respective designated chunk relevance scores;
determining a plurality of query response prompts each including a second respective portion of text, the natural language query, and a second set of natural language instructions to address the natural language query based on the second respective portion of text;
receiving from the large language model a second plurality of response messages, each of the second plurality of response messages including a respective intermediate answer to the natural language query;
determining a response to the natural language query based on the intermediate answers; and
transmitting the response to a remote computing device via the communication interface.