Patent ID: 11899677
Assignee: ELASTICSEARCH B.V.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. A query system comprising:
a processor; and
a memory for storing executable instructions, the processor executing the instructions to communicate with a client device to enable a client use of a search engine via a network, the search engine interfacing with a relevance model executing on the query system, the query system comprising a specially configured computing resource including a curation engine and the relevance model, the relevance model accessing a target resource for providing responses to queries from the client device over the network;
obtain, at the relevance model, user action metrics over a period of time corresponding to model responses provided in reply to a query, the model responses being provided based on the relevance model;
determine, by the relevance model, one or more of the user action metrics having statistical significance;
place one or more of the responses to the query into a curated list based on their statistical significance to create curated responses;
provide the curated responses for the query rather than the model responses used to create the curated responses, and
determine a defined length for the period of time based on a volume of user actions,
wherein the model responses not having statistical significance continue to be generated by the relevance model for display as model results with the curated responses.