Patent ID: 11947551
Assignee: MAPLEBEAR INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 19:
20. A system comprising:
at least one processor; and
memory storing computer-readable instructions that, when executed by the at least one processor, cause the at least one processor to:
receive a plurality of search queries from a plurality of users directed at an item query engine of an online system, each search query including a search phrase used by a user to conduct the search query;
monitor the item query engine for a period of time;
store the plurality of search queries received within the period of time as a set of historical query records associated with the item query engine, the set of historical query records comprising a plurality of search phrases, wherein each historical query record of the set of historical query records is associated with a search phrase and a list of items returned by the item query engine;
determine search frequencies of the search phrases used in the historical query records for the period of time, wherein a search frequency for a given search phrase is a number of times the given search phrase used by the plurality of users within the period of time;
stratify the set of historical query records into a plurality of bins according to the search frequencies of the search phrases, wherein each bin of the plurality of bins includes a subset of historical query records, wherein each bin defines a range of numbers of times a search phrase is used by the plurality of users within the period of time;
sample the historical query records from the plurality of bins to collect a representative set of historical query records;
output the representative set of historical query records for rating; and
adjust the item query engine based on the representative set.