Patent ID: 11971892
Assignee: SCUBA ANALYTICS, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 13:
14. A method for stratified sampling-based query execution, comprising:
receiving a query through an API at a query engine of a distributed computing system; and
determining a result to the query using: an event database comprising a plurality of data shards partitioned across a plurality of data nodes distributed across a plurality of computers of the distributed computing system, wherein the data shards are stored in persistent memory at the plurality of computers, wherein data is sharded across the plurality of data shards based on a user identifier associated with the datum, and the query engine, wherein the query engine is coupled to the event database and is configured to selectively sample a subset of data shards from the plurality of data nodes and determine the result based on the subset of data shards by:
determining a set of stratum classifiers, wherein, when the event database comprises missing data, a portion of the set of stratum classifiers determined represent the missing data;

identifying a set of datasets from the event database, wherein each dataset is associated with a set of strata for each of the set of stratum classifiers, wherein the set of strata are determined by:
producing a set of three-dimensional distributions across a classifier space of an initial data sample of the plurality of data shards; and
determining a set of strata that maximize clustering across the three-dimensional distributions;

sampling a subset from each dataset, comprising sampling data from the set of strata for a stratum classifier, wherein sampling the subset from each dataset comprises:
querying data shards of the event database over a web server connecting the query engine to the plurality of nodes of the distributed computing system; and
retrieving the subset from the queried data shards via the web server;

combining the sampled subsets from each dataset into a target dataset;
calculating the result to the query based on analysis of the target dataset; and
returning the result to the query via the API.