Patent ID: 11971892
Assignee: SCUBA ANALYTICS, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method for stratified-sampling-based query execution, comprising:
receiving a query through an API at a query engine of a distributed computing system; and
determining a result to the query using: an event database comprising a plurality of data shards partitioned across a plurality of data nodes distributed across a plurality of computers of the distributed computing system, and the query engine, wherein the query engine is coupled to the event database and is configured to selectively sample a subset of data shards from the plurality of data nodes and determine the result based on the subset of data shards by:
determining a set of stratum classifier values, wherein, when the event database comprises anomalous data, determining the set of stratum classifier values comprises identifying fields that represent the anomalous data;
identifying an initial dataset containing data relevant to the query from the plurality of data shards, wherein each datum within the initial dataset is associated with a user identifier and the set of stratum classifier values;
sampling a sampled dataset from the initial dataset based on the respective user identifiers, wherein sampling the sampled dataset comprises:
querying data shards of the event database over a web server connecting the query engine to the plurality of nodes of the distributed computing system, wherein data stored at the nodes is stored in a persistent memory; and
retrieving the sampled dataset from the queried data shards via the web server;

segmenting the sampled dataset into a set of strata, based on the respective stratum classifier value for a stratum classifier, wherein the set of strata are determined by producing a set of three-dimensional distributions of the sampled data across a classifier space and determining a set of strata that maximize clustering across the three-dimensional distributions;
sampling an analysis dataset, comprising sampling data from each stratum of the set over the web server; and
calculating the result to the query based on analysis of the analysis dataset; and

returning the result to the query via the API.