Patent ID: 11868436
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 4:
5. A method, comprising:
performing, by one or more computing devices:
one or more classifier training iterations until a training completion criterion is met, wherein a particular classifier training iteration comprises at least:
obtaining, via an interactive interface, asynchronously with respect to a start of the particular classifier training iteration, respective class labels from a label provider for at least some data items of a particular set of data items identified as candidates for labeling feedback in an earlier classifier training iteration;
identifying, based at least in part on an analysis of classification predictions generated using one or more classifiers whose training set includes at least one of the class labels obtained using the interactive interface, another set of data items as candidates for labeling feedback to request class labels from the label provider with respect to a next training iteration;

wherein a different training iteration prior to the particular classifier training iteration comprises:
using a first machine learning model to identify at least a first attribute value of one or more data items, such that a correlation between presence of the first attribute value and a variation in classification predictions of the one or more data items exceeds a threshold;
identifying, using the first attribute, at least one data item as a candidate for labeling feedback in the particular training iteration; and

storing a classifier trained using a particular training set, wherein class labels for at least some items of the particular training set were obtained in the one or more training iterations.