Patent ID: 11875230
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 5:
6. A method, comprising:
performing, by one or more computing devices:
causing, during a first labeling feedback session of one or more labeling feedback sessions, a first visualization data set to be presented via an interactive programmatic interface, wherein the first visualization data set comprises a representation of one or more data items for which labeling feedback is requested for generating a training set of one or more classifiers which includes the one or more data items, wherein the one or more data items for which the labeling feedback is requested include a first data item selected based at least in part on a determination that a variation among predictions for the first data item from a plurality of classifiers exceeds a threshold;
obtaining, via the interactive programmatic interface during the first labeling feedback session, (a) respective labels for the one or more data items, including the first data item, represented in the first visualization data sets and (b) a filter criterion to be used to select one or more additional data items out of one or more data sources for which one or more additional visualization data sets are added to the visualization data sets presented to the label provider such that the selected additional data items are newly displayed via the interactive programmatic interface as new data items to be labeled for use in the training set; and
storing a classifier trained using a training set which includes at least one label of the respective labels.