Patent ID: 9195910
Filing Date: 2015-11-24
Classification: G06F,G06K

Abstract:
1. A method for classification, the method comprising: training, by a computer system, a classification model using a training data set; classifying, by the computer system, using the classification model, a first record set to generate a first classification outcome set, outcomes of the first classification outcome set each having associated therewith a record, a classifier for the record according to the classification model, and a confidence score according to the classification model; submitting, by the computer system, to a crowdsourcing system, the records and the classifiers for at least a portion of the first classification outcome set; receiving, by the computer system, validation decisions and non-validation decisions with respect to the at least the portion of the first classification outcome set from the crowdsourcing system; training, by the computer system, an accuracy model according to the at least the portion of the first classification outcome set and the validation and non-validation decisions; and setting, by the computer system, a confidence threshold according to the accuracy model.