Patent Document ID: 20140214862
Application ID: 13754802
Patent Flag: 0

Claim One:
1. A method for labeling, the method comprising: identifying, by a computer system, a plurality of patterns in a plurality of documents, the plurality of patterns not covered by a set of validated contextual rules; (a) selecting, by the computer system, a batch of documents of the plurality of documents according to a frequency of usage of patterns included in the batch of documents, where the frequency of usage is for the plurality of documents; (b) submitting, by the computer system, the batch of documents to a crowdsourcing community for labeling; (c) receiving, by the computer system, labels for the batch of documents; (d) generating, by the computer system, proposed contextual rules based on labeled documents of the plurality of documents; (e) submitting, by the computer system, the proposed contextual rules to an analyst community for validation; (f) receiving, by the computer system, validation of a portion of the proposed contextual rules; and (g) adding the validated portion of the proposed contextual rules to the validated contextual rules.