Patent Document ID: 9348902
Application ID: 13754802

Base Claim:
1. A method for labeling, the method comprising: identifying, by a computer system comprising one or more processors, a plurality of patterns in a plurality of documents, the plurality of patterns not covered by a set of validated contextual rules; (a) selecting, by the computer system, a batch of documents of the plurality of documents according to a frequency of usage of patterns included in the batch of documents of the plurality of documents, where the frequency of usage is for the plurality of documents, the batch of documents of the plurality of documents is selected by, for each document of the plurality of documents: identifying a pattern set for the each document; removing from the pattern set those patterns for which a rule of the set of validated contextual rules applies; and computing a score for the each document according to a sum of usage frequencies for the patterns of the pattern set for the plurality of documents; (b) submitting, by the computer system, the batch of documents of the plurality of documents to a crowdsourcing community for labeling; (c) receiving, by the computer system, labels for the batch of documents of the plurality of documents; (d) generating, by the computer system, proposed contextual rules based on labeled documents of the plurality of documents; (e) submitting, by the computer system, the proposed contextual rules to an analyst community for validation; (f) receiving, by the computer system, validation of a portion of the proposed contextual rules; and (g) adding the portion validated of the proposed contextual rules to the set of validated contextual rules.

---

Claim 6:
6. The method of claim 1 , wherein the set of validated contextual rules (a) take as inputs a value and a value context and (b) output an attribute label for the value.