Patent ID: 7296020

Claim:
A computerized method for evaluating the quality of a training base comprising a taxonomy comprising a plurality of categories and a set of training documents, in which method the training base is usable for categorizing the set of training documents according to the taxonomy, the method being characterized by the steps of: a. rating training documents of the set of training documents on a lower level by associating one of the predicates: correct, inbound, outbound, unassigned, to a training document, b. rating the categories on a lower level by determining precision/recall values for each category, c. generating higher level category rating attributes from lower-level rating attributes, by associating to the categories one or more of: aa) weak category, bb) existing source/sink relationship between the categories, cc) close categories, d. deriving an overall quality measure for the training base from the higher-level and lower-level rating attributes, e. determining action proposals to improve the training base including one or more of the following operations on the categories: aa) modifying the number of categories by adding a new category or deleting an existing category, or bb) splitting a category in one or more new categories, or cc) merging a category with another category, or dd) modifying the number of training documents of a category by adding or removing training documents; and f. modifying the training base according to one or more of the action proposals.