Patent Document ID: 20090240643
Application ID: 12050436
Patent Status: 0

Claim One:
1. A method for rescaling human judgment data for one or more items of content, the method comprising: generating one or more test sets comprising one or more items of content; generating one or more benchmark sets comprising one or more items of content common to each of the one or more test sets; receiving judgment data for the one or more items of content comprising the one or more test sets from one or more human editors; identifying a variation correction factor for each of the one or more human editors on the basis of the judgment data received from the one or more human editors for the one or more items of content comprising the benchmark sets; identifying a drift correction factor for each of the one or more human editors on the basis of historical judgment data associated with the one or more items of content comprising the benchmark sets; and applying the variation correction factor and drift correction factor associated with each respective human editor to the one or more items of content comprising the test set for which each human editor provided judgment data.