Patent ID: 8538833

Claim:
A computer-implemented method for paying for an existing report comprising: receiving an existing report for which a first combination of entities is identified, the existing report being generated for work performed by the first combination of entities; thereafter, receiving a set of other reports for which respective second combinations of entities are identified, the other reports being generated for work performed by the respective second combinations of entities; selecting a weighting for other reports in the set of other reports based on the respective second combinations of entities; with a processor, computing an accuracy metric for peer prediction-based truthfulness assessment of the existing report, the accuracy metric being computed based on: a) a function which gives reporters an incentive to report the truth given a selected scoring rule, b) a measure of variability of scoring by the selected scoring rule, assuming a true report; and c) at least a subset of the other reports; and making a payment for the existing report based on the weighting, the selected scoring rule, and the set of other reports at a time when the accuracy metric for at least a subset of the other reports exceeds a stopping threshold.