Patent ID: 7844641

Claim:
A computer-implemented method for measuring quality of a data processing operation performed by data processing operators on a plurality of documents, each processed document comprising at least one field, the method comprising a computer system executing software to effect the steps of: for each document in a selected set of documents: accessing at least three versions of the document, each version processed by a different data processing operator; comparing the at least three versions of the document with each other; determining a plurality vote answer for at least one field in the document, the plurality vote answer being the most common answer for the field in the at least three versions of the document, the plurality vote answer being determined on the basis of the comparison; and identifying potential errors in the data processing operation based on using the plurality vote answer as the correct answer for the field; recognizing a pattern of errors for a field based on comparison to the plurality vote answer for the field; identifying a root cause for the recognized pattern of errors; generating a database on the basis of the recognized pattern of errors and the identified root causes; and determining a rule based correction, based on a correlation of the pattern of errors, the root cause, the specific error patterns, and critical fields of the data processing operator within the document.