Patent ID: 8498948

Claim:
A method of evaluating production data classified from a data source comprising steps of constructing provisional truth data by classifying data from the data source independently of the production data with an automatic recognition system, constructing master truth data by equating the production data to the provisional truth data and resolving discrepancies with reference to the data source, the step of constructing the master truth data including: incorporating into the master truth data contents from corresponding data fields in the production data and the provisional truth data that match, presenting an image of the source data together with contents from corresponding data fields in the production data and the provisional truth data that do not match each other to a first analyst for visual comparison of the source data to the contents of each of the corresponding data fields in the production data and the provisional truth data, the first analyst performing either: (i) selecting between the contents of the corresponding data fields in the production data and the provisional truth data as a match to the imaged source data based on the visual comparison for appending the selected contents to the master truth data, or (ii) assigning a first interpretation of the image of the source data, presenting the image of the source data together with contents from corresponding data fields in the production data and the provisional truth data that do not match each other or the selection of the first analyst to a second analyst for visual comparison of the source data to the contents of each of the corresponding data fields in the production data and the provisional truth data, the second analyst performing either: (i) selecting between the contents of the corresponding data fields in the production data and the provisional truth data as a match to the imaged source data based on the visual comparison for appending the selected contents to the master truth data, or (ii) assigning a second interpretation of the image of the source data, comparing the first and second interpretations of the image of the source data for adding matching interpretations of the image of the source data to the master truth data, and scoring the production data by comparing the production data to the master truth data.