Patent Document ID: 9477809
Application ID: 12343408
Patent Flag: 1

Claim One:
1. A computer-implemented method for processing workflow data generated by inspection systems, the workflow data comprising training for users of a method, data analysis, performance analysis, data mining, or quality control systems for the workflow data, the inspection systems including a plurality of inspection devices comprising image modalities, each modality generating unscreened data comprising one or more patient medical image files, the method comprising: with a computing system comprising one or more computing devices, the computing devices comprising: a plurality of inspection devices comprising a plurality of image modalities each modality generating unscreened data comprising one or more patient medical image files; an unscreened data coordinator for combining the unscreened data from the image modalities and generating a workflow; a server comprising: a distribution module, and a data evaluation module; the server configured to access the workflow of the unscreened data, the workflow comprising a plurality of sets of the unscreened data, each set comprising the one or more patient medical image files; the distribution module configured to distribute the workflow of the unscreened data to one or more workstations, each workstation, comprising: a display for providing notifications or alerts to a user, and a user input device, the user comprising an interpreter of the unscreened data, the user providing interpretative data to the workstation via the user input device; the data evaluation module comprising a processor configured to execute instructions to carry out the method, comprising: receiving, from an interpreter's workstation, the interpretive data created by the interpreter during review of a set of the one or more patient medical image files that have not been previously reviewed by the interpreter, wherein the interpretive data comprises a textual characterization of structures or findings that the interpreter observed in the set of the one or more patient medical image files; storing in the data evaluation module a plurality of keywords that are commonly literally found in the textual characterization within the interpretive data, the keywords associated with the one or more patient medical image files; associating each keyword with a rank; parsing text in the interpretive data for keywords, wherein the keywords are indicative of a degree of richness of the structures or findings, the degree of richness reflecting a degree of seriousness, abnormality, rarity, criticality, and/or difficulty of characterization; accessing keywords and associated scores or ranks stored in the data evaluation module; comparing the parsed keywords with the accessed keywords; applying a numerical ranking algorithm to the interpretive data based on a comparison of the parsed keywords and the associated score or rank for each keyword, such that an aggregated numerical rank is assigned to the set of the one or more patient medical image files, wherein the algorithm is configured to assign a smaller rank when the characterization indicates normal structures or a lack of findings and an increasingly larger rank to increasingly rich structural variants or findings; generating an aggregate rank for the interpreter for the plurality of sets of the one or more patient medical image files based on the assigned rank; and based on the aggregate rank for all interpreters using the computing system, cause the unscreened data coordinator to adjust the workflow of the inspection systems by halting the inspection or adjusting a rate of inspection from the imaging modalities.