Patent Document ID: 20070239405
Application ID: 11218015
Patent Status: 0

Claim One:
1. A method for consensus-based validation and analysis of response data gathered from a plurality of panelists in response to a plurality of items regarding a subject matter comprising the steps of: collecting a set of response data from each of the plurality of panelists for each of the plurality of items; formatting the response data from each of the plurality of panelists into a response data matrix in accordance with a predetermined data model; estimating from the response data matrix the empirical point estimate matrix indicative of the amount of agreement in the responses on all items between panelists; determining the saliency of the subject matter to the plurality of panelists; estimating the competency of each panelist based on the empirical point estimate matrix; and, computing the consensus model of correct answers based on the estimated competency of each panelist and the responses for each item in the response data set.