Patent ID: 7630867

Claim:
A method for consensus-based validation and analysis of response data gathered from a plurality of panelists in response to a plurality of items regarding a subject matter, the method comprising: a host device collecting a set of response data from the plurality of panelists for the plurality of items; the host device formatting the set of response data from the plurality of panelists into a response data matrix in accordance with a predetermined data model; the host device estimating from the response data matrix an empirical point estimate matrix indicative of the amount of agreement in the set of response data on the plurality of items between two or more panelists; the host device determining a saliency of the subject matter to the plurality of panelists; the host device estimating a competency of the plurality of panelists based on the empirical point estimate matrix; and, the host device computing a consensus model of correct answers based on the estimated competency of the plurality of panelists and the set of response data for the plurality of items.