Patent ID: 8374540
Filing Date: 2013-02-12
Classification: G09B

Abstract:
1. A computer-implemented method for benchmarking responses to test prompts, the method comprising: during a benchmarking process, assigning with a computer a temporary score to each of a number of candidate responses, wherein said assigning is based upon a scorer review of each of the number of candidate responses, and wherein the number of candidate responses is at least a number of score measures on a score scale; identifying an official score response from the number of candidate responses for each score measure on the score scale based on the temporary scores assigned to the candidate responses, the official score response being a benchmark response providing a basis for scoring other responses during a scoring process; assigning with the computer an official score to each official score response based on another scoring review performed during the benchmarking process by the first scorer of the respective temporary score; assigning with the computer an electronic scoring record for each official score response, wherein the electronic scoring record includes a justification for an official score assigned to an official score response, and wherein the electronic scoring record is associated with the first scorer; and distributing the official score responses to one or more scorers.