Patent ID: 9471667
Filing Date: 2016-10-18
CPC Classification: G06F,G09B

Claim Text:
1. A computer-implemented method of scoring a response to a character-by-character highlighting task, comprising: comparing, using a processing system, the response to the character-by-character highlighting task to a correct response to the task, the comparison generating a dissimilarity value that indicates an extent of a dissimilarity of the response and the correct response; selecting, using the processing system, a threshold dissimilarity value for the task, the threshold dissimilarity value being based on (i) a first set of responses to the task, each response of the first set differing from the correct response and being scored by a human grader as being correct or incorrect, and (ii) a second set of responses to the task, each response of the second set being scored by a human grader as being correct, the threshold dissimilarity value being further based on comparing, using the processing system, the dissimilarity value for the response to the threshold dissimilarity value; and scoring the response based on the comparing of the dissimilarity value for the response to the threshold dissimilarity value, wherein the response is scored as being correct if the dissimilarity value is less than or equal to the threshold dissimilarity value, and wherein the response is scored as being incorrect if the dissimilarity value is greater than the threshold dissimilarity value.