The faculty consultants who will grade a particular question meet as a group with the leaders for that question to discuss the question and acceptable correct responses. The group reviews the scoring guidelines, adding refinements based on their discussion. These samples reflect all levels of ability. Each group of faculty consultants then compares and discusses the scores for the samples, based on the scoring guidelines. The groups work together to assign an appropriate score, and then the question or table leader reveals the original scores.
Discussion then follows about the basis for the score.
This process is repeated with other papers that have been chosen, either because they demonstrate a particular level of mastery, or because they contain particular features that will help faculty consultants understand the scoring scale more clearly. As the teams become more proficient in their use of the scale, they are presented with papers that are in some way more problematic. Scores and differences in judgment are discussed until agreement is reached, with the question leaders, the table leaders, or the CFC acting as arbitrator when needed. After a team shows consistent agreement on its scores, its members proceed to score individually. Faculty consultants are encouraged to seek advice from each other, the question leaders and table leaders, or the CFC when in doubt about a score.