If they could accurately score seven or eight papers out of 10, they were hired. A dozen or so could not meet the accuracy standard. They weren't hired. Some of them were rehired to come back in April to be retrained and score short essays on the fourth-grade reading test. No student names or school names, only a five-digit code to identify students.
Scorers read each paper, then assign each a score from one to six.
With 190,000 papers to read, the scorers might get through almost 100 essays a day. Later, each paper is read and scored by another trained reader. If the two scores are the same, that's the grade. If they are far apart, that paper goes to a third reader. This is a far cry from the simplicity and speed of machine scoring multiple choice tests.