Nevertheless, at least some evidence about validity should be routinely collected. This includes preparation of new tasks by Maryland teachers who have been trained in aspects of performance assessment to write the needed materials. The structure of the MLOs includes Indicators for each outcome. It is at the Indicator level that the connections are clearest. The focal feature to use in making these connections is the stem statement of the scoring rubric, which is generated during test construction.
Scorers are aware at the time of scoring of each stem statement as well as the specific ratings.
This refers to consistency between the activities the test demands on the part of examinees and the processes the test is supposed to represent. Unlike almost all other tests, including NAEP, students are not told what is being assessed, and in fact some tasks combine assessments of all six content areas and some student responses are scored for more than one content area. Usage Math Science Social St. Reading 1.00 0.61 0.62 0.69 0.79 0.73 Writing 0.61 1.00 0.77 0.59 0.64 0.62 Lang. 0.78 1.00 Grade 5 Reading Writing Lang. Usage Math Science Social St. Reading 1.00 0.58 0.61 0.62 0.68 0.68 Writing 0.58 1.00 0.76 0.59 0.57 0.60 Lang.