All testing involves the issue of sampling the content area or domain. That is, whenever someone wishes to test someone on information learned, only a sample of what was taught is included on the test. Classroom tests, norm-referenced tests, the SATs, medical licensing exams, and the ubiquitous driver's test all sample what is expected of the person being tested, not the entire realm of the subject matter at hand. There must be a balance between what is appropriate to judge the level of accomplishment of the student and the amount of time that will be devoted to the process of testing. The length of the SOL tests was based on the recommendations of the Content Review Committees, composed of Virginia teachers and educators, during the development of the test blueprints.
Time spent in testing is always a strong consideration when tests are developed.
This also ties into why the tests are considered secure. If everyone knew which specific questions were going to be included on the SOL test, these items would be the focus of instruction instead of all of the content contained in the SOLs. Another point in this sampling domain issue is that each time the test is given different SOLs are included to ensure that a pattern of the same SOLs appearing on each test does not occur and improperly drive instruction in the classroom. This method of testing is not unique to SOL tests. In the area of the SOL History tests, the Board of Education has recently addressed the sampling domain issue.