effects of examinee motivation on multiple-choice item calibration and test construction.
Published: 2004
Language: eng
Number of pages: 94
Subjects: Educational tests and measurements -- Design and construction.; Psychological tests -- Design and construction.; Item response theory.; Motivation (Psychology).
Description: The purpose of this study was to examine the effects of a false assumption regarding the motivation of examinees on multiple-choice item calibration and test construction. A simulation study was conducted using data generated based on two models of item responses (the 3-parameter logistic item response model alone, and in combination with Wise's Examinee Persistence model (1996a)). Items were calibrated using a Bayesian method. For the conditions studied, the item parameter estimates based on responses from poorly motivated examinees were biased and more variable than estimates based on responses from a "normal" group of examinees. Bias in item parameter estimates resulted in bias in item information estimates and test information estimates for optimally constructed tests. The implications of the results for test development companies, examinees and users of test results are discussed.
Notes: Adviser:  Ross Traub.

Thesis (Ph.D.)--University of Toronto, 2004.

Electronic version licensed for access by U. of T. users.

Source: Dissertation Abstracts International, Volume: 65-05, Section: A, page: 1752.