Further computerizing its administration will eliminate time wasted in converting test answers to the electronic format. Eventually, score reports will be mailed to examinees and transmitted to medical schools within two weeks of the examination, rather than the months it takes now. In spite of CBT's supposed benefits over PPT, however, controversy surrounds the possible differences in performance directly caused by the mode of administration. The researchers employed a crossover experimental design, in which students took both the PPT test and CBT test. Thus, the authors concluded that computerization of the test alone did not appear to affect examinee performance.
Medical students vary in their experience using computers, and physicians vary even more.
So it is noteworthy that Leucht also found that subjects' prior computer experience had little or no effect on CBT performance. Practice sessions are particularly emphasized for the last afternoon session in Step 3, using its Primum CCS software. Practice sessions are also offered at the testing centers prior to the actual exam, for an additional fee. The NBME cannot provide a computer for every student taking the exam. Unfortunately, as the test takers may take the exam at different times, this presents a new security issue.