02.09 Simulator Performance. Assess the adequacy of the facility licensee’s control room simulator in modeling the actual and for meeting the requirements contained in 10 CFR 55.46. Assess the facility licensee’s periodic testing of the simulator, installation of simulator modifications, and for identifying and correcting simulator discrepancies. 02.10 Problem Identification and Resolution. Assess the facility licensee’s ability to identify, evaluate, and resolve licensed operator performance problems which occur in the actual plant/main control room. As part of this assessment, this section checks the effectiveness of the licensee in evaluating and revising requalification training based on licensed operator performance, as specified in Element (5) of a SAT. 02.11 Resident Inspector Quarterly Review of Licensed Operator Requalification and Licensed Operator Performance. At least once each quarter, observe the facility licensee’s requalification testing and training for licensed operators, identify any deficiencies and discrepancies, assess licensed operator performance and evaluators critique, and assess simulator performance. In addition, observe licensed operator performance in the actual plant/main control room during periods of heightened activity or risk. 71111.11-03 INSPECTION GUIDANCE General Guidance As demonstrated by the accidents at Three Mile Island and Chernobyl, other plant events, and from probabilistic risk analyses, licensed operator performance can be a significant contributor to overall plant risk. For this IP, licensed operator performance in the actual plant/main control room will be observed and assessed during periods of heightened plant activity or risk, and licensed operator performance will be inferred from their performance on facility-conducted requalification examinations, other examinations, and facility training exercises. Regarding requalification examinations, each licensed operator at a facility must, in accordance with 10 CFR 55.59(a), pass a comprehensive (biennial) written examination and an annual operating test. However, in order for the requalification examinations to be an effective tool for evaluating licensed operator performance, it is necessary that facility licensees develop and administer these examinations in accordance with accepted standards.
Requalification Written Examination Questions Review Worksheet (Continued) Written examination reviewed or date administered: ________ Q# 1. LOD (1-5) 2. Question Flaws 3. Q flawed or not flawed? (F/NF) 4. Explanation LOD Direct L/U Correct Answer Cues T/F Cred. Dist.
ATTACHMENT 1 - Revision History - IP 71111.11 Commitment Tracking Number Accession Number Issue Date Change Notice Description of Change Description of Training Required and Completion Date Comment and Feedback Resolution Accession Number N/A ML012420444 08/16/2001 CN 01-015 Revised to clarify the original intent of the procedure as it relates to sample size selection. None N/A N/A ML022320730 08/20/2002 CN 02-031 Revised to reflect the amended 10 CFR Part 55, "Operators' Licenses," regarding operator license eligibility and the use of simulation facilities in operator licensing (66 FRN 52657, dated October 17, 2001). This revision provides specific guidance to inspector when assessing conformance with simulator requirements specified in 10 CFR 55.46. None N/A N/A ML040210317 12/16/2003 CN 03-041 Revised to include an additional section that inspects excessive test item repetition among comprehensive requalification exams that are taken by crews undergoing the same training program cycle. Excessive item repetition adversely affects validity of the exam. Clarify the original intent of the procedure as it relates to sample size selection. None N/A
Commitment Tracking Number Accession Number Issue Date Change Notice Description of Change Description of Training Required and Completion Date Comment and Feedback Resolution Accession Number N/A ML14217A409 09/24/14 CN 14-022 Flexibility added for the frequency of main control room observations, clarified individual examination failure rate, changed the methodology for assessing simulator scenario quality (including a new worksheet), eliminated the 10% re-take exam failure rate metric None Closed FF: 71111.11-1850, ML14266A099 ML14266A101 71111.11-1950 ML14266A104