Fundamentals and LAP

Problem Preparation

Course

Future Roadmap:

“Getting Staff Ready

for NIST Seminars”

Series of StudyAssignmeMentorin

On‐the‐JoTraining,WebinarsHomewoAssignme(BlendedLearning

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Session Learning Objectives• IDENTIFY AND DESCRIBE:

• Expectations for students and mentors for “interi

• New resources (website, forms, and training mate

On‐the‐Job Training (OJT) and Mentoring

• Form for documenting OJT• Marked up SOP with Comments – approach fo

identifying learning objectives

• Sample forms with learning objectives for SOP 

Modified Substitution and SOP 19 Volume Tra

• Training materials previously shared.....

• Possible approaches for best preparing new staff

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Identifying current

staffing needs and

solutions

LMIH Mentoring and OJT ‐ 2020‐08‐04
Thank

you!

• A coordinated working group to:

• Identify interim training solutio

obtaining temporary conditionApproved Signatory status for 

and

• Consider longer‐term improve

conducting on‐the‐job training staff (Roadmap for staff prepar

• Thank You:

• AK – Gary Brown• FL – Amy Smith• OH – Dan Walker

• OK – Jeremy Nading

• OR – Aaron Aydelotte• TX – Lisa Corn• OWM – Mike Hicks, Val Miller, 

Chavez, Mark Ruefenacht, Jose 

Georgia Harris

• Be patient! We are all trying to be f

given current national issues.....

LMIH Mentoring and OJT ‐ 2020‐08‐04 
The role of students

(and new staff)

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Student

(New Staff)

Responsibilities

• Take initiative and ask question

• Consider it a career and not ju

• Complete pre‐work/qualify for 

(math test) – meets FundamenMetrology requirement

• Complete reading (pre‐work a

recommendations)

• Complete OJT, self‐study, and

measurements (student roles)

• Read SOPs and Complete Read

Outlines

• Attend 100 % of the Webinars 

Course Assignments

• Be patient – OWM expects tha

3 to 5 years to become proficie

LMIH Mentoring and OJT ‐ 2020‐08‐04 
“Fundamentals

and LAP

Problems

Preparation”

Course

(Blended

Learning)

• Prerequisites

• Math Test, Need SP 811

• Pre‐work (same as currently requ

Fundamentals of Metrology):

• NPL Beginner’s Guide to Mea

(link is external)

• NPL Beginner's Guide to Mea

in Mechanical Engineering (li

external)

• ISO/IEC 17025:2017 "Genera

Requirements for the Compe

Testing and Calibration Labor(staff must demonstrate they 

copy of this standard)

• Mentoring (will cover later)

• Lab QMS and Admin Procedu

• SOP 8 and SOP 19

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Modules in the

“Fundamentals

and LAP

Problem

Preparation”

Course

• Four week course, two 4‐hour webi

week, plus additional homework, sementoring tasks

• Modules (Webinars)

• Introduction to Course and LAP Problem

Calibration Certificates (SOP 1)

• Traceability and Risk (GMP 11, 13)• Measurement Assurance (SOP 30)• SOP 8, Modified Substitution• SOP 19, Volume Transfer• SOP 19, Volume Transfer• Basic Uncertainty (SOP 29)• Proficiency Testing (GLP 1, PT Follow Up

• Calibration Certificates (SOP 1) and Wra

NOTE: Detailed learning objectives, ho

assignments, OJT are posted with the the OWM Events page

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Reminder:

LAP

Problems

1. PT in Mass (SOP 8) and PT in Volume 

2. Internal Audit:

1. Create and evaluate calibration 

(SOP 1); maybe complete amen

certificates if needed

2. Assess Traceability: evaluate su

calibration certificates, traceabhierarchy, and calibration progr

status of equipment and stand

3. Assess Measurement assuranc

check standards and control ch

4. Assess Uncertainties: calculate

uncertainties and compare wit

uncertainties

5. PT Follow Up Form

3. Summary Report – Summarizing all a

and action items in ONE document

(communicating the analysis) and su

OWM

4. Outputs from the LAP Problems are 

Lab Internal Audit and Managemen

Remember: risk, continual improvement...

LMIH Mentoring and OJT ‐ 2020‐08‐04 
The role of mentors in

on‐the‐job training

(and staff

preparations)

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Mentoring

“Requirements”

• Complete and document training 

instructional design and assessme

methodologies – it’s not just “telli

• Conduct OJT on:

• Lab QMS (ISO/IEC 17025:201• Lab SAPs (audit process, non

conformities, action items)

• SOP 8 – modified substitution

• SOP 19 – volume transfer

• Be familiar and supportive of train

requirements and LAP problem ne

• Assess reading outlines, perform

measurement demonstrations, pemeasurement assurance analysis feedback, observe measurementsgaps and provide constructive fee

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Mentor Training Requirement

Training – for Mentor• Why?• Ensure consistent use of

learning objectives,activities, and assessments

• Provide resources for a skill

set beyond “metrology” –opportunity for professional development

OJT Tools• Reading Outline – a

in seminars (dual pu

save it!)

• SOPs marked up – p

framework and out

can be used with AN

• OJT form – for asse

and documenting oevidence

• Sample forms

• SOP 8• SOP 19

LMIH Mentoring and OJT ‐ 2020‐08‐04 
The laboratory system:

Think about work flowand the lab processes:

‐ when conducting OJT,

‐ for risk assessments,

‐ for continualimprovements,‐ approach often used in

on‐site assessments

LMIH Mentoring and OJT ‐ 2020‐08‐04 
      

Resource Requirements (Staff, Facilities, Equipment, Standard

c

Process Requirements (Care/Handling, Methods, Release ...)

• Contract Review

• Laboratory Calibration and Measurement

Capability

• Contract Review

• Laboratory Calibration and Measurement

Capability

Management Requirements (Risk, QMS, Doc/Record Control, Auditing, Action

c

Documentary Standard: ISO/IEC 170

“General requirements for the competence of t

and calibration laboratories”

Resource Requirements (Staff, Facilities, Equipment, Standard

Process Requirements (Care/Handling, Methods, Release ...)

S 

X 

U X MR 

• Contract Review

• Laboratory Calibration and Measurement

Capability

Management Requirements (Risk, QMS, Doc/Record Control, Auditing, Action

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Guidance:

QMS andProceduresObjectiveEvidence:Records

• Safety and Lab QMS (QM 

• Failures often noted when 

items is not completed or 

• Metrology and Laborator

(Covered in Fundamenta

• GMP 12 – selection o

(in Mass/Volume)

• GMP 11 and 13 – cal

program and traceab(care/handling of staand equipment, and 

evaluation)

• SOP 9, 17, 20, 30 – c

charts and measuremassurance

• SOP 29 ‐ uncertaintie• SOP 1 – calibration c

(and lab admin proce

templates)

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Guidance:

QMS andProceduresObjectiveEvidence:Records

• Mass (Covered in Mass) – plus 

• SOP 8 – modified substit• SOP 2 – conventional ma

MABC and calculation of 

(and MABC for uncertain

• GMP 10 – good weighing 

• Volume (Covered in Volume) – 

above

• SOP 19 – volume transfe

• SOP 31 – neck calibratio• GMP 3 – meniscus readi• GLP 10 – water quality a

calculations of water de

• Covered in Mass/Volume: Han

3, 105‐1 (1990), 105‐1 (2019), 

617‐18, OIML R111

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Checklist of OJT/Mentoring an SO

Accepting Unknown Standards for Calibration: ContractReview (SAP)

Care and Handling of Incoming Items (SAP); Handling Non‐conformities (SAP)

Resources: Standards, Equipment, and Environment (GMP11, 13, Inventories and Calibration Program; SOP

Prerequisites)

Processes: Measurement Preparation (SAP, e.g., GMP 12,

SOP 8, 19)

Processes: Measurements (e.g., SOP 8, 19)

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Checklist of OJT/Mentoring an SO

Processes: Calculations (e.g., SOP 8, 19) (SAP SoftwareV&V)

Ensuring Validity: Measurement Assurance Evaluation(SOP 9, 17, 20, 30 and Section 4 of the Msmt SOPs)

Processes: Uncertainty Calculations (SOP 29, andSection 5 of Msmt SOPs)

Reporting (SOP 1, Section 6 of Msmt SOPs, SAP)

Returning Unknown Standards to Customers (SAP)

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Overall

Goal?

• Taking staff from “new” hire st

being a productive member of 

laboratory; a metrologist with 

sign calibration certificates and that measurement results are and traceable and compliant w

ISO/IEC 17025:2017 and the laquality system.....

• Consistently in all labs....• Training, on‐the‐job training, L

problem completion and asses(including PTs), and approvals

LMIH Mentoring and OJT ‐ 2020‐08‐04 
OJT and Mentoring

Resources

OWM Web

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Thank

you!

• A number of State laboratories ha

participated in sharing on‐the‐job 

resources during the 2016 RMAPs

2017 Lab Metrology Info Hour, anthe 2020 working group sessions fdeveloping the Fundamentals and 

Problem Preparation Course.

• Thank you!

• AK – Gary Brown

• CA – Tony Gruneisen• FL – Amy Smith• KS – Keith Arkenberg, Kevin U• MN – Benj FitzPatrick

• NC – Robert Rogers

• PA – Jim Gownley• TX – Lisa Corn

LMIH Mentoring and OJT ‐ 2020‐08‐04 
Website

https://www.nist.gov/pml/weights‐and‐measures/owm‐ojt‐and‐mentoring‐reso

LMIH Mentoring and OJT ‐ 2020‐08‐04 
What questions o

comments do you

have?

LMIH Mentoring and OJT ‐ 2020‐08‐04