TEDINPRENHEDWThe Food and Environment Research Agency

ONTROLL

Protocol for Proficiency Testing Schemes

NOTC

Version 2, January 2012

Part 5 – LEAP® Scheme© Crown Copyright 2012

PREFACE
This Protocol is a series of inter-related documents. This document, Part 5, sets out specific details
for the Laboratory Environmental Analysis Proficiency (LEAP®) Scheme. Although this document
duplicates some of the text in Part 1 – Common Principles, it cannot be used in isolation. Part 5must always be read in conjunction with Part 1 and vice versa.

VERSION HISTORYThis Protocol was completely revised in 2009, superseding all proficiency testing scheme Protocols
previously published by the Food and Environment Research Agency (previously, Central ScienceLaboratory), i.e. all previous editions of the separate FAPAS and FEPAS Protocols.

TED

Version 2 of January 2012, this version, supersedes Version 1 of November 2009. The changes are
as follows;
Change from LEAP™ to LEAP®

IN

1.1 Addition of text taken from Reports on the rationale for water quality PTPR

1.2 Amendments to reflect publication of standard ISO/IEC 17043 and compliance with its
requirements
4.1.2 Standard deviation updateW

4.3 Update on qualitative microbiology assessments

HEN

3.3 Electronic instructions, not covering letters

NOTCONTROLLED

5 References updated

Page 2 of 9

CONTENTS
1. INTRODUCTION

4

1.1. Fera, Defra, PTG and FAPAS

4

1.2. Accreditation

4®

4

2.1. Management System

4

3. PARTICIPATION in SCHEMES

4

2. ORGANISATION of LEAP SCHEME

4

3.2. Dispatch and Receipt of Test Materials

5

3.3. Analysis of Test Materials

5

3.4. Submission of Results and Outline Methodology

5TED

3.1. Test Material Preparation and Homogeneity

3.4.1 Rapid Indication of Consensus of Results

PRIN

3.5. Follow-Up Services
4. PERFORMANCE ASSESSMENTEN

4.1. Potable Water Chemistry PT

H

4.1.1 Inorganic GroupsW

4.1.2 Organics

5556677

4.3. Potable Water Microbiology/Parasitology PTs

7

LLED

4.2. Effluent, Waste Water, Contaminated Land & Hazardous Waste PTs

NO

TCONTRO

5. REFERENCES

Page 3 of 98

1. INTRODUCTION
1.1. Fera, Defra, PTG and FAPASThe Food and Environment Research Agency (Fera) is an Executive Agency of the UK Government
Department for Environment, Food and Rural Affairs (Defra). Fera provides a wide range ofproficiency testing (PT) schemes.
The management of these PT schemes is the sole task of one of many teams within Fera. Known
internally at Fera as the Proficiency Testing Group (PTG), this team provides Fera’s PT schemes
globally under the brand name of FAPAS PT. The Laboratory Environmental Analysis Proficiency(LEAP®) scheme is one of these PT schemes.
For the purpose of this Protocol we use FAPAS PT to mean Fera PTG.

PRINTE
DTogether with laboratory accreditation and the use of validated methods, PT is an important
requirement of the EU Council Directive 98/83/EC [1] on the quality of water intended for humanconsumption. With the increasing demands for independent proof of competence from regulatory
bodies and customers, proficiency testing is relevant to all laboratories testing water for quality andsafety in every country.

EN

1.2. Accreditation

WH

LEAP® Scheme is accredited by the United Kingdom Accreditation Service (UKAS). Accreditation isconferred upon LEAP® Scheme in accordance with ISO/IEC 17043:2010 [2].

LLED

The formal schedule of the accreditation can be obtained from the United Kingdom Accreditation
Service (UKAS) web site (Adobe PDF format) [3].

TRO

2. ORGANISATION OF LEAP® SCHEMECO
N

2.1. Management SystemOT

The scope of the LEAP® Scheme’s accreditation covers all aspects of the following PTs organised byLEAP® Scheme:
Potable Water Chemistry•Effluent, Waste Water, Contaminated Land and Hazardous Waste•

Potable Water Microbiology/Parasitology

N•

Note that Chemistry PTs are grouped according to their standard analytical methodology.

3. PARTICIPATION IN SCHEMES
3.1. Test Material Preparation and Homogeneity
LEAP® Scheme test materials are a combination of real samples, standard solutions and standard
concentrates that require dilution. Liquid samples, by their nature have a high degree of natural
homogeneity and this, coupled with rigorous process control during preparation, means thathomogeneity testing is not normally required.
Page 4 of 9

3.2. Dispatch and Receipt of Test Materials
All LEAP® Scheme test materials are sent by courier and so can be tracked on-line throughout theirjourney. It is the responsibility of the customer to anticipate an email on the day of dispatch advisingthem of the tracking number and then to monitor the progress of their samples. It is particularly
important for non-UK participants to track their samples to ensure a smooth transit through theircountry’s Customs. FAPAS PT cannot be held responsible for delays arising at Customs.

3.3. Analysis of Test Materials
Many LEAP® Scheme test materials are supplied in the form of a water sample and an associatedspiking concentrate. Full details of how to add the spiking solution to the water sample are suppliedin the instructions (provided electronically via email or downloaded from the FAPAS PT website,www.fapas.com). It is the responsibility of participants to read these instructions and follow themexactly prior to conducting the actual analysis of the test material. LEAP® Scheme cannot be held
responsible for any problems arising from failure to comply with these instructions.

INPR

Example instructions are available on request from LEAP® Scheme.

TED

An indication of the likely concentration range(s) in the test material will only be given if the test
material is in the form of a standard solution or concentrate that must be diluted prior to analysis.

EN

3.4. Submission of Results and Outline Methodology

HThe general results submission requirements are detailed in Part 1 of this Protocol.

W

3.4.1 Rapid Indication of Consensus of Results

ONTR
O

LL

ED

During the period from approximately 5 days after the closing date until the publication of the report
participants can access, via FAPAS SecureWeb, a table listing the median values of the submitted
results for each analyte in the round. These median values are only rapid indicators of the consensusof submitted results. They are NOT the assigned values. They are indicative only and for use atparticipants’ own risk. Fera accepts no liability in any circumstances for the use/misuse of thesevalues.

C3.5. Follow-Up Services

OT

FAPAS PT does not sell surplus test materials from the batches used for LEAP® Scheme PTs.

NMost LEAP® Reports produced since 2003 are available for purchase. Prices are available on request.
Participants in all the FAPAS PT schemes have free access to an electronic copy of reports for thosetests for which they have registered. Electronic copies of reports are available on request and acharge will be made for these.
If a participant wishes to obtain advice on any aspect of their performance they should contact FAPAS
PT by email (info@fapas.com) in the first instance. Participants must note that LEAP® Scheme may
offer assistance in the form of a broker service whereby LEAP® Scheme will either anonymously or,subsequent to all parties agreeing to waive their confidentiality, pass on the participant’s inquiry to anexpert laboratory/external advisor.

4. PERFORMANCE ASSESSMENT
The LEAP® Scheme PTs express participants’ results as z-scores, except for parasitology PTs where
the performance assessment takes the form of percentage recovery.
The standard deviations for each PT are derived as detailed below.
Page 5 of 9

4.1. Potable Water Chemistry PT

4.1.1 Inorganic Groups
For Chemistry PTs (single determinations), z-scores are used for quantitative results.
Regulation 21(2)(d)(iii) [4] outlines the performance required of analytical systems and the maximum
tolerable errors are specified in the following way:
•The maximum tolerable total error of individual results should not exceed C or 20% of the result,whichever is the greater. Each analytical programme has its own analytical range requirement.
At the lower end of such a range, knowledge of the actual concentration provides no additional
benefit. This concentration, known as the Lower Level of Interest (LLI) equates to C, where C =one tenth of the Prescribed Concentration Value (PCV) [5].

TE
D

The reason for this is that, as concentration decreases, the maximum tolerable error of 20% becomes
more difficult to achieve. At low concentrations the satisfactory range will appear small and is notpractical, thus, C is used.

INSome measurands will have lower levels of interest (LLI) not set at 1/10th of the PCV, but set byperception, based on experience of the quality of data that is achievable by laboratories.

PRSatisfactory Range Calculation

ENIf robust mean, median or theory value is less than (<) lower level of interest (LLI) then upper andlower range is set as follows: -WH

Upper = +2 x LLI

EDLower = 1% of LLI

LL

If robust mean, median or theory value is greater than (>) lower level of interest then use one offollowing: -ON

Standard Deviation (σp)

TRO+/- 20% or +/- LLI whichever is the greater.

CFrom the satisfactory range one of two options is used: If assigned value is (<) LLI then σp = (Upper – Lower)/4(ii)

If assigned value is (>) LLI then σp = +/-20% of assigned value divided by two or LLI
divided by 2 which ever was used to set satisfactory range.

NOT(i)

pH is a special case where σp is set at +/- 0.2 units. [5]Potable Water Chemistry PTs may also include multiple determinations, in which participants report
replicate results. Each laboratory will then have a bias, calculated as:
bias = laboratory mean unspiked value - robust mean of all laboratories unspiked value
The bias target is calculated as:
LLI/2 or 10% of overall mean whichever is the greater
The precision (standard deviation) target is calculated as:
LLI/4 or 5% of overall mean whichever is the greater

Page 6 of 9An additional assessment in the Chemistry PTs is the Spiked Sample Recovery. An individuallaboratory mean value for the unspiked sample replicates is calculated along with an individual meanvalue for the spiked sample replicates. The recovery for each laboratory is then calculated as follows:
recovery = mean spiked value - mean unspiked value% recovery = (mean spiked value - mean unspiked value) / (nominal spike level x 100)
The recovery target is calculated as +/- 10% of nominal spike level or +/- LLI/4, whichever is thegreater.

4.1.2 Organics
The standard deviation for proficiency, σp, for potable water organic groups is set with reference toperformance requirements in Water Regulations [5], at a value that reflects best practice for theanalyses in question.

INTE
D

The appropriate tolerable error, for each analyte, is dependent on the assigned value. If the assigned
value is greater than or equal to (≥) 50% of the PCV [5] then σp is set at 12.5% of the assigned
value. If the assigned value is less than (<) 50% of the PCV, σp is set at 6.25% of the PCV. Whereno PCV is available, 0.1 µg/L is used as the PCV.

ENPR

4.2. Effluent, Waste Water, Contaminated Land & Hazardous WastePTsWHThe standard deviation for proficiency in Effluent, Waste Water, Contaminated Land & HazardousWaste PTs is 10% of the assigned value, except pH where it is 0.1 pH units.

ED4.3. Potable Water Microbiology/Parasitology PTsONTRO

LL

Qualitative assessments for Potable Water Microbiology PTs report results as either Satisfactory orNot Satisfactory, against the identification of the verified organism present in the test material. Theassessment will be based only on the reported genus. Abbreviations are not acceptable due to thepossibility of their misinterpretation.

TC

The standard deviation for proficiency in quantitative assessments for Potable Water Microbiology PTs
will be either the robust standard deviation (where the robust mean is set as the assigned value) or
the standard median absolute deviation sMAD (where the median is set as the assigned value).

NO

The standard deviation for proficiency in quantitative assessments for Potable Water Legionella PTs isset at 0.35 log10 cfu/L.
The Potable Water Parasitology PTs differ in that the efficiency of recovery of Cryptosporidium
oocysts and Giardia cysts is assessed, as well as reporting the enumeration. These PTs do not issue
z-scores but instead there is a general comparison of participants’ results. A mean and standard
deviation is calculated for each laboratory, in addition to the overall robust mean and standard
deviation for all results.

Page 7 of 9

5. REFERENCES
Council Directive 98/83/EC of 3 November 1998 on the quality of water intended for humanconsumption (European Drinking Water Directive).

2ISO/IEC 17043:2010, Conformity assessment – General requirements for proficiency testing.

3

http://www.ukas.com/about-accreditation/accredited-bodies/proficiency-testing-organisations.asp

4

Guidance on safeguarding the Quality of Public Water Supplies 1989.

5

Guidance on the implementation of the Water Supply (Water Quality) Regulations 2000 (asamended) in England and the Water Supply (Water Quality) Regulations 2010 in Wales(Published September 2010).

NO

T

C

O
N

TRO

LLED

W

H

EN

PRIN

TE
D1

Page 8 of 9TEDINPRENHWED
LLTROONCTNO

FAPAS LEAP® Scheme
Proficiency Testing GroupThe Food and Environment Research Agency
Sand Hutton, YorkYO41 1LZ
UK
Tel:
Fax:
e-mail:web:+44 (0)1904 462100+44 (0)1904 462040
info@fapas.com
www.fapas.com

Page 9 of 9