Version 1.1 Last change: 13/06/2018 Version Date Change Author 0.1 01/07/2016 First draft Tanja Kleinert 0.2 20/10/2016 Tanja Kleinert, Stefan Klink 3 31/10/2016 WMO Secretariat feedback Tanja Kleinert, Luis Nunes 4 08/12/2016 Tanja Kleinert 5 08/06/2017 Revision according to meeting in Dec 2016 Tanja Kleinert 6 16/11/2017 Revision according to feedback Tanja Kleinert 7 22/11/2017 Tanja Kleinert 8 07/12/2017 Annex 4 added Stefan Klink 9 18/12/2017 Revision according to meeting in Dec 2017 Tanja Kleinert 9a 28/03/2018 Title changed and some edits accepted Luis Nunes 1.0 07/05/2018 Comments from Igor Zahumensky incorporated Tanja Kleinert 1.1 13/06/2018 Additional edits/comments (track-changes) Luis Nunes CONTENT 1. Functions of a WIGOS Data Quality Monitoring System for surface-based system of GOS 4 2. WDQMS Quality Monitoring Practices 6 2.1 WDQMS Quality Monitoring Main 7 2.2 WDQMS Performance Targets 8 2.3 Requirements on Web-tools and Automated Daily Quality Monitoring Reports 9 3. Data quality monitoring and evaluation 3.1 Resources 3.2 Daily Quality Monitoring and Evaluation tasks 4. Incident Management Procedure 4.1 Responsibilities 4.2 Steps of the Incident Management Procedure 4.2.1 Issue Identification (A) 4.2.2 Issue Raised as Incident (Process Initiation) (B) 4.2.3 Receipt Confirmation (C) 4.2.4 Action Proposal (D) 4.2.5 Incident Status (E) 4.2.6 Confirmation of Successful Incident Rectification (F) 4.2.7 Incident Escalation Procedures 5. Quality Performance Reports Annex 1: WDQMS Performance Targets Annex 2: WDQMS Priority Levels
Annex 1: WDQMS Performance Targets Surface Synoptic Land Stations Requirements for Observation cycles are defined in OSCAR/Surface as well as in the Manual on GOS (WMO-No. 544), Volume II - Regional Aspects. According to the Manual on GOS, Volume II, the minimum of 3 observations at main hours in UTC and 5 observations at main and intermediate hours (i.e. 3-hourly) are required (MRQ). Targeted are 4 observations at main hours in UTC and 8 observations at main and intermediate hours (i.e. 3-hourly) required (TRQ). It should be noted that values for performance targets listed below are examples used for the WDQMS of Regional Association RA VI. It is up to the RAs to define their own performance targets. Performance Target Table 1: Surface Synoptic Land Stations Parameter Target Comment Data availability: Percentage of observations received from Network 95% Manual on GOS MRQ: 50% TRQ: 95-100% (depending on the RA) Percentage of monthly data availability from the surface land station network according to the schedule as outlined in OSCAR/Surface (number of obs received per month compared to number of obs expected per month) Timeliness: Percentage received by HH+100 HH+50 95% 90% Percentage of data received by target times (HH+100 or HH+50) to be calculated on a monthly basis. Targets relate to percentage of data actually received, not expected. Threshold requirement Breakthrough requirement Parameter Trueness - Target for bias: Precision - Target for standard deviation: Threshold for gross errors Comment Pressure (hPa) 0.5 hPa 1.5 hPa 10 hPa < 15% of all single obs. Bias as measure of trueness: On average (several days) the absolute value of daily calculated bias of pressure observations (P BIAS) should not exceed the given target. Standard deviation as measure of precision: On average (several days) the daily calculated standard
Quality might be identified concerning suspicious values in the reports, e.g. negative temperatures or snow during summer season, etc.) One station showed suspicious values in reports occasionally in the last 5 days low Several/all stations of one NMHS/country showed suspicious values in reports occasionally in the last 5 days medium All data of one station showed suspicious values in reports over several days (in the last 5 days) high All data of several/all stations of one NMHS/country showed suspicious values in reports over several days (in the last 5 days) very high Priority levels for territorial radiosonde stations: The described issues shall be identified in in the majority of daily monitoring reports of the different WIGOS Monitoring Centres, not only in daily monitoring reports of one particular WIGOS Monitoring Centre. Category Description Level of priority Data availability (issues/incidents might be identified in TAC and/or BUFR data) One station showed data outages occasionally in the last 5 days low Several/all stations of one NMHS/country showed data outages occasionally in the last 5 days medium One station did not provide any data since 5 days high Several/all stations of one NMHS/country did not provide any data since 5 days very high Timeliness (Data of an entire sounding should be available to users within 100 min. after nominal observation time) Data of the entire sounding of one station seemed to arrive delayed (later than 100 min) occasionally in the last 5 days low Data of the entire soundings of several/all stations of one NMHS/country seemed to arrive delayed (later than 100 min) occasionally in the last 5 days medium All data of the entire sounding of one station seemed to arrive delayed (later than 100 min) in the last 5 days high All data of the entire soundings of several/all stations of one NMHS/country seemed to arrive delayed (later than 100 min) in the last 5 days very high Accuracy/ measurement uncertainty (Issues/incidents might be Daily averages of quantitative measures of performance characteristics (based on Observation minus Background (O-B) results from NWP) of one station exceeded the target occasionally since 5 days ago low