‘ANNEX V

Standard quality report

Member States shall submit a standard quality report in accordance with the European Statistical System Standard Quality Report Structure. A copy of the national questionnaire shall be submitted together with the standard quality report.

The standard quality criteria shall apply as follows:

1. RELEVANCE

Implementation of the survey and the degree to which statistics meet current and potential user needs. This covers a description of users and their individual needs and an evaluation to what degree these needs have been satisfied.

2. ACCURACY

2.1. Sampling errors

This covers:

— Description of the sample design and of the effective sample.

— Description of the calculation of the final weighting factors including non-response model and auxiliary variables used, estimator used, e.g. Horvitz-Thompson estimator, variance of the estimates according to the sample strata, variance estimation software. In particular, a description of the auxiliary variables or information used should be reported in order to recalculate the final weighting factors at Eurostat since it is needed for variance estimation.

— In case of non-response analysis, a description of the biases in the sample and results.

Tables to be provided (broken down by NACE Rev. 2 and size classes according to the national sampling plan):

— Number of enterprises in the sampling frame.

— Number of enterprises in the gross sample and in the effective sample.

Tables to be provided for the observed effective sample (broken down by NACE Rev. 2 and size classes according to the national sampling plan):

— Coefficients of variation (2) for the following key statistics.

— Total number of persons employed, total number of enterprises that provided any form of CVT, ratio of the total number of enterprises that provided any form of CVT to the total number of enterprises.

— Total number of enterprises that provided CVT courses, ratio of the total number of enterprises that provided CVT courses to the total number of enterprises.

— Total number of persons employed in enterprises that provided any form of CVT, total number of participants in CVT courses, ratio of the total number of participants in CVT courses to the total number of persons employed, ratio of the total number of participants in CVT courses to the total number of persons employed in enterprises that provided CVT.

— Total costs of CVT courses.

— Total number of enterprises providing IVT, ratio of the total number of enterprises providing IVT to the total number of enterprises.

2.2. Non-sampling errors

2.2.1. Coverage errors

This covers:

— Description of the register used for sampling and its overall quality, information included in the register, and its updating frequency.

— Errors due to the discrepancies between the sampling frame and the target population and sub-populations (over-coverage, under-coverage, misclassifications).

— Methods used to obtain this information and notes on the processing of misclassifications.

Tables to be provided for the observed effective sample (broken down by NACE Rev. 2 and size classes according to the national sampling plan):

— Number of enterprises.

— Ratio of the number of enterprises for which the observed strata equals the sampling strata.

2.2.2. Measurement errors

Where appropriate an assessment of errors that occurred at the stage of data collection due to:

— The questionnaire design (results of pre-tests or laboratory methods; questioning strategies).

— Reporting unit/respondent considering the data collection mode used (e.g. problems and strategies to find the appropriate respondent(s) in the enterprise, memory problems, errors when filling the forms, assistance to the respondent). This includes a description and assessment of measures taken to ensure the high quality of the information related to “participants” and to assure that “participant events” were not collected.

— Existence/use of relevant information systems and administrative records in the enterprise, e.g. correspondence between the administrative and survey concept (reference period, availability of individual data).

— Methods used to reduce this kind of errors, problems with the questionnaire as a whole or with single questions.

2.2.3. Processing errors

This covers a description of the data editing process such as processing system and tools used, errors due to coding, editing, weighting or tabulation, quality checks at macro/micro level and corrections/failed edits.

2.2.4. Non-response errors

This covers an assessment of unit non-response and item non-response and a description of the measures undertaken regarding “re-contacts” as well as:

— Report on imputation procedures including methods used for imputation and/or re-weighting.

— Methodological notes and results of non-response analysis or other methods to assess the effects of non-response.

Tables to be provided for the observed effective sample (broken down by NACE Rev. 2 and size classes according to the national sampling plan):

— Unit response rates (3).

— Item response rates (4) for the following with respect to all respondents: total number of hours worked for all respondents and total labour cost for all respondents.

— Item response rates for the following with respect to enterprises offering CVT courses: — Total number of participants in CVT courses for enterprises offering CVT courses. — Total number of hours of all CVT courses for enterprises offering CVT courses, number of hours of internal CVT for enterprises offering CVT courses, number of hours of external CVT for enterprises offering CVT courses. — Total costs of CVT courses for enterprises offering CVT courses.

3. TIMELINESS AND PUNCTUALITY

This covers a table of dates when different phases of the project started and ended such as fieldwork (considering the different data collection modes), reminders and follow-up, data checking and editing, further validation and imputation, non-response survey (as appropriate) and estimations as well as data transmission to Eurostat and dissemination of national results.

4. ACCESSIBILITY AND CLARITY

This covers the type of results sent to enterprises, a dissemination scheme of results and a copy of any methodological documents about the statistics provided.

5. COMPARABILITY

This covers the deviations from the standard European questionnaire and definitions provided in the manual referred to in Article 8 and a description of links done with other statistical sources (use of certain data available in registers, survey linked to another national survey).

6. COHERENCE

This covers a comparison of statistics for the same phenomenon or item from other surveys or sources and an assessment of coherence with structural business statistics for the number of persons employed as a function of NACE Rev. 2 and size classes.

Tables to be provided for the observed effective sample (broken down by NACE Rev. 2 and size classes according to the national sampling plan):

— Number of persons employed from structural business statistics and number of persons employed from CVTS.

— Percentage of differences (SBS — CVTS)/SBS.

7. COST AND BURDEN

This covers an analysis of the burden and benefit at national level through, for example, a consideration of average time for answering the questionnaire, problematic questions and variables, variables most/least useful in describing CVT at national level, estimated or actual satisfaction level of data users at national level, difference of burden between small and large enterprises and efforts made to reduce the burden.’