Report on the Review of the Implementation of the Strategic Plan for 2015-2019 —  Complete Version for 2015-2019  — 20 February 2020 Statistical Institute for Asia and the Pacific
I.
Introduction
1. The Strategic Plan is an instrument that steers an organization as it navigates the roadmap to achieving the results it has set for itself for a given period. As a 'living' instrument, the plan requires review and updating especially in the light of changes that challenge the assumptions under which the plan was made. The Governing Council of the Institute endorsed the Strategic Plan for 2015- 2. 2019 guiding the work of the Institute at its tenth session in November 2014. Since then, the Institute has had to respond to major developments and changes in official statistics priorities and prominence given to statistics in the 2030 Agenda for Sustainable Development to track progress towards the Sustainable Development Goals (SDGs). 3. operates. The Institute needs to ensure that its work programme is attuned to the training requirements of region-wide initiatives on capacity building. It must also ensure that it is in a position to deliver on its mandate as the ESCAP regional training centre while balancing the demands on its services and the resource constraints under which it
II.
Key elements of the 2015-2019 plan
The key elements of the 2015-2019 Strategic Plan were a set of four 4. institutional goals, each associated with an outcome, priority outputs, activities and indicators of achievement; the identification of a set of strategic challenges; and a set of three broad strategic directions. 5. The institutional goals by which the Institute was to be judged were: . Excellence in Providing Training . Excellence in Training Resources . Strengthened Engagement with Stakeholders . Excellence in Institutional Stewardship 6. The identified strategic challenges were: . Addressing increase in demand for training. Balancing the continuing need for training on basic statistics with demand for training in new topics, wider reach and diversity of training needs. . Facilitating clear articulation by member and associate member States of their training needs. Targeted and appropriately designed training to increase efficiency and effectiveness of training in light of increased demand. . Maintaining highly qualified and technologically-competent core staff. Providing leadership for developing, coordinating and providing regional training requires maintaining a staffing pattern and acquiring staff with areas of expertise and competencies that match the priority areas. . Developing a viable model for e-learning and blended learning courses. Setting criteria to select appropriate instructional design and modalities for optimal utilization and impact of web-based training. . Making collaborative mechanisms work. To institutionalize partnerships, facilitate sharing of training resources and mobilize financial resources, collaboration is essential. . Measuring quality of programmes and training resources. Quality redounds to excellence and needs to be effectively and convincingly measured, with particular challenges in evaluating impact of web-based courses. . Attaining financial sustainability. Assured funding to ensure continuity and stability needed for short-term and long-term commitments. 7. The broad strategic directions indicated were: . More focus , via concentration of efforts on the data requirements for the post- 2015 development agenda; priorities expressed by member States through the Committee on Statistics; and the Asia-Pacific Regional Action Plan of the Global Strategy to Improve Agricultural and Rural Statistics (RAP); all while shifting to targeted (sub-regional and country) from regional training. . Effective coordination , with the Institute leveraging its role as secretariat of the Network for the Coordination of Statistical Training in Asia and the Pacific to establish a system of training institute affiliates, certification of trainers through a training-of-trainers (ToT) programme, and quality certification of training materials. . Efficiency and adaptability , through better targeting and adapting the design of courses and materials following periodic training needs assessments in context of the work of the Network.
III.
Reviewing the implementation of the plan
Summary
8. The review, which covers the years 2015-2019, can be summarized as follows: . The number of courses delivered fell somewhat short of the target. . Whereas the Strategic Plan noted (para. 8) that the Institute did not have the in- house capacity to deliver any training in the areas of environment statistics and modernizing statistical information systems during the 2010-2014 period, 7 and 18 courses in these respective areas were conducted between 2015 and 2019. . The number of participants who successfully completed training courses exceeded the target on average, but fell short of the target in the years prior to 2018. . The percentage of participants who evaluated face-to-face and blended courses as very useful for their work was on the target. . The percentage of participants who reported much improved confidence in applying training received through face-to-face and blended courses in their job was on the target on average, but fluctuated considerably over time. Key results and accomplishments The Institute held 109 training courses, workshops and seminars from 1 9. January 2015 to 31 December 2019. These were attended by 6,224 participants from 97 countries and territories. With the exception of e-learning courses, all courses were implemented in collaboration with national or international organizations, research institutes or universities. These courses were at basic and advanced levels, relating to economic, social, agricultural and environment statistics. The courses also covered subjects such as statistical methods, data collection and building business registers. After the adoption of the 2030 Agenda on Sustainable Development by the United Nations General Assembly in September 2015 and the subsequent entrusting of responsibility for the monitoring of SDGs and targets to national statistical systems, the focus of statistical training has changed towards compilation of SDG related global indicators.
Number of courses
10. The institute conducted 19-24 courses every year, including e-learning courses. 11. The Strategic Plan 2015-2019 established a results framework for the plan and the indicators to be used to measure achievement at the outcome and output level. 12. The Institute is expected to conduct 6 e-learning courses, 8 face-to-face courses and 8 blended courses 1 every year. The number of e-learning courses conducted every year was less than the expected number due to lack of full complement of lecturers, except for in 2018. The number of blended courses has also lower than the expected every year. On the other hand, the number of face-to-face courses surpassed the expected number every year. Whereas the Strategic Plan noted that the Institute did not have the in-house capacity to deliver any training in the areas of environment statistics and modernizing statistical information systems during the 2010-2014 period, 7 and 18 courses in these respective areas were conducted between 2015 and 2019 (Annex Table 1). 13. Disaggregating the number of courses by the type, the Institute has to conduct at least 2 long courses, 6 regional short courses, 10 sub-regional courses and 6 country courses every year. The number of long courses and regional short courses reached the expected level every year. However, the number of sub-regional courses and country courses conducted was less than the expected number, except for the country courses conducted in the year 2015. The number of e-learning courses was 3 to 7, around the expected number: 6. The number of long courses was all either 2 or 3, beyond the expected number: 2. Meanwhile, the number of short courses was from 12 to 16, but less than the expected number: 22.
PAMID SADID ICPOS TAPOS AICTI INDAM Production and Statistical Analysis of Monitoring Indicators in Support of Inclusive Development Policies Statistical Analysis of Disaggregated SDG Indicators for Inclusive Development Policies Improving Capability in Producing Official Statistics Relating to MDGs Indicators Theory and Practices in Official Statistics Applying ICT Innovations for Modernizing Official Statistical System Innovations in Use of New Data Sources and Methodologies for SDG Statistics
Development of new e-learning and blended courses
The 2015-2019 Strategic Plan expected the number of e-learning and blended- 14. learning courses should increase at a faster pace and therefore states that increase in number of e-learning and blended-learning courses should be monitored. The baseline for such courses is set at 2 courses every year and the target is at least 5 courses every year. Increase in number of e-learning and blended-learning courses was lower than the baseline except for in 2018.

Delivery of e-learning courses by topic
Disaggregating the number of e-learning courses by topic indicates that the 15. Institute had only two e-learning courses which were related to National Accounts from 2015 to 2017. A number of new e-learning courses have been developed and delivered in 2018 and 2019.
4 1
1 1 1
Face-to-face courses in collaboration with other organizations
16. Strengthening capacity of national statistical system to provide appropriate statistical training is one of the outcomes of the Strategic Plan. Availability to and utilization of training resources on statistics by not only statistical training institutions but also other providers of training on official statistics were planned to be increased. Thus, coordinated network, comprised of national training institutions, at the Institute affiliates for conduct of regional, sub-regional and country training was highlighted. The number of training courses delivered on a regular basis by focal points/centres of excellence under the institutionalized partnership with the Institute was supposed to be monitored and targeted as 5 per year in the plan. The number of topics for which training materials were developed collaboratively was also targeted as 2 topics per year in the plan. All face-to-face courses were implemented in collaboration with the other organizations, developing materials collaboratively. Table 4 indicates the number of courses by organization who co-organized regional short courses or sub-regional courses during the period of the plan. The number was larger than the target every year. With the development of the partnerships, training resources on statistics became available and useful.
17. Other than organizations in the Table 4, the Institute received contribution by resource persons or funding from Economic Commission for Africa (ECA), Economic Commission for Europe (ECE), United Nations Population Fund (UNFPA), WHO, Eurostat, South Asian Association for Regional Cooperation (SAARC) as well as national or local governments, research institutes or universities in member States and non-member States for organizing training during the period of the plan. 18. Collaboration with FAO under the Global Strategy to Improve Rural and Agricultural Statistics continued. In the context of the Global Strategy, the Institute continued implementation of activities of the training component of RAP during the period of the plan. Table 5 shows the topics of training of RAP. Training on sampling and training on CAPI were implemented three times respectively during the period of the plan while new topics are included every year.

Number of participants
19. The Strategic Plan also sets targets for the number of participants of training courses. The total number of participants in various courses conducted by the Institute increased every year. The main contributing factor in the increase of participants is the increasing number of participants in e-learning courses. On the other hand, the number of participants in face-to-face/blended courses has decreased until 2018. 20. According to the Strategic Plan, the number of participants who successfully completed training courses (per year) should be monitored. The baseline number of participants in all SIAP courses is 515 and the target number is 1,000 every year. The number of participants surpassed the baseline every year, but was lower than the target from 2015 to 2017. Nevertheless, the number of participants surpassed the target in 2018 and 2019. 21. The rapid growth of participants is achieved through the delivery of a number of e-learning courses in 2018 and 2019. The Strategic Plan states that the number of participants who avail of e-learning courses (per year) should be at least 100 (baseline) with the target of 500. The number of participants for e-learning courses surpassed the baseline every year, while it was lower than the target from 2015 to 2017, but surpassed the target in 2018 and 2019. The number of participants in face-to-face/blended courses has decreased over 22. the years until 2018. While the number of participants for the regional short courses has remained around 250, the total number of participants in sub-regional courses and country courses has been less than 100 every year. For long courses, the number of participants has decreased every year from 49 in 2015 to 39 in 2019. For short courses, the number of participants has also decreased every year from 335 in 2015 to 293 in 2018 but increased to 299 in 2019.
PAMID SADID ICPOS TAPOS AICTI INDAM Production and Statistical Analysis of Monitoring Indicators in Support of Inclusive Development Policies Statistical Analysis of Disaggregated SDG Indicators for Inclusive Development Policies Improving Capability in Producing Official Statistics Relating to MDGs Indicators Theory and Practices in Official Statistics Applying ICT Innovations for Modernizing Official Statistical System Innovations in Use of New Data Sources and Methodologies for SDG Statistics 23. In the Strategic Plan, to strengthen the capacity of national statistical systems to provide appropriate statistical training, the number of participants who are certified as statistical trainers was targeted as 10 per year. The course for training-of-trainers was held twice in 2016 and 2017 and 24 persons attended these courses, thus surpassing the target. However, this training could not be conducted every year due to high cost. Percentage of participants who evaluate the course as very useful for their work and much improved confidence in applying training received in their job 24. The Strategic Plan established targets on "the percentage of participants who evaluate the course as very useful for their work". The percentage 9 should be at the baseline of 40% and should have the target of 60%. This percentage was around 50%, higher than the baseline but lower than the target during the whole period 2015 to 2017. The percentage in 2018 was 60%, reached the target, and was 91%, exceeded the target overwhelmingly in 2019. 25. According to the Strategic Plan, the number of participants who report much improved confidence in applying training received in their job should be monitored. The baseline is 60% and the target is 70%. The percentage 10 was 72%, higher than the target in 2015 but dropped to 58%, lower than the baseline in 2016, and further dropped to around 44% in 2017. However, the percentage increased to 54% in 2018, and to 84%, beyond the target in 2019. Table 7. Percentage of participants who evaluate the course as very useful for their work and much improved confidence in applying training received in their job (%)
26. The training courses delivered by the Institute can be classified into e-learning course, long course and short face-to-face course. E-learning course is delivered simultaneously to a broad area without less personal support. Long course extends longer than a month during which participants master overall useful skills in their long- term career. Meanwhile, short course is held within a week during which participants will study useful skills for their current work.
a.  E-learning courses
27. The percentage of participants reporting the course being very useful for their work for e-learning courses was between 40-87%. The percentage of much improved confidence in applying training received in their job for e-learning course was between 34-82%. Table 8. Percentage of participants who evaluate the course as very useful for their work and much improved confidence in applying training received in their job for e-learning courses (%)
-
-
b.  Long courses
28. The percentage of participants reporting the course being very useful for their work for long courses was between 58-88%. The percentage of much improved confidence in applying training received in their job for long courses was between 53-82%. Table 9. Percentage of participants who evaluate the course as very useful for their work and much improved confidence in applying training received in their job for long course (%)

c.  Short courses
29. The percentage of participants reporting the course being very useful for their work for short courses was between 59-93%. The percentage of much improved confidence in applying training received in their job for short course was between 56-90%. Table 10. Percentage of participants who evaluate the course as very useful for their work and much improved confidence in applying training received in their job for short courses (%)

Duration of training
30. Participants of long courses were requested to comment on the duration of the courses they completed. The number of participants who think the course was too short was larger than the number of participants who think too long for most courses. 11
Abbreviations: PAMID ICPOS AICTI SADID INDAM Production and Statistical Analysis of Monitoring Indicators in Support of Inclusive Development Policies Improving Capability in Producing Official Statistics Relating to MDGs Indicators Applying ICT Innovations for Modernizing Official Statistical System Statistical Analysis of Disaggregated SDG Indicators for Inclusive Development Policies Innovations in Use of New Data Sources and Methodologies for SDG Statistics
Level of training
Participants of long courses were requested to comment on the level of the 31. courses they completed. The number of participants who think the course was advanced was larger than the number of participants who think elementary for all courses except for the course: Applying ICT Innovations for Modernizing Official Statistical System. 12
Note: Rate of duration is calculated by (number of advanced – number of elementary) × 100 ÷ number of respondents. Abbreviations: Production and Statistical Analysis of Monitoring Indicators in Support of Inclusive Development Policies PAMID Improving Capability in Producing Official Statistics Relating to MDGs Indicators ICPOS AICTI Applying ICT Innovations for Modernizing Official Statistical System Statistical Analysis of Disaggregated SDG Indicators for Inclusive Development Policies SADID INDAM Innovations in Use of New Data Sources and Methodologies for SDG Statistics
Network of coordination of training
According to the Strategic Plan, engagement with stakeholders is to be 32. monitored through participation of members of the Network for the Coordination of Statistical Training in Asia and the Pacific in the Workshops on Forging Partnerships. During the plan period, the Workshop on forging partnerships was held only once, in September 2018, with 24 participants from 10 member countries (77% of all member countries). Thus, the target of 80% participation of all members in the workshop could not be fully met. 33. The Strategic Plan encourages the Institute to facilitate the program of work of the Network. The Network established the following programme of work for 2016- 2017, which was fully implemented during the period.
34. The Network also established a program of work for 2018-2019, which includes the following outputs. . Database of training resources compiled and accessed by Network members . Training needs assessment conducted using the training needs assessment tool . Identification of disparities in understanding about training activities, and measuring and monitoring the SDGs . Development of common training curricula on agricultural and rural statistics . Increase national capacity to deliver training on basic economic statistics 35. In addition, the subgroup on gender statistics training was established in 2018 and discussed priority areas of training on gender statistics in 2019. 36. The database for sharing training materials was constructed by the Government of Japan and SIAP in 2019. 37. A training needs assessment on agricultural statistics was conducted from July to August 2018 and the results of the assessment were presented and discussed at the meeting of the Network in September 2018. A training needs assessment on gender statistics was also conducted by the subgroup on the gender statistics training of the Network and used for development of its discussion in 2019. 38. stakeholders. The above mentioned activities in collaboration with members of the Network during the period of the Strategic Plan contributed to strengthening engagement with
Excellence in organizational stewardship
39. The Strategic Plan points out that the Institute be staffed at required levels and expertise for providing, managing and leading regional training in Asia and the Pacific. The number of core staff of the Institute was targeted at 6 professionals and 3 supporting staff in the plan. The number of professionals was smaller than the target in 2015 and 2016, increased and surpassed the target in 2017, but became below target in 2018 and 2019 based on compilation done in man month terms. The target was surpassed in 2017 due to hiring one P3 staff member on project post who remained on this post for half of 2017 and half of 2018. Supporting staff has surpassed the target since there has been increase of one post in 2015.
40. As the effective communication and advocacy strategy in place and implemented, number of calls for funding to Institute stakeholders by Director was targeted as 2 per year in the Strategic Plan. Increased funding request to the members of ESCAP was made in the session of the Governing Council in addition to follow up letters after a request is issued by ESCAP every year seeking support from member states of the Commission. 41. The Strategic Plan states that state-of-the-art training facilities and infrastructure and appropriate ICT equipment and facilities be provided by the host Government of Japan. These facilities have been provided by the Government of Japan. All equipment are being maintained.
Other Key Indicators
According to the Strategic Plan, the attendance rate of target participants for 42. important meetings should be monitored. The Institute organizes two membership meetings for the Governing Council of the Institute and for the Network for the Coordination of Statistical Training in Asia and the Pacific. The attendance rate of participants for those meetings per member states was higher than the target of 80% in all the years except in 2018.
43. Based on the Strategic Plan, the number of events where SIAP participated in as a speaker should be monitored. Both the baseline and the target are 4. The actual number was higher than the target every year.
Table 16. Number of events where SIAP representative participate in as speaker 44. As a whole, most performance indicators in the Strategic Plan exceeded the baselines and reached the targets.
Annex Table 1.

Trends in number of courses and participants by course: 1 January 2015 - 31 December 2019 Annex Table 2.    Number of participants in SIAP training courses by subregion and gender

Annex Table 2.    (continued)

Annex Table 2.
(continued)

Annex Table 3. Summary of training courses implemented: 1 January 2015 - 31 December 2019
Agricultural and Rural Statistics