Results Hierarchy Indicators Data source / means of verification Baseline (Year) 1 2 3 4 End of strategy performance (Year 5 2019) At the of the strategy, programs may not be able to set realistic milestones and targets. Milestones may be developed (and/or modified) during the life of the strategy as the realistic rate of change becomes more apparent. Overall HRD Delivery Strategy Development Objective: Vietnam accesses and uses high level professional and technical knowledge, skills and competencies, to contribute to the country’s sustainable economic and social development, and enduring links with Australia. Impact Evaluation: Recommend - (i) survey of employer organisations of Outcome 1 Alumni, plus of Outcome2 trainees to assess: (a) Records of actual changes implemented from activities of alumni/trainees; (b) 3rd party observations of relative effectiveness of changes implemented; (c) quantitative data on actual change in production, sales/trade etc or quality in government/services delivery; qualitative data (rubrics) on development impact of actual results recorded. DFAT Aid data, refer note below; plus MTR and Impact survey; Baseline data to be collected from organisations in Outcome 2 at time of approval/contracts. This data to focus on matching information to be sought in Impact evaluation survey (Column B). 2015. refer note below. Target: TBA in as etc TBA TBA TBA TBA Actual: Insert data for the year Insert data for the year Insert data for the year data for the year Insert actual performance data for the relevant year Outcome 1:
End-of-strategy outcome - Refer Outcome 1 sheet [Abridged - Outcome 1 sheet] - Extent change (additional personnel) who use advanced knowledge/technology in: (i) industry/production; (ii) university teaching; (iii) university/RI research for local solutions; (iv) who use TVET certificate/Diploma training in selected workplaces; and extent change in women and PWD who use new training/knowledge in selected workplaces. (i) Australia Awards Vietnam program data base; (ii) Tracer studies on alumni destination, work experience and attitudes (as recommended in 2013 M&E studies); (iii) end term impact studies to assess change in quality/productivity etc (as below in Milestones). 2015. (NB due to likely reduction in scholarship awards in next program the data on change is NOT compared to earlier phases, but to absolute numbers of new alumni available to Vietnam with higher learning of a quality they would not otherwise have). Target: TBA in as etc TBA TBA TBA TBA Actual: Intermediate outcome or output - Refer Outcome 1 Sheet % increase annually of graduates of Australia Awards in agreed categories returning to Vietnam and taking up employment in work relevant to use of new advanced knowledge/skills. (Annual numbers and % to be agreed at AA re-design) As As above Target: TBA in as etc TBA in TBA in TBA in TBA in redesign Actual: Outcome 2: End-of-strategy outcome - Refer Outcome 2 sheet [Abridged - refer Outcome 2 sheet for detail] - Extent change (numbers of personnel) who demonstrate(i) new knowledge of competency standards; and (ii) are using new knowledge to support productivity/quality change in their workplaces. AS above; refers to extended data base, or if relevant, to new data base to be established by new HRD facility for Outcome 2. Target: TBA in as etc TBA TBA TBA TBA
Actual: Intermediate outcome or output - Refer Outcome 2 sheet [Abridged refer above] - (i) Number new staff trained; (ii) Number activities to develop/deliver TA/Training completed satisfactorily at sectoral level; and (iii) at organisation level As above 2015 Target: TBA in as etc TBA TBA TBA TBA Actual: Outcome 3: End-of-strategy outcome - Refer Outcome 3 sheet [abridged refer Outcome 3 sheet] - Australia/Vietnam relationships enhanced through HRD engagement Recorded views of DFAT senior managers at Post and Canberra (survey using Rubric measure to be developed at redesign); plus qualitative surveys as detailed below in Milestones 2015 Target: NA NA NA End Term Review survey (conducted in 2020, after completion) Actual: Intermediate outcome or output - Refer Outcome 3 sheet [Abridged refer above] - (i) % report positive & % maintain regular contacts; and (ii) % in cooperative organisational activities; (iii) Number new Australian organisation engaged in cooperative activities. DFAT/Australia Awards Vietnam Data Base, as designed for both Outcome 1 & 2 2015 Target: TBA in as etc TBA TBA TBA TBA Actual:
Program Milestones (actual) (i) 2014-16 preparatory assessments completed before formal design of HRD Facility; (ii) Facility procurement/ establishment completed on time for 2015 start to new activities; (iii) annual targets for Outcome 1 scholarship award processes maintained; (iv) Agreement process for establishing agencies/ organisation in Outcome 2 completed during Facility Inception; (v) procurement for activities under Outcome 2 completed by end yr 1, commence early in yr 2; (vi) annual targets for numbers personnel trained under Outcome 2 met. (i) quarterly monitoring by DFAT of timely progress of internal and contracted implementation; (ii) Australia Awards Data Base; (iii) New or adapted data base established for Outcome 2;(iv) review (MTR) special Tracer survey of extent of application of learning by Outcome 1 Alumni and Outcome 2 personnel; (v) Regular Tracer surveys PLUS end term impact study to measure change in quality/productivity in target organisations. Target: (i) by end 2015; (ii) by end 2015; (iv) (4 from (v) 2 (iii) & (vi) for 1 met; 2 by mid year for 1 met; 2 for met and of yr 2 to MTR on of for for 1 and 2 met; Annual Targets for Awards/training delivered for Outcome 1 and 2 met; end term survey of learning effectiveness commenced; Impact assessment of change in quality/ productivity planned (for implementation 2020)