effectiveness of the Australian aid program? 4. What is the capability to commission and conduct operational evaluations across the department? ODE: to better understand current practices in the department and to provide relevant advice to the Executive survey on evaluation capability conducted Quantitative analysis of survey responses 5. How are the findings from operational evaluations used in the department? ODE: to better understand current practices in the department and to provide relevant advice to the Executive Management responses assessed to examine which recommendations accepted Examine percentage of recommendations which were fully, partially or not accepted 6. How can the publication rate of operational evaluations be improved? ODE and P&Q staff: to improve policies and systems for publication Work together with the Internal Audit Branch to develop methods to collect and analyse data on why publication rate is low and how it can be improved 7. How do DFAT’s evaluation policies and practices compare to the evaluation policies and practices of other donors? ODE staff: to inform operational evaluation policies and guidance To be collected through the OECD DAC Review of Evaluation Systems in Development Cooperation Analysis to determine pertinent points which will support good quality independent evaluations across the department
6. The number of evaluation questions addressed Previous USAID found a greater number of evaluation questions to lower quality, but the 2013 found statistical no association of this manner (p. 27) Large numbers of evaluation questions are assumed to result in lower evaluation quality (not tested statistically; p. 72)
ING310 Laos Australia NGO Cooperation Agreement (LANGOCA) Program Laos Yes Yes INH157 Development Cooperation Program Phase II Multi-country Policy and Regulations and Trade-Related Adjustment No Yes INH329 Enterprise Challenge Fund for Pacific and South East Asia Multi-country Yes Yes INH946 Independent Completion Review of the Philippines Response to Indigenous Peoples' and Muslim Education Program Philippines Education Yes Yes INI486a Evaluation of the ICRC Special Fund for the Disabled Multi-country Government and Civil Society Yes No INI486b Health Organisation Value for Money Assessment Multi-country Government and Civil Society Yes No INI486c United Nations Development Program Value for Money Assessment Multi-country Government and Civil Society No No INI598, INK586, INI194 & INI767 Review of Australian aid initiatives in the Pacific at ending violence against women Multi-country Government and Civil Society Yes Yes INI620 Kiribati Education Improvement Program Kiribati Education Yes Yes INI820 Evaluation of the Pacific Sub Regional Programme on Violence against and Girls 2011-2014 Multi-country Government and Society Yes No INI864 Reducing Rheumatic Fever and controlling Rheumatic Heart Disease in four Pacific Island nations Government and Civil Society Yes No INI946 Mid-Term Review of the MRC Programmes Climate Change and Adaptation Multi-country No Yes INI952 Improved food and nutrition security of vulnerable households in Zimbabwe through market-based input assistance FAO Agricultural Inputs Provision Programme 2012-14 Project Completion Review Zimbabwe Agriculture No Yes
INI953, INJ860, INJ826, ING310 Independent Evaluation of Australia’s Support to the UXO Sector in Laos Laos Government and Society Yes Exempted from publication INJ129 Clinton Health Access Initiative (CHAI) Vietnam: Phase III Mid-Term Review Vietnam Population and Reproductive Health Yes Yes INJ137 Independent Progress Review of DFAT Law and Justice Assistance in Indonesia Indonesia Government and Society Yes Yes INJ318 Australia-Africa Community Engagement Scheme Mid-Term Review Pan Africa No Yes INJ346 Formative Evaluation Report Joint Engagement between WFP and AusAID in Cox’s Bazar, Bangladesh Bangladesh Humanitarian Aid No No INJ485 Review of the Solomon Islands National Transport Fund Solomon Islands Transport and Storage Yes Yes INJ636 Final evaluation TI Asia Pacific Regional Programme Government and Civil Society Yes No INJ640 High level Strategic Review Fiji Health Sector Support Program Fiji Health Yes No INJ768 MAEPA Development Assistance Facility for Afghanistan (DAFA) DAFA I, II, III Afghanistan Yes Exempted from publication INJ785 Independent evaluation for early childhood care and education in Khyber Pakhtunkhwa (ECCE-KP) Pakistan Education Yes Yes INJ857 Children of Uruzgan Mid-Term Review Afghanistan Yes Yes INJ889 Nepal Public Financial Management Support Multi Donor Trust Fund (MDTF) Mid-term evaluation Nepal Government and Civil Society No Yes INJ898 Rapid Appraisal Report for the National Library and Archive Building Vanuatu Social Infrastructure and Services Yes No
INK078 Mid-Term Review of the Philippines-Australia Public Financial Management Program (PFMP) Philippines Government and Civil Society Yes Yes INK103 Sri Lanka Community Forestry Project Review Sri Forestry No Yes INK178 Mid Term Review of the DFAT - TAF Partnership Yes Exempted from publication INK211 Roads for Development (R4D) Program Final Mid-Term Review Timor-Leste Transport and Storage Yes Yes INK235 Mid-Term Review of International Mining for Development Centre (IM4DC) Multi-country Mineral Resources and Mining Yes Yes INK437 Improving Health Service Delivery in Myanmar: UN Joint Program on Maternal, Newborn and Child Health Burma Health Yes Yes INK509, INL291 Australia's humanitarian response to the Syria Crisis The Middle East Humanitarian Aid Yes Yes INK523b Partner-led Mid-Term Review of Sweden’s Support to Transparency International Cambodia Cambodia Government and Civil Society Yes Yes INK733 Independent Progress Review of the Regional HIV Capacity Building Program Multi-country Government and Civil Society Yes No