2. To what extent was the technical capacity of governments built? Type of technical assistance requested Extent of technical assistance provided Improved capacity and skills of government National stocktake reports Availability of data and gender indicators in national statistics report Government led gender mainstreaming activities Government plans and policies include gender analysis and include gender strategies 4 gender statistic profile by 2018 Government ministries have tools and systems in place to guide and inform staff on how to integrate gender into programmatic work (target as per country workplan) Trip reports Feedback forms post workshop State reports (e.g. Triennial, CEDAW, BPA etc.) NWM Annual reports Each individual staff travelling Annual Analysis of trip reports for discussion in annual gender team retreat Mid- and evaluations KR, MR, BM &BL Mid-2017 Annually 3. To what extent was gender embedded in national development plans with clear strategies and adequate resourcing? National development plans and corporate plans have clear gender strategies and gender analysis included National stocktake reports UNFPA review of NDP’s 65% of PICs reviewing NDP include gender equality targets (2015 onwards) Number of requests received to assist with reviews of plans and strategies Implementation plan for NDP includes gender impacts Medium-Term Expenditure Framework includes gender financing National development plans, corporate plans and other government policies Each individual staff travelling Annual Analysis of trip reports for discussion in annual gender team retreat Mid- and evaluations KR, MR, BM &BL End 2015 Efficiency 1. To what degree is there improved accountability for gender mainstreaming? Corporate services recruitment, performance management and human resource policies National advisory council/task force for gender mainstreaming Stocktake reports Number of senior management job descriptions with gender mainstreaming criteria Gender Focal Points appointed for each Ministry Number of agency reports to national advisory council/task force for gender mainstreaming 100% of senior management job descriptions have gender mainstreaming criteria 100% of government ministries have gender focal points 100% of ministries report annually to gender mainstreaming advisory body Public Service Commission (or equivalent) NWMs Trip reports Gender mainstreaming progress reports Each individual staff travelling Annual Analysis of trip reports for discussion in annual gender team retreat BL, JLK, KR Annually
Table 3. Draft evaluation question matrix Note: each bullet in the table will contain a number of questions related to this topic Question topics related to evaluation objectives Obj 1. Extent of progress against outcomes Project development/ context Obj. 2 &3. Effective approaches & strategies Obj. 4&6. Success factors and barriers Obj. 5&7. Lessons learned and recommendations Exploration of the demonstration of, extent of, relationship between outcomes (and unintended outcomes): governments’ willingness to take measures to promote gender equality production and use of sex disaggregate data and gender statistics building technical capacity of governments technical assistance leading to improved capacity of governments to introduce policies & gender reforms gender being embedded in national development plans improved accountability for gender mainstreaming What context supported implementation? country context organisational context resourcing What activities were implemented and how? Project drivers and design Activities implemented and outcomes achieved Strategies adopted Effectiveness of activities and strategies What project and contextual factors supported or hindered implementation? Project factors Contextual factors (country, organisational) Pre-conditions or ‘levers’ to support implementation What lessons are learned for the project in relation to: Project implementation Project assumptions, theory and MEF PGEP as a regional initiative SPC organisational priorities Gender mainstreaming as a tool for working with governments Staff survey (Phase One) SPC documentation (Phase One) PICT government documents (Phase One) Stocktake reports (Phase One) Stakeholder interviews (Phase Two) Country case studies (Phase Three)
Capacity building of GAD more limited, where implementation of the gender policy has not occurred. No central agency for support for GM (aside from MFEM templates) Little increase in resourcing for gender (aside from Pacific Women) Little increase in resourcing for gender (aside from VAW services) Increase in resourcing from external donors Additional support requested Application of GM in policies and programs More specific TA (less introductory) Gender analysis Awareness raising in outer islands Application of GM in policies and programs Publicity of gender profile Awareness raising in outer islands GS on women in informal employment Support to Ministry of Education Application of GM in policies and programs More specific TA (less introductory) Support to IPAM Support to CSOs Enablers Developments in gender, including Family Health and Safety Study and CSO advocacy PGEP technical assistance Strong NSO Women in leadership positions Donor requirements Developments in gender, including Family Health and Safety Study and CSO advocacy PGEP technical assistance Women in leadership positions Strong CSOs Donor requirements Family Health and Safety Study PGEP technical assistance Donor requirements (RAMSI) Leadership from PSC and MPS Strong NWM Barriers Limited political will for any public sector reform Limited capacity in public service Limited capacity of NWM Lack of resourcing Limited accountability mechanisms in public service Limited capacity in public service Limited capacity of NWM Limited capacity in NSO Lack of coordination by donors Limited developments in other gender areas (esp women in leadership) Limited capacity of NSO New opportunities Public Sector Reform Strategy Use of MFEM template Agenda 2020 Aid harmonisation framework Education curriculum review MPS policy development Other sectoral policies
7. The outcome and indicator assessment is based on a range of data sources – project team reports and interviews, interviews with other stakeholders, and documentation (e.g. policies, tools, gender profiles). The level of progress has been divided according to: no progress, little progress, moderate progress and significant progress. Specific criteria apply to each of these levels, which draw from the definitions provided in the stocktake reports. In addition, the level of evidence and contribution from PGEP has been noted. The following table details the criteria used to assess progress, evidence and contribution. Scores were given to each country, and then averaged to provide an overall progress rating. In some instances, there has not been data to make an assessment. These countries have been marked with ‘DD’ and have been excluded from the overall regional assessment. Icon Meaning Significant progress Moderate progress Little progress No progress Score 3 2 1 0 Outcome 1 criteria Attitude or awareness change among NSO and/or NWM plus other agencies Attitude or awareness changes among NSO and/or NWM Attitude or awareness changes among individuals No attitude or awareness changes Outcome 2 criteria Presence of gender champions Existing gender policy Other policies mentioning gender Implementation of policies/ programs 2-3 criteria met 1 criteria met 0 criteria met Outcome 3 criteria Capacity demonstrated by individuals in NWM, NSO, and other agencies Capacity demonstrated by individuals in 2 agencies Capacity demonstrated by individuals in 1 agency No progress on capacity Outcome 4 criteria Gender-responsive HR policies Tools to support gender integration Sex-disaggregated data Gender balance at all levels 2-3 criteria met 1 criteria met 0 criteria met Outcome 5 criteria Gender mentioned in NDP, with clear strategies and with resourcing Gender mentioned in NDP with either strategies or resourcing Gender mentioned in NDP without clear strategies or resourcing Gender not mentioned in NDP Outcome 6 criteria Coordination by NSOs with other agencies/devt partners Coordination by NWMs with others Coordination by SPC with others Coordination by other GM partners 2 criteria met 1 criteria met 0 criteria met Indicators 67-100% of PICs have demonstrated progress on the indicator 34-66% of PICs have demonstrated progress on the indicator 1-33% of PICs have demonstrated progress on the indicator 0% of PICs have demonstrated progress on the indicator Rich documentation: identified by 3 type of data sources (team notes/interviews, other stakeholder interviews, documentation) Indication: identified by 2 types of data sources Limited: identified by 1 type of data source
No progress: No progress on capacity; Limited progress: Capacity by individuals in 1 agency; Moderate progress: Capacity by individual in 2 agencies; Significant progress: Capacity by individuals in NWM, NSO, and other agencies Significant progress by multiple GFPs and by the Division of Women, IPAM, progress still required around capacity to implement GM and around GS) Moderate progress by NSO, somewhat by MIA and somewhat by OPM, progress required around capacity to implement GM) Moderate progress (capacity by NWM and NSO) Limited progress only somewhat by NWM and NSO) Moderate progress by NWM and Finance and Planning) Moderate progress by NWN and HR department) Limited progress by NSO) Limited progress partially by NSO) Moderate progress by NSO and NWM) Limited progress by NSO) DD DD DD DD 17 points (out of 10) = 1.7 progress) Level of evidence Rich (team, interviews, IPAM training module) Rich (team, interviews, GM strategy, Stats Act) Indication (team, interviews) Indication (team, interviews) Indication (team, interviews) Indication (team, interviews) Limited (team) Limited (interviews) Limited (interview) Indication (team, interviews) DD DD DD DD Moderate (multiple forms of TA) Moderate (multiple forms of TA) Moderate (multiple forms of TA) Moderate (multiple forms of TA) Moderate (multiple forms of TA) Moderate (multiple forms of TA) Moderate (multiple forms of TA) Moderate (multiple forms of TA) Limited (limited TA) Moderate (multiple forms of TA) DD DD DD DD Outcome Criteria Solomon Islands Cook Islands Palau RMI Tonga Tuvalu FSM Kiribati Samoa Fiji Nauru Niue PNG Overall progress Organisational culture DD DD DD DD
Assessment No progress: 0 criteria met; Limited progress: 1 criteria met; Moderate progress: 2 criteria met; Significant progress: Coordination by NSOs with other partners, coordination by NWMs with other partners, coordination by SPC with other partners, coordination by other GM partners Significant progress (seen by MPS, NWM and SPC with agencies but not as much with NSO) Moderate progress (seen by NSO, SPC, PSC but as much by NWM) Moderate progress (seen by NWM and SPC) Moderate progress (seen by NWM and SPC) Moderate progress (seen by NWM and SPC) Limited progress (seen by NWM) Significant progress (seen by NSO, NWM and SPC) Limited progress (seen by NSO) Moderate progress (seen by NWM and NSO) Moderate progress (seen by NWM and NSO) DD DD DD DD 18 points (out of 10) = 1.8 progress) Level of evidence Rich (team, interview, GFP role and Indication (team, interviews) Indication (team, interviews) Indication (team, interviews) Indication (team, interviews) Indication (team, interviews) Limited (team) Indication (team, interviews) Indication (team, interviews) Indication (team, interviews) DD DD DD DD Moderate (multiple activities by SPC encouraging coordination) Moderate (multiple activities by SPC encouraging Limited (some activities encouraging Moderate (multiple activities by SPC encouraging Moderate (multiple activities by SPC encouraging Moderate (multiple activities by SPC encouraging Moderate (multiple activities by SPC encouraging None not driven by PGEP) Limited (some activities encouraging None not driven by PGEP) DD DD DD DD