Coffee Industry Support Project Value for Money Assessment rubric with component scores Value for Money Dimension Components Score Components and domains are rated 1,2 or 3 High Level (3) Satisfactory (2) Poor (1) Component Domain Dimension Very strong performance without gaps or weaknesses Acceptable performance with no significant gaps or weaknesses Performance is unacceptably weak with significant gaps Dimensions are rated 1-6 6- satisfies criteria in all domains 4-on balance satisfies criteria; does not fail in any major domain 2-does not satisfy criteria in several major domains 5- satisfies criteria in almost all domains 3-on balance satisfies criteria but marginal in at least one major domain 1-does not satisfy criteria in any domain Economy Financial Management Cost conscious principles are embedded in all aspects of program management and delivery ** Adequate principles of cost consciousness evident Inadequate cost consciousness principles practiced 3 3 5 High levels of competition practiced in procurement** Competition principles appropriately applied in procurement Inadequate competition practiced in procurement 3 The Project uses international expertise in the most cost effective way with evidence of appropriate skills transfer The Project uses international expertise in a cost effective way The Project is over reliant on international expertise without evidence of skills transfer 3 High degree of proportionality in the balance of investments** Adequate degree of proportionality Low degree of proportionality 2 Financial management system ensures accurate budget, management and reporting Financial system used to monitor costs and aggregate budget in timely manner Financial system does not allow for timely monitoring of costs and forecasting 3 Efficiency Project Model The Project is underpinned by a strong theory of change, community consultation, and informed by global learning The Project is underpinned by a sound theory of change with some evidence of use of global learning The Project is not underpinned by sound theory of change 3 3 6 Program management systems Strong risk management system in place that is regularly reviewed and updated as necessary Processes are in place to manage risks and respond to challenges Limited or no evidence of risk management plans or timely identification and or response to risks 3 3 The Project effectively employs the necessary number of staff with the right skills to meet the requirements of the Project design The Project has an adequate number of staff with the right skills to meet the requirements of the Project design The Project does not have adequate number of staff with the necessary skills to meet the requirements of the Project design 3
Data Collection Plans Questions Documents Source Interviews Field visits 1. How efficiently are inputs (resources and funds) applied in the delivery of CISP? CISP financial documents and reports CARE PNG 2. Was due diligence exercised? CISP files management and financial documents CARE PNG 3. To what extent is the Project on track to achieve its objectives? CISP design document July 2013-June 2019 (Redesigned April 2015) CISP reports to PW Partnership agreements PW PNG files CARE PNG Interviews with CISP staff and coffee Industry stakeholders 4. What are the challenges with the Project model and how these are overcome? CISP reports to PW CISP Program and policy documents Minutes of meetings between CISP and implementing partners CARE PNG Interviews with Care PNG staff and coffee Industry stakeholders Feedback from project participants 5. Has the Project influenced industry stakeholders to increase priority for women empowerment in their work? CISP reports to PW Minutes of meetings between CISP and implementing partners implementing partner documentation / reports provided to CISP or to Reviewers during interviews PW PNG files CARE PNG Interviews with Implementing Partners, coffee Industry stakeholders, Extension Officers, CISP staff and select project participants Feedback from project participants 6. What results, expected and unexpected, direct and indirect, were produced by the Project? CISP reports to PW CISP and Extension Officers’ field reports Documents illustrating innovation, influence or leveraging PW PNG files CARE PNG Interviews with Implementing Partners, coffee Industry stakeholders, Extension Officers, CISP staff and select project participants Feedback from project participants 7. To what extent have lessons for improvement been integrated into the Project? CISP reports to PW CISP Program and policy documents PW PNG files CARE PNG Interviews with CISP staff and Implementing Partners