The department also offers targeted learning on programme logic and developing performance measures. Measures of success Evaluation maturity Developing and maintaining evaluation maturity is an ongoing process that must be balanced with other organisational objectives. This Strategy establishes a framework to guide the department through the stages of maturity which encompass good evaluation practices. To establish a baseline from which we can identify strengths and weaknesses and priorities for improvement, the department has assessed its current evaluation maturity. While it is following best practice in some elements of evaluation maturity, overall it is at the developing stage of maturity. Maturity level Beginning Developing (Current rating) Embedded (June 2016) Leading (June 2018) Integrated Awareness of the benefits of evaluation is low. Evaluation is seen as a compliance activity and threat. Fear of negative findings and recommendations leads to a perception of ‘mandatory optimism’ regarding programme performance. Insufficient resources allocated to evaluation activities. Evaluation and performance measurement skills and understanding limited, despite pockets of expertise. Appreciation of the benefits of evaluation improving. Evaluation is being viewed as core business for the department, not simply a compliance activity. A culture of evaluative thinking and continual improvement is introduced and communicated across the department. Skills in performance measurement and evaluation developed through targeted training and guidance materials. Evaluation website and guidance materials developed. The role of the Evaluation Unit is A culture of evaluative thinking and continual improvement is embedded across the department, with lessons learnt being acted upon. Evaluation is seen as an integral component of sound performance management. General evaluation skills widespread. Improved skills and knowledge in developing quality performance measures. Evaluation Unit team members have high order skills and experience which is leveraged by the agency. Evaluation Unit team members hold and are encouraged to undertake formal qualifications in Evaluations motivate improvements in programme design and policy implementation. Demonstrated commitment to continuous learning and improvement throughout the agency. Department is recognised for its evaluation and performance monitoring expertise, and innovative systems and procedures.
widely communicated. Unit seen as the authoritative source for advice. Developing further expertise in the Evaluation Unit. evaluation and related subjects. Fit for Purpose Frequency and quality of evaluation is lacking. Guidelines for prioritising and scaling evaluation activity are used. Priority programmes are evaluated. Evaluations use fit for purpose methodologies. Evaluation effort is scaled accordingly. Specialist and technical skills well developed to appropriate methodologies. Data holdings and collection methods are insufficient or of poor quality. Planning at programme outset improves data holdings and collection methods. Developing skills and knowledge in applying robust research and analytical methods to assess impact and outcomes. Quality of evaluations is improving. A of administrative and other data is used in the assessment of performance. Robust research and analytical methods are used to assess impact and outcomes. Evaluations conform to agency standards. The department continually develops and applies robust research and analytical methods to assess impact and outcomes. Evaluation and performance measurement conforms to recognised standards of quality. Specific and timely Effort and resources are allocated in an ad hoc and reactive manner with little foresight. Developing performance information at the inception of a programme is ad hoc and of variable quality. Evaluation activity is coordinated. An Evaluation plan is in place and regularly monitored. Strategically significant and risky programmes are prioritised. Planning for evaluation and performance monitoring is being integrated at the programme design stage. All programmes are assessed for being ‘evaluation ready’. The department employs strategic risk-based, criteria to prioritise evaluation effort. Evaluation Plans are updated annually and progress is monitored on a regular basis. Planning for evaluation and performance measurement is considered a fundamental part of policy and programme design. All programmes have programme logic, performance The department’s approach to evaluation and performance planning is seen as the exemplar. All programmes assessed as ‘evaluation ready’.