# Benchmarking & Evaluation

Heidi Bellamy - Director, Culture First Introduction to the session The purpose of today is to:
'enable you to better evaluate performance of the archive service and gain realistic comparisons of potential'.

The topics Bench marking: measuring performance against other comparable services to identify realistic outcomes and targets

## Developing An Evaluation Process: How To Design An Effective Evaluation Process What Is Benchmarking?

A systematic process for comparing performance
More than a rank in a league table - track 
performance, plan and advocate It differs from other improvement techniques:
- focuses on excellence; - involves detailed comparisons;
- pools shared information to benefit all contributors; 
- encourages front line managers and staff in seeking out and implementing change
Benchmarking in an archive context 
Benchmarking data is usually quantitative so it's 
important to support with more qualitative 
statements
It can be put to best use when illustrating 'stories'
•
how well an exhibition went (higher visitor numbers 
than in the same period of a previous year)
•
how you are contributing to social agendas (how many volunteers and the hours they give)
•
how effectively you are spending public/charitable 
money (the amount of match £ and 
things you've been able to deliver as a result
What is available for archives? 

## Archive Service Accreditation - Is A Uk Wide Quality Standard Which Offers A General Benchmark Psqg Data - Survey Of Visitors To Uk Archives Every 18 Months Allows You To Compare Groups Or Apply Filters. It Covers: - Purpose Of Visit

•
Frequency of visit
•
Satisfaction with staff, services and facilities
•
Outcome of visit 

## Headline Report And Benchmarking Template For October 14 Is Available From The Ara Website What Is Available For Archives?

CIPFA data - comparative profiles enable you to examine how your service costs and performance compare to your peers/nearest neighbours The profiles look at the following key aspects of archive service provision:
o numbers of access points and service users/visitors

o
costs of running archives services
o
levels of staffing and volunteers
o
availability of resources to the public
o
holdings and storage capacity levels 
o
levels of funding levered in
o
user satisfaction
How to use the benchmarking data 

Strategic Decision makers - Corporate level, 
Board of Trustees, Vice Chancellor etc
Councillors Funders Commissioners Media Other?

## Corporate Level

Good organisations will be assessing their performance at Corporate level Demonstrating that archives offer vfm is vital Compelling benchmarking data =

- £ funding secured in past years, 
- user numbers have grown despite reduced staff or 
through volunteer support
Worth benchmarking the range of functions carried out for the parent body 

## Councillors & Other Decision-Makers Benchmarking Data Can Be Used To Grab Attention! Statistics Go Down Well, But Make A Simple Statement, Such As 'Archives Users Up By 10%' Some Key Things To Bear In Mind:

- Be accurate - make sure the data can be substantiated - Be clear about why you are communicating the information and 
what you expect as a result 
- Be concise - politicians are presented with a lot of facts so make 
yours stand out, it needs to bite-sized and memorable
- Make it personal approach - tailor message to their 
individual interest or give it a local constituency focus
Funders Benchmarking data is good for demonstrating 
'how many' or 'how much' 
Doesn't illustrate benefit to the individual, community or place, so supplement with user testimony, surveys and interviews Funders are likely to require additional reporting  
measures

## Commissioners

Archives can to contribute to wider outcomes and a range of local priorities You need to have an understanding of your unit costs It helps to compare the proposed activity with alternative interventions or describe the proxy savings

## Media Benchmarking Data Is A Great 'Hook' For Media Communications Use A Key Fact Such As An Increase In User Numbers Or The Financial Value Of Your Volunteers Then Enrich With Narrative:

- How did you achieve the increase - new 
service/exhibition?
- How does volunteering bring the community together? - What did the users enjoy/learn/benefit?

## Summary

Benchmarking data will provide a bedrock of 
evidence 
Basic principles of using your Benchmarking 
data for advocacy: 
•Know what message(s) you want to get across •Concentrate on delivering few key points well 
•Be clear about what Benchmarking data can and 
can't do 
•Be sure of your conclusions
# Evaluation - A

## Powerful Tool For Learning What Is Evaluation? A Structured Way Of Thinking About What Happens And Why Evaluation Is Based On The Following Ideas

- Evaluation involves making judgements, based on 
evidence, about the value and quality of a project 
- Evaluation is open and clear and involves all 
partners, including the people taking part 
- Evaluation helps with decision-making during a 
project and for future projects 
Why evaluate? 

Evaluation has two main purposes: 
- to improve practice during the project and for 
future projects 
- to show what happened as a result of a 
project

## It Can Be Simple Or Complex Internal Assessment Or External Evaluator Five Stages Of Evaluation

# Stage 1 - Planning To Evaluate

## Think About Evaluation At The Beginning And Include In The Project Schedule/Project Budget Set Clear Aims, Objectives And Measures Of Success To Inform The Evaluation Consider:

- Who will have overall responsibility for evaluation? - Who else will have a role in collecting evidence?
- How much will evaluation cost in time and money?
- How will you collect the evidence you need? - When will you review the project? 

## Stage 2 - Collecting Evidence

Collect evidence before, during and at the end of a project This will help establish a baseline and enable you to illustrate change The evidence collected should help you judge if the aims and objectives have been achieved and capture any unplanned outcomes Quantitative and qualitative evidence 

## Stage 2 - Choose The Right Methods

- Will the methods meet funders' requirements? 
- Flexible enough to reveal unexpected outcomes? 
- Are they 'user friendly' for everyone taking part? 
- Do they take account of equal opportunities, ethical and 
safeguarding issues for CYP and vulnerable adults? - Will evidence be likely to give different points of view? - Can evidence be collected without disrupting project? - Do you have the resources to manage the chosen 
methods?

## Pros & Cons Of Evaluation Methods

Comments' boxes and books
Questionnaires
Small group discussions 
Individual interviews Recordings
Displays at the end of a project
Observation
Online websites/chatrooms
Photograhy

## Stage 3 - Interpreting And Analysing Turning Raw Data Into Evidence Can Be Time Consuming Quantitative - Survey Monkey And Similar Speed This Up Qualitative Evidence May Not Be As Easy To Interpret The Following Techniques May Help You: - Look Back At Your Original Measures Of Success To Help Pick Out

what you need
- Initially sort comments into positive and negative groups - Check that your judgements are based on evidence from the range 
of people involved with the project
- Focus on evidence which shows change, progress and development
- Try to establish the majority view - Look for unexpected outcomes
- 'Quotable quotes'

## Stage 4 - Reflecting & Moving Forwards A Meeting At The End Of The Project Should Not Be The End Of The Evaluation Process!

- What were the key findings from the evaluation for the archive 
service and/or for other partners?
- How can strengths and opportunities be built on? - How can weaknesses be reduced? - Is the project likely to have longer-term outcomes, as yet 
unknown? If so, how will you find out about them? Are they likely to be significant for future work?
- What decisions and changes should now be made?

## Stage 5 - Reporting & Sharing

A written project report is useful for:

•
building up organisational knowledge s
•
sharing ideas and good practice with others
•
helping with future funding applications
•
showing people what you do

## Other Ways Of Reporting May Be More Appropriate? In Presenting The Evidence Consider Safeguarding And Confidentiality Issues Remember To Share Finding With Participants! Stage 5 - Written Reports Avoid The Pitfall Of Too Much Description And Not Enough Analysis, Conclusions And Future Action Points

•
aim to make your report as short as possible
•
use tables and bullet points to summarise
•
remember that photographs/diagrams save on words

## And Keep Asking These Questions:

Are we just telling the story of the project?
Have we interpreted the evidence?
Are future recommendations based on conclusions?