1

Chapter 1 – Evaluation Planning 

Checklist

The following checklist is designed to support evaluation planning. If most or all of these activities are completed, the State is prepared for SHSP evaluation.

1. Identify evaluation objectives.

2. Identify the data needed to address the objectives and perform 

the evaluation.

3. Determine if existing data collection strategies are sufficient for evaluation.

4. Identify resources needed to collect data or adjust evaluation objectives if available data are insufficient 

for evaluation purposes.

5. Assign responsibility for generating and distributing evaluation results.

6. Document a reporting process to update agencies, partners, and 

decision-makers on SHSP evaluation results.

7. Determine how evaluation results will be applied.

8. Document the approach or plan for the evaluation.
2

Strategic Highway Safety Plan

Evaluation Process Model

Worksheet – Chapter 2

The elements examined in process evaluation are: Process Evaluation – Getting on the Right Track

SHSP organizagoal and objective setting methods; data driven and evi tional structure; multidisciplinary, multimodal collaboration; -

aligning agency priorities. dence-based emphasis areas, strategies, and actions; and 

 For each of these elements the primary 

Wquestion driving the evaluation is:

hat will it take to convince us our programs

strategies/actions/investments are on the right track?their particular situation. nature. States should feel free to add to or modify these questions to fit based on noteworthy practices and current research and is general in process evaluation efforts and identify areas for improvement. The EPM is The questions below will help determine the effectiveness of current 

Column DescriptionAs evidenced by: What is the evidence for the yes (or the What is the Impact:no) answer?

 What impact, positive or negative, is 

Opportunities: this having on our SHSP process?

 How can we improve our efforts with 

Action Items:respect to this question?

 What steps will we take to improve our 

responsible for completing them? process, when should the steps be completed, and who is 

Structure QuestionsSHSP Organizational 

Yes/No

As evidenced by 

(observations)

What is the 

impact (positive 

or negative)? Opportunities Action Items

1.

by an actively engaged orgaIs the SHSP process supported 

-

nizational structure?
3

SHSP Organizational Structure Questions Yes/No

As evidenced by 

(observations)

What is the 

impact (positive 

or negative)? Opportunities Action Items

2. Are top-level managers 

represented in executive committees or leadership structures/groups established for the SHSP?

3. Do members of the executive committee or leadership 

group have the decisionmaking authority needed to effectively support the SHSP process?

4. Do members of the executive committee or leadership 

group assign persons with decision-making authority to the steering committee or working group?

5. Are multiple transportation 

modes represented, and do they actively participate on the steering committee/working groups and emphasis area teams?
4

Structure QuestionsSHSP Organizational 

Yes/No

As evidenced by 

(observations)

What is the 

impact (positive 

or negative)? Opportunities Action Items

6. Has a SHSP program coorassigned? What percent dinator or manager been -

age of this person’s time is the SHSP?dedicated to 

7. Do the leadership and workas frequently as expected? ing groups/committees meet 8. Are emphasis areas supportleaders? ed by teams with engaged 

QuestionsMultimodal Collaboration Multidisciplinary and 

Yes/No

As evidenced by 

(observations)

What is the 

impact (positive 

or negative)? Opportunities Action Items

1. Are members of the execusteering committee, the em tive or leadership group, the -

multimodal?groups multidisciplinary and phasis area teams, and other 
5

Multidisciplinary and Multimodal Collaboration Questions Yes/No

As evidenced by 

(observations)

What is the 

impact (positive 

or negative)? Opportunities Action Items

2. Are local/regional/district 

coalitions supported by the SHSP organizational structure? 

3. Are the necessary disciplines, 

modes, and agencies (representing the 4 E’s) engaged in SHSP decision-making and implementation? 

4. Do the stakeholders regularly 

collaborate on decisions that affect SHSP updates and implementation?

5. Do the necessary stakeholders 

collaborate and jointly decide on SHSP goal and objectivesetting methods?
6

QuestionsSetting MethodsGoal- and ObjectiveYes/No As evidenced by (observations) What is the impact (positive or negative)? Opportunities Action Items

1.

objectives?aggressive, yet achievable to establish goals and set such as trend analysis, used Are data-driven methods, 

2. Are objectives specific, mearealistic? surable, time bound, and 

Data-Driven and EviAreas, Strategies, and Ac dence-Based Emphasis -tions Questions Yes/No

As evidenced by 

(observations)

What is the 

impact (positive 

or negative)? Opportunities Action Items

1.

select the emphasis areas?Is data analysis used to 

2. Are the emphasis area stratevidence based process? egies selected through an 3.

of effectiveness accompastrategies with less evidence Are promising and innovative 

-

nied by an evaluation? 
7

Aligning Agency Priorities Questions Yes/No

As evidenced by 

(observations)

What is the 

impact (positive 

or negative)? Opportunities Action Items

1. Have the various agencies 

and safety partners incorporated elements of the SHSP into their planning documents? (HSPs, HSIPs, CVSPs, LRTPs, S/TIPs, etc.)
8

Action Item Summary

SHSP Organizational Structure – Action Items Deadline Responsible PersonMultidisciplinary and Multimodal Collaboration

6.5.4.3.2.1.

– Action Items Deadline Responsible Person

6.5.4.3.2.1.
9

Goal- and Objective-Setting Methods – Action Items Deadline Responsible Person

1.2.3.4.5.6.

Data-Driven and Evidence-Based Emphasis Areas, Strategies, and Actions – Action Items Deadline Responsible Person

1.2.3.4.5.6.
10

Aligning Agency Priorities – Action Items Deadline Responsible Person

6.5.4.3.2.1.
11

Chapter 2 – Self Assessment Questions

The following self assessment questions are designed to inform process evaluation. Answering “yes” to a 

question indicates the State has a well functioning SHSP process in that area of review. Answering “no”

indicates improvements can be made.

1. Is the SHSP process supported by an actively engaged 

organizational structure?

2. Are top-level managers represented in executive committees or leadership structures/groups established 

for the SHSP?

3. Are members of the executive or leadership group, the steering committee, the emphasis area teams, and 

other groups multidisciplinary and multimodal?

4. Do members of the executive committee or leadership group have the decision-making authority needed 

to effectively support the SHSP process?

5. Do members of the executive committee or leadership group assign persons with decision-making authority to the steering committee or working group?

6. Are multiple transportation modes represented, and do they actively participate on the steering committee/working group and emphasis 

area teams?

7. Has an SHSP program coordinator or manager been assigned? What percentage of this person’s time is 

dedicated to the SHSP?

8. Do the leadership and working groups/committees meet as frequently 

as expected?

9. Are emphasis areas supported by teams with engaged leaders?

10. Are local/regional/district coalitions supported by the SHSP organizational structure?

11. Are the necessary disciplines, modes, and agencies (representing the 

4 E’s) engaged in SHSP decision-making and implementation?

12. Do the stakeholders regularly collaborate on decisions that affect SHSP updates and implementation?

13. Do the necessary stakeholders collaborate and jointly decide on SHSP goal and objective setting 

methods?

14. Are data-driven methods, such as trend analysis, used to establish goals and set aggressive, yet achievable, objectives?

15. Are objectives specific, measurable, time bound, and realistic?
12

16. Is data analysis used to select the emphasis areas?

17. Are the emphasis area strategies selected through an evidence-based process?

18. Are promising and innovative strategies with less evidence of effectiveness accompanied by an 

evaluation?

19. Have the various agencies and safety partners incorporated elements of the SHSP into their planning 

documents? (HSPs, HSIPs, CVSPs, LRTPs, 

S/TIPs, etc.)
13

Performance Evaluation Questions Yes/No

As evidenced by 

(observations)

What is the 

impact (positive 

or negative)? Opportunities Action Items

1. Has the current status of all 

output and outcome performance measures been gathered and reviewed?

Strategic Highway Safety Plan

Evaluation Process Model

Worksheet – Chapter 3

Process Evaluation – Getting on the Right TrackThe elements examined in process evaluation are: SHSP organizational structure; multidisciplinary, multimodal collaboration; goal and objective setting methods; data driven and evidence-based emphasis areas, strategies, and actions; and aligning agency priorities. For each of these elements the primary question driving the evaluation is:What will it take to convince us our programsstrategies/actions/investments are on the right track?The questions below will help determine the effectiveness of current process evaluation efforts and identify areas for improvement. The EPM is based on noteworthy practices and current research and is general in nature. States should feel free to add to or modify these questions to fit their particular situation. 

Column DescriptionAs evidenced by: What is the evidence for the yes (or the no) answer?What is the Impact: What impact, positive or negative, is this having on our SHSP process?Opportunities: How can we improve our efforts with respect to this question?Action Items: What steps will we take to improve our process, when should the steps be completed, and who is responsible for completing them? 
14

Evaluation QuestionsPerformance 

Yes/No

As evidenced by 

(observations)

What is the 

impact (positive 

or negative)? Opportunities Action Items

2.

SHSP goals and objectives?measures clearly related to Are the performance 

3.

statistical measures?injuries used as general of fatalities and serious Are the numbers and rates 

4.

of fatalities and serious injuAre the numbers and rates 

-

emphasis area and comries tracked and reported by 

-

set objectives?pared to previously 

5.

injury objectives been met?Have fatality and serious 

6.

track changes in awarecollected and analyzed to or telephone survey data Are observation and/

-

behaviors?ness, attitudes, and 

7.

been met?and behavior objectives Have awareness, attitude, 
15

Performance Evaluation Questions Yes/No

As evidenced by 

(observations)

What is the 

impact (positive 

or negative)? Opportunities Action Items

8. Are program-level benefit/ 

cost analyses conducted on certain SHSP programs?

9. Have the benefits of the 

program(s) outweighed the costs?
16

Action Item Summary

SHSP Organizational Structure – Action Items Deadline Responsible Person

10.9.8.7.6.5.4.3.2.1.
17

Chapter 3 – Self-Assessment Questions

The following self-assessment questions are designed to inform performance evaluation. Answering “yes” to a 

question indicates the State’s SHSP has been effective or successful in this area of performance evaluation. 

Answering “no” indicates improvements can be made.

1. Has the current status of all output and outcome performance measures been gathered and reviewed?

2. Are the performance measures clearly related to SHSP goals and objectives?

3. Are the numbers and rates of fatalities and serious injuries used as general statistical measures?

4. Are the numbers and rates of fatalities and serious injuries tracked and reported by emphasis area and 

compared to previously set objectives?

5. Have fatality and serious injury objectives been met?

6. Are observation and/or telephone survey data collected and analyzed to track changes in awareness, 

attitudes, and behaviors? 

7. Have awareness, attitude, and behavior objectives been met?

8. Are program-level benefit/cost analyses conducted on certain 

SHSP programs?

•	 If so, have the benefits of the program(s) outweighed the costs?
18

Chapter 4 – The Focus is Results

Checklist

The following checklist is designed to support the use of evaluation results. If an action on the checklist is in 

progress or completed, the State is well on the way to using evaluation results to improve the SHSP process 

and performance.

•	 Evaluation results have been interpreted and documented.

•	 Evaluation results were reviewed to identify lessons learned.

•	 Lessons learned have been used to improve SHSP process and performance.

•	 SHSP stakeholders are made aware of both successful and unsuccessful programs and strategies as soon 

as sufficient information is available.

•	 Evaluation results are being used to increase public understanding of SHSP programs and strategies.

•	 Evaluation results are being used to help inform elected and appointed officials so they might support 

increased funding and resources for safety programs and strategies.

•	 Evaluation results are being used to identify additional safety leaders 

and partners.

•	 Evaluation results that identify gaps and weaknesses in SHSP process or performance are being addressed 

through follow-up actions.

•	 Evaluation results are used to direct resources to areas with the highest probability of improving safety.