USA Banner
  U.S. flag
              An official website of the United States government Here's how you knowOfficial US Government Icon
              **Official websites use .gov**A **.gov** website belongs to an official government organization in the United States.
            Secure Site Icon
              **Secure .gov websites use HTTPS**
                  A **lock** ( A locked padlock ) or **https://** means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites. 
 U.S. Department of Transportation Icon United States Department of Transportation
 Search DOT
            Search
                    About FHWAFHWA Organization
                Headquarters Offices
                Field Offices
                Strategic Plan
                Business Opportunities
                Staff Directories
                Careers
                Highway History
                Contact UsProgramsAcquisition Management
                Civil Rights
                Federal Lands Highway
                Infrastructure
                Innovative Program Delivery
                Operations
                Planning, Environment, and Realty
                Policy
                Research, Development, and Technology
                Safety
                Browse by TopicsResourcesCore Highway Topics
                Federal Aid Essentials
                Automation
                Complete Streets
                Laws and Regulations
                Policy & Guidance Center
                Section 508
                Publications and Statistics
                Professional Development
                National Highway Institute
                Resource Center
                Accessibility Resource Library
                FHWA Research LibraryNewsroomPress Releases
                Speeches & Testimony
                Photos
                Videos
                Media ContactsMenu FHWA Highway Safety Programs Home
                        SHSP Evaluation Process Model


            
            In This Section
        Highway Safety Improvement Program (HSIP)
                                Overview
                About
                Planning
                Implementing
                Evaluating
                Reporting
                Noteworthy Practices
                Legislation and Guidance
                Resources
                HSIP Special Rules
                Strategic Highway Safety Plan (SHSP)
                                Overview
                About
                Develop
                Implement
                Evaluate
                Promote
                Legislation and Guidance
                Resources
                Noteworthy Practices
                Safety Performance Measure
                                Overview
                State Safety Performance Targets
                Policy & Guidance
                Fact Sheets & Informational Webinars
                Target-Setting Resources
                Safety Data Resources
                State Safety Reports
                Safety Contacts
                Technical Assistance & Training
                Railway Highway Crossing Program
                                Overview
                Policy and Guidance
                Resources
                
                Checklists, Worksheets, and Self Assessment Questions
shsp_epm_checklists_worksheets.pdf (308.51 KB)


Chapter 1 – Evaluation Planning Checklist

The following checklist is designed to support evaluation planning. If most or all of these activities are completed, the State is prepared for SHSP evaluation.

Identify evaluation objectives.
	Identify the data needed to address the objectives and perform the evaluation.
	Determine if existing data collection strategies are sufficient for evaluation.
	Identify resources needed to collect data or adjust evaluation objectives if available data are insufficient for evaluation purposes.
	Assign responsibility for generating and distributing evaluation results.
	Document a reporting process to update agencies, partners, and decision-makers on SHSP evaluation results.
	Determine how evaluation results will be applied.
	Document the approach or plan for the evaluation.Strategic Highway Safety Plan Evaluation Process Model Worksheet – Chapter 2

Process Evaluation – Getting on the Right Track

Column Descriptions

**As evidenced by:** What is the evidence for the yes (or the no) answer?

**What is the Impact:** What impact, positive or negative, is this having on our SHSP process?

**Opportunities:** How can we improve our efforts with respect to this question?

**Action Items:** What steps will we take to improve our process, when should the steps be completed, and who is responsible for completing them?

The elements examined in process evaluation are: **SHSP organizational structure; multidisciplinary, multimodal collaboration; goal and target setting methods; data driven and evidence-based emphasis areas, strategies, and actions; and aligning agency priorities.** For each of these elements the primary question driving the evaluation is:

What will it take to convince us our programs/
strategies/actions/investments are on the right track?

The questions below will help determine the effectiveness of current process evaluation efforts and identify areas for improvement. The EPM is based on noteworthy practices and current research and is general in nature. States should feel free to add to or modify these questions to fit their particular situation.

SHSP Organizational
			Structure Questions
			Yes/No
			As evidenced by (observations)
			What is the impact
			(positive or negative)?
			Opportunities
			Action Items1. Is the SHSP process supported by an actively engaged organizational structure?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell2. Are top-level managers represented in executive committees or leadership structures/groups established for the SHSP?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell3. Do members of the executive committee or leadership group have the decision-making authority needed to effectively support the SHSP process?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell4. Do members of the executive committee or leadership group assign persons with decision-making authority to the steering committee or working group?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell5. Are multiple transportation modes represented, and do they actively participate on the steering committee/working groups and emphasis area teams?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell6. Has an SHSP program coordinator or manager been assigned? What percentage of this person’s time is dedicated to the SHSP?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell7. Do the leadership and working groups/committees meet as frequently as expected?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell8. Are emphasis areas supported by teams with engaged leaders?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cellMultidisciplinary and Multimodal Collaboration Questions
			Yes/No
			As evidenced by (observations)
			What is the impact
			(positive or negative)?
			Opportunities
			Action Items1. Are members of the executive or leadership group, the steering committee, the emphasis area teams, and other groups multidisciplinary and multimodal?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell2. Are local/regional/district coalitions supported by the SHSP organizational structure?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell3. Are the necessary disciplines, modes, and agencies (representing the 4 E’s) engaged in SHSP decision-making and implementation?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell4. Do the stakeholders regularly collaborate on decisions that affect SHSP updates and implementation?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell5. Do the necessary stakeholders collaborate and jointly decide on SHSP goal and objective setting methods?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cellGoal- and Objective-Setting Methods Questions
			Yes/No
			As evidenced by (observations)
			What is the impact
			(positive or negative)?
			Opportunities
			Action Items1. Are data-driven methods, such as trend analysis, used to establish goals and set aggressive, yet achievable objectives?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell2. Are objectives and goals specific, measurable, time bound, and realistic?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cellData-Driven and Evidence-Based Emphasis Areas, Strategies, and Actions Questions
			Yes/No
			As evidenced by (observations)
			What is the impact
			(positive or negative)?
			Opportunities
			Action Items1. Is data analysis used to select the emphasis areas?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell2. Are the emphasis area strategies selected through an evidence based process?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell3. Are promising and innovative strategies with less evidence of effectiveness accompanied by an evaluation?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cellAligning Agency Priorities Questions
			Yes/No
			As evidenced by (observations)
			What is the impact
			(positive or negative)?
			Opportunities
			Action Items1. Have the various agencies and safety partners incorporated elements of the SHSP into their planning documents? (HSPs, HSIPs, CVSPs, LRTPs, S/TIPs, etc.)
			empty cell
			empty cell
			empty cell
			empty cell
			empty cellAction Item Summary

SHSP Organizational Structure – Action Items
			Deadline
			Responsible Person1.
			empty cell
			empty cell2.
			empty cell
			empty cell3.
			empty cell
			empty cell4.
			empty cell
			empty cell5.
			empty cell
			empty cell6.
			empty cell
			empty cellMultidisciplinary and Multimodal Collaboration – Action Items
			Deadline
			Responsible Person1.
			empty cell
			empty cell2.
			empty cell
			empty cell3.
			empty cell
			empty cell4.
			empty cell
			empty cell5.
			empty cell
			empty cell6.
			empty cell
			empty cellGoal- and Objective-Setting Methods – Action Items
			Deadline
			Responsible Person1.
			empty cell
			empty cell2.
			empty cell
			empty cell3.
			empty cell
			empty cell4.
			empty cell
			empty cell5.
			empty cell
			empty cell6.
			empty cell
			empty cellData-Driven and Evidence-Based Emphasis Areas, Strategies, and Actions – Action Items
			Deadline
			Responsible Person1.
			empty cell
			empty cell2.
			empty cell
			empty cell3.
			empty cell
			empty cell4.
			empty cell
			empty cell5.
			empty cell
			empty cell6.
			empty cell
			empty cellAligning Agency Priorities – Action Items
			Deadline
			Responsible Person1.
			empty cell
			empty cell2.
			empty cell
			empty cell3.
			empty cell
			empty cell4.
			empty cell
			empty cell5.
			empty cell
			empty cell6.
			empty cell
			empty cell

Chapter 2 – Self Assessment Questions

The following self assessment questions are designed to inform process evaluation. Answering “yes” to a question indicates the State has a well functioning SHSP process in that area of review. Answering “no” indicates improvements can be made.

Is the SHSP process supported by an actively engaged organizational structure?
	Are top-level managers represented in executive committees or leadership structures/groups established for the SHSP?
	Are members of the executive or leadership group, the steering committee, the emphasis area teams, and other groups multidisciplinary and multimodal?
	Do members of the executive committee or leadership group have the decision-making authority needed to effectively support the SHSP process?
	Do members of the executive committee or leadership group assign persons with decision-making authority to the steering committee or working group?
	Are multiple transportation modes represented, and do they actively participate on the steering committee/working group and emphasis area teams?
	Has a SHSP program coordinator or manager been assigned? What percentage of this person’s time is dedicated to the SHSP?
	Do the leadership and working groups/committees meet as frequently as expected?
	Are emphasis areas supported by teams with engaged leaders?
	Are local/regional/district coalitions supported by the SHSP organizational structure?
	Are the necessary disciplines, modes, and agencies (representing the 4 E’s) engaged in SHSP decision-making and implementation?
	Do the stakeholders regularly collaborate on decisions that affect SHSP updates and implementation?
	Do the necessary stakeholders collaborate and jointly decide on SHSP goal and target setting methods?
	Are data-driven methods, such as trend analysis, used to establish goals and set aggressive, yet achievable, objectives?
	Are objectives specific, measurable, time bound, and realistic?
	Is data analysis used to select the emphasis areas?
	Are the emphasis area strategies selected through an evidence-based process?
	Are promising and innovative strategies with less evidence of effectiveness accompanied by an evaluation?
	Have the various agencies and safety partners incorporated elements of the SHSP into their planning documents? (HSPs, HSIPs, CVSPs, LRTPs, S/TIPs, etc.)Strategic Highway Safety Plan Evaluation Process Model Worksheet – Chapter 3

Performance Evaluation – Outputs and Outcomes

Column Descriptions

**As evidenced by:** What is the evidence for the yes (or the no) answer?

**What is the Impact:** What impact, positive or negative, is this having on our SHSP process?

**Opportunities:** How can we improve our efforts with respect to this question?

**Action Items:** What steps will we take to improve our process, when should the steps be completed, and who is responsible for completing them?

Performance evaluation is comprised of: output evaluation and outcome evaluation. For each of these areas the primary question driving the evaluation is:

What will it take to convince us our programs/
strategies/actions/investments are getting us where we need to be?

The questions below will help determine the effectiveness of current performance evaluation efforts and identify areas for improvement. The EPM is based on noteworthy practices and current research and is general in nature. States should feel free to add to and/or modify these questions to fit their particular situation.

Performance Evaluation Questions
			Yes/No
			As evidenced by (observations)
			What is the impact
			(positive or negative)?
			Opportunities
			Action Items1. Has the current status of all output and outcome performance measures been gathered and reviewed?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell2. Are the performance measures clearly related to SHSP goals and objectives?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell3. Are the numbers and rates of fatalities and serious injuries used as general statistical measures?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell4. Are the numbers and rates of fatalities and serious injuries tracked and reported by emphasis area and compared to previously set objectives?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell5. Have fatality and serious injury objectives been met?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell6. Are observation and/or telephone survey data collected and analyzed to track changes in awareness, attitudes, and behaviors?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell7. Have awareness, attitude, and behavior objectives been met?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell8. Are program-level benefit/cost analyses conducted on certain SHSP programs?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cell9. Have the benefits of the program(s) outweighed the costs?
			empty cell
			empty cell
			empty cell
			empty cell
			empty cellAction Item Summary

SHSP Organizational Structure – Action Items
			Deadline
			Responsible Person1.
			empty cell
			empty cell2.
			empty cell
			empty cell3.
			empty cell
			empty cell4.
			empty cell
			empty cell5.
			empty cell
			empty cell6.
			empty cell
			empty cell

Chapter 3 – Self-Assessment Questions

The following self-assessment questions are designed to inform performance evaluation. Answering “yes” to a question indicates the State’s SHSP has been effective or successful in this area of performance evaluation. Answering “no” indicates improvements can be made.

Has the current status of all output and outcome performance measures been gathered and reviewed?
	Are the performance measures clearly related to SHSP goals and objectives?
	Are the numbers and rates of fatalities and serious injuries used as general statistical measures?
	Are the numbers and rates of fatalities and serious injuries tracked and reported by emphasis area and compared to previously set objectives?
	Have fatality and serious injury objectives been met?
	Are observation and/or telephone survey data collected and analyzed to track changes in awareness, attitudes, and behaviors?
	Have awareness, attitude, and behavior objectives been met?
	Are program-level benefit/cost analyses conducted on certain SHSP programs?
	If so, have the benefits of the program(s) outweighed the costs?Chapter 4 – The Focus is Results Checklist

The following checklist is designed to support the use of evaluation results. If an action on the checklist is in progress or completed, the State is well on the way to using evaluation results to improve the SHSP process and performance.

Evaluation results have been interpreted and documented.
	Evaluation results were reviewed to identify lessons learned.
	Lessons learned have been used to improve SHSP process and performance.
	SHSP stakeholders are made aware of both successful and unsuccessful programs and strategies as soon as sufficient information is available.
	Evaluation results are being used to increase public understanding of SHSP programs and strategies.
	Evaluation results are being used to help inform elected and appointed officials so they might support increased funding and resources for safety programs and strategies.
	Evaluation results are being used to identify additional safety leaders and partners.
	Evaluation results that identify gaps and weaknesses in SHSP process or performance are being addressed through follow-up actions.
	Evaluation results are used to direct resources to areas with the highest probability of improving safety.
      
  Book traversal links for Checklists, Worksheets, and Self Assessment Questions
      ‹ Recommended Actions
                    Up
                
                Book:SHSP Evaluation Process Model
              Chapter 1 – Planning for Evaluation: Getting Started
                Chapter 2 – Process Evaluation: Getting on the Right Track
                Chapter 3 – Performance Evaluation: Outputs and Outcomes
                Chapter 4 – Using Evaluation: The Focus is Results
                Conclusion
                Appendix – EPM Worksheets
                Recommended Actions
                Checklists, Worksheets, and Self Assessment Questions U.S. DEPARTMENT OF TRANSPORTATION

**Federal Highway Administration**

1200 NEW JERSEY AVENUE, SE

WASHINGTON, DC 20590

202-366-4000Subscribe to email updates
                    About
  

        
              About FHWA
                Careers
                Org Chart
                Staff Directories
                Work with UsPrograms
  

        
              Acquisition Management
                Civil Rights
                Federal Lands Highway
                Infrastructure
                Innovative Program Delivery
                Operations
                Planning, Environment, and Realty
                Policy
                Research, Development, and Technology
                SafetyPolicies, Rights, Legal
  

        
              About DOT
                Accessibility
                Budget and Performance
                Civil Rights
                FOIA
                Information Quality
                No FEAR Act
                Office of Inspector General
                Privacy Policy
                USA.gov
                Web Policies and Notices
                Web StandardsNews & Events
  

        
              Newsroom
                Press Releases
                Speeches & Testimony
                Media Contacts
                Connect with Us