USA Banner
  U.S. flag
              An official website of the United States government Here's how you knowOfficial US Government Icon
              **Official websites use .gov**A **.gov** website belongs to an official government organization in the United States.
            Secure Site Icon
              **Secure .gov websites use HTTPS**
                  A **lock** ( A locked padlock ) or **https://** means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites. 
 U.S. Department of Transportation Icon United States Department of Transportation
 Search DOT
            Search
                    About FHWAFHWA Organization
                Headquarters Offices
                Field Offices
                Strategic Plan
                Business Opportunities
                Staff Directories
                Careers
                Highway History
                Contact UsProgramsAcquisition Management
                Civil Rights
                Federal Lands Highway
                Infrastructure
                Innovative Program Delivery
                Operations
                Planning, Environment, and Realty
                Policy
                Research, Development, and Technology
                Safety
                Browse by TopicsResourcesCore Highway Topics
                Federal Aid Essentials
                Automation
                Complete Streets
                Laws and Regulations
                Policy & Guidance Center
                Section 508
                Publications and Statistics
                Professional Development
                National Highway Institute
                Resource Center
                Accessibility Resource Library
                FHWA Research LibraryNewsroomPress Releases
                Speeches & Testimony
                Photos
                Videos
                Media ContactsMenu FHWA Highway Safety Programs Home
                        SHSP Evaluation Process Model


            
            In This Section
        Highway Safety Improvement Program (HSIP)
                                Overview
                About
                Planning
                Implementing
                Evaluating
                Reporting
                Noteworthy Practices
                Legislation and Guidance
                Resources
                HSIP Special Rules
                Strategic Highway Safety Plan (SHSP)
                                Overview
                About
                Develop
                Implement
                Evaluate
                Promote
                Legislation and Guidance
                Resources
                Noteworthy Practices
                Safety Performance Measure
                                Overview
                State Safety Performance Targets
                Policy & Guidance
                Fact Sheets & Informational Webinars
                Target-Setting Resources
                Safety Data Resources
                State Safety Reports
                Safety Contacts
                Technical Assistance & Training
                Railway Highway Crossing Program
                                Overview
                Policy and Guidance
                Resources
                
                Recommended Actions
shsp_epm_recommended_actions.pdf (167.53 KB)


Chapter 1 – Planning for Evaluation: Getting Started

Identify Evaluation Objectives – Recommended Actions

Determine the SHSP process and performance areas to evaluate.
	Identify the resources needed to conduct the evaluation.
	Develop evaluation objectives for assessing the SHSP process.
	Develop evaluation objectives for assessing SHSP performance (outputs and outcomes).
	Circulate the objectives and resource requirements among SHSP decision-makers to obtain their support.Review Methods for Data Collection and Management – Recommended Actions

Review the existing data collection and management methods to determine the following:
	Quality data are available to track progress and answer the evaluation questions;
		Resources are available to collect data not currently available; and
		Objectives for which no evaluation data are available are reconsidered or modified.
	Review the tracking mechanism(s) in place to determine:
	Where the information can be obtained and what is captured (e.g., implementation status of SHSP strategies and actions, number and rates of fatalities and serious injuries, etc.).
		If information needed for the evaluation is not formally tracked, can a mechanism be put in place or information gathered using an alternative method?Determine How to Measure Progress – Recommended Actions

Review the existing SHSP performance measures and categorize them as (in descending order of importance):

	Primary outcome;
		Secondary outcome;
		Self reporting;
		Attitudinal;
		Awareness; or
		Activity level.Chapter 2 – Process Evaluation: Getting on the Right Track

Identify Process Evaluation Elements: SHSP Organizational Structure – Recommended Actions

Review the SHSP organizational structure to identify and document its format and functions(s).
	Examine the positions of persons serving on SHSP committees (e.g., steering and executive committees), as well as emphasis area and local/regional/district teams to determine their contribution to the SHSP process and access to leadership and resources.
	Review the schedule of SHSP leadership and committee meetings to determine if they meet as frequently as planned or needed.
	Review the SHSP organizational structure to determine the level of support provided to partners in local and regional coalitions.
	Review the role and function of SHSP committees, teams, and/or groups. Compare these current roles and functions with the expectations set at the beginning of the SHSP process.Identify Process Evaluation Elements: Multidisciplinary, Multimodal Collaboration – Recommended Actions

Review the membership of the various committees, emphasis area action teams, task forces, etc. to assess the degree to which multiple disciplines and modes are represented and actively involved.
	Determine if mechanisms are in place that facilitate an active, efficient collaborative process, such as MOUs.
	Review the planning documents of the various agencies and safety partners to discern how well they reflect elements of the SHSP, such as the goals, objectives, and strategies.
	Determine if the SHSP vision, mission, and goals are clearly and continually communicated to all partners and stakeholders.Identify Process Evaluation Elements: Goal and Objective Setting Methods – Recommended Actions

Review the analysis methods used to set objectives. Are they data driven?
	Determine if objectives are specific, measurable, time bound, and realistic.Identify Process Evaluation Elements: Data-Driven and Evidence-Based Emphasis Area Strategies and Actions – Recommended Actions

Review methods used for identifying safety problems and selecting emphasis areas. Determine whether safety data analysis was the primary input to problem identification and emphasis area selection.
	Determine whether the latest safety data and research was used to identify evidence based strategies and actions.
	Identify strategies in the SHSP that may lack a preponderance of evidence of effectiveness. Determine if there was enough information or evidence (e.g., success in another State) to justify its use, or if an evaluation was conducted to validate the use of the strategy.Identify Process Evaluation Elements: Aligning Agency Priorities – Recommended Actions

Review the HSP, CVSP, HSIP, LRTP, and S/TIPs to determine the degree to which they align with the SHSP.
	Review other plans, e.g. pedestrian/bicycle plans, corridor plans, local road plans, etc., to determine the degree to which their goals and strategies align with the SHSP.Process Evaluation Activities – Recommended Actions

Review the possible methods to collect process evaluation information. Identify the pros and cons of each method.
	Determine and document the most appropriate method and the rationale for the selection.Include the higher level performance measures (e.g., primary outcomes) in the evaluation if data are available (to answer the evaluation objectives) and consider other, more attainable measures if they are not available.Identify and Secure Resources – Recommended Actions

Identify available resources to support SHSP evaluation.
	Identify individuals or agencies with the skills to analyze data and other information and provide evaluation support.
	Explore the availability of universities, professors/graduate students, and others if extra help or expertise is needed.
	Collect information on current evaluation efforts among the partners, e.g. CVSP, HSP, etc.
	Determine a timeframe for conducting SHSP evaluation.Assign Evaluation Roles and Responsibilities – Recommended Actions

Determine the agency responsible for coordinating the overall program evaluation effort.
	Identify the individual(s) who will manage the evaluation effort, collect and analyze data, and report the evaluation results.Report and Use Evaluation Results – Recommended Actions

Identify the parties responsible for generating the evaluation results.
	Assign a lead person to pull together the results from the various parties and distribute them to the appropriate committees, agencies, etc.
	Determine who will receive the results of the evaluation, i.e., agency executives, Steering Committee members, all stakeholders, etc.
	Decide how the results will be formatted, i.e., formal reports, spreadsheets, PowerPoint presentations, etc.
	Identify how the evaluation results will be used.Document Evaluation Approach – Recommended Actions

Document the evaluation elements (objectives, data needs, resources, roles and responsibilities, application methods, etc.) to formalize the process.Chapter 3 – Performance Evaluation: Outputs and Outcomes

Performance Evaluation – Recommended Actions

Assemble data for assessing output and outcome performance measures.
	Identify missing data which may prevent assessment of performance measures.
	Determine if other performance measures can be used to determine progress.
	Document baseline data.
	Determine the output and outcome measures for each SHSP emphasis area.
	Compare output performance measures with baseline data.
	Compare outcome performance measures with baseline data.
	Compare observation and/or telephone survey results to measure changes in awareness, attitudes, and behaviors.
	Collect and review the data available for benefit/cost analyses.
	Conduct program level benefit/cost analyses where feasible.
      
  Book traversal links for Recommended Actions
      ‹ Appendix – EPM Worksheets
                    Up
                    Checklists, Worksheets, and Self Assessment Questions ›
                
                Book:SHSP Evaluation Process Model
              Chapter 1 – Planning for Evaluation: Getting Started
                Chapter 2 – Process Evaluation: Getting on the Right Track
                Chapter 3 – Performance Evaluation: Outputs and Outcomes
                Chapter 4 – Using Evaluation: The Focus is Results
                Conclusion
                Appendix – EPM Worksheets
                Recommended Actions
                Checklists, Worksheets, and Self Assessment Questions U.S. DEPARTMENT OF TRANSPORTATION

**Federal Highway Administration**

1200 NEW JERSEY AVENUE, SE

WASHINGTON, DC 20590

202-366-4000Subscribe to email updates
                    About
  

        
              About FHWA
                Careers
                Org Chart
                Staff Directories
                Work with UsPrograms
  

        
              Acquisition Management
                Civil Rights
                Federal Lands Highway
                Infrastructure
                Innovative Program Delivery
                Operations
                Planning, Environment, and Realty
                Policy
                Research, Development, and Technology
                SafetyPolicies, Rights, Legal
  

        
              About DOT
                Accessibility
                Budget and Performance
                Civil Rights
                FOIA
                Information Quality
                No FEAR Act
                Office of Inspector General
                Privacy Policy
                USA.gov
                Web Policies and Notices
                Web StandardsNews & Events
  

        
              Newsroom
                Press Releases
                Speeches & Testimony
                Media Contacts
                Connect with Us