USA Banner
  U.S. flag
              An official website of the United States government Here's how you knowOfficial US Government Icon
              **Official websites use .gov**A **.gov** website belongs to an official government organization in the United States.
            Secure Site Icon
              **Secure .gov websites use HTTPS**
                  A **lock** ( A locked padlock ) or **https://** means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites. 
 U.S. Department of Transportation Icon United States Department of Transportation
 Search DOT
            Search
                    About FHWAFHWA Organization
                Headquarters Offices
                Field Offices
                Strategic Plan
                Business Opportunities
                Staff Directories
                Careers
                Highway History
                Contact UsProgramsAcquisition Management
                Civil Rights
                Federal Lands Highway
                Infrastructure
                Innovative Program Delivery
                Operations
                Planning, Environment, and Realty
                Policy
                Research, Development, and Technology
                Safety
                Browse by TopicsResourcesCore Highway Topics
                Federal Aid Essentials
                Automation
                Complete Streets
                Laws and Regulations
                Policy & Guidance Center
                Section 508
                Publications and Statistics
                Professional Development
                National Highway Institute
                Resource Center
                Accessibility Resource Library
                FHWA Research LibraryNewsroomPress Releases
                Speeches & Testimony
                Photos
                Videos
                Media ContactsMenu FHWA Highway Safety Programs Home
                        HSIP Noteworthy Practice Series
                        HSIP Project Evaluation


            
            In This Section
        Highway Safety Improvement Program (HSIP)
                                Overview
                About
                Planning
                Implementing
                Evaluating
                Reporting
                Noteworthy Practices
                Legislation and Guidance
                Resources
                HSIP Special Rules
                Strategic Highway Safety Plan (SHSP)
                                Overview
                About
                Develop
                Implement
                Evaluate
                Promote
                Legislation and Guidance
                Resources
                Noteworthy Practices
                Safety Performance Measure
                                Overview
                State Safety Performance Targets
                Policy & Guidance
                Fact Sheets & Informational Webinars
                Target-Setting Resources
                Safety Data Resources
                State Safety Reports
                Safety Contacts
                Technical Assistance & Training
                Railway Highway Crossing Program
                                Overview
                Policy and Guidance
                Resources
                
                University Conducting HSIP Project Evaluations Using Empirical Bayes – Wisconsin
Wisconsin DOT contracted with the University of Wisconsin Traffic Operations and Safety (TOPS) Laboratory to investigate multiple project evaluation methods through a research grant for HSIP evaluation support. Initial research efforts included project evaluations based on before and after collision maps using the software Intersection Magic and before-after evaluations using benefit-cost analysis. From the beginning of the research, the intent was to use Empirical Bayes (EB) analysis in the project evaluations, but Wisconsin did not have safety performance functions (SPFs), which are required for the EB method. However, once the State acquired the SafetyAnalystsoftware, the TOPS Laboratory was able to incorporate the EB method into the project evaluations by using the SPFs contained in SafetyAnalyst. The SPFs in SafetyAnalyst were developed using national data and are intended to be calibrated to local conditions. While it was not possible to calibrate the SPFs to Wisconsin conditions due to lack of data, the TOPS Laboratory uses the SPFs to provide a comparison of performance in Wisconsin to that of the nation.

The TOPS Laboratory developed a process to extract the appropriate crashes (by location, type, and year) from the Wisconsin crash database based on the project location and scheduled start and completion dates for evaluation purposes. HSIP projects are evaluated based on five years of before data and three years of after data. Fatal and injury crashes are the focus of the evaluation, but the analysis also considers target crash types based on the nature of the improvement.

The TOPS Laboratory conducts a benefit-cost analysis based on results of both a simple before-after evaluation and an EB analysis to evaluate the projects from an economic perspective. This provides a simple comparison of the results of the two evaluation methods (In the table shown, “S. No.” refers to the site number for the project evaluated, and the “FOS (financial operating system) ID” is used by Wisconsin DOT as the specific project identifier.) and demonstrates how a simple before-after evaluation can overestimate the safety benefits.

Table 1. Benefit-Cost Analysis
	S. No.
			FOS ID
			Benefit-Cost Analysis Using Empirical Bayes Estimates
			Benefit-Cost Analysis Using Before-After Data1
			10220674
			1.38
			2.862
			11504371
			31.64
			44.663
			12060680
			N/A
			N/A4
			15300191
			5.34
			5.945
			22001570
			1.39
			2.016
			22401570
			7.72
			7.917
			40500971
			1.01
			1.218
			44790371
			5.14
			5.349
			45401572
			1.66
			1.7910
			46851471
			1.22
			1.2411
			50600072
			0.76
			1.2812
			52520071
			1.04
			2.2113
			69960674
			1.58
			1.5214
			69991072
			-1.19
			-0.8615
			70300370
			0.33
			0.3616
			72200191
			13.09
			14.6617
			86100270
			1.71
			1.6218
			86810571
			1.44
			1.4719
			92000371
			2.00
			2.94Key Accomplishments

Developed a project evaluation process incorporating Empirical Bayes analysis into all HSIP project evaluations.
	Demonstrated the importance of using statistical evaluations to reduce the overestimation of safety benefits due to regression-to-the-mean bias.Results

Originally, engineers in Wisconsin were reluctant to use EB. However, with the assistance of the TOPS Laboratory, the Wisconsin DOT was able to successfully implement a project evaluation process incorporating EB analysis and to receive buy-in at the regional level. The TOPS Laboratory demonstrated the importance of statistical EB techniques in project evaluations through a comparison benefit-cost analysis using simple before and after results to before and after using EB. The results demonstrate the EB analysis reduces the overestimation of safety benefits due to regression-to-the-mean bias.

Contact

Andrea Bill
Traffic Safety Engineering Research Program Manager
Traffic Operations and Safety (TOPS) Laboratory
University of Wisconsin
608-890-3425bill@wisc.edu
      
  Book traversal links for University Conducting HSIP Project Evaluations Using Empirical Bayes – Wisconsin
      ‹ Safety Evaluation Group – North Carolina
                    Up
                    Safety Data Collection, Analysis, and Sharing ›
                
                Book:HSIP Noteworthy Practice Series
              HSIP Project Identification
                                Safety Warrants and Spot Safety Index – North Carolina
                Implementation of Systemwide Improvements – Missouri
                Funding Goals for Proactive Improvements – Minnesota
                Development of SPFs for All State Routes and Intersections – Illinois
                Level of Service of Safety and Diagnostic Analysis – Colorado
                HSIP Project Evaluation
                                Project Evaluations Using Empirical Bayes – Colorado
                Crash Reduction Analysis System Hub – Florida
                Safety Evaluation Group – North Carolina
                University Conducting HSIP Project Evaluations Using Empirical Bayes – Wisconsin
                Safety Data Collection, Analysis, and Sharing
                                Law Enforcement Expert for Improved Data Collection – Louisiana
                Data Analysis for County Highway Safety Plans – Minnesota
                Data Sharing and Decision Support Tool – New Jersey
                SHSP Stakeholder Involvement
                                Statewide and Regional SHSP Coalitions – Missouri
                SHSP Road Shows – Nevada
                Engaging Native American Tribes in the SHSP – Washington
                MPO Safety Management Planning – Cheyenne, Wyoming
                Revisiting SHSP Emphasis Areas
                                Focusing on Fewer Emphasis Areas – West Virginia
                Tiered Emphasis Areas for Statewide and County Safety Planning – Washington
                Speeding and Aggressive Driving and Distracted Driving Task Forces – Louisiana
                Use of the HSIP Flexible Funding Provision
                                Alabama Flexes HSIP Funds for Increased Enforcement – Alabama
                Michigan Uses HSIP Flex Funds for Winter Safe Driving Campaign – Michigan
                Nevada Funds Education and Outreach Programs with HSIP Flex Funds – Nevada
                Utah Flexes HSIP Funds to Enhance Partners’ Safety Efforts – Utah
                SHSP – Leadership that Saves Lives
                SHSP – Get Involved! U.S. DEPARTMENT OF TRANSPORTATION

**Federal Highway Administration**

1200 NEW JERSEY AVENUE, SE

WASHINGTON, DC 20590

202-366-4000Subscribe to email updates
                    About
  

        
              About FHWA
                Careers
                Org Chart
                Staff Directories
                Work with UsPrograms
  

        
              Acquisition Management
                Civil Rights
                Federal Lands Highway
                Infrastructure
                Innovative Program Delivery
                Operations
                Planning, Environment, and Realty
                Policy
                Research, Development, and Technology
                SafetyPolicies, Rights, Legal
  

        
              About DOT
                Accessibility
                Budget and Performance
                Civil Rights
                FOIA
                Information Quality
                No FEAR Act
                Office of Inspector General
                Privacy Policy
                USA.gov
                Web Policies and Notices
                Web StandardsNews & Events
  

        
              Newsroom
                Press Releases
                Speeches & Testimony
                Media Contacts
                Connect with Us