U.S. flag
      An official website of the United States government, Department of Justice.
        Here's how you know
      Here's how you know**Official websites use .gov**
            
            A **.gov** website belongs to an official government organization in the United States.
      **Secure .gov websites use HTTPS**
            
            A **lock** (
            A locked padlock
            ) or **https://** means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites. Menu

      
        close

            
            
                                              About NIJ
        
                    
  
          About NIJ
      
    
          The NIJ Director
          How NIJ Is Organized
          Mission and Guiding Principles
          Research and Development Process
          Strategic Framework
          Assessments of NIJ
          Annual Reports & Reports to Congress
          Staff Directory
          Funding & Awards
        
                    
  
          Funding & Awards
      
    
          Current Funding
          Forthcoming Funding
          Expired Funding
          Awards: Listing of Funded Projects
          Guidance for Applicants and Awardees
          Fellowship & Student Programs
          Travel Scholarships
          NIJ Challenge Program
          Library & Multimedia
        
                    
  
          Library & Multimedia
      
    
          NIJ Journal
          Podcasts
          Publications Listing
          Multimedia Listing
          Rated Practices on CrimeSolutions
          Rated Programs on CrimeSolutions
          Software & Databases
          Datasets
          Patents
          Topics
        
                    
  
          Topics
      
    
          Article Listing
          Corrections
          Courts
          Crime Prevention
          Crimes
          Drugs and Crime
          Equipment and Technology
          Forensic Sciences
          Youth Justice
          Justice System Reform
          Law Enforcement
          Tribal Crime and Justice
          Victims of Crime
          Events
        
                    
  
          Events
      
    
          NIJ 2024 Research Conference
          Scheduled Events
          On-Demand Events
          Research Meetings & Workshops
          NIJ-Hosted Online Training

                            
                                About
          Contact Us
          Subscribe
          Topics A-Z
                  Share
FacebookXLinkedInRedditPinterestEmail Home
                            Funding & Awards
 Operationalizing the Individual versus Group Fairness Dichotomy for Recidivism Risk Assessment: US Legal Challenges and Technical Proposals
Award Information
Awardee
              UNIVERSITY OF MARYLAND, COLLEGE PARK
Award #
              15PNIJ-23-GG-01932-RESS
Funding Category
              Competitive Discretionary
Location
                    COLLEGE PARK, MD
Awardee County
              Prince George's
Congressional District
              4
Status
              Open
Funding First Awarded
              2023
Total funding (to date)
              $166,500
Original Solicitation
              NIJ FY23 Graduate Research Fellowship
Description of original award (Fiscal Year 2023, $166,500)
The legal and technical AI communities have developed concepts of fairness largely independently. Consequently, complications arise on how technical progress on AI fairness can be incorporated into existing sources of law that are relevant to downstream high-stakes applications such as recidivism risk assessment for bail, probation, sentencing, or parole. From the legal side, we propose to map the individual versus group fairness dichotomy onto US sources of law, as well as to identify the challenges of translating a high-level constitutional concept like “equal protection” into operationalizable fairness standards of criminal law, selecting permissible features, and guarding against overreliance on AI. Three technical research questions follow:
RQ1: At which technical stage should individual v. group fairness be enforced?
RQ2: How much scrutiny and which fairness criteria does each feature warrant?
RQ3: How does AI reliance relate to the fairness of criminal risk assessment by humans?
For RQ1, we propose semi-structured interviews with domain experts followed by both deductive and inductive coding to attain qualitative insights about whether and why individual or group fairness should be enforced on each technical component of a four-stage criminal risk assessment pipeline: dataset pre-processing, algorithm design, output post-processing, and result analysis.
For RQ2, we give a conceptual extension of the case laws-based framework of continuous scrutiny ranges for features. Our extension includes three discrete scrutiny thresholds: third-highest threshold (exclusion from model inputs), second-highest threshold (group parity required), and highest threshold (ignorance in individual similarity function). The pass conditions of these thresholds are related to procedural fairness, group outcome fairness, and individual outcome fairness, respectively. With this conceptual framework, we propose quantitative and qualitative human studies to arrange disputed features with respect to those thresholds, including both algorithmic innovations and semi-structured expert interviews.
For RQ3, we propose an AI-assisted bail decision human study to characterize the relationship between reliance metrics (appropriate reliance, over-reliance, and under-reliance) versus individual or group fairness metrics per participant. The goal is to spot any concerning patterns, e.g. over-reliance above a certain pattern may severely affect fairness of humans’ decisions.
Across the three RQs, we expect several concrete short term outcomes, such as publications at Fairness-oriented, Human-centric, or Law-informed Computer Science conferences (e.g. FAccT, AIES, CHI, ICAIL). In terms of broader social impact, our work will systemize the process of evaluating the fairness of recidivism risk assessment models across US jurisdictions and answer the normative questions about which demographic features are relevant. CA/NCF

  
Date Created: September 14, 2023
    
          Side navigation
  

        

  
  
              Current Funding
    
      
            
            
            
      Forthcoming Funding
    
      
            
            
            
      Expired Funding
    
      
            
            
            
      Awards: Listing of Funded Projects
    
      
            
            
            
      Guidance for Applicants and Awardees
    
      
            
            
            
      Fellowship & Student Programs
    
      
            
            
            
      Travel Scholarships
    
      
            
            
            
      NIJ Challenge ProgramSimilar Awards
        
                      Thriving, Not Surviving: Refocusing Juvenile Justice Assessments and Strategies
                  Sampling and Selection Bias in Research using Documented Skeletal Collections
                  The Extremism Sentencing Study:  Judicial Outcomes and Recidivism Among Individuals Convicted of International and Domestic Terrorism
 Top

      National Institute of Justice

        
        
                        About NIJ
                    About NIJ
      
    
                  How NIJ Is Organized
      
    
                  NIJ Director
      
    
                  Research Disclaimer
      
    
                  Funding & Awards
                    Funding & Awards Home
      
    
                  Awards Listing
      
    
                  Current Funding
      
    
                  Guidance for Applicants and Awardees
      
    
                  Resources
                    Events
      
    
                  Podcasts
      
    
                  Publications
      
    
                  Topics
      
    
                  Multimedia
      
    
                  Reuse Policy
      
    
                  Contacts
                    Contact NIJ
      
    
                  Staff Directory
      
    
                  Submit a FOIA Request
      
    
                  File a Civil Rights ComplaintFacebook
          
                      X
          
                      YouTube
  

      810 7th St. NW, Washington, D.C. 20531
      
              Secondary Footer link menu
            Accessibility
              Plain Language
              Privacy Policy
              Legal Policies and Disclaimer
              No FEAR Act
              Freedom of Information Act
              USA.gov
              Justice.gov