U.S. flag
      An official website of the United States government, Department of Justice.
        Here's how you know
      Here's how you know**Official websites use .gov**
            
            A **.gov** website belongs to an official government organization in the United States.
      **Secure .gov websites use HTTPS**
            
            A **lock** (
            A locked padlock
            ) or **https://** means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites. Menu

      
        close

            
            
                                              About NIJ
        
                    
  
          About NIJ
      
    
          The NIJ Director
          How NIJ Is Organized
          Mission and Guiding Principles
          Research and Development Process
          Strategic Framework
          Assessments of NIJ
          Annual Reports & Reports to Congress
          Staff Directory
          Funding & Awards
        
                    
  
          Funding & Awards
      
    
          Current Funding
          Forthcoming Funding
          Expired Funding
          Awards: Listing of Funded Projects
          Guidance for Applicants and Awardees
          Fellowship & Student Programs
          Travel Scholarships
          NIJ Challenge Program
          Library & Multimedia
        
                    
  
          Library & Multimedia
      
    
          NIJ Journal
          Podcasts
          Publications Listing
          Multimedia Listing
          Rated Practices on CrimeSolutions
          Rated Programs on CrimeSolutions
          Software & Databases
          Datasets
          Patents
          Topics
        
                    
  
          Topics
      
    
          Article Listing
          Corrections
          Courts
          Crime Prevention
          Crimes
          Drugs and Crime
          Equipment and Technology
          Forensic Sciences
          Youth Justice
          Justice System Reform
          Law Enforcement
          Tribal Crime and Justice
          Victims of Crime
          Events
        
                    
  
          Events
      
    
          NIJ 2024 Research Conference
          Scheduled Events
          On-Demand Events
          Research Meetings & Workshops
          NIJ-Hosted Online Training

                            
                                About
          Contact Us
          Subscribe
          Topics A-Z
                  Share
FacebookXLinkedInRedditPinterestEmail Home
                            Library & Multimedia
 Validation of ground truth fire debris classification by supervised machine learning
NCJ Number
              303556
Journal

*Forensic Chemistry* Volume: 26 Dated: December 2021
Author(s)
          Michael E. Sigman;
                        Mary R. Williams;
                        Nicholas Thurn;
                        Taylor Wood
Date Published

December 2021
Annotation
              This article reports on a project in which a set of 767 laboratory-generated fire debris samples of known ground truth as to whether an ignitable liquid residue was present (class IL) or absent (class SUB) were used to train five machine learning classifiers.
Abstract
              Linear and quadratic discriminant analysis (LDA and QDA), k-nearest neighbors (kNN), and support vector machines with radial and linear kernels (SVMr and SVMl) were tested for their performance in correctly classifying the fire debris samples into class IL or class SUB. Each classifier was trained and tested/validated on 500 class-balanced data sets, each comprised of 400 fire debris samples (200 IL and 200 SUB) that were bootstrapped from the 767 laboratory-generated samples. Each bootstrapped data set was split into subsets for training (75 percent, 300 samples) and testing/validation (25 percent, 100 samples). The LDA, SVMr, and SVMl were found to give satisfactory performance based on area under the receiver operating characteristic curve (0.86–0.92), equal error rates (17−22 percent) and well-calibrated probabilities. The three satisfactory classifiers were further applied to a set of 129 fire debris samples produced in large-scale test burns. The classifications generated by the machine learning models were compared with the sample classes assigned by an informed analyst having knowledge of the chromatographic patterns of the ignitable liquids used to start the large-scale fires. The LDA and SVMl models gave results most closely aligned with the informed analyst. (publisher abstract modified)
      
  
          Additional Details
Grant Number(s)
        2017-IJ-CX-0023


  
  
        
  Agencies
        NIJ-Sponsored


  
  
        
  Publication Type
        Research (Applied/Empirical)


  
  
        
  Award
        Development and Implementation of a Fire Debris Inference Validation Database:  Moving to Probabilistic Statements of the Strength of the Evidence
    
  
  
Date Published: December 1, 2021
    
          Downloads
        
                      HTML

Side navigation
  

        

  
  
              NIJ Journal
    
      
            
            
            
      Podcasts
    
      
            
            
            
      Publications Listing
    
      
            
            
            
      Multimedia Listing
    
      
            
            
            
      Rated Practices on CrimeSolutions
    
      
            
            
            
      Rated Programs on CrimeSolutions
    
      
            
            
            
      Software & Databases
    
      
            
            
            
      Datasets
    
      
            
            
            
      PatentsRelated Topics
        
                Trace evidence
        Research and development
        Forensic sciences
        Evidence analysis
        Evidence analysis and processing



  
Similar Publications
        
                      Atlanta Youth Count 2018 Community Report: The Prevalence of Sex and Labor Trafficking Among Homeless Youth in Metro Atlanta
                  Technical Note – Direct Analysis In Real Time Mass Spectrometry (DART-MS)
                  Attitudes of Reporting Officers Extracted From Incident Reports Can Affect Rape Case Outcomes
 Top

      National Institute of Justice

        
        
                        About NIJ
                    About NIJ
      
    
                  How NIJ Is Organized
      
    
                  NIJ Director
      
    
                  Research Disclaimer
      
    
                  Funding & Awards
                    Funding & Awards Home
      
    
                  Awards Listing
      
    
                  Current Funding
      
    
                  Guidance for Applicants and Awardees
      
    
                  Resources
                    Events
      
    
                  Podcasts
      
    
                  Publications
      
    
                  Topics
      
    
                  Multimedia
      
    
                  Reuse Policy
      
    
                  Contacts
                    Contact NIJ
      
    
                  Staff Directory
      
    
                  Submit a FOIA Request
      
    
                  File a Civil Rights ComplaintFacebook
          
                      X
          
                      YouTube
  

      810 7th St. NW, Washington, D.C. 20531
      
              Secondary Footer link menu
            Accessibility
              Plain Language
              Privacy Policy
              Legal Policies and Disclaimer
              No FEAR Act
              Freedom of Information Act
              USA.gov
              Justice.gov