U.S. flag
      An official website of the United States government, Department of Justice.
        Here's how you know
      Here's how you know**Official websites use .gov**
            
            A **.gov** website belongs to an official government organization in the United States.
      **Secure .gov websites use HTTPS**
            
            A **lock** (
            A locked padlock
            ) or **https://** means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites. Menu

      
        close

            
            
                                              About NIJ
        
                    
  
          About NIJ
      
    
          The NIJ Director
          How NIJ Is Organized
          Mission and Guiding Principles
          Research and Development Process
          Strategic Framework
          Assessments of NIJ
          Annual Reports & Reports to Congress
          Staff Directory
          Funding & Awards
        
                    
  
          Funding & Awards
      
    
          Current Funding
          Forthcoming Funding
          Expired Funding
          Awards: Listing of Funded Projects
          Guidance for Applicants and Awardees
          Fellowship & Student Programs
          Travel Scholarships
          NIJ Challenge Program
          Library & Multimedia
        
                    
  
          Library & Multimedia
      
    
          NIJ Journal
          Podcasts
          Publications Listing
          Multimedia Listing
          Rated Practices on CrimeSolutions
          Rated Programs on CrimeSolutions
          Software & Databases
          Datasets
          Patents
          Topics
        
                    
  
          Topics
      
    
          Article Listing
          Corrections
          Courts
          Crime Prevention
          Crimes
          Drugs and Crime
          Equipment and Technology
          Forensic Sciences
          Youth Justice
          Justice System Reform
          Law Enforcement
          Tribal Crime and Justice
          Victims of Crime
          Events
        
                    
  
          Events
      
    
          NIJ 2024 Research Conference
          Scheduled Events
          On-Demand Events
          Research Meetings & Workshops
          NIJ-Hosted Online Training

                            
                                About
          Contact Us
          Subscribe
          Topics A-Z
                  Share
FacebookXLinkedInRedditPinterestEmail Home
                            Funding & Awards
 Development and Properties of Kernel-Based Methods for the Interpretation and Presentation of Forensic Evidence
Note:
              This awardee has received supplemental funding. This award detail page includes information about both the original award and supplemental awards.
Award Information
Awardee
              South Dakota State University
Award #
              2015-R2-CX-0028
Funding Category
              Continuation
Location
                    Brookings, SD
Status
              Closed
Funding First Awarded
              2015
Total funding (to date)
              $74,560
Original Solicitation
              NIJ FY 15 Graduate Research Fellowship Program in Science, Technology, Engineering, and Mathematics
Description of original award (Fiscal Year 2015, $33,513)
As submitted by the proposer:

The development of quantifiable measures of uncertainty in forensic conclusions has resulted in the apparition of several ad-hoc methods for approximating the weight of the evidence (WoE) [1]. In particular, following developments in the field of biometry in the 1990s, forensic researchers have attempted to use similarity measures, or scores, to simplify the approximation of the weight of high-dimensional and complex evidential data. Score-based methods have been proposed for numerous evidence types such as fingerprints, handwritings, inks, controlled substances, firearms, and voice analysis. Researchers have designed different score-based statistics to approximate the weight of evidence. In general, scorebased methods consider the score as a projection onto the real line and focuses on different sampling distributions of the score. We can show that score-based methods do not converge to, or share the same basic properties as, the true WoE. Overall, there is currently some controversy on whether these score-based methods are statistically sound and whether they might overestimate the weight of evidence, thus resulting in prejudicial forensic conclusions. Given the convenience and power of score-based methods for reducing the dimensionality of complex evidential forms and the resulting widespread interest from the forensic community, there is significant risk that these methods will have a long-lasting negative impact on the United States criminal justice system. Another type of statistic takes advantage of the data reduction abilities of similarity measures, but shows properties that are similar to the WoE. Kernel-based methods consider the transformation of the entire feature space using the score as a kernel function. Gantz and Saunders [2] and Lock and Morris [3] have proposed some initial developments for these methods. During this 2-year research project, we propose to:
1. Systematically study the (lack of) theoretical and empirical convergence of score-based methods to the true WoE in examples that can be derived analytically;
2. Review the appropriateness of different metrics as kernel functions (with respect to forensic problems);
3. Explore the theoretical foundations of kernel-based methods as an alternative for quantifying the WoE using similarity measures, and propose a set of requirements
ensuring their convergence.
The aim of this project is to deliver two main products with applications to forensic science:
1. A Ph.D. thesis (and relevant computer code and data) developing and justifying a set of requirements ensuring the convergence of kernel-based methods with the WoE;
2. A series of peer-reviewed publications and presentations based on the Ph.D. research program.
[1] Good, I. J. (1950), Probability and the Weighting of Evidence 1st Ed., London, Charles Griffin.
[2] Gantz, D., Saunders, C. P. (2014) Quantifying the Effects of Database Size and Sample Quality on Measures of Individualization Validity and Accuracy in Forensics. National Institute of Justice, Final Grant Report for award 2009_DN_BX_K234
[3] Lock, A. B., Morris, M. D. (2013), Significance of Angle in the Statistical Comparison of Forensic Tool Marks, Technometrics, 55(4), 548-561

This project contains a research and/or development component, as defined in applicable law.

ca/ncf
Supplemental Award 1 (Fiscal Year 2016, $41,047)
As submitted by the proposer:  The development of quantifiable measures of uncertainty in forensic conclusions has resulted in the apparition of several ad-hoc methods for approximating the weight of the evidence (WoE) [1]. In particular, following developments in the field of biometry in the 1990s, forensic researchers have attempted to use similarity measures, or scores, to simplify the approximation of the weight of high-dimensional and complex evidential data.
Score-based methods have been proposed for numerous evidence types such as fingerprints, handwritings, inks, controlled substances, firearms, and voice analysis. Researchers have designed different score-based statistics to approximate the weight of evidence. In general, score-based methods consider the score as a projection onto the real line and focuses on different sampling distributions of the score.
During the first year of this project, we have shown that score-based methods do not follow a set of desirable properties analogous to the true WoE. It was found that these score-based methods are not statistically sound and will unreliably overestimate or underestimate the weight of evidence, thus resulting in prejudicial forensic conclusions. Given the convenience and power of score-based methods for reducing the dimensionality of complex evidential forms and the resulting widespread interest from the forensic community, there is significant risk that these methods will have a long-lasting negative impact on the United States criminal justice system.
Another type of statistic takes advantage of the data reduction abilities of similarity measures, but shows properties that are similar to the WoE. Kernel-based methods consider the transformation of the entire feature space using the score as a kernel function. Gantz and Saunders [2] and Lock and Morris [3] have proposed some initial developments for these methods.
During the remainder of this research project, we propose to:
1. Review the appropriateness of different metrics as kernel functions (with respect to forensic problems);
2. Explore the theoretical foundations of kernel-based methods as an alternative for quantifying the WoE using similarity measures, and propose a set of requirements ensuring their convergence.
The aim of this project is to deliver two main products with applications to forensic science:
1. A Ph.D. thesis (and relevant computer code and data) developing and justifying a set of requirements ensuring the convergence of kernel-based methods with the WoE;
2. A series of peer-reviewed publications and presentations based on the Ph.D. research program.
[1] Good, I. J. (1950), Probability and the Weighting of Evidence 1st Ed., London, Charles Griffin.
[2] Gantz, D., Saunders, C. P. (2014) Quantifying the Effects of Database Size and
Sample Quality on Measures of Individualization Validity and Accuracy in Forensics. National Institute of Justice, Final Grant Report for award 2009_DN_BX_K234
[3] Lock, A. B., Morris, M. D. (2013), Significance of Angle in the Statistical Comparison of
Forensic Tool Marks, Technometrics, 55(4), 548-561.
This project contains a research and/or development component, as defined in applicable law.  nca/ncf.


  
Grant-Funded Publications
        
                      Defence against the modern arts: the curse of statistics-Part II: 'Score-based likelihood ratios'
                  Two-stage approach for the inference of the source of high-dimensional and complex chemical data in forensic science
                  Kernel-based Methods for Source Identification Using Very Small Particles From Carpet Fibers

  
Date Created: September 15, 2015
    
          Side navigation
  

        

  
  
              Current Funding
    
      
            
            
            
      Forthcoming Funding
    
      
            
            
            
      Expired Funding
    
      
            
            
            
      Awards: Listing of Funded Projects
    
      
            
            
            
      Guidance for Applicants and Awardees
    
      
            
            
            
      Fellowship & Student Programs
    
      
            
            
            
      Travel Scholarships
    
      
            
            
            
      NIJ Challenge ProgramSimilar Awards
        
                      Understanding and Refining Violence Intervention Implementation: St. Louis (MO) as a Crucial Case
                  911, What's Your Emergency?: Factors Impacting Call Coding
                  Optimizing Analytical Parameters for Detection of Chronic and Single Dose Drug Exposure in Forensic Hair Analysis
 Top

      National Institute of Justice

        
        
                        About NIJ
                    About NIJ
      
    
                  How NIJ Is Organized
      
    
                  NIJ Director
      
    
                  Research Disclaimer
      
    
                  Funding & Awards
                    Funding & Awards Home
      
    
                  Awards Listing
      
    
                  Current Funding
      
    
                  Guidance for Applicants and Awardees
      
    
                  Resources
                    Events
      
    
                  Podcasts
      
    
                  Publications
      
    
                  Topics
      
    
                  Multimedia
      
    
                  Reuse Policy
      
    
                  Contacts
                    Contact NIJ
      
    
                  Staff Directory
      
    
                  Submit a FOIA Request
      
    
                  File a Civil Rights ComplaintFacebook
          
                      X
          
                      YouTube
  

      810 7th St. NW, Washington, D.C. 20531
      
              Secondary Footer link menu
            Accessibility
              Plain Language
              Privacy Policy
              Legal Policies and Disclaimer
              No FEAR Act
              Freedom of Information Act
              USA.gov
              Justice.gov