Skip to main content    

An official website of the United States government

Here’s how you know

**Official websites use .gov**              A **.gov** website belongs to an official government organization in the United States.            

**Secure .gov websites use HTTPS**              A **lock** (  LockA locked padlock) or **https://** means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.            

https://www.nist.gov/programs-projects/multiple-biometric-evaluation-mbe

            -  Topics  -  All Topics 
-  Advanced communications 
-  Artificial intelligence 
-  Bioscience 
-  Buildings and construction 
-  Chemistry 
-  Climate 
-  Cybersecurity 
-  Electronics 
-  Energy 
-  Environment 
-  Fire 
-  Forensic science 
-  Health 
-  Information technology 
-  Infrastructure 
-  Manufacturing 
-  Materials 
-  Mathematics and statistics 
-  Metrology 
-  Nanotechnology 
-  Neutron research 
-  Performance excellence 
-  Physics 
-  Public safety 
-  Resilience 
-  Standards 
-  Transportation 
 
            -  Publications 
            -  Labs & Major Programs  -  Laboratories    -  Communications Technology Laboratory 
  -  Engineering Laboratory 
  -  Information Technology Laboratory 
  -  Material Measurement Laboratory 
  -  Physical Measurement Laboratory 
-  User Facilities    -  NIST Center for Neutron Research 
  -  CNST NanoFab 
-  Research Test Beds 
-  Research Projects 
-  Tools & Instruments 
-  Major Programs    -  Baldrige Performance Excellence Program 
  -  CHIPS for America Initiative 
  -  Manufacturing Extension Partnership (MEP) 
  -  Office of Advanced Manufacturing 
  -  Special Programs Office 
  -  Technology Partnerships Office 
 
            -  Services & Resources  -  Standards and Measurements    -  Calibration Services 
  -  Laboratory Accreditation (NVLAP) 
  -  Quality System 
  -  Standard Reference Materials (SRMs) 
  -  Standards.gov 
  -  Time Services 
  -  Office of Weights and Measures 
-  Software 
-  Data    -  Chemistry WebBook 
  -  National Vulnerability Database 
  -  Physical Reference Data 
  -  Standard Reference Data (SRD) 
-  Storefront 
-  License & Patents 
-  Computer Security Resource Center (CSRC) 
-  NIST Research Library 
 
            -  News & Events  -  News 
-  Events 
-  Blogs 
-  Feature Stories 
-  Awards 
-  Video Gallery 
-  Image Gallery 
-  Media Contacts 
 
            -  About NIST  -  About Us    -  Leadership 
  -  Organization Structure 
  -  Budget & Planning 
-  Contact Us 
-  Visit 
-  Careers    -  Student programs 
-  Work with NIST 
-  History    -  NIST Digital Archives 
  -  NIST Museum 
  -  NIST and the Nobel 
-  Educational Resources 
 

PROJECTS/PROGRAMS

# Multiple Biometric Evaluation (MBE)

## Share

Facebook

Linkedin

Twitter

Email

## Summary

### Structure

**MBE Re-organization**

2009-11-14: In order to produce a more comprehensive evaluation and incorporate our sponsor's requirements, we are reorganizing the Multiple Biometric Evaluation. The MBE 2010 will have three tracks: Portal, Video, and Still Face. The Video and Portal tracks will have the same structure as planned but with a delayed start. The Still Face Track has been expanded to include a large-scale identification component, in addition to the verification components. These changes will be beneficial to both our sponsors and the biometrics research community.

## Description

### **MBE 2D Still Update**

The evaluation of 2D face recognition algorithms yielded two reports.  First, NIST Interagency Report 7709 gave results for both verification and identification algorithms. Second, the NIST Interagency Report 7830 surveyed compression and resolution parameters for storing face images on identity credentials.

## MBE PORTAL and VIDEO - Ongoing Updates

### New version of the MBE Portal Track Guideline Released

2010-04-01: A new version of the MBE 2010 Portal Track: Guidelines for Participants has been released. The new version has an expanded FAQ. If you have any questions please contact the MBE Liaison at mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov).

### New versions of the MBE Portal and Video Track Applications and Guidelines Released

2010-03-29: A new version of the MBE 2010 Portal Track: Guidelines for Participants and MBE 2010 Portal Track Application have been released. A new version of the MBE 2010 Video Track: Guidelines for Participants and MBE 2010 Video Track Application have been released as well. Participants in either the MBE Portal or Video Tracks should download and review these documents. The Guideline Documents contain an expanded FAQ answering some questions submitted by participants. The Applications have also been amended. If you have any questions please contact the MBE Liaison at mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov).

### Application and Guidelines for MBE 2010 Portal Track Released

2010-02-16: The MBE 2010 Portal Track: Guidelines for Participants and MBE 2010 Portal Track Application have been released. MBE 2010 Portal Track Participants should download and review both of these documents. Due to a gigantic snowstorm the MBE Team was delayed in releasing this information. Accordingly we have delayed the final submission date for the MBE 2010 Portal Track to Monday, April 12th, 2010. If you have any questions please contact the MBE Liaison at mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov).

### Application and Guidelines for MBE 2010 Video Track Released

2010-01-22: The MBE 2010 Video Track: Guidelines for Participants and MBE 2010 Video Track Application have been released. MBE 2010 Video Track Participants should download and review both of these documents. If you have any questions please contact the MBE Liaison at mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov).

## MBE STILL - Ongoing Updates

### Participation window

2010-03-29: This notice reaffirms the date for the closure of the participation window for the MBE-STILL evaluation of face recognition technologies as May 14, 2010. This is the date given in the final API document (ver. 1.0.0).Any decision on whether to continue testing in a second phase has not been made. The participation window opened January 27, 2010.

### Procedural updates for the MBE-STILL Test

2010-02-19: An updated validation suite is available. This corrects some minor software bugs, uses PPM instead of JPEG images, and includes an expanded set of images. The images form non-identical gallery and probe sets, and thereby give non-degenerate genuine scores.

2010-02-12: Participants must use the NIST public key to submit MBE-STILL implementations to NIST. The encryption procedure uses GPG.

2010-02-01: An updated validation software is available.

2010-02-01: The final API, version 1.0.0, is now available. This modifies prior version with respect to the single function call given in Table 24. The MBE-STILL submission period is open.

2010-01-28: Annex A of the MBE STILL API document has been added. It gives information on how to submit SDKs to NIST. This API document (version number 0.9.3) is otherwise identical to the January 14 document (version 0.9.2).

2010-01-28: The

have been released. To initiate participation in the still face track of MBE 2010, participants must complete this application procedure.

2010-01-15: The MBE-Still validation package is now available. The purpose of validation is to ensure that NIST's execution of your SDK submission produces the expected output. The process requires you to 1) compile and link the provided validation code against your libraries, 2) run the executables, and 3) email the results to mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov). NIST will run the same validation code on your submitted SDKs and check that the results come out identical. Comments regarding the source code should be directed to gw [at] nist.gov (gw[at]nist[dot]gov).

2010-01-12: Organizations wishing to participate in MBE 2010 should email mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov). After January 20, 2010 the organizers will respond with the procedural details of the application process.

Participation is open from January 27, 2010 through to May 14, 2010. This applies to 2D still images only. For video and iris tracks of the MBE 2010 please contact mbe2010 [at] nist.gov (mbe2010[at]nist[dot]gov) for further information.

The primary requirement for participation is an ability to implement the MBE API specifications. The latest Evaluation Plan and API document is version 0.9.2 released January 12, 2010. It modifies version 0.9 released December 18, 2009. The modifications are highlighted in yellow.

The API specification contains an elementary one-to-one verification interface specification for testing core face recognition algorithm capability. This part of the test is suitable for academics and new entrants in the face recognition field.

### Revised MBE-STILL Test Plan and API

2010-01-12: A slightly revised version of the Concept, Test Plan, and API of the MBE's Still Face recognition track has been released. This version, Concept, Test Plan, and API 0.9.2, supersedes prior versions.

### Final MBE-STILL Test Plan and API

2009-12-18: The third version of the Concept, Test Plan, and API of the MBE's Still Face recognition track has been released.

### Revised MBE-STILL Draft Test Plan and API

2009-12-09: The second public draft of the Concept, Test Plan, and API of the MBE's Still Face recognition track has been released. Comments and questions should be directed to the mbe2010 [at] nist.gov (organizers) by December 16, 2009. NIST apologizes for the short review period

### MBE-STILL Draft Test Plan and API

2009-11-15: The first public draft of the Concept, Test Plan, and API of the MBE's Still Face recognition track has been released. Comments and questions should be directed to the mbe2010 [at] nist.gov (organizers) by November 30, 2009.

### MBE Schedule

2009-11-15: The MBE schedule is as follows. A number of contingencies mean that it remains tentative.
                  - 2009-11 to 2009-12: Work with community on protocol
                  - 2010-01: Submission / iteration cycle begins (submit, evaluate, return) for Still Face track.
                  - 2010-02: Portal and Video Track executables due at NIST
                  - 2010-05: Closing of submission period for still face track
                  - 2010-08: Protocol and detailed data descriptions delivered
                  - 2010-09: Initial report is published

## Major Accomplishments

## MBE STILL - Publications

### MBE Compression Study

2011-12-06: Results of a follow-up study to the MBE-STILL test have been published as NISTIR 7830 -Performance of Face Recognition Algorithms on Compressed Images .  The report provides a comprehensive assessment of the ability of face recognition algorithms to compare compressed standard face images.  

### Final MBE-STILL Report

2010-6-17: The first public report of the MBE-STILL test has been published as NIST Interagency Report 7709 - Report on the Evaluation of 2D Still-Image Face Recognition Algorithms.

##     Associated Product(s)  

Still Face Final API

Portal Track Guidelines for ParticipantsPortal Track ApplicationVideo Track Guidelines for ParticipantsVideo Track Application

Information technologyBiometrics

## Organizations

                          - NIST Headquarters
                            - Laboratory Programs
                              - Information Technology Laboratory
                                - Information Access Division
                                  - Image Group

## Project Status

## Funding

Department of Homeland Security                    - Science & Technology
                    		
                    - Transportation Security Administration
                    	
Department of Justice                    - Federal Bureau of Investigations
                    		
                    - National Institute of Justice
                    	

Director of National Intelligence

Multi-Agency
                    - Technical Support Working Group (TSWG)
                    	

## Related NIST Projects

Face Projects

Iris Projects

### HEADQUARTERS

301-975-2000

Webmaster | Contact Us | Our Other Offices

TwitterFacebookLinkedInInstagramYouTubeGiphyRSS FeedMailing List

Feedback

            -  Site Privacy 
            -  Accessibility 
            -  Privacy Program 
            -  Copyrights 
            -  Vulnerability Disclosure 
            -  No Fear Act Policy 
            -  FOIA 
            -  Environmental Policy 
            -  Scientific Integrity 
            -  Information Quality Standards 
            -  Commerce.gov 
            -  Science.gov 
            -  USA.gov 
            -  Vote.gov