Skip to main content    

An official website of the United States government

Here’s how you know

**Official websites use .gov**              A **.gov** website belongs to an official government organization in the United States.            

**Secure .gov websites use HTTPS**              A **lock** (  LockA locked padlock) or **https://** means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.            

https://www.nist.gov/itl/iad/image-group/irex-ii-iqce

            -  Topics  -  All Topics 
-  Advanced communications 
-  Artificial intelligence 
-  Bioscience 
-  Buildings and construction 
-  Chemistry 
-  Climate 
-  Cybersecurity 
-  Electronics 
-  Energy 
-  Environment 
-  Fire 
-  Forensic science 
-  Health 
-  Information technology 
-  Infrastructure 
-  Manufacturing 
-  Materials 
-  Mathematics and statistics 
-  Metrology 
-  Nanotechnology 
-  Neutron research 
-  Performance excellence 
-  Physics 
-  Public safety 
-  Resilience 
-  Standards 
-  Transportation 
 
            -  Publications 
            -  Labs & Major Programs  -  Laboratories    -  Communications Technology Laboratory 
  -  Engineering Laboratory 
  -  Information Technology Laboratory 
  -  Material Measurement Laboratory 
  -  Physical Measurement Laboratory 
-  User Facilities    -  NIST Center for Neutron Research 
  -  CNST NanoFab 
-  Research Test Beds 
-  Research Projects 
-  Tools & Instruments 
-  Major Programs    -  Baldrige Performance Excellence Program 
  -  CHIPS for America Initiative 
  -  Manufacturing Extension Partnership (MEP) 
  -  Office of Advanced Manufacturing 
  -  Special Programs Office 
  -  Technology Partnerships Office 
 
            -  Services & Resources  -  Standards and Measurements    -  Calibration Services 
  -  Laboratory Accreditation (NVLAP) 
  -  Quality System 
  -  Standard Reference Materials (SRMs) 
  -  Standards.gov 
  -  Time Services 
  -  Office of Weights and Measures 
-  Software 
-  Data    -  Chemistry WebBook 
  -  National Vulnerability Database 
  -  Physical Reference Data 
  -  Standard Reference Data (SRD) 
-  Storefront 
-  License & Patents 
-  Computer Security Resource Center (CSRC) 
-  NIST Research Library 
 
            -  News & Events  -  News 
-  Events 
-  Blogs 
-  Feature Stories 
-  Awards 
-  Video Gallery 
-  Image Gallery 
-  Media Contacts 
 
            -  About NIST  -  About Us    -  Leadership 
  -  Organization Structure 
  -  Budget & Planning 
-  Contact Us 
-  Visit 
-  Careers    -  Student programs 
-  Work with NIST 
-  History    -  NIST Digital Archives 
  -  NIST Museum 
  -  NIST and the Nobel 
-  Educational Resources 
 

Information Technology LaboratoryInformation Access Division

## Image Group

-  Programs/Projects  Expand or Collapse    -  Fingerprint  Expand or Collapse      -  ANSI/NIST-ITL Standard 
    -  Fingerprint Compression  Expand or Collapse        -  WSQ Certification Procedure 
      -  Biometric Compression Information 
      -  JPEG 2000 Conformance Testing 
    -  Fingerprint Recognition  Expand or Collapse        -  Minutiae Interoperability Exchange (MINEX) 
      -  Proprietary Fingerprint Template Evaluations (PFT) 
      -  Fingerprint Vendor Technology Evaluation (FpVTE) 
      -  Slap Fingerprint Segmentation Evaluation (Slapseg) 
      -  Biometric Quality 
      -  Evaluation of Latent Fingerprint Technologies (ELFT) 
    -  Next Generation Fingerprint Technologies  Expand or Collapse        -  Contactless Fingerprint Capture 
      -  Fast Tenprint Capture 
      -  Statistical Friction Ridge Analysis (SFRA) 
  -  Iris  Expand or Collapse      -  IRIS Experts Group II 
    -  Iris Challenge Evaluation (ICE) 
    -  Iris Exchange (IREX) 
    -  Multiple Biometric Evaluation (MBE) 
    -  Multiple Biometrics Grand Challenge (MBGC) 
  -  Face  Expand or Collapse      -  Chexia Face Recognition 
    -  Face Challenges 
    -  Face Recognition Grand Challenge (FRGC) 
    -  Face Recognition Prize Challenge (FRPC) 2017 
    -  Face Recognition Technology (FERET) 
    -  Face Recognition Vendor Test (FRVT) Ongoing 
    -  Face Recognition Vendor Test (FRVT) 
    -  Face and Ocular Challenge Series (FOCS) 
    -  Face in Video Evaluation (FIVE) 
    -  Multiple Biometric Evaluation (MBE) 
    -  Multiple Biometric Grand Challenge (MBGC) 
    -  Point and Shoot Face Recognition Challenge (PaSC) 
    -  Text Recognition Algorithm Independent Evaluation (TRAIT) 
  -  Tattoo  Expand or Collapse      -  Tattoo Recognition Technology - Evaluation (Tatt-E) 
    -  Tattoo Recognition Technology – Challenge (Tatt-C) 
  -  Biometrics 
  -  Legacy Projects  Expand or Collapse      -  Neural Networks 
    -  Optical Character Recognition (OCR) 
    -  PATRIOT Act Research 
  -  Biometric Web Services (BWS) 
  -  Digital Video Exchange Standards 
-  Resources  Expand or Collapse    -  Biometric Special Databases and Software 
  -  Biometrics Evaluations 
  -  INCITS Standardized Biometric Data 
  -  Image Group Publications (by year) 
  -  Image Group Workshops/Conferences/Talks 
-  Staff Listing 
-  Publications 
-  Products and Services  Expand or Collapse    -  Image Group Open Source Server (NIGOS) 
  -  Encrypting Software/Data for Transmission to NIST 
  -  Software  Expand or Collapse      -  Biometric Evaluation Framework 
    -  Fingerprint Minutiae Viewer (FpMV) 
    -  Multimodal Biometric Application Resource Kit (MBARK) 
    -  NIST Biometric Image Software (NBIS) 
    -  BiomAPP - NIST Biometric Data Interchange Format Software Tools 
    -  BiomDI - Software tools supporting Standard Biometrics Data Interchange Formats 
    -  Dental Encoding Translator Applications Suite (DEnTAS) 
    -  Development of NFIQ 2.0 
    -  NIST Fingerprint Registration and Comparison Tool (NFRaCT) 
    -  Public Domain OCR 
    -  Video-based Automatic System for Iris Recognition (VASIR) 

## Connect with us

Facebook

# IREX II IQCE

## Share

Facebook

Linkedin

Twitter

Email

## 

## 

### 

### IREX II IQCE - Final Evaluation Report

September 23, 2011: The final IQCE report: Iris Quality Calibration and Evaluation (IQCE): Performance of Iris Image Quality Assessment and Algorithms .

### Update to API.

April 26, 2010: The newest version is 4.4. Table of device identifier (Table 7) is updated. Clarification on scan_type values and handling of KIND_VGA images that do not satisfy margin requirement of current draft of ISO/IEC 19794-6 (N3620) have been added to Tables 9 and 10.

### Update to API.

February 24, 2010: Table of device identifier (Table 7) is updated. Newest version is 4.4.

### Final Version of FAQ .

February 4, 2010: Final version FAQ here.

### Release of sample data

February 1, 2010: NIST will use iris images collected by Clarkson University. Clarkson University has kindly made sample images of one subject available for public release. Sample data can be downloaded from here.

Clarkson University's Quality-Face/Iris Research Ensemble (Q-FIRE) is a multi-biometric (face and iris) dataset where images are collected at five distances from camera (baseline, 5 feet, 7 feet, 11 feet, 15 feet, and 25 feet) with varying quality (resolution, ambient (or external) illumination, out-of-focus blur, multiple faces, gaze/pose angles, motion blur, and iris occlusion). Over 175 subjects are included with at least two visits each. The dataset also includes soft biometrics such as height and weight, for subjects of different age groups, ethnicity and gender with variable number of sessions/subject. Only Q-FIRE iris images (i.e. NIR illumination) will be used in IQCE.

Detail information on Q-FIRE dataset overview here.

Detail information on Q-FIRE data collection steps here.

Q-FIRE is funded by the Department of Homeland Security (DHS) Science and Technology (S&T) Directorate in cooperation with the National Science Foundation.

NIST is grateful to Clarkson University Q-FIRE team, specially Prof. Stephanie Schuckers for making this data available to us. Special thanks to Mr. Christopher Miles at DHS for supporting Q-FIRE and IQCE.

### SDK submission is open

January 27, 2010: Organizations wishing to participate in IQCE should follow steps oulined in section A.2 of the latest version (version 4.4) of IQCE API specification. FAQ is posted here.

### Validation package

January 27, 2010: Validation dataset is available here. Question should be directed to irex [at] nist.gov (irex[at]nist[dot]gov).

The purpose of validation is to verify the correct operation of participants' software before and after delivery to NIST. Validation is the process of checking that our linking and execution of your software gives identical results to your execution given the same input data. Participants are asked to use the images in the validation dataset and send us, along with their encrypted SDK, output file(s) as specified below:

Class X participants: One output file1. Quality (IQAA) SDKFormat: [imagefilename] [quality_vector] [image_enhanced]

Class Y participants: Two output files1. Quality and template generation SDKFormat:[imagefilename] [template_size] [quality_vector] [image_enhanced]2. Matching (comparison) SDKFormat: [imagefilename1] [imagefilename2] [comparison_score]

Class Z participants: Two output files1. Template generation SDKFormat (without quality computation):[imagefilename] [template_size] [image_enhanced]Format (with quality computation):[imagefilename] [template_size] [quality_vector] [image_enhanced]2. Matching (comparison) SDKFormat: [imagefilename1] [imagefilename2] [comparison_score]Quality_vector shall have the format specified in Table 4 of the latest version of IQCE API specification. A full cross comparison of images in the validation dataset shall be performed.

## IREX II IQCE - Cryptographic Protection of Vendor Data

### Public Key for Encrypting SDK submissions to NIST

October 4, 2009: The NIST public key for encryption of all software send to NIST is as follows. Use of this key is required. NIST does not accept responsiblity for any unencrypted software sent to NIST.

pub 1024D/856B9B28 2008-05-28 Key fingerprint = 846E 7008 996A E912 974C F8D7 1C7A 0F22 856B 9B28 uid IREX Test Liaison (IREX Test Liaison Key) irex [at] nist.gov (irex[at]nist[dot]gov) sub 2048g/5ABA2D90 2008-05-28

## IREX II IQCE - Test Plan Development

### Procedural updates

January 16, 2010: Organizations wishing to participate in IREX II IQCE should email irex [at] nist.gov (irex[at]nist[dot]gov). Participation is open from January 26 till May 24, 2010. The primary requirement for participation is an ability to implement the IQCE API specification. The latest version is 4.1. A validation package will be released in few days.

### Final Draft of CONOPS + API

January 12, 2010: Bug fix in section 15.2. IREX II IQCE concept, evaluation plan and API version 4.4 gcc version 4.1.2-14 for RedHat Linux gcc version 3.4.4 for Windows.

December 24, 2009: The fourth and final draft of the IREX II IQCE concept, evaluation plan and API is posted. Many thanks to those who reviewed and sent us comments. NIST proposed disposition of comments here.

### CDF of iris and pupil radii

December 21, 2009: Cumulative distribution functions of (best estimate) of pupil radius and iris radius of IREX I corpra are here.

### 3rd Draft of CONOPS + API

November 27, 2009: The third draft of the IREX II IQCE concept, evaluation plan and API is posted. Many thanks to those who reviewed and sent us comments. NIST proposed disposition of comments here. Please send us any fixes, questions, or suggestion by December 21, 2009.

Major changes:

Table 4 -IQAAs output format has been changed. The length of quality vector is extended to 64, and new quality metrics (margin, magnification, pupil shpae and interlacehas been added.

Timeline and Clause 12 has been revised. To support research and development, IQCE will embed multiple rounds of testing. Submission period begins in January 2010 and will end in May 2010. See Clause 12.

### 2nd Draft of CONOPS + API

October 22, 2009: The second draft of the IREX II IQCE concept, evaluation plan and API is now available. Many thanks to those who reviewed and sent us comments. Per comments and requests, the deadline for submission of final SDKs is extended. See page 2 for the update IQCE schedule.

Comments on the 2nd draft are welcome, please send us your comments by November 15.

### Important dates:

October 4, 2009: Launch of IREX II IQCE - Relaese of 1st draft of test plan

October 18, 2009: Comments on 1st draft due

October 22, 2009: Release of 2nd draft of test plan

November 15, 2009: 2nd (and final) comment period ends

December 14, 2009: Release of final evaluation plan

January 26, 2010: Submission period opens (rounds of submit -> evaluate -> report)

February 4, 2010: Deadline for submission of signed Annex A Particiaption Application to NIST

May 24, 2010: Submission period ends

### Initial CONOPS + API

October 4, 2009: The first draft of the IREX II IQCE concept, evaluation plan and API is now available. Comments are welcome, please send us your comments by October 18. See page 2 for the IQCE (tentative) schedule.

### Scope

October 4, 2009: The IQCE activity supports a new, formal, standard addressing iris quality. That standard, ISO/IEC 29794-6 Iris Image Quality, was initiated by the Working Group 3 of the ISO SC 37 committee in July 2009. The standard will define a vector of quality components each of which is some quantitative measure of a subject-specific or image-specific covariate. The current working draft (SC 37 N 3331) defines 21 subject or image covariates and 12 metrics for assessing the utility of an iris image. The 12 quality metrics are mostly quantification of the covariates. IQCE will evaluate these quality metrics influence on iris recognition accuracy. In addition, any measure identified as being influential on accuracy will be considered. The outcome will be a refined list of quality metrics with tolerance bounds for each. Furthermore, IQCE will establish precise methods for measuring each metric. This ensures development of a clear, tested and implementable iris image quality by excluding or avoiding any over-prescriptive and non-testable statements. The overall effect of IQCE and the ISO/IEC 29794-6 standard will be to validate and support camera imaging properties and system design.

Also, IQCE aims to evaluate the effectiveness of image quality assessment algorithms (IQAAs) that produce a scalar overall image quality in predicting the recognition accuracy of particular comparison algorithms (from the supplier of the IQAA), and of other algorithms. Furthermore, per the IREX I result that quality scores are not immediately interoperable, IQCE will establish a score calibration procedure for IQAAs.

This activity encourages participation from the main commercial providers and academic institutions, non-profit research laboratories and consultancies for which prototype implementations exist.

The NIST Iris Exchange Program was initiated at NIST in support of an expanded marketplace of iris-based applications based on standardized interoperable iris imagery. IREX I was primarily conducted in support of the ISO/IEC 19794-6 standard, now under revision. It secondarily supports the recently completed ANSI/NIST ITL 1-2007 Type 17 standard, as derived from the ISO/IEC 19794-6:2005 parent, and future revisions thereof. The Iris Quality Calibration and Evaluation (IQCE) is the second activity under the IREX iris image interoperability umbrella.

NIST intends to publish the results of the IREX II IQCE before the end of 2010.

### IREX II Mailing List

October 4, 2009: To be notified of future IREX II announcements please send a request email to elham.tabassi [at] nist.gov (elham.tabassi[at]nist.gov)

### IRIS Links

IREX OverviewIREX DatasetsIREX VIIIREX VIIREX VIREX IVIREX IIIIREX IICEIris Image Quality Bibliography

### Sponsors

Department of Homeland Security
                      - S & T

Information technologyBiometrics

## Contacts

                -      Email comments    irex@nist.gov   

### HEADQUARTERS

301-975-2000

Webmaster | Contact Us | Our Other Offices

TwitterFacebookLinkedInInstagramYouTubeGiphyRSS FeedMailing List

Feedback

            -  Site Privacy 
            -  Accessibility 
            -  Privacy Program 
            -  Copyrights 
            -  Vulnerability Disclosure 
            -  No Fear Act Policy 
            -  FOIA 
            -  Environmental Policy 
            -  Scientific Integrity 
            -  Information Quality Standards 
            -  Commerce.gov 
            -  Science.gov 
            -  USA.gov 
            -  Vote.gov