Multiple Biometric Grand Chal

Third Workshop 

04 D
MBGC Sponsors 

Executing Agency 

Sponsoring Agencies 

Director of National Intelligence Intelligence Advanced Research Projects Activity 

– Science & Technology Directorate 

– Criminal Justice Informa– Operational Technology 
The MBGC Team 

• NIST

– Test Director, Dr. P. Jonathon Phillips

• Colorado State University

– Prof. Ross Beveridge, Prof. Geof Givens, Prof. Bruce D

Bolme, Yui Man Lui, Nayeem Teli

• SAIC

– Dr. Todd Scruggs, Dr. Grace E. Cho

• Schafer Corporation

– Jay Scallan Jay Scallan

• University of Notre Dame

– Prof. Kevin Bowyer & Prof. Patrick Flynn

• University University of Texas at Dallas

– Prof. Alice O’Toole
Overview 

• MBGC Overview• Results MBGC Version 2.0 Part 1

– Still Face– Video

• Talk & Lunch• Result M B s MGC V ersi on 2 0 P 2t 2.0 Part 2

– Portal

• Future Challenges Future Challenges • Multiple Biometric Evaluation 2010
Challenge Problems 

• What are challenge problems? 

– A series of experiments designed to advan

technology’s state-of-the-art 

• Experiments designed • Experiments and test data distributed to resear• Researchers complete experiments and submit • S cores are consolid ate

dand reporte

d 

– Introduction of new technology 
Ideal Challenge Problem 

Today 

Challenge Problem Difficulty 

Time 

eg rmance / Perfo /ogress Pr

Time / Effort / $ 
Technology Progress 

2000 

1996 

2002 

1993 

• 17 Years • 7E l i 

Evaluations 

• 5 Challenge Problems 

(Technology Develo

pment) 

2010 

( gy p • 3 Biometrics 

MBE • 150,000+ Facial and Iris 

Images 

2008 

2010 

2006 
Improved FR Performance 

Face Recognition Error Rate 
Still Face

MBGC Challenge Problems 

Portal Video 

Video Still Face 

I

Mugshot 
MBGC Goal 

• The main goal of the Multiple Biometric Grand Challen

(MBGC) is to

– Address face and iris recognition problems tha

relevant to those found in operational data

• Low to medium resolution face• Still and video iris• Near Infrared (NIR) & High Definition (HD) video f

portals

• Unconstrained recognition from still & video
MBGC Goal 

– o c 

• Programmatic method

Sequence Sequence f ochallenge hallenge problems problems

• Modeled after the FRGC and ICE 2005• Challenge problems and data distributed to

researchers

– Workshops– Multiple Biometric Evaluation 2010
Schedule Task 

December 2007 

Formal annoucement of MBGC project Begin data collection at University of Notre DDesign protocols, challenge problems and p

ame 

repare 

April 2008 1st MBGC Workshop Release 1st challenge problem 

December 2008 2nd MBGC Workshop Results Challenge Problem Version 1 

May 2009 Release Challenge Problem Version 2 

December 2009 3rd MBGC Workshop Results Challenge Problem Version 2 

Timeline • Estimated task schedule for MBGC: Estimated task schedule for MBGC:
MBGC Implementation • MBGC Team MBGC Team 

– Collect and prepare data– Define challenge problems Define challenge problems – Develop challenge problem protocols– Prepare data for distribution– Score submitted results

• Participants

– Develop technology and algorithms– Submit self reported similarity matrices for

challenge problems problems.
MBGC Participation to Date 

• Organizations given access to MBGC data. 78 • Organizations submitting results for MBGC version 2.0• Both industry and academic organizations participated 

– Industry 8 – Academic 5 

• Countries 

– China – France – Germany – Japan – Lithuania – United Kingdom – United States 
MBGC Version 2 Results 

• Challenge p roblems released late s

p g rin

g 200

• Results were submitted in November 2009. 

– Portal 2 November – Video 9 November – Still Face 16 November 

• Similarity matrices submitted. • Similarity matrices are self reported Similarity matrices are self reported. 

• These matrices represent participants best ef
Challenge problem assessments 

• Provides Provides snapshot snapshot at one date

– MBGC v2: Beginning of November 2009

• Power from multiple ultiple results results

• Reasonable assessment
Summary 

• Solid Progress Progress

– Frontal Face– Portal

• Challenge Challenge areas identified. areas identified.