# Presentation: 119288

## Usability Considerations for Face Image Capture at U.S. Ports of EntryNIST International Workshop on Usability and Biometrics June 23-24, 2008 Lawrence D. Nadel, Ph.DNoblis

- Usability Considerations for Face Image Capture at U.S. Ports of EntryNIST International Workshop on Usability and Biometrics June 23-24, 2008** **Lawrence D. Nadel, Ph.DNoblis

## Agenda

- US-VISIT background
- Potential face recognition applications in US-VISIT
*Port of entry* (POE) operational environments
- Usability considerations

## US-VISIT Background

*US‐VISIT provides biometric identification and analysis services to agencies throughout the immigration and border management, law enforcement and intelligence communities*
- US‐VISIT’s services help decision makers accurately identify people and assess whether they pose a risk to the United States
- Biometrics captured from non-US citizens, ages 14-79
- Biometrics captured at *Entry *– enhances security and facilitates legitimate travel
- Fingerprints
- 10P enrollment/background check, four‐finger verification
- Exit verification (under development)
- Facial image
- Human verifiable traveler history
- Currently no automated face recognition
- Biometrics captured at *Exit* (to be determined) – identify overstays, crosscheck watch lists

**Notes:**
US-VISIT Vision:  Advancing ... 
US-VISIT Mission:  To collect, maintain, and share information, including biometric identifiers, through a dynamic system, on foreign nationals to determine whether the individual:
Should be prohibited from entering the U.S.
Can receive, extend, change, or adjust immigration status
Has overstayed or otherwise violated the terms of their admission
Should be apprehended or detained for law enforcement action
Needs special protection/attention (i.e. refugees)
FP identification and verification
Enhance the security of our citizens and visitors 
Facilitate legitimate travel and trade
Ensure the integrity of our immigration system
Protect the privacy of our visitors

## Applications for Face Imaging/Recognition

- Human comparison
- Compare live photo with visa and/or past photos for visitors who have not been fingerprinted
- Compare live photo with e-Passport photo for first time Visa Waiver Program visitors
- Increase verification confidence through decision level or score level fusion
- Supplement fingerprint check for detecting aliased (duplicate) records or fraud
- Search face-only watch lists

## Diversity of Operational Environments,Use Cases, and Travelers

- Diversity of Operational Environments,Use Cases, and Travelers

- POE types
- Land – pedestrian, car, truck, bus
- Air – small plane, jumbo jet
- Sea – small boat, cruise ship
- Ambient environment - indoor/outdoor
- Variable illumination - day/night, directional, multi-spectral
- Entry – formal inspection stations
- Exit – little or no inspection infrastructure
- Travelers
- Cooperative, non-cooperative, uncooperative
- Multiple languages, cultures, appearances/clothing
- Hands full - luggage, packages, small children

## Air POE Environment

- Key factors for face recognition
- Pose angle
- Interocular pixel resolution
- Illumination
- Subject distance from camera
- 	(head size, distortion)
- Background

**Notes:**
Can’t show real images due to privacy regulations.

## Land POE Examples 

- Land POE Examples** **

_**Pedestrian Exit**_

_**Entry**_

## Usability-Related Interactions

**Workstation/**
**System**

**CBP Officer**

**Traveler**

## Indicate that a picture is being taken—where and when
Image capture sensor should look and sound like a camera
Provide simple and clear guidance (oral/written, foreign language, still images, video)
Limit physical degrees of freedom, e.g., indicate where feet should be placed on floor to control distance to camera
Accommodate traveler whose hands may be occupied, e.g.,  baggage,  small child
Align camera with user’s face—accommodate variable height (short/tall, standing, wheelchair); multiple cameras, portrait mode, wide field of view digital camera 

- Indicate that a picture is being taken—where and when
- Image capture sensor should look and sound like a camera
- Provide simple and clear guidance (oral/written, foreign language, still images, video)
- Limit physical degrees of freedom, e.g., indicate where feet should be placed on floor to control distance to camera
- Accommodate traveler whose hands may be occupied, e.g.,  baggage,  small child
- Align camera with user’s face—accommodate variable height (short/tall, standing, wheelchair); multiple cameras, portrait mode, wide field of view digital camera

- Cooperative Traveler

## Non-cooperative Traveler*

- Human factors engineering to direct traveler’s gaze at camera and have traveler pause for photo – no conscious effort on part of traveler required
- Printed signage
- Video display (static or variable)
- Strategic chokepoint
- Top of escalator
- Turnstile
- Portal

** For US-VISIT Exit*

## CBP Officer

- Officer needs to review documents, operate workstation, and interview and observe traveler.  Position equipment to minimize officer movement and minimize use of peripheral vision.
- Simple and logical workstation GUI.
- For officer positioning of camera, show geometric overlay on video screen to indicate proper placement and size of image to be captured.  Provide easy to use automated or manual camera control.

## Workstation/System

- Audio-visual feedback to both traveler and officer
- Automated image capture (“quality in the loop”)
- Automated control of camera focus, exposure
- Electronic control of pan-tilt-zoom (PTZ) camera
- Automated face finding and quality assessment algorithms
- Select image
- Crop

## Quality-in-the-Loop – Face Image Quality Improvement and Face Recognition Study

- Select and assess representative cameras
- Webcams
- Video with Pan-Tilt-Zoom
- Digital Still
- Wide Dynamic Range

- Determine “best” hardware/software combination; integrate to run *real time*; assess potential impact on image selection

- Integrate selected cameras; capture photos and video streams; run image quality software *post-capture* to assess impact

- Select and assess several face quality metric software tools
- Inter-eye distance, head position, face contrast, lighting uniformity, ...

## Simulated Demonstration of “Quality in the Loop” for Image Selection (Webcam) 

- Simulated Demonstration of “Quality in the Loop” for Image Selection (Webcam)** **

**(sec.)**

**(0-10)**

## Discussion

- Lawrence D. Nadel, Ph.D.
- Phone:  (703) 610-1677
- Email:  nadel@noblis.org