Individualization of People fr

Individualization of People f

Richard W. Vorder Brue

Richard W. Vorder Brue

FBI Operational Technology D

FBI Operational Technology D

Forensic Audio, Video a

Forensic Audio, Video a

Image Analysis Unit (FAV

Image Analysis Unit (FAV

Quantico, VA 22135 Quantico, VA 22135

703

-632

-6315

rvorderbruegge@fbiacad

rvorderbruegge@fbiacad
Operational Technology 

Operational Technology 

DIGITAL EVIDENCE SEC

DIGITAL EVIDENCE SEC

FORENSIC AUDIO, VIDEO AND IMAGE AN

IMAGE ANALYSIS 

VIDEO 

AU

VIDEO 

AUDIO ENHA

SPEC

FACIAL & CLOTHING COMPARISIONS

HEIGHT DETERMINATION

IMAGE AUTHENTICTY

IMAGE ENHACEMENT

AUDIO

AUDIO ENHANCEMENT

SIGNAL ANALYSIS

AUTHENTICITY

VOICE COMPARISON

MISCELLANEOUS REPAIRS
 Film

 Photogr

Photogr

 Video t

Video t

 Digital 

Digital 

 Digital 

Digital 

EVIDENC

EVIDENC

CASES SUBMITTED CASES SUBMITTED

 Terrorism Terrorism Homicide Homicide Armed Robbery Armed Robbery Financial Fraud Financial Fraud  Public Corruption Public Corruption Health Care Fraud Health Care Fraud Money Laundering Money Laundering
Forensic Photographic E

Forensic Photographic E

 Comparisons of Questioned Imag

Comparisons of Questioned Imag

Known Objects, Places, or Image

Known Objects, Places, or Image

– Facial Comparisons/Personal Ident

Facial Comparisons/Personal Ident

– Identification of camera as source o

Identification of camera as source o

– Clothing, vehicles, rooms, etc. (An

Clothing, vehicles, rooms, etc. (An

can be photographed can be compa

can be photographed can be compa

 Detection of Image Manipulation 

Detection of Image Manipulation 

Image Authentication Image Authentication

 Photogrammetric Examinations Photogrammetric Examinations Information Extraction (Enhance

Information Extraction (Enhance
Forensic Photographic E

Forensic Photographic E

 FBI Laboratory has conducted th

FBI Laboratory has conducted th

since the 1930 since the 1930’s.

 Bank Protection Act of 1967 Bank Protection Act of 1967 Expert Witness Testimony Expert Witness Testimony Open Court Open Court Daubert & Daubert & Kumho Tire Standard

Tire Standard

– Accepted field, peer Accepted field, peer-reviewed, kno

reviewed, kno

rate, testable. rate, testable.

– Facial ID Statistics? Facial ID Statistics?
Personal Identification fr

Facial Identificat

Personal Identification fr

Facial Identificat

 Lack of statistics means: Lack of statistics means: Conclusions are ultimately opinio

Conclusions are ultimately opinio

– 100% certainty (ID or Elimination) 

100% certainty (ID or Elimination) 

knowledge, training, and experienc

knowledge, training, and experienc

– Same as fingerprint testimony! Same as fingerprint testimony!

– Error rates calculated for practition

Error rates calculated for practition

technique. technique.

 Forensic science needs more data

Forensic science needs more data
Recognition vs. Iden

Recognition vs. Iden
Personal Identificatio

Photographic An

Personal Identificatio

Photographic Ana

 Positive Identification of Individ

Positive Identification of Individ

depends upon presence and visib

depends upon presence and visib

individual identifying characteri

individual identifying characteri

– Ear patterns Ear patterns

– Moles, Skin Tags, Birthmarks Moles, Skin Tags, Birthmarks

– Freckle Patterns Freckle Patterns

– Scars

– Tattoos Tattoos

– Knuckle Crease Patterns Knuckle Crease Patterns
Techniques of Photogr

Facial Comparison

Techniques of Photogr

Facial Comparison

 Morphological Analysis Morphological Analysis

– Point

-by

-point analysis point analysis

– Measurements secondary/approxim

Measurements secondary/approxim

 Photo

-Anthropometric Techniqu

Anthropometric Techniqu

– Dimensional analysis Dimensional analysis

– Measurements primary, points sec

Measurements primary, points sec

 Photographic Video Superimpos

Photographic Video Superimpos

–

“Real

-time

” combination of other 

combination of other 

– Inherently dimensional, but not Inherently dimensional, but not 

“m

m
Photographic Compar

Principle of Individuali

Photographic Compar

Principle of Individuali

 The individualization of an item 

The individualization of an item 

is established by finding agreem

is established by finding agreem

corresponding individual charact

corresponding individual charac

such number and significance as 

such number and significance as 

the possibility (or probability) of 

the possibility (or probability) of 

having occurred by mere coincid

having occurred by mere coincid

establishing that there are no ine

establishing that there are no ine

differences. differences. (Adapted from Tuthi

(Adapted from Tuthi
Class Characteristic

Class Characteristic

Photographic Facial Com

Photographic Facial Com

 Characteristics s Characteristics shared by perso

hared by perso

group

– Overall shape of face, chin, m

Overall shape of face, chin, m

eyes, ears eyes, ears 

...

– General shape and characteris

General shape and characteris

hairline, facial hair, eyebrows

hairline, facial hair, eyebrows
Individual Identifyi

Individual Identifyi

Characteristics ( Characteristics (

“Minu

Minu

 Individual Identifying Characterist

Individual Identifying Characterist

differentiate persons from others in 

differentiate persons from others in 

can make a person can make a person 

“unique

” either 

either 

combination combination

 Moles, freckles, ear patterns, b

Moles, freckles, ear patterns, b

chipped teeth, tattoos chipped teeth, tattoos 

...

 Irregularities of hairline, eyeb

Irregularities of hairline, eyeb

hair... hair...
Critical Factors in Pho

Facial Comparis

Critical Factors in Pho

Facial Comparis

 Comparable views of Questioned 

Comparable views of Questione

Known individuals is crucial Known individuals is crucial

– Camera

-subject geometry subject geometry

» Angle» Distance/Perspective Distance/Perspective

– Lighting/shadows Lighting/shadows

– Image resolution (feature visibility

Image resolution (feature visibility

 SAME AS FACIAL RECOGNIT

SAME AS FACIAL RECOGNIT
Critical Factors in Phot

Facial Compariso

Critical Factors in Phot

Facial Compariso

 Transient nature of human face can a

Transient nature of human face can a

analysis: analysis:

– Facial expression Facial expression– Changes in weight or age Changes in weight or age– Addition/removal of facial hair Addition/removal of facial hair– Transience of blemishes (acne, freckles, 

Transience of blemishes (acne, freckles, 

 Intentional alteration: Intentional alteration:

– Make

-up

– Surgery Surgery
Visibility of Feat

Questioned Ima

Visibility of Featu

Questioned Ima

 Must be able to see features to id

Must be able to see features to id

people and object. people and object.

 Visibility is Dependent upon: Visibility is Dependent upon:

– Size of characteristic Size of characteristic

– Shape of characteristic Shape of characteristic

– Contrast of characteristic and 

Contrast of characteristic and 

»Dark marks on light skin Dark marks on light skin vs dar

dar

dark skin dark skin


Side-by-side compariso

side compariso

Questioned 

Questioned 
Facial Comparison Facial Comparison 

- Mo

Mo
Questioned vs. Known 

Questioned vs. Known 
Points of Comparison Points of Comparison 

- 
Points of Comparison Points of Comparison 





FBI Facial Comparis

General Procedure (1

FBI Facial Comparis

General Procedure (1

 Review questioned & known image

Review questioned & known image

 Ensure quality is best available Ensure quality is best available

– ask for more if needed ask for more if needed

 Matching views selected for best 1:

Matching views selected for best 1:

 Consider following for potential ov

Consider following for potential ov

– Nostrils Nostrils’ visibility (tilt of face) visibility (tilt of face)

– Eyes’ & Ears’ visibility (rotation of h

visibility (rotation of h

– If similar in Q & K, then If similar in Q & K, then

 Attempt image rotation and resizing 

Attempt image rotation and resizing 
FBI Facial Comparis

General Procedure (2

FBI Facial Comparis

General Procedure (2

 Select similar points for rotation of 

Select similar points for rotation of 

– Center of pupils or outer Center of pupils or outer corners of ey

corners of ey

 Once rotated, resize one (or both) im

Once rotated, resize one (or both) im

– Center of pupils, typically, but others 

Center of pupils, typically, but others 

 Create overlay in Photoshop and co

Create overlay in Photoshop and co

characteristics: characteristics:

– Relative spacing and size of features Relative spacing and size of features

– Class and Individual Identifying chara

Class and Individual Identifying char

– One

-page checklist utilized. page checklist utilized.
FBI Facial Comparis

Best Case Scenari

FBI Facial Comparis

Best Case Scenario

 High Quality Images (Q & K) High Quality Images (Q & K)

– Passport Passport-quality photos quality photos

– Passport Passport-quality lighting (no sh

quality lighting (no sh

 Same Camera Same Camera-Subject Geome

Subject Geome

 Potential to photograph subjec

Potential to photograph subjec

– Multiple photos, multiple angle

Multiple photos, multiple angle
FBI Facial Comparis

Best Case Scenari

FBI Facial Comparis

Best Case Scenario

 Recent Case in Washington, D

Recent Case in Washington, D

 Questioned Passport Photo Questioned Passport Photo Subject in custody thought to b

Subject in custody thought to 

passport. passport.

 Differences, however, in skin 

Differences, however, in skin 

hair style and other characteris

hair style and other characteris

defense position defense position 

“Not the sam

Not the sam
Questioned Individual (photogr

passport)

Questioned Individual (photogr

passport)
Known Individual Known Individual

photograph (frame 14) from K10 film 

photograph (frame 14) from K10 film 
Side-by-side comparison of X (from 

side comparison of X (from 

(from K10) (from K10)
Side- y-side comparison of X (from 

side comparison of X (from 

(from K10) (from K10)

by
Side-by-side comparison of X (fro

side comparison of X (fro

(from K10) (from K10)
Side-by-side comparison of X (

(from K10)

Side-by-side comparison of X (f

(from K10)
Reasons for Poor Qua

Reasons for Poor Qu

Imagery Imagery 

-Multi

-generational copies generational copies

-Digital image compression Digital image compression

-Improperly photographed orig

Improperly photographed orig

-All of the above All of the above

-Intentional alterations of imag

Intentional alterations of imag
Comparison of Twin

Comparison of Twin

Points of Comparison/Differ

Freckles on order of 1mm 

Points of Comparison/Differ

Freckles on order of 1mm 
Automated Facial Ident

Automated Facial Ident

Challenges/Problem

Challenges/Problem

 Target

-Camera geometry Camera geometry

– Changes in perspective affect measu

Changes in perspective affect measu

» Great promise in 3D Great promise in 3D

-morphable model

morphable model

» But where will we get 3D images of th

But where will we get 3D images of th

 Changes in facial expression Changes in facial expression 

 Differences in imaging system (ca

Differences in imaging system (ca

recording devices). recording devices).

– Resolution affects ability to identify 

Resolution affects ability to identify 

– Imperfect optics and other system ca

Imperfect optics and other system c
Long Range Challenge 

Enforcement and Intel Co

Long Range Challenge 

Enforcement and Intel Co

 LINKABLE/SEARCHABLE DAT

LINKABLE/SEARCHABLE DAT

– Multiple agencies, states, and jurisdi

Multiple agencies, states, and jurisdi

are building, known offender databa

are building, known offender databa

not necessarily compatible or sharea

not necessarily compatible or sharea

– Quality of images usually poor Quality of images usually poor 

» 640 x 480 is NOT GOOD ENOUGH F

640 x 480 is NOT GOOD ENOUGH F

» JPEG damages images JPEG damages images

– ANSI/NIST STANDARD WILL IM

ANSI/NIST STANDARD WILL IM

QUALITY AND HELP DATA SHA

QUALITY AND HELP DATA SHA
GOAL FOR ANSI/NI

GOAL FOR ANSI/N

STANDARD: STANDARD:

FACIAL EQUIVALENT O

FACIAL EQUIVALENT 

10

-PRINT CARD PRINT CARD

“FORENSIC QUALIT

FORENSIC QUALIT
Can new ANSI/NIST 

Can new ANSI/NIST 

Addresses our Requi

Addresses our Requi

GOAL:

Resolution Resolution

on Face on Face

= 0.1 mm = 0.1 mm

(Requires (Requires

~ 1700 x 2515 ~ 1700 x 2515

pixels on face) pixels on face)
Proposed Level 50/51 Req

Proposed Level 50/51 Req

 0.1 mm resolution on face requires a

0.1 mm resolution on face requires a

1700 x 2515 pixels ON face. 1700 x 2515 pixels ON face.

– 3300 x 4400 pixels will meet for head & 

3300 x 4400 pixels will meet for head & 

– 2400 x 3200 pixels will meet for head o

2400 x 3200 pixels will meet for head o



5

-views needed for comparison purp

views needed for comparison purp

– Full Frontal (1) Full Frontal (1)

– Full Profiles (2) Full Profiles (2)

– 3/4 Profiles (2) 3/4 Profiles (2)
Proposed Level 50/51 Req

Proposed Level 50/51 Req

 Full scope of effect of compression r

Full scope of effect of compression r

determined. Therefore, for full front

determined. Therefore, for full front

lossless compression is requested for 

lossless compression is requested for 

– (Further research remains to be done) (Further research remains to be done)

– 15:1 for profile views is acceptable 15:1 for profile views is acceptable

 Ears MUST be visible in all photos (

Ears MUST be visible in all photos (

– Ear provides strong potential for indivi

Ear provides strong potential for indivi

prominent visible feature in questioned 

prominent visible feature in questioned 
Proposed Level 50/51 Req

Proposed Level 50/51 Req

 Acquisition of all images at level 50 

Acquisition of all images at level 50 

exceed requirements for all other lev

exceed requirements for all other lev

 In other words, if Level 50 is met, al

In other words, if Level 50 is met, al

and applications should have their re

and applications should have their re

as well. as well.

 Note that the 5 Note that the 5

-photo requirement wo

photo requirement w

for 3

-D facial models to be construct

D facial models to be construct

quality than with fewer images. quality than with fewer images.
Other means of Personal I

Other means of Personal I

 Positive Identification of Individ

Positive Identification of Individ

depends upon presence and visib

depends upon presence and visib

individual identifying characteri

individual identifying characteri

– Ear patterns Ear patterns

– Moles, Skin Tags, Birthmarks Moles, Skin Tags, Birthmarks

– Freckle Patterns Freckle Patterns

– Scars

– Tattoos Tattoos

– Knuckle Crease Patterns Knuckle Crease Patterns


Known Photo of Sus

Known Photo of Sus
Left arm detail Left arm detail

Photographic Compari

Knuckle and Freckle 

Photographic Compari

Knuckle and Freckle 

 Some images do not depict ques

Some images do not depict ques

individual individual’s face but do depict th

s face but do depict th

 Case examples have included: Case examples have included:

– Child abuse Child abuse

– Kidnapping Kidnapping

– Murder

 Possible to positively identify su

Possible to positively identify su

identifying characteristics are pr

identifying characteristics are pr
Questioned Thum

Questioned Thum
Known Thumb Known Thumb
Side-by-side Compar

Questioned and Known T

Side-by-side Compari

Questioned and Known T
Side-by-side Compariso

Questioned and Known Index 

Side-by-side Compariso

Questioned and Known Index 
Side-by-side Compariso

Questioned and Known Index 

Side-by-side Compariso

Questioned and Known Index 
Side-by-side comparis

Questioned and Known Th

Side-by-side comparis

Questioned and Known Th
Raw Image Raw Image 
Cropped & Processed version of Cropped & Processed version of 

“DSC

DSC
Left Hand of Suspec

Left Hand of Suspec
Cropped version of Left Hand of Su

Cropped version of Left Hand of Su
Comparison of Questioned Hand 

[from 

“DSC00008.jpg

”] 

with Known Hand (right)

Comparison of Questioned Hand 

[from 

“DSC00008.jpg

”] 

with Known Hand (right)
Comparison of Questioned Hand 

[from 

“DSC00008.jpg

”] 

with Known Hand (right)

Comparison of Questioned Hand 

[from 

“DSC00008.jpg

”] 

with Known Hand (right)
QUESTIONS? QUESTIONS?

Richard W. Vorder Brueg

Richard W. Vorder Brueg

FBI 

- FAVIAU 

- ERF

Building 27958 Building 27958

-

A

Quantico, VA 22135 Quantico, VA 22135

703

-632

-6315

rvorderbruegge@fbiacad

rvorderbruegge@fbiacad