Test Methods for Evaluating Aerial Drones

Safety | Capabilities | Proficiency

RobotTestMethods.nist.gov

VERSION 2023A

Perform the designated flight paths around objects with omni bucket stands. Each flight path includes a sequence of

alignments with one or more buckets. While aligned with each bucket, control camera zoom and exposure to

capture a SINGLE IMAGE of the inscribed ring and IDENTIFY TARGETS inside each bucket or in view nearby. Identify

other objects of interest within the scenario at the same time.

• Score ALIGNMENT POINTS after the trial from images with UNBROKEN RINGS (5 pts) or BROKEN RINGS (1 pt).

• Score ACUITY POINTS by calling out the 5 increasingly small VISUAL ACUITY TARGET GAPS (1 pt each).

• Land CENTERED (5 pts) with the aircraft center inside the designated 60 cm (24 inch) diameter circle, or OFFSET (1

pt) with at least one propeller motor inside the circle.

• Start timer at launch and end after the last task is completed. Trial time limits are typically 5 minutes each (25

minutes to complete all 5 tests) although organizations may set their own trial time limits and passing scores.

• Extreme deviations from the intended flight path, or contact with any object, ends the trial to ensure safety.

20 

Open Vehicle Identification Scenarios

Day and Night Trials

Standard Test Methods for Small Unmanned 

ASTM International Standards Committee for Homeland Sec

Response Robots (E54.09) Website: RobotTestMetho

perches evaluate landing accuracy along with the functional pa

aircraft while landed at the chosen orbit radius. Perching demo

to maintain surveillance while conserving battery. The perch ta

vehicle that represent operationally significant underbody obje

A5, C5). 

Figre 14) Vehicle Identification Scenario flight pathRIGHT

Standard Test Methods for Small Unmanned A

ASTM International Standards Committee on Homeland Sec

Response Robots (E54.09) | Website: RobotTestMet

objects. All targets are on the exterior of the vehicle to eliminate potent

interior target obstructions, window glare, tinting, etc. Interior target id

bonus points because they are less comparable across trials due to chan

 

Figure 12) LEFT: The Open scenario for vehicle identification includes a f

A1 – FRONT SIDE OMNI B1 – PASSENGER SIDE OMNI

D1 – DRIVER’S SIDE OMNI C1 – REAR OMNI

REAR PERCH

FRONT PERCH

ROOF OMNI BUCKET TARGETS

(A1, B1, C1, D1) 

5 TARGETS TO IDENTIFY ON EACH SIDE = 20 TARGETS = 100 POINTS

STICKERS ON ALL SIDES OF THE VEHICLE 

AND SURROUNDING GROUND

PERCH BUCKETS TARGETS

FRONT AND REAR

1 

2 

3 

4 

5 

6 

7 

8 

9 

1

1

1

1

1

1

1

1

1

1

2

OTHER OBJECT

< 10 FT ALTITUDE AND RADIUS

10 FT

7 of 11

Standard Test Methods for Small Unmanned Aircraft Systems ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

Maintain Physical Distancing and Wear Face Coverings

Participants are not required to wear face coverings when working alone outdoors, except when others are 

present. Participants will carry face coverings and wear these when others approach. Minimum physical distances 

of 2 m (6 ft) will be maintained at all times.

Wash Hands Often and Disinfect Surfaces

Participants will wash their hands at the outdoor hand-washing station set up for the event. They should also 

disinfect commonly touched surfaces before initial use and after.

Safety Briefings and Other Gatherings

Safety briefings will be conducted each morning in the outdoor pavilion with physical distancing and mask wearing. 

Any gathering of people on the site should include physical distancing and masks. 

 Figure 1: LEFT) The outdoor pavilion will be set up for physical distancing. RIGHT) It can contain at least 14 people 

seated and 14 more standing in the designated surrounding locations. All are more than 2 m (6 ft) apart.

Pilot Stations:

Each test lane and scenario distributed across the site will have an EZ Up tent which is 3 m (10 ft) square to provide 

shade as a pilot station. There will be no more than four people at any single EZ Up.

Figure 2: Each pilot station typically includes a Pilot, Proctor, and Videographer. All will remain at least 2 m (6 ft) 

apart.

3 m (10 ft)

3 m (10 ft)

TEST LANE or SCENARIO

VIDEOGRAPHER PROCTOR PILOT

PILOTS

A

B C

D

INSPECT 

< 50 FT ALTITUDE AND RADIUS

OVERWATCH 

< 200 FT ALTITUDE AND RADIUS C

D

B

A

LAUNCH/LAND

CENTER

OVERWATCH

INSPECT

OBJECT

VEHICLE

STRUCTURE

ANYTHING OTHER OBJECT

< 10 FT ALTITUDE AND RADIUS

10 FT

7 of 11

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

Maintain Physical Distancing and Wear Face Coverings

Participants are not required to wear face coverings when working alone outdoors, except when others are 

present. Participants will carry face coverings and wear these when others approach. Minimum physical distances 

of 2 m (6 ft) will be maintained at all times.

Wash Hands Often and Disinfect Surfaces

Participants will wash their hands at the outdoor hand-washing station set up for the event. They should also 

disinfect commonly touched surfaces before initial use and after.

Safety Briefings and Other Gatherings

Safety briefings will be conducted each morning in the outdoor pavilion with physical distancing and mask wearing. 

Any gathering of people on the site should include physical distancing and masks. 

 Figure 1: LEFT) The outdoor pavilion will be set up for physical distancing. RIGHT) It can contain at least 14 people 

seated and 14 more standing in the designated surrounding locations. All are more than 2 m (6 ft) apart.

Pilot Stations:

Each test lane and scenario distributed across the site will have an EZ Up tent which is 3 m (10 ft) square to provide 

shade as a pilot station. There will be no more than four people at any single EZ Up.

Figure 2: Each pilot station typically includes a Pilot, Proctor, and Videographer. All will remain at least 2 m (6 ft) 

apart.

3 m (10 ft)

3 m (10 ft)

TEST LANE or SCENARIO

VIDEOGRAPHER PROCTOR PILOT

PILOTS

A

B C

D

INSPECT 

< 50 FT ALTITUDE AND RADIUS

OVERWATCH 

< 200 FT ALTITUDE AND RADIUS C

D

B

A

LAUNCH/LAND

CENTER

OVERWATCH

INSPECT

OBJECT

VEHICLE

STRUCTURE

ANYTHING

ROTATION

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

Related Scenarios with the Same Scoring Tasks

Open Scenarios

WIDE AREA SEARCH URBAN AREA SEARCH VEHICLE IDENTIFICATION

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

Standard Test Lanes Lead To Related Scenarios

Safety | Capabilities | Proficiency

VEHICLE INSPECTION DHS Responder Familiarization Exercise

ROOTOP 

FLUSH

OBSTACLE / SUNNY

RECESSED

OPEN / SUNNY

OPEN / SHADY

CONFINED

WIDE AREA SEARCH BUILDING EXTERIOR SEARCH

REMOTE PILOT TRAINING – CANADIAN POLICE COLLEGE, ONTARIO, CANADA

20 OMNI TARGETS = 100 PTS 20 EXTERIOR/INTEROR = 100 PTS 20 DOWNWARD 20 FORWARD

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

Standard Test Lanes Lead To Related Scenarios

Safety | Capabilities | Proficiency

VEHICLE INSPECTION DHS Responder Familiarization Exercise

ROOTOP 

FLUSH

OBSTACLE / SUNNY

RECESSED

OPEN / SUNNY

OPEN / SHADY

CONFINED

WIDE AREA SEARCH BUILDING EXTERIOR SEARCH

REMOTE PILOT TRAINING – CANADIAN POLICE COLLEGE, ONTARIO, CANADA

20 OMNI TARGETS = 100 PTS 20 EXTERIOR/INTEROR = 100 PTS 20 DOWNWARD 20 FORWARD

21

All scenarios have 20 targets for up to 100 pts each

Standard Test M

ASTM Internatio

Response 

Figure 16) A panel truck version o

targets plus a set of bonus targets 

 Figure 17) Any size vehicle or mulit-

and scoring.

Obstructed Test Lanes and 

Obstructed Test Lanes

VIN 

20 

AC

EXT

LO

NU

CO

CONCURRENT OBJECTIVES

FOR 3 TEAMS TO FLY

Unmanned Aircraft Systems

n Homeland Security Applications; 

 RobotTestMethods.nist.gov

OPEN AREA SEARCH

SCENARIO

10 FT

20 FT

30 FT

40 FT

7 of 11

Standard Test Methods for Small Unmanned Aircraft Systems ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

Maintain Physical Distancing and Wear Face Coverings

Participants are not required to wear face coverings when working alone outdoors, except when others are 

present. Participants will carry face coverings and wear these when others approach. Minimum physical distances 

of 2 m (6 ft) will be maintained at all times.

Wash Hands Often and Disinfect Surfaces

Participants will wash their hands at the outdoor hand-washing station set up for the event. They should also 

disinfect commonly touched surfaces before initial use and after.

Safety Briefings and Other Gatherings

Safety briefings will be conducted each morning in the outdoor pavilion with physical distancing and mask wearing. 

Any gathering of people on the site should include physical distancing and masks. 

 Figure 1: LEFT) The outdoor pavilion will be set up for physical distancing. RIGHT) It can contain at least 14 people 

seated and 14 more standing in the designated surrounding locations. All are more than 2 m (6 ft) apart.

Pilot Stations:

Each test lane and scenario distributed across the site will have an EZ Up tent which is 3 m (10 ft) square to provide 

shade as a pilot station. There will be no more than four people at any single EZ Up.

Figure 2: Each pilot station typically includes a Pilot, Proctor, and Videographer. All will remain at least 2 m (6 ft) 

apart.

3 m (10 ft)

3 m (10 ft)

TEST LANE or SCENARIO

VIDEOGRAPHER PROCTOR PILOT

PILOTS

15

rch Scenario

enue

ns 

. 

th 

e 

t, 

• Teams concurrently fly separate objectives set up at 

safe distances and/or altitudes apart (with a clearly 

designated and safe return path).

• Each pilot flies for 15 minutes across 3 different 

objectives for 5 minutes each. Teams move as 

necessary to maintain sight lines and communication.

• Scenarios restart with a different rotation of Pilot, 

Proctor, and VO.

SEQUENCE DOWN RANGE

RETURN OVER ROAD

Open Area Search Scenarios

Day and Night Trials

SCORABLE SCENARIOS

LEVEL 3 | OPEN AREA
Test Methods for Evaluating Aerial Drones

Safety | Capabilities | Proficiency

RobotTestMethods.nist.gov

VERSION 2023A

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

Version: 2020B12 Page 74

PILOT VIEW

DARK

< 1

LUX

LIGHTING

DAYLIGHT 1000+

LUX

LIGHTED 300+

LUX

GUSTS

_______

MPH

AVERAGE

______

MPH

WIND

(CIRCLE ONE) (CIRCLE ONE)

TIME LIMIT

(CIRCLE ONE OR FILL IN)

5

MIN

10

MIN

___

MIN

PAYLOAD FUNCTIONALITY TRIAL SCORING: PERPENDICULAR BUCKETS: Circle the points when the Pilot sees a completely inscribed ring (5 pts) or 

partial inscribed ring (1 pt). ANGLED BUCKETS: Circle the answer keys when the Pilot correctly identifies the Concentric C gap directions (1 pt each). 

BUCKET SIZE

1 QUART

10 cm (4 in)

(CIRCLE ONE)

INTERFACE

ONLY

BACK TO LANE

MANDATORY V.O.

LINE OF

SIGHT

FACING LANE 

OPTIONAL V.O.

POINTS

POINT

POINT

Edits to the Forms – Partial Credit for Pa

Open Test Lane

5

1

PARTIAL

PARTIAL

ALIGNED

POINTS

POINTS

POINTS

1

1A

1A

BROKEN

BROKEN

5

1

1

ALIGNED

Version: 2020B2

rd Test Methods for Small Unmanned Aircraft Systems

nternational Standards Committee on Homeland Security Applications; 

esponse Robots (E54.09) | Website: RobotTestMethods.nist.gov

10

erformance: Close Proximity Inspection

y | Capabilities | Proficiency

STRUCTURE INSPECTION STRUCTURE INSPECTION

DUAL BUCKET ALIGNMENTS GUIDE 

PILOTS INTO SAFE POSITIONS 

WITHIN PROXIMITY TO OBJECTS

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

36

ery County Police Drone Training & Evaluation Facility

Safety | Capabilities | Proficiency

nal Unmanned Aircraft Systems Program Evaluation, August 2020

I

CONFINED TEST LANE

GPS DENIED

and

DARK (<1 LUX)

DUAL BUCKET 

ALIGNMENTS

AT 1 M (3 FT) 

PROXIMITY TO 

OBSTACLES

E

OBSTRUCTED TEST LANE

DUAL BUCKET 

ALIGNMENTS

AT 2 M (6 FT) 

PROXIMITY TO 

OBSTACLES

LENGTH: 15 M (50 FT) LENGTH: 7.5 M (25 FT)

ree Different Test Lanes for Different Missions Obstructed Safety | Capabilities | ProficiencyTests and Scenarios

CHECKRIDE SCORESHEET

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

v2022B

Key: 

2020B

OBSTRUCTED TEST LANE SCENARIOS

6 Perch 7 Wall 8 Ground 9 Alley 10 Post

1 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt

2 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR

3 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt

4 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R

5 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt

6 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL

7 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt

8 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L

9 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 5 5pts 1pt 5 5pts 1pt

10 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 5A BL R TL L BL 5A BL R TL L BL

11 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 6 5pts 1pt 6 5pts 1pt

12 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 6A TR B TR L BR 6A TR B TR L BR

13 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 7 5pts 1pt 7 5pts 1pt

14 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 7A L BR T TL R 7A L BR T TL R

15 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 8 5pts 1pt 8 5pts 1pt

16 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 8A BR T TL R BL 8A BR T TL R BL

17 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 9 5pts 1pt 9 5pts 1pt

18 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 9A T BL B TR L 9A T BL B TR L

19 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 10 5pts 1pt 10 5pts 1pt

20 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 10A BL R TL L BL 10A BL R TL L BL

TOTAL

Elapsed 

Time : : : : : : : : : : : : : :

PASS FAIL PASS FAIL PASS FAIL PASS FAIL PASS FAIL PASS FAIL PASS FAIL


,I\RXUWUDLQLQJDLUFUDIWFDPHUDKDVDOLPLWHGUDQJHRIPRWLRQDOLJQZLWKDVPDQ\EXFNHWVDVSRVVLEOH3LORWSUR¿FLHQF\LVRQO\FRPSDUHGXVLQJVLPLODUV\VWHPV

		

	
	



	$)'$) %$")$'(%## ))%$%#"$*' )-&&" ) %$(/

(&%$(%%)(7A@1<E84( )0%%)())%(1$ ()1%+


	
$ 		

	
	



$"$ $"# $$  %"$'!!$ #


#! #  $#
(#$	  $#$$ ##$ &

	

+9

		

!" #""!" ! !


+5). %(00 5382* 00+9 367

/5)0+,35(0/-2+*47682*+50/2+,354(57/(047

&/5)0++().)355+)709/*+2/7/,+*32)+275/)-(4*/5+)7/32

 SWVSWSWV     

" "  " "  " "  " "  " "  " "  " "  

	SWVSWSWV 	 	 	 	 	 	

	 "" 	 "" 	 "" 	 "" 	 "" 	 "" 	 "" 


SWVSWSWV 
 
 
 
 
 



 ""  
 ""  
 ""  
 ""  
 ""   
 ""  
 "" 

SWVSWSWV      

""  ""  ""  ""  ""  ""  "" 


SWVSWSWV 
 
 
 
  


 ""  
 ""  
 ""  
 ""  
 ""    "  "

	SWVSWSWV 	 	 	 	 
 


	 "" 	 "" 	 "" 	 "" 	 "" 
" "  
" "  

SWVSWSWV      

" "  " "  " "  " "  " "   ""  "" 

	SWVSWSWV 	 	 	 	  

	 "" 	 "" 	 "" 	 "" 	 ""  ""   "" 


SWVSWSWV 
 
 
 
  


 ""  
 ""  
 ""  
 ""  
 ""   ""  "" 

SWVSWSWV      

""  ""  ""  ""  ""    "   "

""

0(46+*

"/1+       

!! !! !! !! !! !! !!


	


	







 	 
   

  


 
%*(%*!&%# *%() &$$!** &% 	&$#% +(!*. ''#!*!&%)0

)'&%)&&*) 7@?2;A8 4 )!*1 &&*)*
* &)2%!)*2&,

	

   =

&&* 
"1 666666666666666666666666666

&&* 
 666666666666666666666666666

&&* &%!1 666666666666666666666666666

!#&* & 1 6666666  &11666666

!#!*. 1 666666666666666666666666666

5

5 1 666666666666666666666666666

!$ 7=?;;81 666666666666666 %:1 666666



 

 







 


 



22



 


 


	 22



C<




	



	 <;;;B




	 >;;B













6666666


	



666666


	




7
 8 7
 8 7
   

8 7
 8

@





<;





666





#') !$ 1

1 1

1 1

1 1

1 1

1 1

1 1

1 
,I\RXUWUDLQLQJDLUFUDIWFDPHUDKDVDOLPLWHGUDQJHRIPRWLRQDOLJQZLWKDVPDQ\EXFNHWVDVSRVVLEOH3LORWSUR¿FLHQF\LVRQO\FRPSDUHGXVLQJVLPLODUV\VWHPV

		




 



		


	 



	 








	






	

	



 


			
























	


 '")*!)$*#'%'*""" $#$)(7A&)(8.%',' )2=3%+')*!)$*#'%'&') "" $#$)(7=&)8.%'33

)'%*)*!)$*#'%'# ((*!)(7<&)(81
0 '"%'')"- $)  &%' $)) %$(*( $)$(,'!-7=&) 81

=

>

?

@

A

B

C

D

E

=<

==

=>

=?

=@

=A

=B

=C

=D

=E

><

^>

K^dZhd

;ϮϬĐŵ͕ΘΗͿ

KE&/E

;ϭϬĐŵ͕κΗͿ


 

	&

!(
 "

%$ &$  ) %$$

	










	


	







%%)!0 666666666666666666666666666

%%)%"0 666666666666666666666666666

%%)%$ 0 666666666666666666666666666

 "%)%0 6666666%00666666

 " )-0 666666666666666666666666666

550 666666666666666666666666666

 #7>@<<80 666666666666666 $90666666










		 
 
	   
	 
 


	
  	    	 

 
 #'&!%($ " 
 

!!


  	   
 	
 
 

 	
 





	


	

















	


	







	


	   
	 
 


	    	 


 #'&!%($ " 
 

!!



	
   





 
	



 

 

















	




		 
 
	   
	 
 


	
  	    	 

 
 #'&!%($ " 
 

!!





	

		
	




	  


 
	



  
 
 	   






  	






 '! 

 





 ! 
 # 




 





" 




  	

 





 " 
 % 




 



	!$
$  	 &$ 
 "$ 

	
 
 





	  


 
	

 		 
 
	   
	 
 


	
  	    	 

 
 #'&!%($ " 
 

!!



	
  	
   


	  


 
	



	
 



 





  




  

 




 
  




	
 

  

		 
 
	   
	 
 


	
  	    	 

 
 #'&!%($ " 
 

!!





	

		
	




	  


 
	



 
 
 	   






  	






 '! 

 





 ! 
 # 




 






  	







"
 %








	 !$ 
 $  	 &$ 
 "$ 

 
 





	  


 
	



	
' 

!&$"

%$ &$)%$$


	


	

	



	
	


SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

2 GALLON

20 cm (8 in)

Pilot Code : _______ Proctor Code: : ______

Accessories: ___________________________

Drone Make: ___________________________

Drone Model: ___________________________

Facility : ___________________________

YYYY-MM-DD : ___________________________

Pilot Name: ___________________________

TIME:

(6) PERCH (7) WALL (8) GROUND (9) ALLEY (10) POST VEHICLE STRUCTURE

TOP

( T )

( B )

BOTTOM 

( TR ) TOP RIGHT

( R ) RIGHT

( BR ) BOTTOM RIGHT

TOP LEFT ( TL )

LEFT ( L )

BOTTOM LEFT ( BL )

A

Gap size (mm) Gap size (inches) Equivalent Avg. Human vision at 6 m (20 !)

40 mm 1.58 in 4.5 %

16 mm 0.63 in 11 %

6.4 mm 0.25 in 28 %

2.6 mm 0.10 in 70 %

1.0 mm 0.04 in 180 %

0.41 mm 0.016 in 440 %

For accurate calibration, the outer diameter of the largest Landolt C optotype should be 200 mm (7.9 in). 

Standard Test Methods for Response Robots

ASTM International Standards Committee on Homeland Security Applications;

Operational Equipment; Robots (E54.08.01)

Nested Landolt C Vision Test Chart

#3

ALTITUDE

SPACING

Page 4 11/9/21

rch

with delivery of personal floatation devices

pse with school bus and vehicle rescue

5 different flight paths to identify objects from safe altitudes in open 

calable for all sizes of aircraft to demonstrate positive control at all times 

 be performed outdoors or indoors to control lighting and weather. The 

or basketball or tennis court for small drones and/or novice pilots to 

the national airspace.

 well defined altitudes, positions, orientations, and perches to evaluate both 

nctionality.

Standard Test Methods for Response Robots 

M International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

48

st Lanes for Various Sizes of Aircraft

Project Overview

YSTEMS

DURES

VERING

RE

1A

SCALABLE TEST LANES (ALTITUDE = SPACING) ALTITUDE

SPACING

OMNI BUCKETS

Page 4 11/9/21

Standard Test Methods for Small Unmanned Aircraft Systems ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

• Wide area search of a plane crash site

• Vehicle identifications

• Hazardous tanker truck accident and fire

• Suspicious vehicle takedown

• Bus hostage situation

• Collapsed structure search

• Subway terrorist attack

• Flooded house rescue with delivery of personal floatation devices

• Flash flood bridge collapse with school bus and vehicle rescue

OPEN TEST LANES

The Open Test Lanes evaluates 5 different flight paths to identify objects from safe altitudes in open 

environments. These tests are scalable for all sizes of aircraft to demonstrate positive control at all times 

with accurate perches. They can be performed outdoors or indoors to control lighting and weather. The 

smallest size lane fits on an indoor basketball or tennis court for small drones and/or novice pilots to 

practice safely without flying in the national airspace.

Figure 4) The standard tests use well defined altitudes, positions, orientations, and perches to evaluate both 

Maneuvering and/or Payload Functionality.

Standard Test Methods for Response Robots ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

48

Scalable Test Lanes for Various Sizes of Aircraft Project Overview

Standard Test Methods for Small Unmanned Aircraft Systems ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

3

Introduction

Remotely operated aerial systems enable emergency 

responders to perform extremely hazardous tasks from 

safer stand-off distances. The U.S. National Institute of 

Standards and Technology is leading an international effort 

to develop standard test methods to help manufacturers, 

procurement professionals, and users objectively evaluate 

system capabilities and remote pilot proficiency to align 

with mission requirements. Thisimproves the safety and 

effectiveness of emergency responders as they save lives 

and protect property in our communities

The first step toward credentialing remote pilots is to get 

everybody onto the same measuring stick. That’s where 

standard test methods can play a key role. These test 

methods for Basic Maneuvering (MAN 1-5) and Payload 

Functionality (PAY 1-5) are being replicated across the 

country and internationally to focus training with 

quantitative measures of remote pilot proficiency. They are 

low cost and easy to replicate so everyone can measure 

their own progress over time and compare their proficiency 

to regional or national averages on similar 

systems. Concurrent test lanes can be set up to enable 

multiple systems and pilots to train or evaluate 

simultaneously. 

They are being standardized through the ASTM 

International Standards Committee on Homeland Security 

Applications; Response Robots (ASTM E54.09). They are also 

referenced as Job Performance Requirements in 

the National Fire Protection Association Standard for Small 

Unmanned Aircraft Systems Used For Public Safety 

Operations (NFPA 2400) and the ASTM Standard Guide for 

Training for Remote Pilot in Command of Unmanned 

Aircraft Systems Endorsement (ASTM F38.03 F3266-18). 

These suites of standard test methods provide common 

measures of capabilities with quantitative results. They can 

be conducted individually, in sequences, or embedded into 

operational training scenarios as repeatable and 

reproducible tasks with scores to augment qualitative 

assessments. Organizations using these tests set their own 

thresholds of acceptable system and pilot performance to 

align with their airspace, environment, and mission 

complexities. But those decisions are easier to make and 

trust when they’re based on quantitative performance data 

captured within standard test methods.

Basic Maneuvering (MAN 1-5) and Payload Functionality (PAY 1-5)

Safety | Capabilities | Proficiency

INSIDE EACH BUCKET

EVALUATE SENSORS

SMALL SYSTEMS LARGE SYSTEMS

INTERFACES PROCEDURES

SENSORS MANEUVERING

MEASURE & COMPARE

1A

SCALABLE TEST LANES (ALTITUDE = SPACING) ALTITUDE

SPACING

OMNI BUCKETS

URES

ERING

RE SCALABLE TEST LANES (ALTITUDE = SPACING)

Page 4 11/9/21

ne crash site

ccident and fire

wn

h

th delivery of personal floatation devices

e with school bus and vehicle rescue

different flight paths to identify objects from safe altitudes in open 

lable for all sizes of aircraft to demonstrate positive control at all times 

e performed outdoors or indoors to control lighting and weather. The 

r basketball or tennis court for small drones and/or novice pilots to 

e national airspace.

well defined altitudes, positions, orientations, and perches to evaluate both 

ctionality.

Standard Test Methods for Response Robots 

 International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

48

t Lanes for Various Sizes of Aircraft

Project Overview

3

Y 1-5)

STEMS

URES

ERING

E

1A

SCALABLE TEST LANES (ALTITUDE = SPACING) ALTITUDE

SPACING

OMNI BUCKETS

RONES

Pilot Organization _____________________________________

Drone Make _____________________________________

Drone Model _____________________________________

Facility Location _____________________________________

Date (YYYY/MM/DD) ______________________

PROCTOR NAME _____________________________________

Pilot FIRST Name _____________________________________

Pilot LAST Name _____________________________________

Team #: ______

ALIGNMENT SCORE: Circle points for images with UNBROKEN RINGS (5 pts) or BROKEN RINGS (1 pt). Draw a line through all incomplete. 

ACUITY SCORE: Circle correctly identified GAP DIRECTIONS in the answer key (1 pt each). 

Page 3

10 ft).

Figure 3) LEFT: Basic Maneuvering trial scores are based on bucket alignment images showing the 

inscribed ring around the inside perimeter of the bucket. RIGHT: This course focuses on Payload 

Functionality trials that add a modest operational workload at each bucket alignment by zooming into 

the acuity targets in the center of the bucket to correctly identify increasingly small features. The pilot 

Version 2022A 2

g yy 

Payload Functionality Trials with Pilot Back Turned

2

INTERNAL TEAM ROTATION

ILLUMINATED BUCK

POSITIONING AIDS LI

WINDOWS OR STR

BVLOS

BACK TURNED

Line of Sight FACING LANE OR

THE PILOT’S BACK TURNED TO THE LANE FORCES 

RELIANCE ON THE INTERFACE 

(VISUAL OBSERVER REQUIRED)

based on the intended mission:

– MAN (5 min. each) or PAY (10 min. each)

3) Select the minimum proficiency based on 

average or “expert” scores in the same trials:

– Example: 40%, 60%, 80% of “expert”

4) Select pilot view:

– Line of Sight or BVLOS

5) Select lighting (indoor or outdoor) for 

daylight or night credentials:

– Lighted/Daylight or Dark

DAYLIGH

ADDITIONAL

PRACTICE 

INTERFACE ONLY

IN FAMILIARITY 

TRIALS DAY 1 & 2.

USE INTERFACE 

ONLY FOR SCORING 

TRIALS ON DAY 3.

DECLARE EACH 

CONCENTRIC C FOR 

YOUR PROCTOR TO 

SCORE DURING 

THE TRIAL.

Conduct Tests Two Ways

Open Test Lane

[5] 1in screws to affix the buckets

[4] Slotted leg extensions

[8] 1⁄4-20 x 2in hanger bolts and wing nuts for the

leg extensions to slide on and tighten

[15] 8in diameter weatherproof stickers

(see website to download the sticker files)

[4] Big numbers 1-1-1-1 inside the top bucket

[4] Big letters A-B-C-D around the top bucket

[5] Acuity targets A-B-C-D inside bottom of all

[2] Perch acuity targets inside and bottom of A

.

The bucket stands are adjusted to vertical using the slotted leg extensions so the angled buckets are at 45 degrees.

Stickers inside each bucket have a GREEN INSCRIBED RING 

to guide alignment and a visual acuity target with 

increasingly small Concentric Cs gaps to identify the 

correct (1 of 8) orientations.

TOP

( T )

( B )

BOTTOM 

( TR ) TOP RIGHT

( R ) RIGHT

( BR ) BOTTOM RIGHT

TOP LEFT ( TL )

LEFT ( L )

BOTTOM LEFT ( BL )

A

Gap size (mm) Gap size (inches) Equivalent Avg. Human vision at 6 m (20 !)

40 mm 1.58 in 4.5 %

16 mm 0.63 in 11 %

6.4 mm 0.25 in 28 %

2.6 mm 0.10 in 70 %

1.0 mm 0.04 in 180 %

0.41 mm 0.016 in 440 %

For accurate calibration, the outer diameter of the largest Landolt C optotype should be 200 mm (7.9 in). 

Standard Test Methods for Response Robots ASTM International Standards Committee on Homeland Security Applications; Operational Equipment; Robots (E54.08.01)

Nested Landolt C Vision Test Chart

#3

DATE/TIME

PILOT CODE

48IN SQUARE LANDING WITH

12IN CENTER RADIUS TARGET

100-300 FT MEASURING TAPE

A

D

C

B 1, 2, 3, 4

LAUNCH

AD

PERCH 

ACUITY

P1

P1

LEAVE CARRY HANDLE ON TOP BUCKET

1A

1A 1A ALIGNED (5 PTS)

PARTIAL (1 PT)

Align with each bucket long enough to capture a 

single alignment image (NO ZOOM) showing the 

green ring inside the bucket. Score 5 points for a 

continuous green ring or 1 point for a partial. Similar 

scoring for accurate or partial landings.

Align with each bucket long enough to capture a 

single alignment image (NO ZOOM) AND a single 

acuity image of each target (MAX ZOOM). Score 1 

point for each correct identification of the 5 

increasingly small Concentric C gap directions.

Basic Maneuvering (MAN)

ALIGN WITH BUCKETS AND LAND ACCURATELY

Payload Functionality (PAY) 

ALIGN AND IDENTIFY ACUITY TARGETS

20 ALIGNMENTS TOTAL UP TO 100 POINTS 20 TARGETS TOTAL UP TO 100 POINTS

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

Montgomery County Police Drone Training & Evaluation Facility

Safety | Capabilities | Proficiency

DOJ/DHS National Unmanned Aircraft Systems Program Evaluation, August 2020

I

CONFINED TEST LANE

GPS DENIED

and

DARK (<1 LUX)

DUAL BUCKET 

ALIGNMENTS

AT 1 M (3 FT) 

PROXIMITY TO 

OBSTACLES

OPEN TEST LANE

B

LENGTH: 30/60 M (100/200 FT)

E

OBSTRUCTED TEST LANE

DUAL BUCKET 

ALIGNMENTS

AT 2 M (6 FT) 

PROXIMITY TO 

OBSTACLES

LENGTH: 15 M (50 FT) LENGTH: 7.5 M (25 FT)

ACCURATE (5 PTS)

Align with each bucket long enough to verify the 

inscribed ring and declare as many of the 5 Concentric 

C gap directions as possible to score 1 point each. Use 

video or zoomed in images after the trial to score 

yourself, although scores may differ from live trials. 

BROKEN (1 PT)

Payload Functionality Trials (PAY 1-5)

Scoring based on visual acuity targets

ALIGN THEN CONTROL ZOOM AND EXPOSURE

• Payload Functionality trails use alternating white and 

black bucket stands to apply a zoom/exposure 

workload at each alignment to identify acuity targets. 

• Align with each bucket long enough to verify the 

inscribed ring and verbally call out as many of the 

Concentric C gap directions as possible (1 pt each).

• Fly facing away from the test lane or scenario (with a 

visual observer) to rely only on your interface as if 

flying BVLOS.

•

Page 3

Maneuvering trial scores are based on bucket alignment images showing the 

the inside perimeter of the bucket. RIGHT: This course focuses on Payload 

 add a modest operational workload at each bucket alignment by zooming into 

e center of the bucket to correctly identify increasingly small features. The pilot 

2

Payload Functionality Trials with Pilot Back Turned

2

INTERNAL TEAM ROTATION

ILLUMINATED BUCKETS PROVIDE 

POSITIONING AIDS LIKE STRUCTURE 

WINDOWS OR STREET LIGHTS

BVLOS

BACK TURNED

Line of Sight FACING LANE OR

THE PILOT’S BACK TURNED TO THE LANE FORCES 

RELIANCE ON THE INTERFACE 

(VISUAL OBSERVER REQUIRED)

– MAN (5 min. each) or PAY (10 min. each)

3) Select the minimum proficiency based on 

average or “expert” scores in the same trials:

– Example: 40%, 60%, 80% of “expert”

4) Select pilot view:

– Line of Sight or BVLOS

5) Select lighting (indoor or outdoor) for 

daylight or night credentials:

– Lighted/Daylight or Dark

DAY

ADDITIONAL

PRACTICE 

INTERFACE ONLY

IN FAMILIARITY 

TRIALS DAY 1 & 2.

USE INTERFACE 

ONLY FOR SCORING 

TRIALS ON DAY 3.

DECLARE EACH 

CONCENTRIC C FOR 

YOUR PROCTOR TO 

SCORE DURING 

THE TRIAL.

Conduct Tests Two Ways

Open Test Lane

eg extensions

n hanger bolts and wing nuts for the

nsions to slide on and tighten

eter weatherproof stickers

site to download the sticker files)

umbers 1-1-1-1 inside the top bucket

etters A-B-C-D around the top bucket

y targets A-B-C-D inside bottom of all

acuity targets inside and bottom of A

ands are adjusted to vertical using the slotted leg extensions so the angled buckets are at 45 degrees.

 bucket have a GREEN INSCRIBED RING 

and a visual acuity target with 

oncentric Cs gaps to identify the 

ntations.

TOP

( T )

( B )

BOTTOM 

( TR ) TOP RIGHT

( R ) RIGHT

( BR ) BOTTOM RIGHT

TOP LEFT ( TL )

LEFT ( L )

BOTTOM LEFT ( BL )

A

Gap size (mm) Gap size (inches) Equivalent Avg. Human vision at 6 m (20 !)

40 mm 1.58 in 4.5 %

16 mm 0.63 in 11 %

6.4 mm 0.25 in 28 %

2.6 mm 0.10 in 70 %

1.0 mm 0.04 in 180 %

0.41 mm 0.016 in 440 %

For accurate calibration, the outer diameter of the largest Landolt C optotype should be 200 mm (7.9 in). 

Standard Test Methods for Response Robots ASTM International Standards Committee on Homeland Security Applications; Operational Equipment; Robots (E54.08.01)

Nested Landolt C Vision Test Chart

#3

/TIME

PILOT 

48IN SQUARE LANDING WITH

12IN CENTER RADIUS TARGET

100-300 FT MEASURING TAPE

D

C

B 1, 2, 3, 4

AD

LEAVE CARRY HANDLE ON TOP BUCKET

1A

1A 

ucket long enough to capture a 

mage (NO ZOOM) showing the 

the bucket. Score 5 points for a 

 or 1 point for a partial. Similar 

or accurate or partial landings.

Align with each bucket long enough to capture a 

single alignment image (NO ZOOM) AND a single 

acuity image of each target (MAX ZOOM). Score 1 

point for each correct identification of the 5 

increasingly small Concentric C gap directions.

ic Maneuvering (MAN)

ETS AND LAND ACCURATELY

Payload Functionality (PAY) 

ALIGN AND IDENTIFY ACUITY TARGETS

OTAL UP TO 100 POINTS 20 TARGETS TOTAL UP TO 100 POINTS

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

Montgomery County Police Drone Training & Evaluation Facility

Safety | Capabilities | Proficiency

DOJ/DHS National Unmanned Aircraft Systems Program Evaluation, August 2020

I

CONFINED TEST LANE

GPS DENIED

and

DARK (<1 LUX)

DUAL BUCKET 

ALIGNMENTS

AT 1 M (3 FT) 

PROXIMITY TO 

OBSTACLES

OPEN TEST LANE

B

LENGTH: 30/60 M (100/200 FT)

E

OBSTRUCTED TEST LANE

DUAL BUCKET 

ALIGNMENTS

AT 2 M (6 FT) 

PROXIMITY TO 

OBSTACLES

LENGTH: 15 M (50 FT) LENGTH: 7.5 M (25 FT)

ACCURATE (5 PTS)

Align with each bucket long enough to verify the 

inscribed ring and declare as many of the 5 Concentric 

C gap directions as possible to score 1 point each. Use 

video or zoomed in images after the trial to score 

yourself, although scores may differ from live trials. 

18 7

4

NE CENTERLINE

ALIGN

NON-STOP

NON-STOP

z

S

5(S)

CCW

4

5(S)

tainable speed directly over 

sh a stable hover over an 

onnaissance tasks. 

out starting over the 

 designated buckets and 

e lane.

 each bucket and the 

nments after the trial. 

luded in this test. 

nce of 80(S).

AN): Complete 5 laps with 20 

p to 100 alignment points. 

PAY): Same as Basic 

entify as many acuity target 

o 100 acuity points.

Unmanned Aircraft Systems Small Standard Test Methods for 

ASTM International Standards Committee for Homeland Security Applications;

RobotTestMethods.nist.gov Website: Response Robots (E54.09)

4 Page 

as many of the ts when correctly identifying scores poin and when they are aligned res the verbally decla

center acuity target. directions in the gap 5 increasingly small Concentric C 

. Alternating black trials Figure 4) All white omni bucket stands are used to evaluate Basic Maneuvering

. The visual acuity targets inside are trials omni bucket stands evaluate Payload Functionality and white 

Alternating either black on white or white on black to maintain the intended contrast with the buckets. 

e points. forces control of exposure to score all availabl buckets 

) LEFT: The remote pilot can fly either facing the test lane or with their back turned to fly 5 Figure 

a visual observer when with only as if operating beyond visual line of sight interface the using 

the as by rotating through roles Pilot teams help each other fly safely and efficiently required. RIGHT: 

Pilot, Visual Observer, and Proctor to practice each role.

11/9/21 5 Page 

Unmanned Aircraft Systems Standard Test Methods for Small

Standards Committee on Homeland Security Applications; ASTM International

RobotTestMethods.nist.gov Response Robots (E54.09) | Website: 

Figure 5) There are two ways to conduct test trials in the most basic Open Test Lane. LEFT: Basic 

ite buckets to guide alignments with to capture NO ZOOM images. RIGHT: Maneuvering trials use only wh

Payload Functionality trials add some operational workload to each bucket alignment task by capturing 

hite and black buckets MAX ZOOM images of the visual/thermal acuity targets. They also use alternating w

to maximize exposure control.

Figure 6) Open test lanes with all white buckets are used to evaluate basic Maneuvering trials only, which is 

buckets are used to the typical starting point for novice pilots. Test lanes with alternating white and black 

evaluate operational readiness and system capabilities.

Conduct Tests Two Ways

Open Test Lane

Standard Test Methods for Small Unmanned Aircraft Systems ASTM International Standards Committee on Homeland Security Applications; 

RobotTestMethods.nist.gov Response Robots (E54.09) | Website: 

5

Stands Bucket directional bucket stands, a - Each lane uses (4) omni

Platform, and a measuring taps Launch/Land

parts for each stand include: The centerline.

post center in 6x4x4 ] 1[

ends both taper deg 45 with legs in 12 x4x2 ] 4[

diameter) in 8( buckets white gallon - 2 ] 5[

top at leg per 2 – legs the affix to screws in 3 ] 10

buckets the affix to screws in 1 ] 5[

extensions leg Slotted ] 4[

the for nuts wing and bolts hanger in 2 x 20 - 1⁄4 ] 8[

tighten and on slide to extensions leg

stickers weatherproof diameter in 8 ] 15 [

files) sticker the download to website see (

bucket top the inside 1- 1- 1- 1 numbers Big ] 4[

bucket top the around D- C- B- A letters Big ] 4[

all of bottom inside D- C- B- A targets Acuity ] 5[

A of bottom and inside targets acuity Perch ] 2[

.

the angled buckets are at 45 degrees. so extensions leg slotted The bucket stands are adjusted to vertical using the 

Stickers inside each bucket have a GREEN INSCRIBED RING 

to guide alignment and a visual acuity target with 

increasingly small Concentric Cs gaps to identify the 

correct (1 of 8) orientations.

TOP

( T )

( B )

BOTTOM 

( TR ) TOP RIGHT

( R ) RIGHT

( BR ) BOTTOM RIGHT

TOP LEFT ( TL )

LEFT ( L )

BOTTOM LEFT ( BL )

A

) ! Equivalent Avg. Human vision at 6 m (20 Gap size (inches) Gap size (mm) 4.5 % 1.58 in 40 mm

11 % 0.63 in 16 mm

28 % 0.25 in 6.4 mm

70 % 0.10 in 2.6 mm

180 % 0.04 in 1.0 mm

440 % 0.016 in 0.41 mm

For accurate calibration, the outer diameter of the largest Landolt C optotype should be 200 mm (7.9 in). 

Standard Test Methods for Response Robots ASTM International Standards Committee on Homeland Security Applications; Operational Equipment; Robots (E54.08.01)

Nested Landolt C Vision Test Chart

#3

DATE/TIME PILOT CODE

48IN SQUARE LANDING WITH

12IN CENTER RADIUS TARGET

300 FT MEASURING TAPE - 100

(4) OMNI STANDS

A D

C

1, 2, 3, 4 B

LAUNCH

DA

PERCH 

ACUITY

P1

P1

LEAVE CARRY HANDLE ON TOP BUCKET

1A

1A 1A PARTIAL (1 PT) ALIGNED (5 PTS)

a enough to capture each bucket long Align with 

the showing (NO ZOOM) single alignment image 

bucket. Score 5 points for a ring inside the green 

continuous green ring or 1 point for a partial green 

ring. Similar scoring for accurate or partial landings.

Align with each bucket long enough to capture a 

of each bucket ) single alignment image (NO ZOOM

of each MAX ZOOM) single acuity image ( AND a 

target. Score 1 point for each correct identification of 

. directions increasingly small Concentric C gap 5 the 

) Basic Maneuvering (MAN

ALIGN WITH BUCKETS AND LAND ACCURATELY

Payload Functionality (PAY) 

ALIGN AND IDENTIFY ACUITY TARGETS

UP TO 100 POINTS TARGETS TOTAL 20 20 ALIGNMENTS TOTAL UP TO 100 POINTS

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

RobotTestMethods.nist.gov Response Robots (E54.09) | Website: 

Montgomery County Police Drone Training & Evaluation Facility

Safety | Capabilities | Proficiency

Program Evaluation, August 2020 DOJ/DHS National Unmanned Aircraft Systems 

I

CONFINED TEST LANE

GPS DENIED

d an

DARK (<1 LUX)

DUAL BUCKET 

ALIGNMENTS

AT 1 M (3 FT) 

PROXIMITY TO 

OBSTACLES

LANE OPEN TEST 

B

FT) LENGTH: 30/60 M (100/200 

E

OBSTRUCTED TEST LANE

DUAL BUCKET 

ALIGNMENTS

(6 FT) AT 2 M

PROXIMITY TO 

OBSTACLES

FT) LENGTH: 7.5 M (25 FT) LENGTH: 15 M (50 

ACCURATE (5 PTS)

BLACK BUCKETS & COLOR RINGS 

EMBEDDED INTO SCENARIOS

1

TOP

1A FRONT 

BACK 1C 1B LEFT 

RIGHT 1D 

ALL “A” BUCKETS

POINT TOWARD THE 

LAUNCH LAND /

HANDLE

CENTERLINE

ONLY THE NUMBERS 

CHANGE FOR EACH 

OMNI BUCKET STAND

1A

BROKEN INNER BLACK EDGE

IS THE JUDGEMENT POINT

POST

LEGS 

FLUSH WITH TOP

SHOWN ALIGNED ALIGNED NOT SHOWN 

BUCKETS & GREEN RINGS WHITE 

STANDARD TEST LANES IN 

Select Trial Settings for Different Flight Credentials

Focus Training and Evaluate Proficiency for Credentialing

Night Ops BVLOS Daylight/LOS CREDENTIALS

Standard Lane 

(Indoor or Outdoor)

Pilot’s Eyes On 

(Available)

Pilot’s Back Turned

(Interface Only) Lights Out, Buckets Lit

Embedded Scenario (Indoor or Outdoor)

Pilot’s Eyes On 

(Available)

Pilot’s Back Turned

(Interface Only) Lights Out, Buckets Lit

ILLUMINATED BUCKETS PROVIDE 

POSITIONING AIDS LIKE STRUCTURE 

WINDOWS OR STREET LIGHTS

BVLOS

BACK TURNED

Line of Sight FACING LANE OR

THE PILOT’S BACK TURNED TO THE LANE FORCES 

RELIANCE ON THE INTERFACE 

(VISUAL OBSERVER REQUIRED)

Select the test lane and scenarios based 1)

on the intended environment and aircraft: 

Open, Obstructed, or Indoor –

Select the test procedure and time limit 2)

based on the intended mission:

MAN (5 min. each) or PAY (10 min. each) –

Select the minimum proficiency based on 3)

average or “expert” scores in the same trials:

Example: 40%, 60%, 80% of “expert” –

Select pilot view: 4)

Line of Sight or BVLOS –

Select lighting (indoor or outdoor) for 5)

daylight or night credentials:

Lighted/Daylight or Dark –

DAYLIGHT / LOS ADDITIONAL

Line of SightE LAN FACINGInstruments Only D TURNE BACK

Interface

Only

BACK TURNED

Line of

Sight

FACING LANE • Verify your score after 

the trial using captured 

video, although scores 

may vary due to 

increased image or 

monitor resolution.

REPORT GAP DIRECTIONS RELATIVE TO THE BUCKET NUMBER (TOP)

TEST OR 

SCENARIO

Pilot with Interface

FACING AWAY

Visual Observer

FACING AIRCRAFT

OPEN SCENARIO | SEARCH ALIGNMENT ACUITY 

START TIMER. 

CAPTURE PRE-LAUNCH IMAGE OF CLOCK.

ALIGN 

BUCKET

IMAGE 

POINTS

CORRECT GAPS 

(1 POINT EACH)

1 HOVER OVER STAND #1 AT CHOSEN ALTITUDE 1 5 1 T BL R BR L

2 PITCH BACKWARD 1A 5 1 TR B TR L BR

3 ORBIT LEFTWARD 90° 1B 5 1 R TL T BL B

4 ORBIT LEFTWARD 90° 1C 5 1 BR R TL L BR

5 ORBIT LEFTWARD 90° 1D 5 1 B TL R BL T

6 HOVER OVER STAND #2 AT CHOSEN ALTITUDE 2 5 1 BL T BR R TL

7 PITCH BACKWARD 2A 5 1 L BR T TL R

8 ORBIT RIGHTWARD 90° 2D 5 1 TR B TL B BL

9 ORBIT RIGHTWARD 90° 2C 5 1 T BL R TL B

10 ORBIT RIGHTWARD 90° 2B 5 1 TL R TR L BR

11 HOVER OVER STAND #3 AT CHOSEN ALTITUDE 3 5 1 R TL B BL R

12 PITCH BACKWARD 3A 5 1 BR T TL R BL

13 ORBIT LEFTWARD 90° 3B 5 1 B TR R BL T

14 ORBIT LEFTWARD 90° 3C 5 1 BL R BL T BR

15 ORBIT LEFTWARD 90° 3D 5 1 L TL R BR T

16 HOVER OVER STAND #4 AT CHOSEN ALTITUDE 4 5 1 TL B TR R BR

17 PITCH BACKWARD 4A 5 1 T BL B TR L

18 ORBIT RIGHTWARD 90° 4D 5 1 BR B TL B TR

19 ORBIT RIGHTWARD 90° 4C 5 1 R BL T TR B

20 ORBIT RIGHTWARD 90° 4B 5 1 TR L BL R TL

STOP TIMER. 

RECORD SCORES AND ELAPSED TIME. /100 /100

ELAPSED TIME (MM:SS) TOTAL SCORE

OPEN SCENARIO | SEARCH OPEN SCENARIO | VEHICLE ALIGNMENT ACUITY 

START TIMER. 

CAPTURE PRE-LAUNCH IMAGE OF CLOCK.

ALIGN 

BUCKET

IMAGE 

POINTS

CORRECT GAPS 

(1 POINT EACH)

ALIGN OVER OMNI BUCKET – START TIMER # DESCRIPTION:

1 A1 - FRONT SIDE - ROOFTOP OMNI BUCKET A1 5 1 T BL R BR L

2 A2 - FRONT SIDE - WINDSHIELD CENTER A2 5 1 TR B TR L BR

3 A3 - FRONT SIDE - VIN # A3 5 1 R TL T BL B

4 A4 - FRONT SIDE - LICENSE PLATE A4 5 1 BR R TL L BR

5 A5 - FRONT SIDE - PERCH UNDERBODY BUCKET A5 5 1 B TL R BL T

6 B1 - PASSENGER SIDE - ROOFTOP OMNI BUCKET B1 5 1 BL T BR R TL

7 B2 - PASSENGER SIDE - FRONT WINDOW B2 5 1 L BR T TL R

8 B3 - PASSENGER SIDE - REAR WINDOW B3 5 1 TL R TR L BR

9 B4 - PASSENGER SIDE - EXTERIOR FEATURE B4 5 1 T BL R TL B

10 B5 - PASSENGER SIDE - SURROUNDING GROUND B5 5 1 TR B TL B BL

11 C1 - REAR SIDE - ROOTOP OMNI BUCKET C1 5 1 R TL B BL R

12 C2 - REAR SIDE - WINDOW CENTER C2 5 1 BR T TL R BL

13 C3 - LICENSE PLATE C3 5 1 B TR R BL T

14 C4 - EXTERIOR FEATURE C4 5 1 BL R BL T BR

15 C5 - PERCH UNDERBODY BUCKET C5 5 1 L TL R BR T

16 D1 - DRIVER SIDE - ROOFTOP OMNI BUCKET D1 5 1 TL B TR R BR

17 D2 - DRIVER SIDE - FRONT WINDOW D2 5 1 T BL B TR L

18 D3 - DRIVER SIDE - REAR WINDOW D3 5 1 TR L BL R TL

19 D4 - EXTERIOR FEATURE D4 5 1 R BL T TR B

20 D5 - SURROUNDING GROUND OBJECT D5 5 1 BR B TL B TR

STOP TIMER. 

RECORD SCORES AND ELAPSED TIME. /100 /100

ELAPSED TIME (MM:SS) TOTAL SCORE

OPEN SCENARIO | VEHICLE

STAND #1 STAND #2 STAND #3 STAND #4

FRONT PASSENGER DRIVER REAR

ELAPSED TIME (MM:SS) ELAPSED TIME (MM:SS)

SCORABLE SCENARIOS

LEVEL 3 | OPEN AREA

(FILL IN) (CIRCLE ONE or FILL IN)

5

MIN

10

MIN

__

MIN

PILOT VIEW TIME LIMIT

LINE OF

SIGHT

INTERFACE

ONLY

(CIRCLE ONE)

FACINE LANE

OPTIONAL V.O.

BACK TO LANE

MANDATORY V.O.

WIND

AVERAGE

_______

GUSTS

_______

MPH MPH

(CIRCLE ONE)

VISIBILITY

DARK

< 1 LUX

(CIRCLE ONE)

4 IN

(10 CM)

8 IN

(20 CM)

BUCKET DIAMETER

LIGHTED

300+ LUX

DIM

1-300 LUX