Test Methods for Evaluating Aerial Drones

Safety | Capabilities | Proficiency

RobotTestMethods.nist.gov

VERSION 2023A

Perform 5 different flight paths around the omni bucket stands. Each flight path includes as sequence of alignments

with one or more buckets. Capture a SINGLE IMAGE of the inscribed ring inside each bucket and land accurately.

• Score ALIGNMENT POINTS after trial from images with UNBROKEN RINGS (5 pts) or BROKEN RINGS (1 pt).

• Land CENTERED (5 pts) with the aircraft center inside the designated 60 cm (24 inch) diameter circle, or OFFSET

(1 pt) with at least one propeller motor inside the circle.

• Start timer at launch and end after the last task is completed. Trial time limits are typically 5 minutes each (25

minutes to complete all 5 tests) although organizations may set their own trial time limits and passing scores.

• Extreme deviations from the intended flight path, or contact with any object, ends the trial to ensure safety.

Unmanned Aircraft Systems

n Homeland Security Applications; 

 RobotTestMethods.nist.gov

20B9 Page 60

Related Scenarios

ORESHEET

0B2

he omni bucket stands in the test lane or as embedded

lignments with one or more buckets to identify recessed

e can maintain the designated position, orientation, and

ibed ring at the bottom of the bucket. A single alignment

al. Additional targets inside each bucket evaluate camera

nd thermal acuity and identify color shifts, hazardous

deviations from the intended flight paths or contact with

1

2

3

FLIGHT LINE

4

z

z

ALTITUDE S FLY STRAIGHT AND LEVEL OVER THE LANE CENTERLINE

START | END

ALIGN

NON-STOP

NON-STOP NON-STOP

NON-STOP

NON-STOP

NON-STOP

z

S

S S S S

5(S)

S

ALIGN CW

CCW

RECON

MAN/PAY 5

FLIGHT LINE

4

z

START | END 3

2

1

5(S)

S

S S S S

ALTITUDE 1⁄2( S) 2

3 4

5

1 2

5 4

3

CW

CCW

1

CCW

1 2

5 4

3

2

3 4

5

CW INSPECT

1

MAN/PAY 4

1

2

3

FLIGHT LINE

4

ALTITUDE S

START | END

5(S)

S

S S S S

1A

1B

2B

3B 3C

3D

2D

1D

TRAVERSE

MAN/PAY 2

FLIGHT LINE

4

z

z

z

ALTITUDE S

START | END 3

2

1

5(S)

ALTITUDE 2(S)

S

S S S S

POSITION

MAN/PAY 1

1

2

3

FLIGHT LINE

4 ALTITUDE 2(S)

START | END

S

S S S S

5(S

)

ALTITUDE S

#2 & 3A

3B 3C

3D

#1 & 3A

3B

3C

3D

ORBIT

MAN/PAY 3

,

e

f

o

d

e

d

e

d

e

d

d

e

h

n

e

t

e

d

n

e

e

e

e

d

g

A

)

o

• Demonstrate basic flight maneuvers between designated hover positions, 

orientations, and altitudes along the lane centerline at altitudes S and 2(S).

• Climb, descend, yaw, pitch, and roll to simultaneously align with downward 

buckets to check position then forward buckets to check altitude. 

• Complete 10 positions along the lane centerline with 18 alignments and 1 

accurate landing (counts double) to score up to 100 points. 

• Fly sideways parallel to objects while looking forward to identify features as if 

along a road, truck, bus, building, fence, tree line, etc. 

• Maintain altitude S flying leftward and rightward around the first three bucket 

stands to align with all the designated buckets.

• Complete 1 lap leftward then 1 lap rightward with 18 alignments and 2 

accurate landings to score up to 100 points. 

• Fly circular orbits around designated bucket stands while looking inward to 

identify features on all four sides. Fly altitude 2(S) leftward and rightward around 

stand #3 (white), then altitude S leftward and rightward around stand #2 (black).

• Each orbit has 5 bucket alignments starting with 1 downward radius check then 4 

altitude checks around the orbit looking inward at the angled buckets.

• Complete 4 orbits with 20 alignments to score up to 100 points. 

• Fly in closer proximity around objects to inspect detailed features on top and all 

four sides of the bucket stands.

• Maintain altitude 1/2(S) starting on top of each bucket stand with alternating 

leftward and rightward rotations to inspect all four sides of each bucket stand. 

• Complete all 4 stands with 20 alignments to score up to 100 points. 

• Fly straight and level over the centerline to establish a stable hover over an 

object down range to perform reconnaissance tasks. 

• Maintain altitude S to align with buckets and the landing at each end of the lane. 

Reconnaissance tasks are performed every 8(S) over a total distance of 80(S).

• Complete 5 laps (or 10 lane lengths) with 20 alignments to score up to 100 

points. 

1

2

3

FLIGHT LINE

4 ALTITUDE 2(S)

START | END

S

S S S S

5(S)

ALTITUDE S #1 & 2A

2B 2C

2D

#1 & 3A

3B

3C

3D

POSITION

MAN 1

TRAVERSE

MAN 2

RECON

MAN 5

INSPECT

MAN 4

ORBIT

MAN 3

MANEUVERING ONLY

LEVEL 2 | OPEN LANE M
Test Methods for Evaluating Aerial Drones

Safety | Capabilities | Proficiency

RobotTestMethods.nist.gov

VERSION 2023A

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

Version: 2020B12 Page 74

PILOT VIEW

DARK

< 1

LUX

LIGHTING

DAYLIGHT 1000+

LUX

LIGHTED 300+

LUX

GUSTS

_______

MPH

AVERAGE

______

MPH

WIND

(CIRCLE ONE) (CIRCLE ONE)

TIME LIMIT

(CIRCLE ONE OR FILL IN)

5

MIN

10

MIN

___

MIN

PAYLOAD FUNCTIONALITY TRIAL SCORING: PERPENDICULAR BUCKETS: Circle the points when the Pilot sees a completely inscribed ring (5 pts) or 

partial inscribed ring (1 pt). ANGLED BUCKETS: Circle the answer keys when the Pilot correctly identifies the Concentric C gap directions (1 pt each). 

BUCKET SIZE

1 QUART

10 cm (4 in)

(CIRCLE ONE)

INTERFACE

ONLY

BACK TO LANE

MANDATORY V.O.

LINE OF

SIGHT

FACING LANE 

OPTIONAL V.O.

POINTS

POINT

POINT

Edits to the Forms – Partial Credit for Pa

Open Test Lane

5

1

PARTIAL

PARTIAL

ALIGNED

POINTS

POINTS

POINTS

1

1A

1A

BROKEN

BROKEN

5

1

1

ALIGNED

Version: 2020B2

rd Test Methods for Small Unmanned Aircraft Systems

nternational Standards Committee on Homeland Security Applications; 

esponse Robots (E54.09) | Website: RobotTestMethods.nist.gov

10

erformance: Close Proximity Inspection

y | Capabilities | Proficiency

STRUCTURE INSPECTION STRUCTURE INSPECTION

DUAL BUCKET ALIGNMENTS GUIDE 

PILOTS INTO SAFE POSITIONS 

WITHIN PROXIMITY TO OBJECTS

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

36

ery County Police Drone Training & Evaluation Facility

Safety | Capabilities | Proficiency

nal Unmanned Aircraft Systems Program Evaluation, August 2020

I

CONFINED TEST LANE

GPS DENIED

and

DARK (<1 LUX)

DUAL BUCKET 

ALIGNMENTS

AT 1 M (3 FT) 

PROXIMITY TO 

OBSTACLES

E

OBSTRUCTED TEST LANE

DUAL BUCKET 

ALIGNMENTS

AT 2 M (6 FT) 

PROXIMITY TO 

OBSTACLES

LENGTH: 15 M (50 FT) LENGTH: 7.5 M (25 FT)

ree Different Test Lanes for Different Missions Obstructed Safety | Capabilities | ProficiencyTests and Scenarios

CHECKRIDE SCORESHEET

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

v2022B

Key: 

2020B

OBSTRUCTED TEST LANE SCENARIOS

6 Perch 7 Wall 8 Ground 9 Alley 10 Post

1 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt

2 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR

3 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt

4 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R

5 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt

6 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL

7 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt

8 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L

9 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 5 5pts 1pt 5 5pts 1pt

10 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 5A BL R TL L BL 5A BL R TL L BL

11 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 6 5pts 1pt 6 5pts 1pt

12 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 6A TR B TR L BR 6A TR B TR L BR

13 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 1 5pts 1pt 7 5pts 1pt 7 5pts 1pt

14 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 1A TR B TR L BR 7A L BR T TL R 7A L BR T TL R

15 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 2 5pts 1pt 8 5pts 1pt 8 5pts 1pt

16 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 2A L BR T TL R 8A BR T TL R BL 8A BR T TL R BL

17 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 3 5pts 1pt 9 5pts 1pt 9 5pts 1pt

18 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 3A BR T TL R BL 9A T BL B TR L 9A T BL B TR L

19 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 4 5pts 1pt 10 5pts 1pt 10 5pts 1pt

20 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 4A T BL B TR L 10A BL R TL L BL 10A BL R TL L BL

TOTAL

Elapsed 

Time : : : : : : : : : : : : : :

PASS FAIL PASS FAIL PASS FAIL PASS FAIL PASS FAIL PASS FAIL PASS FAIL


,I\RXUWUDLQLQJDLUFUDIWFDPHUDKDVDOLPLWHGUDQJHRIPRWLRQDOLJQZLWKDVPDQ\EXFNHWVDVSRVVLEOH3LORWSUR¿FLHQF\LVRQO\FRPSDUHGXVLQJVLPLODUV\VWHPV

		

	
	



	$)'$) %$")$'(%## ))%$%#"$*' )-&&" ) %$(/

(&%$(%%)(7A@1<E84( )0%%)())%(1$ ()1%+


	
$ 		

	
	



$"$ $"# $$  %"$'!!$ #


#! #  $#
(#$	  $#$$ ##$ &

	

+9

		

!" #""!" ! !


+5). %(00 5382* 00+9 367

/5)0+,35(0/-2+*47682*+50/2+,354(57/(047

&/5)0++().)355+)709/*+2/7/,+*32)+275/)-(4*/5+)7/32

 SWVSWSWV     

" "  " "  " "  " "  " "  " "  " "  

	SWVSWSWV 	 	 	 	 	 	

	 "" 	 "" 	 "" 	 "" 	 "" 	 "" 	 "" 


SWVSWSWV 
 
 
 
 
 



 ""  
 ""  
 ""  
 ""  
 ""   
 ""  
 "" 

SWVSWSWV      

""  ""  ""  ""  ""  ""  "" 


SWVSWSWV 
 
 
 
  


 ""  
 ""  
 ""  
 ""  
 ""    "  "

	SWVSWSWV 	 	 	 	 
 


	 "" 	 "" 	 "" 	 "" 	 "" 
" "  
" "  

SWVSWSWV      

" "  " "  " "  " "  " "   ""  "" 

	SWVSWSWV 	 	 	 	  

	 "" 	 "" 	 "" 	 "" 	 ""  ""   "" 


SWVSWSWV 
 
 
 
  


 ""  
 ""  
 ""  
 ""  
 ""   ""  "" 

SWVSWSWV      

""  ""  ""  ""  ""    "   "

""

0(46+*

"/1+       

!! !! !! !! !! !! !!


	


	







 	 
   

  


 
%*(%*!&%# *%() &$$!** &% 	&$#% +(!*. ''#!*!&%)0

)'&%)&&*) 7@?2;A8 4 )!*1 &&*)*
* &)2%!)*2&,

	

   =

&&* 
"1 666666666666666666666666666

&&* 
 666666666666666666666666666

&&* &%!1 666666666666666666666666666

!#&* & 1 6666666  &11666666

!#!*. 1 666666666666666666666666666

5

5 1 666666666666666666666666666

!$ 7=?;;81 666666666666666 %:1 666666



 

 







 


 



22



 


 


	 22



C<




	



	 <;;;B




	 >;;B













6666666


	



666666


	




7
 8 7
 8 7
   

8 7
 8

@





<;





666





#') !$ 1

1 1

1 1

1 1

1 1

1 1

1 1

1 
,I\RXUWUDLQLQJDLUFUDIWFDPHUDKDVDOLPLWHGUDQJHRIPRWLRQDOLJQZLWKDVPDQ\EXFNHWVDVSRVVLEOH3LORWSUR¿FLHQF\LVRQO\FRPSDUHGXVLQJVLPLODUV\VWHPV

		




 



		


	 



	 








	






	

	



 


			
























	


 '")*!)$*#'%'*""" $#$)(7A&)(8.%',' )2=3%+')*!)$*#'%'&') "" $#$)(7=&)8.%'33

)'%*)*!)$*#'%'# ((*!)(7<&)(81
0 '"%'')"- $)  &%' $)) %$(*( $)$(,'!-7=&) 81

=

>

?

@

A

B

C

D

E

=<

==

=>

=?

=@

=A

=B

=C

=D

=E

><

^>

K^dZhd

;ϮϬĐŵ͕ΘΗͿ

KE&/E

;ϭϬĐŵ͕κΗͿ


 

	&

!(
 "

%$ &$  ) %$$

	










	


	







%%)!0 666666666666666666666666666

%%)%"0 666666666666666666666666666

%%)%$ 0 666666666666666666666666666

 "%)%0 6666666%00666666

 " )-0 666666666666666666666666666

550 666666666666666666666666666

 #7>@<<80 666666666666666 $90666666










		 
 
	   
	 
 


	
  	    	 

 
 #'&!%($ " 
 

!!


  	   
 	
 
 

 	
 





	


	

















	


	







	


	   
	 
 


	    	 


 #'&!%($ " 
 

!!



	
   





 
	



 

 

















	




		 
 
	   
	 
 


	
  	    	 

 
 #'&!%($ " 
 

!!





	

		
	




	  


 
	



  
 
 	   






  	






 '! 

 





 ! 
 # 




 





" 




  	

 





 " 
 % 




 



	!$
$  	 &$ 
 "$ 

	
 
 





	  


 
	

 		 
 
	   
	 
 


	
  	    	 

 
 #'&!%($ " 
 

!!



	
  	
   


	  


 
	



	
 



 





  




  

 




 
  




	
 

  

		 
 
	   
	 
 


	
  	    	 

 
 #'&!%($ " 
 

!!





	

		
	




	  


 
	



 
 
 	   






  	






 '! 

 





 ! 
 # 




 






  	







"
 %








	 !$ 
 $  	 &$ 
 "$ 

 
 





	  


 
	



	
' 

!&$"

%$ &$)%$$


	


	

	



	
	


SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV SWVSWSWV

2 GALLON

20 cm (8 in)

Pilot Code : _______ Proctor Code: : ______

Accessories: ___________________________

Drone Make: ___________________________

Drone Model: ___________________________

Facility : ___________________________

YYYY-MM-DD : ___________________________

Pilot Name: ___________________________

TIME:

(6) PERCH (7) WALL (8) GROUND (9) ALLEY (10) POST VEHICLE STRUCTURE

TOP

( T )

( B )

BOTTOM 

( TR ) TOP RIGHT

( R ) RIGHT

( BR ) BOTTOM RIGHT

TOP LEFT ( TL )

LEFT ( L )

BOTTOM LEFT ( BL )

A

Gap size (mm) Gap size (inches) Equivalent Avg. Human vision at 6 m (20 !)

40 mm 1.58 in 4.5 %

16 mm 0.63 in 11 %

6.4 mm 0.25 in 28 %

2.6 mm 0.10 in 70 %

1.0 mm 0.04 in 180 %

0.41 mm 0.016 in 440 %

For accurate calibration, the outer diameter of the largest Landolt C optotype should be 200 mm (7.9 in). 

Standard Test Methods for Response Robots

ASTM International Standards Committee on Homeland Security Applications;

Operational Equipment; Robots (E54.08.01)

Nested Landolt C Vision Test Chart

#3

ALTITUDE

SPACING

Page 4 11/9/21

rch

with delivery of personal floatation devices

pse with school bus and vehicle rescue

5 different flight paths to identify objects from safe altitudes in open 

calable for all sizes of aircraft to demonstrate positive control at all times 

 be performed outdoors or indoors to control lighting and weather. The 

or basketball or tennis court for small drones and/or novice pilots to 

the national airspace.

 well defined altitudes, positions, orientations, and perches to evaluate both 

nctionality.

Standard Test Methods for Response Robots 

M International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

48

st Lanes for Various Sizes of Aircraft

Project Overview

YSTEMS

DURES

VERING

RE

1A

SCALABLE TEST LANES (ALTITUDE = SPACING) ALTITUDE

SPACING

OMNI BUCKETS

Page 4 11/9/21

Standard Test Methods for Small Unmanned Aircraft Systems ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

• Wide area search of a plane crash site

• Vehicle identifications

• Hazardous tanker truck accident and fire

• Suspicious vehicle takedown

• Bus hostage situation

• Collapsed structure search

• Subway terrorist attack

• Flooded house rescue with delivery of personal floatation devices

• Flash flood bridge collapse with school bus and vehicle rescue

OPEN TEST LANES

The Open Test Lanes evaluates 5 different flight paths to identify objects from safe altitudes in open 

environments. These tests are scalable for all sizes of aircraft to demonstrate positive control at all times 

with accurate perches. They can be performed outdoors or indoors to control lighting and weather. The 

smallest size lane fits on an indoor basketball or tennis court for small drones and/or novice pilots to 

practice safely without flying in the national airspace.

Figure 4) The standard tests use well defined altitudes, positions, orientations, and perches to evaluate both 

Maneuvering and/or Payload Functionality.

Standard Test Methods for Response Robots ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

48

Scalable Test Lanes for Various Sizes of Aircraft Project Overview

Standard Test Methods for Small Unmanned Aircraft Systems ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

3

Introduction

Remotely operated aerial systems enable emergency 

responders to perform extremely hazardous tasks from 

safer stand-off distances. The U.S. National Institute of 

Standards and Technology is leading an international effort 

to develop standard test methods to help manufacturers, 

procurement professionals, and users objectively evaluate 

system capabilities and remote pilot proficiency to align 

with mission requirements. Thisimproves the safety and 

effectiveness of emergency responders as they save lives 

and protect property in our communities

The first step toward credentialing remote pilots is to get 

everybody onto the same measuring stick. That’s where 

standard test methods can play a key role. These test 

methods for Basic Maneuvering (MAN 1-5) and Payload 

Functionality (PAY 1-5) are being replicated across the 

country and internationally to focus training with 

quantitative measures of remote pilot proficiency. They are 

low cost and easy to replicate so everyone can measure 

their own progress over time and compare their proficiency 

to regional or national averages on similar 

systems. Concurrent test lanes can be set up to enable 

multiple systems and pilots to train or evaluate 

simultaneously. 

They are being standardized through the ASTM 

International Standards Committee on Homeland Security 

Applications; Response Robots (ASTM E54.09). They are also 

referenced as Job Performance Requirements in 

the National Fire Protection Association Standard for Small 

Unmanned Aircraft Systems Used For Public Safety 

Operations (NFPA 2400) and the ASTM Standard Guide for 

Training for Remote Pilot in Command of Unmanned 

Aircraft Systems Endorsement (ASTM F38.03 F3266-18). 

These suites of standard test methods provide common 

measures of capabilities with quantitative results. They can 

be conducted individually, in sequences, or embedded into 

operational training scenarios as repeatable and 

reproducible tasks with scores to augment qualitative 

assessments. Organizations using these tests set their own 

thresholds of acceptable system and pilot performance to 

align with their airspace, environment, and mission 

complexities. But those decisions are easier to make and 

trust when they’re based on quantitative performance data 

captured within standard test methods.

Basic Maneuvering (MAN 1-5) and Payload Functionality (PAY 1-5)

Safety | Capabilities | Proficiency

INSIDE EACH BUCKET

EVALUATE SENSORS

SMALL SYSTEMS LARGE SYSTEMS

INTERFACES PROCEDURES

SENSORS MANEUVERING

MEASURE & COMPARE

1A

SCALABLE TEST LANES (ALTITUDE = SPACING) ALTITUDE

SPACING

OMNI BUCKETS

URES

ERING

RE SCALABLE TEST LANES (ALTITUDE = SPACING)

Page 4 11/9/21

ne crash site

ccident and fire

wn

h

th delivery of personal floatation devices

e with school bus and vehicle rescue

different flight paths to identify objects from safe altitudes in open 

lable for all sizes of aircraft to demonstrate positive control at all times 

e performed outdoors or indoors to control lighting and weather. The 

r basketball or tennis court for small drones and/or novice pilots to 

e national airspace.

well defined altitudes, positions, orientations, and perches to evaluate both 

ctionality.

Standard Test Methods for Response Robots 

 International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

48

t Lanes for Various Sizes of Aircraft

Project Overview

3

Y 1-5)

STEMS

URES

ERING

E

1A

SCALABLE TEST LANES (ALTITUDE = SPACING) ALTITUDE

SPACING

OMNI BUCKETS

RONES

Pilot Organization _____________________________________

Drone Make _____________________________________

Drone Model _____________________________________

Facility Location _____________________________________

Date (YYYY/MM/DD) ______________________

PROCTOR NAME _____________________________________

Pilot FIRST Name _____________________________________

Pilot LAST Name _____________________________________

Team #: ______

TRAVERSE (MAN 2) ORBIT (MAN 3) INSPECT (MAN 4) RECON (MAN 5)

LAUNCH

TO ALT S

LAND

LANDLEFTWARD RIGHTWARD

LAUNCH TO

ALT S

START TIMER

END TIMER

LAUNCH TO

ALT 2(S)

END TIMER

REVERSE

DESCEND

TO ALT S

REVERSE LEFTWARD RIGHTWARD LEFTWARD RIGHTWARD

START TIMER

LEFTWARD RIGHTWARD LEFTWARD RIGHTWARD

LAUNCH TO

ALT 1/2(S)

NEXT

STAND

END TIMER

NEXT

STAND

NEXT

STAND

START TIMER

LAUNCH TO

ALT S

END TIMER

LAP 5

LAP 4

LAP 3

LAP 2

START TIMER

UP RANGE

UP RANGE

UP RANGE

UP RANGE

UP RANGE

18 IMAGES TO CAPTURE

2 Landings Scored Separately

20 IMAGES TO CAPTURE

No Landing

POSITION (MAN 1)

18 IMAGES TO CAPTURE

1 Landing Scored Twice

LAUNCH TO

ALT S

YAW L-360

YAW R-360

CLIMB

DESCEND

FORWARD

BACKWARD

FORWARD &

YAW L-180

FORWARD &

YAW R-180

LAND

START TIMER

END TIMER

ALIGNMENT SCORE: Circle points for images with UNBROKEN RINGS (5 pts) or BROKEN RINGS (1 pt). Draw a line through all incomplete. 

COUNTS 

DOUBLE

Page 3

Figure 3) LEFT: Basic Maneuvering trial scores are based on bucket alignment images showing the 

inscribed ring around the inside perimeter of the bucket. RIGHT: This course focuses on Payload 

Functionality trials that add a modest operational workload at each bucket alignment by zooming into 

the acuity targets in the center of the bucket to correctly identify increasingly small features. The pilot 

Version 2022A 

yy 

INTERNAL TEAM ROTATION

THE PILOT’S BACK TURNED TO THE LANE FORCES 

RELIANCE ON THE INTERFACE 

(VISUAL OBSERVER REQUIRED)

3) Select the minimum proficiency based on 

average or “expert” scores in the same trials:

– Example: 40%, 60%, 80% of “expert”

4) Select pilot view:

– Line of Sight or BVLOS

5) Select lighting (indoor or outdoor) for 

daylight or night credentials:

– Lighted/Daylight or Dark

D

ADDITIONAL

PRACTICE 

INTERFACE ONLY

IN FAMILIARITY 

TRIALS DAY 1 & 2.

USE INTERFACE 

ONLY FOR SCORING 

TRIALS ON DAY 3.

DECLARE EACH 

CONCENTRIC C FOR 

YOUR PROCTOR TO 

SCORE DURING 

THE TRIAL.

y

Open Test Lane

[8] 1⁄4-20 x 2in hanger bolts and wing nuts for the

leg extensions to slide on and tighten

[15] 8in diameter weatherproof stickers

(see website to download the sticker files)

[4] Big numbers 1-1-1-1 inside the top bucket

[4] Big letters A-B-C-D around the top bucket

[5] Acuity targets A-B-C-D inside bottom of all

[2] Perch acuity targets inside and bottom of A

.

The bucket stands are adjusted to vertical using the slotted leg extensions so the angled buckets are at 45 degrees.

Stickers inside each bucket have a GREEN INSCRIBED RING 

to guide alignment and a visual acuity target with 

increasingly small Concentric Cs gaps to identify the 

correct (1 of 8) orientations.

TOP

( T )

( B )

BOTTOM 

( TR ) TOP RIGHT

( R ) RIGHT

( BR ) BOTTOM RIGHT

TOP LEFT ( TL )

LEFT ( L )

BOTTOM LEFT ( BL )

A

Gap size (mm) Gap size (inches) Equivalent Avg. Human vision at 6 m (20 !)

40 mm 1.58 in 4.5 %

16 mm 0.63 in 11 %

6.4 mm 0.25 in 28 %

2.6 mm 0.10 in 70 %

1.0 mm 0.04 in 180 %

0.41 mm 0.016 in 440 %

For accurate calibration, the outer diameter of the largest Landolt C optotype should be 200 mm (7.9 in). 

Standard Test Methods for Response Robots ASTM International Standards Committee on Homeland Security Applications; Operational Equipment; Robots (E54.08.01)

Nested Landolt C Vision Test Chart

#3

48IN SQUARE LANDING WITH

12IN CENTER RADIUS TARGET

100-300 FT MEASURING TAPE

A

D

C

B 1, 2, 3, 4

LAUNCH

AD

PERCH 

ACUITY

P1

P1

LEAVE CARRY HANDLE ON TOP BUCKET

1A

1A 1A ALIGNED (5 PTS)

PARTIAL (1 PT)

Align with each bucket long enough to capture a 

single alignment image (NO ZOOM) showing the 

green ring inside the bucket. Score 5 points for a 

continuous green ring or 1 point for a partial. Similar 

scoring for accurate or partial landings.

Align with each bucket long enough to capture a 

single alignment image (NO ZOOM) AND a single 

acuity image of each target (MAX ZOOM). Score 1 

point for each correct identification of the 5 

increasingly small Concentric C gap directions.

Basic Maneuvering (MAN)

ALIGN WITH BUCKETS AND LAND ACCURATELY

Payload Functionality (PAY) 

ALIGN AND IDENTIFY ACUITY TARGETS

20 ALIGNMENTS TOTAL UP TO 100 POINTS 20 TARGETS TOTAL UP TO 100 POINTS

Standard Test Methods for Small Unmanned Aircraft Systems

ASTM International Standards Committee on Homeland Security Applications; 

Response Robots (E54.09) | Website: RobotTestMethods.nist.gov

Montgomery County Police Drone Training & Evaluation Facility

Safety | Capabilities | Proficiency

DOJ/DHS National Unmanned Aircraft Systems Program Evaluation, August 2020

I

CONFINED TEST LANE

GPS DENIED

and

DARK (<1 LUX)

DUAL BUCKET 

ALIGNMENTS

AT 1 M (3 FT) 

PROXIMITY TO 

OBSTACLES

OPEN TEST LANE

B

LENGTH: 30/60 M (100/200 FT)

E

OBSTRUCTED TEST LANE

DUAL BUCKET 

ALIGNMENTS

AT 2 M (6 FT) 

PROXIMITY TO 

OBSTACLES

LENGTH: 15 M (50 FT) LENGTH: 7.5 M (25 FT)

ACCURATE (5 PTS)

Align with each bucket long enough to verify the 

inscribed ring and declare as many of the 5 Concentric 

C gap directions as possible to score 1 point each. Use 

video or zoomed in images after the trial to score 

yourself, although scores may differ from live trials. 

BROKEN (1 PT)

UPSIDE

DOWN

4

UPSIDE

DOWN

4

UPSIDE

DOWN

4

UPSIDE

DOWN

4

UPSIDE

DOWN

4

UPSIDE 2 DOWN

MANEUVERING ONLY

LEVEL 2 | OPEN LANE

PASS FAIL

(CIRCLE ONE) 

PASS FAIL

(CIRCLE ONE) 

PASS FAIL

(CIRCLE ONE) 

PASS FAIL

(CIRCLE ONE) 

PASS FAIL

(CIRCLE ONE) 

M

(FILL IN) (CIRCLE ONE or FILL IN)

5

MIN

10

MIN

__

MIN

PILOT VIEW TIME LIMIT

LINE OF

SIGHT

INTERFACE

ONLY

(CIRCLE ONE)

FACINE LANE

OPTIONAL V.O.

BACK TO LANE

MANDATORY V.O.

WIND

AVERAGE

_____

GUSTS

_____

MPH MPH

(CIRCLE ONE)

VISIBILITY

LIGHTED

300+ LUX

DARK

< 1 LUX

(CIRCLE ONE) (CIRCLE ONE)

5 FT

(1.5 M)

10 FT

(3 M)

20 FT

(6 M)

4 IN

(10 CM)

8 IN

(20 CM)

BUCKET DIAM. LANE SPACING (S)

20 IMAGES TO CAPTURE

No Landing

20 IMAGES TO CAPTURE

No Landing