UNCLASIFTMn

SECURITY CLASSIFICATION OF THIS PAGE (When Data Entered) 4

REPORT DOCUMENTATION PAGE READ INSTRUCTIONS BEFORE COMPLETING FORM 1. REPORT NUMBER 2. GOVT ACCESSION NO. 3. RECIPIENT'S CATALOG NUMBER

ARI Research Note 84-120

* 4. TITLE (end Subtitle) 5. TYPE OF REPORT & PERIOD COVERED

HUMAN RESOURCES TEST AND EVALUATION SYSTEM (HRTES) Final Report

Comprehensive Workbook period ending May 1982

(%b 6. PERFORMING ORG. REPORT NUMBER

7. AUTHOR(a) S. CONTRACT OR GRANT NUMBER(&)

"0 Jonathan D. Kaplan, William H. Crooks,

Mark S. Sanders and Rina Dechter DAHC 19-77-C-0055

(.0 9. PERFORMING ORGANIZATION NAME AND ADDRESS 10. PROGRAM ELEMENT, PROJECT, TASK

'-"ic<,2Q262717A765 Perceptronics, Inc. AREA & WORK UNIT NUMBERS and

6271 Variel Avenue

Woodland Hills, CA 91367 2Q263743A775

11. CONTROLLING OFFICE NAME AND ADDRESS 12. REPORT DATE

U.S. Army Research Institute for the Behavioral August 1984

and Social Sciences, 5001 Eisenhower Avenue, 13. NUMBER OF PAGES

.4m Alexandria, VA 22333-5600 370

14. MONITORING AGENCY NAME & ADDRESS(li different from Controlling Office) 15. SECURITY CLASS. (of this report)

Unclassified 1Sa. DECLASSI FICATION/ DOWNGRADING

SCHEDULE _ _

16. DISTRIBUTION STATEMENT (of this Report)

Approved for public release, distribution unlimited.

mA 4 IF6

17. DISTRIBUTION STATEMENT (of the abstract entered in Block 20, If different from Report) i

IS. SUPPLEMENTARY NOTES

This is the comprehensive version of HUMAN RESOURCES TEST AND EVALUATION SYSTEM

(HRTES). It differs in many respects from the later HRTES TEST PROCEDURES AND

SUPPLEMENT. This is Volume II of a two-volume set.

(over)

19. KEY WORDS (Continue on revoree side if necessary end identify by block number)

C.-- Test Evaluation' ,Performance Taxonomy , /

Performance Testing.

Criteria

Operational Testing

I.L Human Factors Testing,

2L, ABTRACT (Cama e a rewras Lf N necvemy a md identif by block number)

This research note is the second volume of a two-volume set designed to aid in

Cz L king the decisions needed in operational testing, including front-end analysis. e series of structured decision aids herein aid in determining the required

classes of performance, the conditions that apply to performance, the criteria for performance, the measures of performance, the value of performance outcomes,

and the causes of inadequate system performance.

SFOM 1473 EDITION OF I NOV 65 IS OBSOLETE UNCLASSIFIED

I JAN 7 N L A S F E

i SECURITY CLASSIFICATION OF THIS PAGE (When Data Entered)

%--A.

-,~ ~~~ J *. - % - -
Research Note 84-120

HUMAN RESOURCES TEST AND EVALUATION SYSTEM

(HRTES) Comprehensive Workbook

Jonathan D. Kaplan, William H. Crooks,

Mark S. Sanders, and Rina Dechter

Perceptronics, Inc.

Contracting Officer's Representatives Irving N. Alderman and Charles 0. Nystrom

4 "

Battlelield Information Systems Technical Area

Franklin L. Moses, Chief

SYSTEMS RESEARCH LABORATORY

Jerrold M. Levine, Director

(i;i

U. S. Army

Research Institute for the Behavioral and Social Sciences

August 1984

Approved for public release; distribution unlimited.

% 4A.. -".. , p'' ."+" " ,! " "", ,+.' .,. , ') , ,. ", ", . J " ' ""r ;" , ,. . .,, ,. e. v, ; ,
UNCLASSIFIED

SECURITY CLASSIFICATION OF THIS PAGE(Whan Data aneerod)

ARI Research Note 84-120

18. (continued)

Volume I is published separately as ARI Research Note 84-119. See also related

ARI Research Products 84-19 and 84-20.

Irving N. Alderman and Charles 0. Nystrom, contracting officer's representatives

Accession For

NTIS GRA&

DTIC TAB

Unannounced E

Justification

Ava il t Codes

., ..;:" ! caad/or

.ist

QUA LITY I N &V E CTE D

'S

UNCLASSIFIED

i SECURITY CLASSIFICATION OF THIS PAGE(lWhen Date Entered)
HRTES i INTRODUCTION

The Human Resources Test and Evaluation System (HRTES) Workbook consists of

a series of Worksheets and applicable Guidelines. Each Worksheet and

Guideline is referenced by associated text in a chapter of the HRTES

Handbook. The chapter numbers in the Workbook and the Handbook are

equivalent. When Chapter 5 of the Handbook references Worksheets and

Guidelines in the Workbook, they will be found in Workbook Chapter 5.

Since the HRTES Workbook is likely to be used for more than one Operational

Test, the recommended strategy is to use the contained Worksheets as master

copies. When each is to be used, copy it, and work only on the copy.

If you make additions or substantial changes to the material in HRTES, such

as adding new "System Performance Issues," "Conditons," or "Human Performance

Functions," it is suggested that you include a statement of these changes

on a copy of a HRTESGRAM (see the following page), and send it to:

U.S. ARMY RESEARCH INSTITUTE

for the BEHAVIORAL and SOCIAL SCIENCES

Aftention: PERI-SZ

5001 Eisenhower Avenue

Alexandria, Virginia 22333

S-. . * % , q. .. .- ,\ .- ,-> W

AmI-I

% .:,,
*fl We suggest that the following I, change(s), addiion(s), or deletion(s)

EU SG Rbe made to HRTES:

Please return comments to: U.S. ARMY RESEARCH INSTiTUTE

for the BEHAVIORAL and SOCIAL SCIENCES

Attention: PErt'-SZ

5004 Eisenhower Avenue

Alexandria, Virginia 22333

SYSTEM __________________________TEST-___ DATE _______PAGE

NAME TELEPHONE___________

WI -2
GUIDELINES FOR ASSIGNING HPF'S CRITERIA

AND STATISTICS WITHIN THEIR OVERALL

HTE SPT CRITERION

SPI

OPERATIONAL HPF'S: MAINTENANCE HPF'S: 

SPI CRITERION:

HPF'S WHOSE CRITERIA AND STATISTICS ARE COMPONENTS OF THE ABOVE SPI 'S

TIME AND ERROR BUDGET:

.4,

SYSTEM TEST- DATE _PAGE

NAME TELEPHONE

W1-3
HRTES 2. SYSTEM HRTES , INDEX

CONTENTS

.DefinitTon of System +0 be Tested

2. Set of twelve System Function Worksheets

3. Guidelines for Selecting System Functions

4. Sample System Function Worksheet

5. System Rating Questionnaire

WV

!5
HRTES DEFINITION OF SYSTEM TO BE TESTED

NAME OF TESTED SYSTEM:

ITEMS TO BE INCLUDED IN TEST (Number and Type):

OPERATOR AND MAINTAINER PERSONNEL (Number and Type):

* ,

SYSTEM TO BE AUGMENTED OR REPLACED:

DIAGRAM OF SYSTEM TO BE TESTED:

SYSTEM TEST____ DATE PAGEi- NAME TELEPHONE

W2-2
SYSTEM FUNCTION WORKSHEET

HRTES FOR AIR DEFENSE WEAPONS

SYSTEM FUNCTION RATINGS

SYSTEM CLASS:- -

AIR DEFENSE WEAPONS including:o

Short Range Missiles, Medium RangeW

Missiies, Long Range Missiles, Air

Defense Guns, High Energy Systems z U

SYSTM FUCTIOS hiU,0

1.~~ Deto aicrfr 1,,43 05, L 35L 

______________________________0 _______ ___3

LL Z__ 0 L) __j >__ ___ ix_ 0 , 32

Uj31 3~~~LU aisaefomto Den seece 1,2, 30

to aicrf alacin -o ( 57 29_ z 12 28

acin D x D 230CLU 

SYSTM FUCTINS C C- 14 '22

21,43

15

3._______________ Deny selecte airspac /foratio 1,243

25

1

19

17

16

15

14

________13

12

1

-4 - - - - -0

4,4

W2--
SYSTEM FUNCTION WORKSHEET

FOR ARMORED VEHICLES

SYSTEM FUNCTION RATINGS

SYSTEM CLASS:

ARMORED VEHICLES including: Main Battle Tanks, Armored Reconnaissancez U

Vehicles/Light Tanks, Infantry/Cavalry 09

Fighting Vehicle, Armored Personnel z LL.

Carriers-Mounting, Anti-Tank Weapons z 0 Q

0 ~ 0o 0

u0-. UZ>' (n ! 0

,> _SZ: __, jUj L LL C) y - U2 0 O0()

(D LIJ LL COI-oD -J) 

U5 0 - ( za ~

V) 0 rj 0 LUJ U .

Lw > e.- 1> ~Z UJ < E.< 4nU U

SYSTEM FUNCTIONS -" l o

,2536

I. Destroy fixed emplacements. 125 3

7 3

34

2. Destroy armored vehicles. 1,2,5 33

7 32

31 1,2,5 30

3. Destroy enemy personnel. 7 29

28

4. Destroy/disrupt enemy aircraft. 1,2,5 27

7 26

25 1.,2,5 25

5. Suppress/disrupt enemy activity. 1 24

6. Serve as a platform for mounted 1,2,5 22

21

attack. 21

19

7. Transport troops/materiel. 2,5,7 18

117

2,5,6 16

8. Perform reconnaissance. 7 15

14

9. Protect crew/passengers/materiel 2,3 13

from enemy action. 2 2

1110

9

8

7

6

5

4

3

2

0

SYSTEM TEST__ DATE .,_PAGE

NAME __-------TELEPHONE __

W2-4

:-__-:'-: -. ....- - - -: . - .:.- - - ..--.. . .... ,. , , : ,.,,.,, -- *- ''*.,,. . . *.- . %.. .-, . .. .
HRTESFOR SYSTEM FUNCTION WORKSHEET

AVIATION SYSTEMS ,.,-HRTIES ,.v.,..,.

SYSTEM FUNCTION RATINGS

SYSTEM CLASS:

AVIATION SYSTEMS inc!uding:

Attack Helicopters, Scout Helicopters, 

Transport Helicopters, Utility Helicopters, M

Fixed-Wing Reconnaissance, Fixed- z

Wing Transport z

0 LL

0 0 _ -,- 0 Cn >U uO UO OU 0()J Co- _J J 0

~~ 0g V~Z 0 0 ~L)J

QZ 0 <~ <~ 2U in Lj i

SYSTEM FUNCTIONS .- s vi c q to 1o

I. Destroy enemy vehicles. 1,2,5 36

_7 35

7 3

34

-airraftsystms.12,5 33

2. Destroy anti-rratste. 7 32

31

3. Destroy fixed emplacements. 1,2,5 30

7 29

28 1,2,5 27

4. Destroy enemy personnel. 7 26

25

1,2,5 25

5. Disrupt/suppress enemy activity. 7 24

2,5,6 22

6. Perform reconnaissance. 7 21

20

7 Serve as platform for electronics 2,5,6 9

warfare systems. 7,8 18

16

8 Transport troops'materiel. 2,5,7 15

14

13

9 Transport injured troops. 2,5,7 12

10 Protect crew, passengers/materiel 2,3 10

from enemy action. 9

8

7

6

5

4

3 _ -

2 _ -

0

SYSTEM TEST__ DATE PAGE

NAME -- TELEPHONE ......

W2-5

. . ' .. '% ., ''' -.. - .-. *,1 -, ., ' ' .- ., ,-,''', ..- ... " '.' ---. .- . . - - . . . --.
SYSTEM FUNCTION WORKSHEET

H RIE FOR BATTLEFIELD COMMUNICATIONS SYSTEMS

SYSTEM FUNCTION RATINGS

SYSTEM CLASS.

BATTLEFIELD COMMUNICATION oU

SYSTEMS including Man-Portable

R~adios, Vehicle- Portable R~adios, Visual

Comnmunications Systems, and Base z

Radio Systems z 0

0 2- z L

L__ ~ 0 (90 uO O_ 

0 Uu LL U,

SYTE FUCIN U)U o 0~C~ 0'. __j >

:) 2p 0036

1. Trnse and orer inorato o205,735

beee cocre untindividuals.

_______________________ ____ 3

1.Tase omtionadodr 2,3,7 32

* 34

30

29

28

27

26

25

24

____ ___ ___ ___ ___ ___ ___ ___ ___ ___ __ __ ____ ____ _____ 23

22

21

____________ _ ___________ ____ _____ 20

19

* 18

16

15

____ ___ ___ ___ ____ ___ ___ ____ ___ _ _ ___14

13

I' _ ___ ____ ____12

_______11

10

7

6

5

2

SYTE TET AEPG

y.7
SYSTEM FUNCTION WORKSHEET

FRC 2 /C 2 . HRTES ,o,,,,ss,,, 1 SYSTEMS

SYSTEM FUNCTION RATINGS

SYSTEM CLASS: --

C 2

/C 2

1 SYSTEMS including:

Field Artillery Fire Control, Tank Fire 7

Control, Air Defense Fire ControlD

z

,,LZ "r 0 w L u -- 0 E0 L oUj 

S0~ 0" ZO 0 u .

(n,,> LL W o 0o 

S T F e 0 <_ . < i a <

Provide information on current a. 47 35

battlefield conditions and situation. 4,7 35

'PS 34

2. Provide projections of probable future 33 conditions and enemy behavior. 32

31

3. Control the behavior of friendly 4,7 30

forces. 29

28

4. Manage friendly weapon 27

operation. 4,7 26

25

5. Manage logistics. 4,7 24

• " _23

6. Communicate information to 5,7 22

appropriate units. 21

_,__. _20

19 7. Protect system/crew from enemy 3,7 18

action. 17

16 -

15

_____ ____ ____14

13

12

11"..'8 __11

-i., 10

7-

6 -

5-_

4-

,.,_ __

2

0

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE O - -

4 _ .. 2-7

-. , ' .. ' ., % . . -, . . , ., '. , .. . - . . . , . . . . . . .. . . , .,. - . . .. . - .
SYSTEM FUNCTION WORKSHEET HRTES FOR COMBAT/TACTICAL SUPPORT EQUIPMENT

SYSTEM FUNCTION RATINGS

SYSTEM CLASS: - - - - - -I

COMBAT/TACTICAL SUPPORT

EQUIPMENT including: Combat

Engineer Vehicles, Recovery Vehicles,

Demolition Equipment, and Bridging x Equipment. 0 (5

0 E LL U

__j-- I-__UJ 

U_ Z ) 0 0u

LU~~" Z ) (n0 Oc,, ~~ 0- 5 o. DzU SYSTEM~~L FUCTON 2- CN=

1. Detry/emv obt0ls 1 ,2, 36O

<odlcs )it=M= ( 7 

Zo LZ cc 0 Uj34 1,2,53

3. Bergeoe obstacles 12,5 30

4 ~12,5727 emplstuc osaceme/shedlters. 2

7 2

5. Transp otcmmndpots 2,5,7 20

- 22

6. Transprt dampageedt vehiclers. 2,9 2

196

7. Deasot amred vehicles 2,5, 21

8. Peroc crewm atdeiles romenem 16

actione2,3, 15

13

'10

9.

____ ___ ___ ___ _____ ____ ___ ____ __ __ ____ - -8

7.

6

4-

3-

2

SYSTEM _________________________TEST____ DATE _______PAGE

NAME J ELEPHONE -_ __

W2- 8
SYSTEM FUNCTION WORKSHEET H RTES FOR ELECTRONIC WARFARE & SURVEILLANCE SYSTEMS

SYSTEM FUNCTION RATINGS

SYSTEM CLASS: 4A

ELECTRONIC WARFARE AND 0

SURVEILLANCE SYSTEMS including: z

Countermeasures Equipment and

Sighting and Surveillance Equipment. z L

Z 0 ad

0 E LL LL U . L z 0

* U. 0z a),U

- ,0 -

SYSTEM FUNCTIONS e: c, =/ ____

I. Provide critical information on 36

*potential targets. "5' 735

34

2. Confuse/'disruptidisabole enemy 3

systems. 32

* 31

3. Protect operator/crew from enemy 12,3,5 30

action. 7 29

28

4.Jmelectronic sinas 26

25 _

5. Prodluce false targets/target 24 .

signatures. 23_______ 2

22-

21

___ _ __ __ __ __ __20 . - 19

18-

17

16

15

.1*4

13 _

010 __

9._

7_

UJ6 --

SYSTEM FUNCION s.PG DAE 

-4.

.J 3

2

NAME -____TELEPHONE ____________

W2-9

r- -, .44 ' " A "- -" - "*"* .' " ' - " ' .. . - -.. 
SYSTEM FUNCTION WORKSHEET HRTES

SYSTEM FUNCTION RATINGS

SYSTEM CLASS:- - -

GROU ND TRANSPORTATION

EQUIPMENT including: 114 Ton Utility I.z

Trucks, 314 to 1-1 /2 Ton Trucks, 6 Ton&

Trucks, 8 to 10 Ton Trucks, HeavyLa Equipment Transport Trucks Z 0 0

~ F 0 0~ Z I.-

0~ 00 u 4C ZL. 0

U~ 5R o0 0J 00_ ;

o LLJ < < 4

SYSTEM FUNCTIONS e.4 C6 0

36 1. Transport command personnel. 2,5,7 35

33 '42. Transport troops. 2,5,7 32

4 31

3.Transport materiel. 2573

-- 28

*4. Serve os on ambulance. 2,5,7 27

26

-25 --

5. Protect operator/crew from enemy ,3,7 24

action. 23

22

21

4 20

19

18

16-

15

12

11

W2-10
SYSTEM FUNCTION WORKSHEET

FOR SYTMRUCTOEWRSHE INFANTRY WEAPONS

HT SYSTEM FUNCTION RATINGS

SYSTEM CLASS:

INFANTRY WEAPONS including:

Pistols/revolvers, Rifles, Sub-Machine u Z

Guns, Machine Guns, Recoilless Rifles, D

Anti-Tank Missile Systems. Anti-Aircraft z X "

Missile Systems, Grenades/ Grenade z C = z 0 0- Launchers. Anti-Armor Mines, Anti- 0 LL " M 

Personnel Mines, Flamethrowers, 0 ..0 D M ,,"_ 2 Z < o 0 U L t J t;L~ ,

Mortars p > .Z GC' ,Wa V, LL __0(

= " C.) za U0 L L

(3"' uj OJ (n a Z Z= -

SYSTEM FUNCTIONS c.6 U- o

36

1. Destroy enemy vehicles. 1,7 35

- .- 34

33

2. Destroy low flying enemy aircraft. 1,7 32

31

3. Destroy fixed emplacements. 3,7 30

3. ,ixed1,7 29

28

4. Destroy enemy troops. 1,7 27

26

25

5. Disrupt/suppress enemy activity. 1,7 24-_

23 _"2 -_ 

22

6. Provide illumination. 1,7 21

20

19 7. Protect operator/crew from enemy 3,7 18 -

action.1 ___ _ ____17 _

8. Conceal friendly forces by making 17 156

smoke.

_14

13 _-

12

11-

10

9___

8

7

6

5-

4- ____4__ 3-

2_

0

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

; U W2-11
S SYSTEM FUNCTION WORKSHEET

II E FOR ORDNANCE SYSTEMS

SYSTEM FUNCTION RATINGS

SYSTEM CLASS:

ORDNANCE SYSTEMS including:

Light, Towed, Tube Artillery; Light, z

Self-Propelled, Tube Artillery; Medium, D

Towed, Tube Artillery; Medium Self- z ,.

Propelled, Tube Artillery; Heavy. Towed Z 0 ! 0 _

Tube Artillery; Heavy, Self-Propelled 0 E U ~M 

Tube Artillery; Battlefield Support 0L U. P 0 0 > U U) - ,, Uj 4 UJ , z

Guided Missile; Battlefield Support " U >,> Z 0

Unguided Missiles; Multiple Launch, u_ oO O O5 -

Guided Missiles; Multiple Launch, Z O -- < <( , = = X = .(.

Unguided Missiles

0 a-0 ( - G 8_ (Di =~ (n

SYSTEM FUNCTIONS .- C6 Ii U I d

I. Destroy fixed emplacements on or 1,2,5 36

behind the battlefield. 7 35

_-_- 34

33

2. Destroy enemy vehicles/weapons. 1,2 32

31

1,2,5 3C 3. Destroy enemy personnel. 7 29

28

4. Suppress/deny enemy activity, and 1,2,527

deny terrain to enemy.7 26

1,2,5 25

5. Provide illumination. 7 24 .. ___23

22

6. Conceal friendly forces by making 1,2,5 21

.20 :.smoke. __ __ __ 7__ 20

19 7. Protect crew/material from enemy 2,3,7 18

action. 17

18

16

15

_14

13

12

10

9

SYSTEM TEST_________________ ___ __ DAT 8PG

7

6

5

4

NAME---_ TELEPHONE3...

5*.

W2-12

-AUX .- ,--.4.a ,', ,'. %. ",,€"""i , ,,'t . +''""" + z .. ' .. ' +, . ''., ?,=,,,, -t +', ''+,
SYSTEM FUNCTION WORKSHEET HRTES FOR TARGET ACQUISITION AND/OR DESIGNATOR SYSTEMS

SYSTEM FUNCTION RATINGS

SYSTEM CLASS:- - -

TARGET ACQUISITION AND/OR o

DESIGNATOR SYSTEMS z ) ~".U

D

z ,-. .-

o,,, o=,' 0YoTLL i U- Z-

,. 34

>Uj

0 <U 0U

U-Z>- >< QZ U- <'U U

Uj I- -i >28

z go goc,,I

36_

_____ _____ 24 _

3

321

30 --

actoon. 29

25 -_

14

223___

32311

19 -_

28

27_

25

24--

23 -

2

21

10

419

418

15-

12

SYSTEM _________________________TEST_____ DATE ,_______PAGE

.INAME TELEPHONE______________

1W2-13

AI
SYSTEM FUNCTION WORKSHEET HRTES

SYSTEM FUNCTION RATINGS

SYSTEM CLASS:

z

cn0 o,

LL LLu 0

uj' t= (nc nc

0 5 L

ij U. 2 p r .i"ou s (

(D Lu 0 ~ ccL c u . ! C

vin - Q2 Z z 0 ai ua0 . . c cz . Lu , ,

SYSTEM FUNCTIONS W; C4 vi 14 mi 0

36

35

_ _ _ _ _ _ _ _ _ -- _ _ - - _ _-34

33

_____32

30

29

28

27

26

25

* 24

_ ___ __23

22

21 _ __"__20

19

18 . 17 __ __ _ __ __"__ __ _ __ __ _ __ __1

16

15

14

13

12

____ ____ __ - - _ - 11

'S 10

9

8_

7

6

5

4

3

0

IO SYSTEM TEST__ DATE PAGE

NAME TELEPHONE_

W2-14
GUIDELINES FOR SELECTING

SYSTEM FUNCTIONS

RHRT

System Functions are the ultimate purposes of a system, not intermediate

steps leading to those purposes. Normally they are purposes which can

be performed successfully by an individual system. To develop a test

plan, it is necessary that the most critical System Functions be identified and included. To insure that the field test is not impractically

long or expensive, it is necessary that less critical System Functions be

identified and eliminated from consideration. To evaluate field test

results, it is necessary that the relative criticality of System Functions

which are tested be specified. The process of weighting the criticality

of System Functions is described below.

(I) Read the "System Function Worksheet," and add any System

Functions you find relevant to your system which are not

present. These new System Functions will be treated in

the same manner as those already listed.

(2) Rate each System Function using the "System Function Rating

Questionnaire." Record the values on the "System Function

Worksheet." (See "Sample System Function Worksheet.")

(3) Total the ratings for each System Function, and enter this

total in the "Sum of Rating/Selection Weight" column of

the "System Function Worksheet."

(4) Record the identification number of each System Function

(which precedes each System Function) in the last column,

according to the sum of its ratings. For example, if

System Function number I received a sum of ratings of 24,

then the number "I" would be recorded on line 24 in the

last column.

I3
H GUIDELINES FOR SELECTING

M I- I S SYSTEM FUNCTIONS (Continued)

(5) Select the System Function(s) which you feel must definitely

be tested, based on the sum of its ratings, by estabffshfng

a cut-off point in the last column. The cut-off point should

be based on a consideration of costs of testing differences

between ratings, and MENS, ROC, and LOA requirements.

(6) Return the completed "System Function Worksheet" to sender.

pJ

Id

,
SAMPLE

HT SYSTEM FUNCTION WORKSHEET

H 'I' E S FOR AIR DEFENSE WEAPONS

SYSTEM FUNCTION RATINGS

SYSTEM CLASS:

AIR DEFENSE WEAPONS incluaing:

Short range Mssle. Mediut n ange - z MIts. Long Range Miles, Air

Defense Gu . High Enegy Syste-ms

8

SYSTEM FUNCTIONS fl -. *d4, 

I Oestroyaecrat. • Z 4 "" 5:7 35

33-

Conk" . andd dwt o=aft. 2 I . / 2, / ,'2 3 

31 _

3. Deny semected amcu ocofomn.o1-n 1,2, 3

to aockig otrorft. s z 4 4 / 5,7 129

4. ,,, , , ,,,.- " -0" O " - 287 1,2 27 _ S - - 5,7 2

S. Prot oerctor ° " rew from eris 2., 25 ' '

_ _ _ _ _ _ _6-_Z_ 1 7 23 24-1- --

1 1220

18

137

1- 1 -.--- ~1 - I

13

0

7_

5-

4_

3

2

NAME ,TIL|PMONEW2-17

#'% . . .9 .

,- , ,. ,. ., --,. ; . ..- .. .-. . .... ... ,, ... ...., ... ..... ,.=,..- -., .., '.,... .,-,. . .... -.. . , .,. .,. :a
RATING QUESTIONNAIRE FOR DETERMINING f lI -: CRITICALITY OF SYSTEM FUNCTION

To determine the relative criticality of a System Function for the

system, rate each System Function against the attributes of criticality

listed below. This is done by assigning a number from zero to six to

each attribute, and record them on the "System Function Worksheet."

I. DESIGNED FOR SYSTEM FUNCTION: To what extend is this system, or a

major component of this system, designed specifically to carry out this

System Function?

No Some Very Great

Extent Extent Extent

0 I 2 3 4 5 6

Not designed Design incor- Designed specifor System porates System fically for

Function Function System Function

2. PERFORMED WITH OTHER FUNCTIONS: How often/how long will this System

Function be performed in comparison to its other System Functions?

Never Moderately Always

0 I 2 3 4 5 6

This System This System Only this

Function Function performed System Funcnever performed as often as others tion performed

rW2-18
RATING QUESTIONNAIRE FOR DETERMINING

CRITICALITY OF SYSTEM FUNCTION (Continued) H RTES

3. PROBABILITY OF SYSTEM LOSS: To what extent would failure to successfully complete this System Function in expected battlefield conditions

increase the probability of system loss?

No Some Very Great

Extent Extent Extent

0 I 2 3 4 5 6

No increase Some increase Great increase

in probability in probability in probability

4. PROBABILITY OF UNSUCCESSFUL CONDUCT: To what extent would failure

to successfully complete this System Function increase the probability

of unsuccessful conduct of the military exercise?

No Some Very Great

- Extent Extent Extent

0 I 2 3 4 5 6

No increase Some increase Great increase

in probability in probability in probability

5. GENERIC SYSTEMS HAD PROBLEMS: To what extent have other systems in

this generic class had a history of problems in carrying out this System

Function? (If this is an entirely new System Function for this generic

class, rate this question six.)

No Some Very Great

Extent Extent Extent

0 I 2 3 4 5 6

No problems Some non- Severe and/or

severe problems frequent problems

W2-19
RATING QUESTIONNAIRE FOR DETERMINING

M I- E S CRITICALITY OF SYSTEM FUNCTION (Continued)

6. SPECIFIC SYSTEM HAS PROBLEMS: To what extent have prior OT's and

DT's of this specific system demonstrated a history of problems in

performing this System Function? (If this System Function has not been

tested in a prior OT or DT, substitute the following question: To what

extent do you predict that this System Function will have performance

problems?)

No Some Very Great

Extent Extent Extent

0 I 2 3 4 5 6

No problems Some non- Severe and/or

severe problems frequent problems

W2-20
S HRTES 3. SYSTEM PERFORMANCE ISSUE (SPI) INDEX

CONTENTS

I. System Performance issue (SPI) Worksheet

2. Guidelines for Selecting SPI's

3. Sample System Performance Issue Worksheet

4. SPI Rating Questionnaire

5. SPI Cutoff Worksheet

W3-I

, .. % . . . . . . . ... -... - . . . .
-H R T E SYSTEM PERFORMANCE ISSUE WORKSHEET

SYSTEM FUNCTION

SPI RATINGS

SYSTEM FUNCTION

SELECTION WEIGHT

.'

u. ">j u u Zu D

t0 ul R TS 2E Fz 0

a, 2 c

:, :';.' ,' - .: > ,'' .- ;'Z ; -:,.'',.'' .. fi, MA,.':/ . z-'.. •z . _ -..-"' .. 0,' ."' ~ . ..a.- .- .-. -"..'.

U0 o M0 

SPI's~i SYSTE FUCIN0~FOR THI 

LL - -

GRAND TOTAL

SYSTEM _________________________TEST-__ DATE _______PAGE

NAME _________________________TELEPHONE_______________

W3-2
GUIDELINES FOR SELECTING

HSYSTEM PERFORMANCE ISSUES

System Performance Issues (SPI's) are the intermediate actions which the

system must take to perform each System Function. Normally, they are

formatted as questions. It is the answers to these SPI questions which

are sought in the field tests. On your "System Performance Issue Worksheets" they are formatted as statements both to simplify the rating

process and to save space. These SPI's do not contain mention of tactics,

training, Human Factors Engineering, nor any other condition in general.

They are phrased as simple actions. Qualifying conditions will be added,

as required, in a later stage of the HRTES procedures.

You have received a package of Worksheets including: (a) "System Performance Issue Worksheets" for each System Function, (b) an "SPI Rating

Questionnaire," (c) "Guidelines for Selecting SPI's" (which you are reading

at this moment), and (d) a "Sample Worksheet." You are asked to aid in

the process of selecting the appropriate SPI's.

(I) Examine the "System Performance Issue" Worksheets you have

received and add any issues you feel are significant for

that System Function. Those new SPIs will be treated in

the same manner as those already listed.

(2) Read the "SPI Rating Questionnaire" found in this package.

(3) Rate each SPI according to the specific attributes In the

questionnaire. Record the ratings in the "SPI Rating

Columns" of the Worksheet. (See "Sample SPI Worksheet.")

W3-3

e. ;4 ,W ,L2
GUIDELINES FOR SELECTING I~Il(I~~ SYSTEM PERFORMANCE ISSUES (Continued)

(4) Total the ratings for each SPI, and enter this total in

* the "Sum of Ratings Column." Do not write in the last

3 columns of the Worksheet.

(5) Return the completed Worksheets to sender.

$4%4

-W3-
SAMPLE

HRTES'~ SYSTEM PERFORMANCE ISSUE WORKSHEET

SYSTEM FUNCTION I-s*~

* SPI RAINGS

SYSTEM FUNCTION - - - -

SELECTION WEIGHT 4

I LSPIs FOR THISSYSTEM FUNCTION .4__

&#qj-le r/ 4UITO aJ 27q

k'4'04l / I / e 7 1

/*Aea- wf&Ie i rk .24 j 11 5 /0

A-r~mlTaI1 21 Z Z Z /

Zmi'acy er eMo T2 S 6*P -P

LGRAND TOTAL Le*

SYSTEMAgZV A~ 22.fkAMWS fOrDATE Z51141..hLPAG_..

NAME __________________________TELEPHONE

* W3-5
SAMPLE

HR I-I TE R~lES S, SYSTEM PERFORMANCE ISSUE ,.,o., WORKSHEET

SYSTEM FUNCTION

_____SPI RATINGS

SYSTEM FUNCTION I - - - -

SELECTION WEIGHT

IL z

2

SPrs FOR THIS SYSTEM FUNCTION - C '

GRAND TOTAL/5/

sysTEM Ad iWfAtDffAft 04 TSTE DATE 92&6LpG14 NAME ____________________TELPMONE____________

W3-6 r

I..

p.. '. . . ,. . . . . , . . . . . . . ..
N1

RATING QUESTIONNAIRE FOR DETERMINING

CRITICALITY OF SYSTEM PERFORMANCE ISSUES

N

To determine the relative criticality of SPI's for a given System Function,

rate each SPI against the attributes of criticality listed below. This

is done by assigning a number from zero to six on each criticality attribute for each SPI.

I. PERFORMED WITH OTHER SPI's: How often/how long will this SPI be

performed in comparison to the performance of other SPI's?

Never Moderately Always

0 I 2 3 4 5 6

This SPI not This SPI performed Only this SPI

performed as often an others is performed

2. PROBABILITY OF SYSTEM FUNCTION FAILURE: To what extent would failure

to successfully complete this SPI increase the probability of System

Function failure?

No Some Very Great

Extent Extent Extent

0 I 2 3 4 5 6

No increase Some increase Great increase

in probability in probability in probability

, : W3-7

- °"° . .II . W7 . pTp . ,Nm . .. . ., .
RATING QUESTIONNAIRE FOR DETERMINING

CRITICALITY OF SYSTEM PERFORMANCE ISSUES

'4 (Continued)

3. GENERIC SYSTEMS HAD PROBLEMS: To what extent have other systems

in this generic class had a history of problems in carrying out this

SPI as part of the System Function? (If this is an entirely new SPI

for this generic class, rate this question six.)

No Some Very Great

Extent Extent Extent

0 I 2 3 4 5 6

* No history History of History of

of problems some non- severe and/or

severe problems frequent problems

4. SPECIFIC SYSTEM HAD PROBLEMS: To what extent have prior DT's/OT's

for this specific system demonstrated a history of problems in successfully carrying out this SPI as part of the System Function? (If this

SPI has not been tested in a prior OT or DT, substitute the following

question: To what extent do you predict that this SPI will have performance problems?

No Some Very Great

Extent Extent Extent

0 I 2 3 4 5 6

No problems Some non- Severy and/

severe problems or frequent

problems

W3-8

. ,'I ", , ,,, , . i . . . - w, . . .. . , . . -. . ' . , . j . . . . , . . . . - , , % .. . , . , . . ,.
SPI CUTOFF WORKSHEET HRTES

UNSELECTED SPI's PRODUCTS RELATED SYSTEM FUNCTIO N

IN

SYSTEM _______________________TEST-__ DATE PAGE

NAME __________________________TELEPHONE_______________

W3-9
RTE 4. CONDITION CATEGORY INDEX ?,H RTES

CONTENTS

1. Set of Condition Rating Worksheets

2. Guidelines for Selecting Conditions

3. Sample Condition Rating Worksheets

4. Set of Condition Rating Worksheets (Method 2)

5. Guidelines for Selecting Conditions (Method 2)

6. Sample Condition Rating Worksheet (Method 2)

7. Conditions x SPI's Matching Worksheet

8. SPI Summary Worksheet

W4-1
HRTESCONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

SELECTED SYSTEM PERFORMANCE ISSUES

ILLUMINATION

Full Sunlight

Moonlight

Starlight

Dusk

Overcast, Moon less Night (Pitch Black) _____

Artificial Lighting (specify)

FlIares

* Direct Glare

Indirect Glare (Water, Sand, Clouds, etc.)

Other (specify)

SYSTE!M TEST___ DATE PAGE

NAME ______________________TELEPHONE

W4-2
CONDITION RATING WORKSHEET

HRT

SYSTEM FUNCTION

CONDITION CATEGORY2.WAHRTEPAUE

C: SELECTED SYSTEM PERFORMANCE ISSU ES

TEMPERATURE

High (specify)

Low (specify)

Normal (specify)

SYSTEM ________________________TEST-___ DATE _______PAGE

6 NAME _______________________TELEPHON E ____________

W4-3
HRTES CON DITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

SELECTED SYSTEM PERFORMANCE ISSUES

PREC IPITATION

- Rain

Fog

Falling/Blowing Snow

Sleet

Sand Storm

No Precipitation

Other (specify)

SYSTEM __________________________TEST-__ DATE _______PAGE

U NAME _______________________TELEPH4ONE ____________

W4-4
HRTESCONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

4. WEATHER: WIND

SELECTED SYSTEM PERFORMANCE ISSUES

WIND

High Head Wind (specify)

High Tail Wind (specify) __

Significant Swirling Wind Gusts

Cross Wind (specify)

No Wind

Other (specify) _____ __ _______

SYSTEM _______________________TEST-___ DATE PAGE

NAME _________________________TELEPHONE

W4-5
CONDITION RATING WORKSHEET

SYSTEM FUNCTION

-. CONDITION CATEGORY

SELECTED SYSTEM PERFORMANCE ISSUES

HUMIDITY

* High (specify)

Low (specify)

Normal (specify)_____

SYSTEM _____________________ ___TEST____ DATE PAGE

NAME ________________________TELEPHONE

W4-6
CONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

SELECTED SYSTEM PERFORMANCE ISSUES

GROUND SLOPE

Flat

Low Positive Hilly (specify)

Low Negative Hilly (specify)

High Positive Mountainous (specify)

.5 High Negative Mountainous (specify)

Other (specify)_________

SYSTEM ________________________TEST-___ DATE PAGE

NAME ______________________TELEPHONE_____________

W4-7
H RS CONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

SELECTED SYSTEM PERFORMANCE ISSUES

GROUND SURFACE

Sandy

Rocky

Loam (Deep Soil)

Paved (specify type and carrying level)

Broken Paved

Broken Ground

Plowed Fields

Vegetation Covered________

P ~ ~~Other (specify)_________

SYSTEM TEST - DATE PAGE

NAME ___________________________TELEPHONE

w4-8

V . " .. .'
HRTESCONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

AND 8 WATER TERI:GROUND SURFACE

Light Mud

Heavy Mud

Dry

* Water Covered

Ice Covered

Snow Covered

Other (specify)

SYSTEM ________________________TEST-___ DATE _______PAGE

NAME TELEPHONE

W4-9'
HRTES CON DITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEG3ORY 9. TRAN OB AC E

SELECTED SYSTEM PERFORMANCE ISSUES

OBSTAC LES

Dense Vegetation _____

Light Vegetation

Hedge Rows __ __

Rivers (specify depth, width)

Manmade Structures (specify)

Traps (specify)

No Obstacles

Other (specify)

SYSTEM______________________TEST-__ DATE PAGE

4NAME ________________________TELEPHONE______________

VV -i
0 Z TN

CONDITION RA ING WORKSHEET

E-uTE~

SYSTEM FUNCTION

CONDITION CATEGORY 1.TRE:TP

SELECTED SYSTEM PERFORMANCE ISSUES

TYPE

(specify by type or size)

SYSTEM ____________________TEST-__ DATE PAGE

NAME ______________________TELEPHONE

* W4-11I
HRTE CONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

,I1. TARGET: NUMBER

SELECTED SYSTEM PERFORMANCE ISSUES

NUMBER

Single Target

Multiple Simultaneous Targets (specify)

-~~ -. Multiple Sequential Targets (specify)_____

Combination of Multiple Simultaneous

and Multiple Sequential Targets (specify)

Noise - Number/% of Targets Within Nontarget Background (specify)

'- Other (specify)

SYSTEM ________________________TEST-___ DATE AGE

NAME TELEPHONE

W4-12
hHRTES CONDITION co,,.,oRATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

12. TARGET: LOCATION

SELECTED SYSTEM PERFORMANCE ISSUES

LOCATION

Minimum Range (specify)

Maximum Range (specify)

Normal Range (specify)

ft.

r'.Azimuth and Elevation Target (specify)

Other (specify)

6.'

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

, .-~ -. .. ,. .. . ./ .: . . '.' - - . . . . - -. . ,- W4-13 -. . . . .. -.. -, .- , - . . ,, -- . . - -
HRTESCONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

SELECTED SYSTEM PERFORMANCE ISSUES

SPEED

Maximum Speed (specify)

Minimum Speed (specify)_____

Cruising Speed (specify)

Radical Alterations of Speed (specify) __

.

SYSTEM ________________________TEST-___ DATE -PAGE

4NAME TELEPHONE

W4-14
CONDITION RATING WORKSHEET

HRTEE

SYSTEM FUNCTION

CONDITION CATEGORY

14. TARGET: DIRECTION OF MOTION

SELECTED SYSTEM PERFORMANCE ISSUES

DIRECTION OF MOTION

* Closing (specify angle)

Retreating (specify angle) __

Crossing (specify direction)_____

* ~Complex Maneuver (specify)_____

Other (specify) __

SYSTEM _____________________TEST-..... DATE PAGE

W4-15
-T CONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY i~i-::i 5. TARGET: CONCEALMENT

SELECTED SYSTEM PERFORMANCE ISSUES

CONCEALMENT

Concealed by Physical Means (specify)

Concealed by Electronic Means (specify)

Partially Concealed (specify) __

Concealed by Smoke

Unconcea Ied

Other (specify)

.5,,

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W4-16 ,o ,-.......
T97 V* -v--rr-M

CONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY 16 PESNL:WROA

SELECTED SYSTEM PERFORMANCE ISSUES

WORKLOAD

* When Personnel are only performing this SPI

When Personnel perform all activities which

might occur at the same time this SPI is___________

being performed (specify)

Other (specify) __ __ _______

SYSTEM _________________________TEST-__ DATE PAG

NAME ________________________TELEPHONE

W4-1 7
CONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

17. PERSONNEL: DURATION OF PRECEEDING WORK

* SELECTED SYSTEM PERFORMANCE ISSUES

"4

DURATION OF PRECEEDING WORK

Following No Work

Following an Extended Period of Work (specify)

Following a Normal Period of Work (specify)

Other (specify)

SYSTEM TEST-_ DATE PAGE

1,

NAME, TELEPHONE.

-W4-18

' -
HRTES CON DITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

8.PERSONNEL: PROTECTIVE GEAR

SELECTEDSYSTEM PERFORMANCE ISSUES

PROTECTIVE GEAR

While wearing applicable protective clothing!

gear (specify)

While wearing normal clothing/gear (specify)

Other Cspecify)

S~1

SYSTEM _________________________TEST-__ DATE _______PAGE

4 NAME _______________________TELEPHONE

k i&--~..- -~ *:K-K<.W4-49;::-.. . .
SHRTES CONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

19: PERSONNEL: PHYSICAL STRENGTH

SELECTED SYSTEM PERFORMANCE ISSUES

PHYSICAL STRENGTH

With Personnel With Minimum Strength

With Personnel With Normal Strength

With Personnel With Optimum Strength

Other (specify)

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

W4-20
HRTESCONDITION RATING WORKSHEET ~HRTES

SYSTEM FUNCTION

CONDITION CATEGORY

20: PERSONNEL: PERCEPTUAL ABILITY

SELECTED SYSTEM PERFORMANCE ISSUES

4

PERCEPTUAL ABI LITY

With Personnel With Minimal Perceptual

Ability(s) (specify)

With Personnel With Normal Perceptual

_Ability(s) (specify)

*With Personnel With Optimum Perceptual

Ability(s) (specify)

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

W4-21
HRTE CONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

21 PESNE:EPREC

SELECTED SYSTEM PERFORMANCE ISSUES

* EXPERIENCE

With Personnel With Minimum Experience

(specify)

With Personnel With Normal Experience

(specify)___

* With Personnel With Optimum Experience

(specify) __

Other (specify)

* SYSTEM TE ST__ DATE -PAGE

* NAME ________________________TELEPHONE______________

4-2
.HRTES CONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

SELECTED SYSTEM PERFORMANCE ISSUES

APTITUDES

With Personnel With Minimum Applicable

Aptitudes (specify)

With Personnel With Normal Applicable

Aptitudes (specify)

With Personnel With Optimum Applicable

Aptitudes (specify)

Other (specify)

S..

[%m -

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W4-23

..' ., L ' , .. . .. _ , . ', . . .., . .., , -, -. o ' . , , . . .. - - ' . ° -, , . , . . . . . -, - , . -, , .. -. . , , - .. , , - , , . , .. -. .%
,.,-.HRTE5 ~~jP~in~CONDITION OO.ON RATING WORKSHEET w...

SYSTEM FUNCTION

CONDITION CATEGORY

23: PERSONNEL: PHYSICAL SIZE

SELECTED SYSTEM PERFORMANCE ISSUES

PHYSICAL SIZE

- -. With Personnel of Minimum Size (specify)

With Personnel of Normal Size (specify)

With Personnel of Maximum Size (specify)

Other (specify)

SYSTEM TEST- DATE PAGE

NAME _TELEPHONE

W4-24

_J 'j-IMI'-A--P
HRTESw... CONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY 24: TRAINING: INSTITUTION

SELECTED SYSTEM PERFORMANCE ISSUES

INSTITUTION

With OJT-Trained Personnel

With School-Trained Personnel

With Combination OJT and School

With Personnel Without Specific Training

With Factory-Trained Personnel

Other (specify)

SYSTEM TEST- DATE -PAGE

4 NAME _TELEPHONE

W4-25 *. 4 *p 4*.4 , **' *..***.**" - -= * - >:- • .. .I-- • . ° - .7 . *. . ,_ ..- *.:. . . . -. . *...-
CONDITION RATING WORKSHEET

mEE'IE

SYSTEM FUNCTION

CONDITION CATEGORY

a,25: TRAINING: LATENCY

SELECTED SYSTEM PERFORMANCE ISSUES

LATE NCY

Following a Period of Time Without Specific

* ~Training or Practice (specify) _____

* Immediately Following Training

With the Normal Period of Latency (specify)

Other (specify)

SYSTEM ________________________TEST-___ DATE PAGE

NAME ___________________________TELEPHONE

I1W42
CONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

SELECTED SYSTEM PERFORMANCE ISSUES

TEAM VS. INDIVIDUAL

With Personnel Who Have Had Only Individual

Training __

With Personnel Who Have Had Only Team Training __

With Personnel Who Have Had a Combination of

Team and Individual Training (specify)________

Other (specify)

i4

SYSTEM TEST___ DATE PAGE

4 NAME ______________________TELEPHONE-____________

W4-27

. .. .- . . . .
H RiESCONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGYORY

SELECTED SYSTEM PERFORMANCE ISSUES

CREW

With Opt imum Crew (specify)

With Normal Operational Crew (specify)

With Minimum Crew (specify)

Other (specify)

SYSTEM TEST - DATE PAGE

NAME _______________________TELEPHONE _____________

W4-28
* HR1ES CONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

a HARDWARE

With Hardware Fully Up

With Partial Breakdown (specify)

Wth Hardware Fully Down

Other (specify)

SYSTEM ________________________TEST-___ DATE -PAGE

*NAME TELEPHONE

h. W4-29
HRTESc~o.o CONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY , . 29: OPERATIONAL: INFORMATION INPUTS

SELECTED SYSTEM PERFORMANCE ISSUES

.

INFORMATION INPUTS

With Full Information Inputs

With Partial Information Inputs (specify)

With No Information Inputs

Other (specify)

4

SYSTEM TEST.- DATE PAGE

NAME TELEPHONE

W4-30

' .- - - . -. ..
GUIDELINES FOR DETERMINING

TACTIC CONDITIONS

Tactics as Conditions: Army systems are employed according to the established tactics and doctrine at a specific time. Tactical conditions to

be exercised in the field test will be those most significant for the SPI

under investigation. It is not possible for this Workbook to list all

tactics for Army systems now and in the future. To deal with the question

of tactics, two alternatives are presented.

(1I) It is preferable to obtain a list of probable tactics for the system

from the appropriate Combat Development Center experts; analyze it into a

format similar to that on Page W4-33, and then treat the resulting tactical

conditions in the same manner as all other conditions. A blank Tactical

Conditions Worksheet is provided for this purpose (page W4-32).

(2) If necessary, the Tactics Worksheets (pages W4-33 through W4-40) may

be used directly to rate tactics as conditions for each SPI. These Worksheets

may be incomplete for a number of system types, and for this reason we

suggest that these Tactics Worksheets be used only as examples.

W4-31

, .' . .- , .. ,. . .- -,.-. .- . ., . -. . .. , . .. . . . . . -.- |~-
HRTESCONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

-* SELECTED SYSTEM PERFORMANCE ISSUES

W4-3
~ CONDITION RATING WORKSHEET

H SYSTEM FUNCTION

CON DITION CATEGORY 31 TA T C : N M E OF S T MS MP Y D

SELECTED SYSTEM PERFORMANCE ISSUES

NUMBER OF SYSTEMS EMPLOYED

Single System

Multiple System of Same Type (specify)___

Multiple Systems of Different Types (specify

types and numbers)______

Other (specify)_____

SYSTEM TEST- DATE PAGE

NAME ______________________TELEPHONE_____________
HRTESCONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

SELECTED SYSTEM PERFORMANCE ISSUES

SPEED

Maximum Speed (specify)

Minimum Speed (specify)

Cruising Speed (specify)

Radical Alterations of Speed (specify)

SYSTEM _________________TEST-__ DA* Y PAGE

* NAME ________________________TELEPHONE______________

W4-34
HRTESCONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

SELECTED SYSTEM PERFORMANCE ISSUES

LOCATION

Specify

SYSTEM ________________________TEST-___ DATE PAGE

.4 NAME ________________________TELEPHONE______________

W4-35
HRTES CONDITION ooo RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY 34: TACT ICS : D IRECT ION OF MOT ION

SELECTED SYSTEM PERFORMANCE ISSUES

p-,

DIRECTION OF MOTION

Closing (specify angle)

Retreating (specify angle)

Crossing (specify angle)

Complex Maneuver (specify)

Other (specify)

SYSTEM TEST_ DATE PAGE

NAME TELEPHONE

W4-36
CONDITION RATING WORKSHEET

I~'I SYSTEM FUNCTION

CONDITION CATEGORY

35: TACTICS: CONCEALMENT

SELECTED SYSTEM PERFORMANCE ISSUES

* "CONCEALMENT

Concealed by Physical Means (specify)

,-.- * Concealed by Electronic Means (specify)

Partially Concealed

Concealed by Smoke

,

Unconcealed

Other (specify)

-- -,,-,-

SYSTEM TEST___ DATE -PAGE

NAME ________________________TELEPH4ON E

.4' W4-37

, -. .- :, 
H RTESCONDITION RATING WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

SELECTED SYSTEM PERFORMANCE ISSUES

CREW PROTECTION

Crew Ful ly Protected-Buttoned Up

Crew Partial ly Protected (specify)

Crew in Least Protected Configuration

(specify)

NBC Conditions

Cther (specify)

SYSTEM TEST - DATE PAGE

NAME TELEPHONE____________

~-. *N~'~ **W4-38
CONDITION RATING WORKSHEET

-~ SYSTEM FUNCTION

CONDITION CATEGORY 3:TCIS MUTO UOAI UCINN

SELECTED SYSTEM PERFORMANCE ISSUES

AMOUNT OF AUTOMATIC FUNCTIONING

Fully Automatic

Semi-Automatic (specify)

Manual Mode

Other (specify)

.moo/

NAME~ -TEEPON

SYTE _______________________________ETW___-AT39G
CONDITION RATING WORKSHEET

SYSTEM FUNCTION

* CONDITION CATEGORY

SELECTED SYSTEM PERFORMANCE ISSUES

SYSTEM WORKLOAD

Overloaded (specify) __ __

100% Loaded (by weight or volume)

Operationally Loaded (specify) __

* Un loaded

Other (specify)

W4-4
7 HRTE5 CONDITION ooo RATING ,. WORKSHEET

SYSTEM FUNCTION

CONDITION CATEGORY

39: OTHER CONDITIONS

SELECTED SYSTEM PERFORMANCE ISSUES

I

OTHER CONDITIONS

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

W4-41
GUIDELINES I N FOR SELECTINcO 

CONDITIONS

This package of worksheets consists of "Condition Rating Worksheets" and

the Guidelines which you are reading now. You are asked to assist in the

selection of conditions under which the "System Performance Issues"

(SPI's) will be tested.

Your role is to rate the criticality of the ccnditions for each of the

SPI's listed while considering the System Function associated with each.

Based on your and other expert's ratings, the most critical conditions

will be picked and combined with the appropriate SPI's to yield more

specific SPI's. This procedure will insure that the Operational Test

will be conducted in those conditions which are critical concerns for

the system.

The rating procedure has two phases. In the first phase you will rate

the relevant categories on a 3-point criticality scale for each of the

SPI's. In the second phase you will rate the conditions within each of

the categories on the same scale for each of the SPI's.

You are not being asked to rate the conditions on specific attributes

of criticality, but rather on one overall scale of criticality. It is

suggested that you keep in mind the following dimensions when you make

this overall rating:

(a) The extent to which the system is designed specifically

to perform the given SPI as part of the System

Function in this condition.

|I

W4-42

- a, w
GUIDELINES FOR SELECTING

CONDITIONS (Continued)

(b) The extent to which this condition is likely to

negatively affect the system's ability to perform

the SPI as part of the System Function.

(c) The extent to which this condition has already been

associated with inadequate performance of the given

SPi--either during prior OT's/DT's or in sinilar

systems in the field.

(d) The amount or number of times the given SPI will be

performed under this condition as part of the System

Function.

The following are instructions for rating the conditions for each of

the SPI's:

(1) Examine the "Condition Rating Worksheets" and rate each

condition category on the following 3-point scale of

criticality. Do this for each SPI. A category might be

rated differently for different SPI's.

0 1 2

Irrelevant Relevant, Relevant,

but not critical and very critical

Use the "2" Rating sparingly! Only the most critical

categories should be so designated. Condition categories

rated "I" will also be included in the field test, but

only those rated "2" will become part of the SPI.

-

W4-43
GUIDELINES FOR SELECTING HRTE CONDITIONS (Continued)

NOTE: The same SPI may occur under different System Punctions, anC

your rating may be different in each occurrence.

(2) Record your ratings in the appropriate boxes on the

worksheets. (See the "Sample Condition Rating Worksheet."!)

After completing this, each of the boxes at the intersection of the SPI's and the category names will have

either "," "I ," or "2."

(3) Each SPI now has relevant (rated "I" or "2") and irrelevant

(rated "0") categories. For each SPI, rate and record each

specific condition within its relevant categories (i.e.,

those categories rated "I" or "2") on the same scale as

used above.

-* (4) Return the completed rating Worksheets to the sender.

W44

- 4-4 t -, 
SAMPLE

SH RTES CONDITION RATING WORKSHEET

SYSTEM FUNCTION

'" CONDITION CATEGORY

""O ?. WEATHER: ILLUMINATION

SELECTED SYSTEM PERFORMANCE ISSUES

.CO

LWMINA7 I ON

-u'i SunlgMh __ __ 2 Z .

moon I;M fgh

Star I igh

-ercas-, Moon less Nightv (PitCi Black) ___ Z [ 2.

Arl~~liclal ing i -im -se 

ares / //

~roc i Glare

Indirect- Glare (Water, Sad, Clouds, etc.) I IC 

Other (soeciLy)

SYSTEM &jffCjAO4 AA E C- L2 ArAO.J £ ST~dI5 DATE 9E±1d&.dPAGE_....

NAME _TILINON

W4-45 .. . - . - . - . *5 - .. .- . . . . . . . . . . . . . -. - .

,,]#. ." .' .'j,. . '- .'- '.. .- ;' .' .' ..... , -. -. . , ,." . .. , ." .: ," ."..t ,, % c ". . ',- - .,' " " J .. '..-" ". '..' W.'5 "" ." ."". .
SAMPLE

H RTES CONOITION RATING WORKSHEET

SYSTEM FUNCTION 'sn / *e~Er

CONDITON CATORY 2. WEATHER: TEMPERATURE

SELECTED SYSTEM PERFORMANCE ISSUES

N~A.

TE PERATURE / I - /

4igh (Specify) __

Low (soec I fy) -

Norma( (specify) i. z..

NAAASLEPON

:7 .W4-46

• ' .',., . .. .,-,-.- _._ - .-.. _ ,-..-L.".".-,-, _ _ __._ ,> __-. ,,jZ. ,,,,. -.,.-.-Z 7-, ,,. . ... ... . .7. , . ,
V ~_L -n -.r 

CONDITION RATING WORKSHEETMETHOD 2

HRTESWEATHER

1. ILLUMINATION 3. PRECIPITATION

Full Sunlight Rain

Moonlight Fog

Starlight Falling/Blowing Snow

Dusk SlIeet

Pitch Black Sand Storm

Artificial Light (specify) No Precipitation

As Occurs

Ftlares Other (specify)

Direct Glare

Indirect Glare______ ______

As Occurs 4. WIND

Other (specify) HIgh Head Wind (specify)

__________________High Tail Wind (specify)

2. TEMPERATURE

High (specify) Swirling Gusts

Cross Wind (specify)

Low (specify)

No Wind

Normal (specify) As Occurs

Other (specify)

As Occurs j

Other (specify) ____________

5. HUMIDITY

2 High (specify)

Low (specify)

Normal (specify)

* As Occurs

Other (specify)

SYSTEM _________________________TEST____ DATE _______PAGE

NAME___________________ --TELEPHONE

W4 -47
CONDITION RATING WORKSHEET -

METHOD 2 (CONTINUED)

TERRAIN

6. GROUND SLOPE 8. GROUND + WATER

Flat (specify) Light Mud

Heavy Mud

Low Positive Hilly Dry

(specify) Water Covered

- ,.Low Negative Hilly Ice Covered ,, -"(specify) (seif)Snow Covered

High Positive Mountain As Occurs

(specify) Other (specify)

High Negative Mountain

(specify)

0 I9. OBSTACLES

As Occurs Dense Vegetation .-. As Occurs OLight Vegetation

i': -!'!Other (spec ify)

Hedge Rows

Rivers Width and Depth

7. GROUND SURFACE Manmade Structures (specify)

Sandy

Rocky Traps (specify)

Loam

[ "-.-Paved Paved No ObstacIes f' ' ' 

-- As Occurs

-,'. " Broken Paved

Broken Ground Other (specify)

Plowed Fields

Bare Packed

Vegetation Covered

A' As Occurs

Other (specify)

SYSTEM TEST- DATE PAGE

NAME-- TELEPHONE__

' -W4-4Rs
CONDITION RATING WORKSHEET

H RT" METHOD 2 (CONTINUED)

TARGET

10. TYPE 13. SPEED

Type/Size (specify) Maximum Speed (specify)

As Occurs Minimum Speed (specify)

Other

Cruising Speed (specify)

11. NUMBER Rad Alter of Speed (specify)

Single Target

Multi Simul Targs Stationary

(specify) As Occurs

Multi Sequent Targs Other (specify)

(specify)

Comb Multi Simul +

Sequent (specify) 14. D;RECTION

Closing (specify angle)

Noise - Target/Nontarget

Ratio (specify)

Retreating (specify angle)

As Occurs

Other (specify) Crossing (specify direction

and angle)

Complex Maneuver (specify)

12. LOCATION

Minimum Range (specify) As Occurs

Other (specify)

Maximum Range (specify)

Normal Range (specify)

Azimuth + Elevation

(specify)

As Occurs

Other (specify)

SYSTEM TEST_ DATE PAGE

NAME __TELEPHONE

f'" '- '.' ,'-°- .'-'"". "".''"" " , " "' . '- "" " -WA'--"""""""AO" , / '"""'- """" -".•","- - '. ' " "
CONDITION RATING WORKSHEET- H~tmIES METHOD 2 (CONTINUED)

TARGET (CONTI NUED)

15. CONCEALMENT

Concealed Physically (specify)

Concealed Electronically

(specify)

Concealed Partially (specify)

Concealed by Smoke

UnconcealIed

As Occurs

Other (specify)

SYSTEM _________________________TEST-___ 

DATE _______PAGE

NAME __________________TELEPHONE

W4-50
Im"l CONDITION RATING WORKSHEET -

% METHOD 2 (CONTINUED)

PERSONNEL

16. WORKLOAD 19. STRENGTH

Full Operat Loading Minimum Strength

Partial Operat Loading Normal Strength ~~(specify) - (seif)Optimum Strength

As OAs Occurs ~~As Occurs-- --- Other (specify)

Other (specify)

20. PERCEPTION 17. WORK DURATION

Minimum Perception

Following no Work Normal Perception

Following Extended Work Oe

(specify) Optimum Perception

As Occurs

Following Normal Work Other (specify)

(specify)

As Occurs 21. EXPERIENCE

Other (specify) Minimum Experience (specify)

Normal Experience (specify)

18. PROTECT GEAR

Wearing Protect Gear Optimum Experience (specify)

(specify)

As Occurs Wearing Normal Gear Other (specify)

(specify)

As Occurs

Other (specify)

II SYSTEM TEST- DATE PAGE

NAME TELEPHONE

-. . , ... . . . : W 4 -5 1
------- 1.r 

 r.w as

 q J

 FPrT r

 r q~ Wr9 F. ggt

HTCONDITION RATING WORKSHEETIIIE METHOD 2 (CONTINUED)

PERSONNEL (CONTINUED)

22. APTITUDES

Minimum Aptitudes (specify)

Normal Aptitudes (specify)

Optimum Aptitudes (specify)

As Occurs

Other (specify)

23. SIZE

Minimum Size

Normal Size

Maximrum Size

As Occurs

Other (specify)

SYSTEM -- ___________________TEST____ DATE _______PAGE

NAME TELEPHONE

W4-5
,E METHOD 2 (CONTINUED)

TRAINING

24. INSTITUTION

OJT-Tra i ned

School-Trained

Comb OJT + School

No Specific Training

Factory-Tra i ned

• -As Occurs

Other (specify)

25. LATENCY

Period W/O Training/Prac

(specify)

Immed After Training

Normal Latency (specify)

As Occurs

Other (specify)

26. TEAM VS INDIV

Only Indiv Training

Only Team Training

Comb of Indiv + Team

(specify)

As Occurs

Other (specify)

- W4-53
METHOD 2 (CONTINUED)

OPERATIONAL

27. CREW

Optimum Crew (specify)

Normal Crew (specify)

Minimum Crew (specify)

As Occurs

-- Other (specify)

28. HARDWARE

Fully Up

Partial Breakdown (specify)

Fully Down

As Occurs

Other (specify)

29. INFORMATION INPUTS

Full information Inputs

Partial Info Inputs (specify)

No Info Inputs

As Occurs

Other (specify)

SYSTEM TEST_ DATE PAGE

NAME TELEPHONE

W4-54
EU ~ CONDITION RATING WORKSHEET- 'B. HE ~METHOD 2 (CONTINUED)

TACTI CS

30. TACTICS 33. LOCATION(S)

Specify Tactic(s) or Rate Specify Location(s)

Tactical Conditions Wls

31-38)

34. DIRECTION

Closing Angle (specify)

- Retreating Angle (specify) 31. #OF SYSTEMS

Single System

Crossing Angle, Direction Multiple of Same Type(seiy (speccify)

Multiple Systs of 01ff Complex Maneuver (specify)

Types (specify)

As Occurs

As Occurs Other (specify)

Other (specify)

_________________35. CONCEALMENT

32. SPEED Concealed Physical ly

Maximum Speed (specify) Concealed Electronically (specify)

"B Minimum Speed (specify)

Partially Concealed (specify)

Cruising Speed (specify) Concealed by Smoke

Rad Alter of SpeedUnocae

(specify) As Occurs

StatinaryOther (specify)

*As Occurs6-

Other (specify)

U.

SYSTEM _____________________TEST-___ DATE ______PAGE

NAME- __________________ _TELEPHONE__________

W4-55
CONDITION RATING WORKSHEET -

-- METHOD 2 (CONTINUED)

TACTICS (CONTINUED)

36. CREW PROTECTION

Fully Protected-But~oned

Up

Partially Protected Config

(specify)

Least Protected Config

(specify)

NBC Conditions

As Occurs

Other (specify)

U

"37. AUTOMATIC FUNCTION

Fully Automatic

Semi-Automatic (specify)

Manual Mode

As Occurs

Other (specify)

38. SYSTEM LOADING

Overloaded

100% Loaded (WT/VOL)

Operationally Loaded

(specify)

Unloaded

As Occurs

Other (specify)

SYSTEM TEST_ DATE PAGE

NAME TELEPHONE

W4-56

r ,- '&~.A~AA. 1~.---
CONDITION RATING WORKSHEET R TE METHOD 2 (CONTINUED)

NH

OTHER CONDITION CATEGORIES

39. CONDITIONS

W49
GUIDELINES FOR SELECTING CONDITIONS -

METHOD 2

This package consists of "Condition Rating Worksheets - Method 2" and the

Guidelines that you are now reading. Also included is a copy of the "Description of the System to be Tested," several "System Function Worksheets," and a

"System Performance Issue Worksheet." These additional pages describe the

system that is to be tested during the Operational Test (OT) and list the

* System Functions and System Performance Issues that have already been identified for this system. Refer to these pages to refresh your memory of the items

being Included in the test and the Issues that are to be evaluated.

You are asked to assist In selecting the conditions under which the system

will be tested during the OT. Your role is to rate the criticality of the

4cond itions for the performance and maintenance of the system.

Some conditions may be so important for this particular system that these

conditions should be stated explicitly as part of the Issues upon which the

test is planned and conducted. Other conditions may be Important for a

thorough assessment of the system, but they need not be stated explicitly In

the Issues. Finally, some conditions will be left uncontrolled to vary "as

occurs" during the test. Your ratings will help to determine how the conditions will be treated in the test.

* Some of the condition categories or Individual conditions within a category

may have been crossed out. In this case, it has already been determined either

that they are not within the charter of the testing agency to specify these

* conditions, or that these conditions will be left uncontrolled to vary "as

occurs."I You may simply ignore these "crossed-out" conditions.

The rating procedure has two parts. In the first part, you will rate the

V4ndj condition categories on a 3-point scale of criticality. In the second part,

you will rate the individual conditions within each cotegory. In this second

part, you will use two of three points on the same 3-point rating scale.

SYSTEM ____________________TEST-__ DATE PAGE

NAME -TELEPHONE__________

- -. .'.-.-- - -,.**:2~z~;-.~ . -W4-58
GUIDELINES FOR SELECTING CONDITIONS- HRTES METHOD 2 (CONTINUED)

Rather than asking you to rate these condition categories and individual conditions along several attributes of criticality, you are asked to rate on a

single attribute. However, it Ts suggested that you keep in mind the following

four dimensions when you make your ratings of both the condition categories

and the individual conditions:

(1) The amount or number of times the system will perform or be

maintained under this condition.

(2) The extent to which the system is designed specifically to perform

or be maintained under this condition.

(3) The extent to which this condition is likely to negatively affect

the performance or maintenance of the system.

(4) The extent to which this condition has already been associated

with inadequate performance or maintenance, either in prior tests

of this system, or In significantly similar systems that have

already been fielded.

Use the following instructions to rate the condition categories and the individual conditions wi+hin each category:

(1) Examine the "Condition Rating Worksheets - Method 2"1 and rate each

condition category on the following 3.-point scale:

0 -Not critical. This conditior will be left uncontrolled

to vary "as occurs" during the test.

1 -Important. This condition should be controlled during

d the test, but is not so critical that it need be stated

explicitly as part of an Issue.

M SYSTEM _________________________TEST____ DATE _______PAGE

14NAME TELEPHONE____

W4 -59
El ~ GUIDELINES FOR SELECTING CONDITIONS- HRTES METHOD 2 (CONTINUED)

2 - Critical. This condition is sufficiently critical to a

thorough evaluation of the system that the test must be

structured explicitly to include this condition. This

condition will be stated explicitly as part of an Issue.

Use the "2" rating sparingly! To rate a condition category as "2"

gives great importance to that condition and highlights its visibility throughout the test planning and execution. Also, as a

practical matter, every time you rate a condition as "2" you may

increase the number of Issues.

Rating a condition category as "I" may be sufficient to flag that

condition as worthy of attention. Conditions rated "1" will be

controlled during the test.

(2) Rate the individual conditions that belong to those categories that

you rated either "1" or "2." It is not necessary to rate conditions

for categories rated "10."1

For categories that you have rated "2," individual conditions may be

rated either "0" or "2," on the original rating scale. They may not

be rated "1." For each condition category rated "2," at least one

individual condition must be rated "2." However, any number of

conditions in that category may be rated "2," as long as at least

one is so rated. You should continue to be sparing in your use of

the "2" rating. However, you should be aware that an individual

condition which you rate "0" in a category rated "2" will not be

used in the field test. Therefore, if you have rated a category

"2," and if you want a "normal" or "as occurs" condition in that

category to be used for this system, you will have to rate the

"normal" or "as occurs" condition as "2," otherwise they will not

appear In the field test.

SYSTEM TEST__ DATE _ PAGE

NAME TELEPHONE

, .W4-60
GUIDELINES FOR SELECTING CONDITIONS

METHOD 2 (CONTINUED)

For categories that you have rated "1," individual conditions may be

rated either "0," or "1" on the original rating scale. Rating an

individual condition "1" in a category rated "1," means that you do

not want this condition added to an issue, but you feel that it

should be used in the field test.

(3) When you have completed your ratings, fill in your name and telephone number at the bottom of each Worksheet, and return them to

the sender.

..

SYSTEM TEST- DATE - - PAGE

41NAME -_TELEPHONE

W4-61

",=r ,-. .. . . ... . - . . . - - . . . , .. ..
H T S WORKSHEET CONDITIONS X SPI MATCHING

SYSTEM

FUNCTIONU

SPI

1. WEATHER: ILLUMINATION

Full Sunlight

Monl ight

Starlight

DusK

J, Pitch Black

Artificial Lighting

Flares

SDirect Glare

Indirect Glare

As Occurs

2. WEATHER: TEMPERATURE

High ,~ow

Norma I

As Occurs

3. WEATHER: PRECIPITATION

Ra i n

Fog

Falling/Blowing Snow

Sleet

Sand Storm

No Precipitatlon

As Occurs

4. oEATHER: WIND

High Head Wind

High Tail Wind

Swirling Gusts

Cross Wind

No Wind

As Occurs

5. WEATHER: HUMIOITY

High

Low

Normal

As Occurs

SYSTEM TEST-____ DATE PAGE

NAME TELEPHONE

W4-62 , :,,?; ,.O.-',,'; ',-- ,;-9;.', ,,-) , --'-v'- --,. : "-" /-. .:,--,:....-.',',,+...-.--.----.-..,-
CONDITIONS X SPI MATCHING HRTES WORKSHEET (CONTINUED)

SYSTEM

FUCTIO N #I I II

SPI f

A6. TERRAIN: GROUND SLOPE

Fl at

Low Positive Hilly

Low Negative Hilly

A High Positive Mountain

High Negative Mountain

As Occurs

7. TERRA IN: GROUND SURFACE

Sandy

Rocky

Loam

Paved

Broken Paved

Broken Ground

Plowed Fields

Bare Packed

Vegetation Covered

As Occurs

8. TERRAIN: GROUND + WATER

Light Mud

Heavy Mud

Dry

Water Covered

Ice Covered

Snow Covered

As Occurs

9. TERRAIN: OBSTACLES

Dense Ve.getation

Light Vegetation

Hedge Rows

Rivers

- Manmade Structures

Traps

No Obstacles

As Occurs

SYSTEM~ ___________________ TEST - DATE ______PAGE

NAME W4-63 TELEPHONE____________
CONDITIONS X SPI MATCHING fll I ~ WORKSHEET (CONTINUED)

* ni- riER IIIIEEEM **

SYSTEM

FUNCTION #

SF1 #

10. TARGET: TYPE

Type/Size

As Occ urs

It. TARGET: 14UMBER

Single Target

Multi Simul Targs

-~ Multi Sequent Tergs

Comb Multi Simul + Sequent

Noise - Target/Nontarget Ratio

As Occurs

12. TARGET: LOCATION

* Minimum Range

Maximum Range

Normal Range

Azimuth + Elevation

As Occurs

13. TARGET: SPEED

Maximum Speed

Minimum Speed

Cruising Speed

Red Alter of Speed

Stationary

As Occurs

{ 14. TARGET: DIRECTION

Closing

Retreating

Crossing

Complex Maneuver

As Occurs

15. TARGET: CONCEALMENT

Concealed Physically

Concealed Electronically

Concealed Partially

Concealed by Smoke

Unconcealed

- As Oc~urs

SYSTEM _______________________TEST-___ DATE _______PAGE

6 NAME TELEPHONE___________

W4-64
CONDITIONS X SPI MATCHING

AT I I WORKSHEET (CONTINUED)

FUNNCTION4 K

165 PESONNEL: WORLOD

FUlIl Opers' Loai" I

Partial oerat Loading--------

AsOccurs

17. PERSONEL. WORK DURATION4

Following No Work~- --

Fol lowing Ext&a'dd Work

Fol lowing Noeel Worc

As Occurs

18. PERSONEL. PtOTGCT

Wearing Protect Gear

Wearing ,orel Gear

As Occurs

19. PERS L: STREGrH

Norml Streng t

Optrm Strongt

As Occurs

20. perPS0 ERL P TION.

Minima Perception

Noreel Percptiaf

optima Aot f Itfln

AS ccurs

21. PSemomm: 0PIERI EWE

Wi nN Exper Ienc

4orI Experience

Optiman Excerience

As Occurs

22. PERSONNL.APITDE

ilniem Aptitudes

Niormil Aptitudes

Oc aI mm Apt Itudle,

As Occurs

Wt"Ih, Size

'4orwal Size

Mxaima Size I

AS OccursI

SYSTEM TEST - DATE PAGE

NAME _ - TELEPHONE _

0. W4-65
H RTES CONDITIONS X SPI MATCHING H RE WORKSHEET (CONTINUED)

% SYSTEM

SPI 0

% 24. TRAINING: INSTITUTION

Como OJT +School

Factory-Tralned

As Occurs

25. TRAINING: LATENCY

Period W/O Tralning/Prac

Inwyed After Training

Normal Latency

As Occurs

26. TRAINING: TEAM VS INDIV

Only Indiv Training

Only Team Training

Comb of IndlIv + Team

As Occurs

SYSTEM ____________________________TEST____ DATE ________PAGE

NAME -_____________________ TELEPHONE_____________

-. : ~W4-66 ~
CONDITIONS X SPI MATCHING HRTES

SYSTEM

FUNCTION

SPI 0

27. OPERATIONAL: CREW

Normial Creaw n

As Occurs

28. OPERATIONAL: INFO4REINIPT

Fully UpomlonIpl

Partial InBraon Ip

As Occurs

29 PRTO.L.NOMAINIPT

FulIfomtonIpt

SYSTEM _______________________TEST____ DATE _ _____PAGE

NAME_____________________ -- TELEPHONE--_____________

* % ***** -*.****7

* J* .'..**...... . . . .
COND IT IONS X SP 1 MATCHING

WORKSHEET (CONTINUED)

SYSTEM

FUNCTION 0

"" SPI 0

30. TACTICS

31. TACTICS: # OF SYSTEMS

Single System

Multiple of Same Type

Multiple Systs of D1ff Types

As Occurs

32. TACTICS; SPEED

Maximum Speed

Minimum Speed

Cruising Speed

Rad Alter of Speed

StatIonary

As Occurs

33. TACTICS: LOCATION(S)

34. TACTICS: DIRECTION

Closing Angle

RetreatIng Angle 

Crossing Angle, Direction

Complex Maneuver

As Occurs

35. TACTICS: CONCEALMENT

Concealed Physically

Concealed Electronically

Partially Concealed

Concealed by Smoke

Jnconcea Ied

As Occurs

I

SYSTEM TEST - DATE PAGE

NAME TELEPHONE

W4-68
H R TE CONDITIONS X SPI MATLHING

WORKSHEET (CONTINUED)

SYSTEMD

FUNCTION I

* 36. TACTICS: CREW PROTECTION

Fully Protected-Buttoned Up

Partially Protected Config

i ."',Least Protected Config

f ': As Occurs

37. TACTICS: AUTOMATIC FUNCTION

FulII y AutomatI c

Sam i-AutomatIc

Manual Mode

As Occurs

V38. TACTICS: SYSTEM LOADING

Overloaded

100% Loaded (WT/VOL)

Operational ly Loaded

Unloaded

As Occurs

S.,

SYSTEM TEST_ DATE PAGE

NAME TELEPHONE

" KW4-69 • .,. , , . .. .::. .: -,::, : ,.- ,, .,- -:.. . :.,. ,,. .. .. " . . . . . . . ..
CONDITIONS X SPI MATCHING

HRTESWORKSHEET (CONTINUED)

39. OTHER CONDIWTION CATEGORIES: CONDITIONS

* &T

'V---gSYTMTS - AEPG

NAETLEHN

W4-7
HX~tbSPI SUMMARY WORKSHEET

SYSTEM FUNCTION [______________________

FINAL

SELECTION CONDITION COMBINATIONS SELECTION

SPI (STATEMENT) WEIGHT ATTACHED TO SPI STATEMENTS WEIGHTS

9 SYSTEM ______________________TEST____ DATE ______PAGE

NAME TELEPHONE __________
Li 3~rE~f~~5. HUMAN PERFORMANCE FUNCTION GROUPS

L-,.E (HPF-Groups)

CONTENTS

1. Set of Operational HPF-Group Worksheets

2. Guidelines for Developing Maintenance Human Performance Functic (HPF's)

3. Maintenance Worksheet

4. Test Condition Worksheet

5. Final Condition Set Worksheet

6. Guidelines for Developing Performance Criteria

7. Sample Criterion Worksheet (2 Pages)

S. Criterion Worksheet

9. Guidelines for Developing Statistics and Statistic Criterion

10. Sample Criterion Worksheet (2 Pages)

.. W5-I

N 

~~jj~;;-y.. .Wi*~§. :ci%& :

J
• HOPERATIONAL HRTES HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

HPFGROUP # -

LU WEAPON DELIVERY

,L.

HPF% Z

1. Assemble system

2. Emplace system

0. 3. Calibrate system components including boresighting and zeroing

4. Acquire target(s) (This HPF is dealt with as a separate HPFGroup. Turn to page W5-3, to complete it.)

5. Select ammunition

6. Prepare ammunition for firing

7. Communicate fire order and other intracrew instructions

8. Fire weapon

9. Dispose of spent casing(s)

10. Guide weapon to target

11. Perform misfire procedure

12. Perform hangfire procedure

13. Clear/swab/clean appropriate sections of system

14. Disassemble system

SYSTEM TEST- DATE .PAGE

NAME TELEPHONE

W5-2
H RTE OPERATIONAL PF-GROUP WORKSHEET

SYSTEM FUNCTION ________________________

jJTARGET ACQUISITION

NZ

HPF'3

1. Detect target(s)

2. Identify target(s)

3. Select target(s) and target order

4. Orient weapon system in general firing position

5. Determine range of target

6. Aim weapon system. This involves a procedure which results in the

system being adjusted for the azimuth and elevation of the target

7. Illuminate or designate target

8. Adjust aim, following miss

9. Shift to second target

SYSTEM ________________________TEST-___ DATE PAGE

4 NAME ______________________TELEPHONE

W5-3
HRTE OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

,HPF-GROUP 1#

3 WEAPON DELIVERY--GROUND TO GROUND Z

MISSILES

- .

HPFs Z

1. Mate warhead to missile

2. Load and secure missile on launcher

3. Convert transport to launcher

4. Position and emplace launcher

5. Lay system for azimuth and elevation

6. Instal I sighting components

7. Calibrate system including boresighting and collimating

8. Conduct missile system prefire checkouts

9. Arm system

10. Inspect system for defects

11. Identify/determine target

"12. Identify/determine target coordinates

13. Program missile

14. Initiate firing sequence

15. Fire system

16. Guide missile to target

17. Handoff missile to intermediate guidance

(CONTINUED ON NEXT PAGE)

SYSTEM TEST__ DATE PAGE

NAME __ TELEPHONE

W5-4

, " p - " % ', % , , % ",,, "+ -, % % , % % % \ " % . . . - , - , . .- - . , " - , % - . ., ..
H RTE OPERATIONAL HPFGROUP WORKSHEET

SYSTEM FUNCTION

SPI

HPF-GROUP

- U WEAPON DELIVERY--GROUND TO GROUND at

MISSILES (CONTINUED)

e z

HPF's

18. Perform missile no-go procedure

19. Perform misfire procedure

20. Perform hangfire procedure

V.

.

1. .

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

W5_5

K ' .- -. - -4.
OPERATIONAL HPF-GROUP WORKSHEET r~~~:HRTES ,,,,N.,.o,

SYSTEM FUNCTION

SPI

* V,

HPF-GROUPr

WEAPON DELIVERY--HAND GRENADES Z

HPFs z

1.. Inspect grenade for defects

2. Correct applicable defects

3. Attach to appropriate part(s) of person/harness/etc. a

4. Acquire target; include the judgment of distance to target

5. Aim grenade

6. Launch grenade

7. Adjust launch based on location of detonation in relation to target

I

SYSTEM TEST-_ DATE. PAGE

NAME TELEPHONE

W5-6
OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

*. SPI

HPF-GROUP "Y5 WEAPON DELIVERY--MINES Z a

LJ6

HPF's

1. Select appropriate location for mine installation

2. Inspect mine/triggering device/fusing device

3. Transport mine

4. Prepare mine for installation

5. Install mine (including the digging of a hole)

6. Camouflage mine/triggering device

7. Aim mine, if applicable

8. Test circuit(s)

9. Arm mine

10. Fire mine, if applicable

11. Disarm mine

SYSTEM TEST- DATE PAGE

NAME _ _ ___ TELEPHONE

W5-7
HRTESOPERATIONAL HPF-GROUP WORKSHEET ~HRTES

SYSTEM FUNCTION

SPI

HPF-GROUP i -

TARGET INFORMATION GATHERING AND Z

INTERPRETATION

U. U

HPFN 2 Z

1. Assemble system

2. Position system in appropriate location

3. Select type and number of sensors

4. Position sensors in appropriate location

5. Calibrate/align system components

6. Detect target(s)

7. Identify target(s)

8. Determine number of targets

9. Determine target(s) location/range

10. Determine target speed

11. Determine target direction

12. Determine target formation/tactical situation

13. Select and order targets based on the matching of priorities with

target information gathered.

14. Recognize countermeasures and take appropriate action

I I

SYSTEM TEST_ DATE PAGE

NAME TELEPHONE : W5-8
HRTES OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPM

- HPF-GROUP I

71 TARGET DESIGNATION Z CO

HPFs

1. Assemble/disassemble system

2. Calibrate/align system

3. Select designator system position

-~ 4. Acqu ire target (See Target Acqu is it ion, page W5-1.

SYSTEM _________________________TEST-__ DATE _______PAGE

NAME TELEPHONE____________

WS-9
OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

HPF-GROUP#-

TARGET BEHAVIOR PREDICTION

HPFs 2 Z

1. Predict maneuver of target(s)

2. Predict location of target(s) after given time interval, or predict

time interval to arrive at given location (location includes range

* altitude, azimuth, elevation, etc.)

3. Predict attack of target(s) on friendly force

4. Predict time/location for successful attack on target(s)

SYSTEM __________________________TEST-__ DATE _______PAGE

1 NAME ________________________TELEPHONE-______________

W5-1 0

N"
H . r.!RTES OPERATIONAL HPF-GROUP WORKSHEET o,,,

SYSTEM FUNCTION

SMI

HPF-GROUP

WEAPON FUNCTION MANAGEMENT

at z

HPFIS z

1. Determine type of target

2. Determine speed/direction of target

3. Determine target range at time of weapon delivery

4. Determine weather conditions which impact weapon delivery and adjusl

for them

5. Determine type of ammunition to be used based on all above factors

6. Determine probable amount of ammunition required to kill target

under existing/projected conditions

7. Recommend action based on available supply of ammunition, future

probable requirements for ammunition, and probable required amount

to kill target at various ranges/speeds

II

SYSTEM TEST-_ , DATE PAGE

NAME TELEPHONE

W5-11
HRTEOPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

NPF-GROUP i

HP.G2U-J REPRESENTATION OF TERRAIN/OBSTACLES/

INSTALLATIONS/WEATHER

%. U.

HPFI z

1. Indicate key terrain features which might affect outcome of the

operation1

2. Indicate man-made obstacles which might affect the outcome of the

operation2

3. Indicate installations which might affect the outcome of the

operation3

4. Indicate features of weather which might affect the outcome of the

operation4

5. Identify important information which is missing

6. Identify important information which is internally inconsistent

or probably inaccurate

7. Develop alternate information sources

8. Prioritize information according to user(s) need and probability

of its accuracy

9. Prioritize list of information users for receipt of information

based on their functions in this specific operation and their

requirements

1, 2,3, 4

See page W5-13 for footnotes

SYSTEM TEST__ DATE PAGE__

NAME TELEPHONE

........................................ W5-12 W:~~ 2

• , . , . c ." l '* -'1 ' ', ,' - i _> _ . , ,i ,_ - .,, ". . ,, .' ;:. ':,'- "* . 'a
FOOTNOTE FOR OPERATIONAL

HPF-GROUP WORKSHEET

10. REPRESENTATION OF TERRAIN/OBSTACLES/INSTALLATIONS/WEATHER

IYour consideration of terrain features should include the following:

coastline configuration soil composition

exits from beaches water depth

avenues of approach terrain slopes

cover and concealment beach characteristics

observation and fields of fire elevations

defiladed areas accessibility of terrain features

areas suitable for avaiation landing

positions for weapons

spaces for maneuver

points of maximum disruption

2Your consideration of man-made obstacles should include the following:

minefields

tank traps

water obstacles

ditches

destroyed/potentially destroyed bridges, tunnels, etc.

3Your consideration of installations should include the following:

airports enemy air defense systems

heliports enemy radar facilities

enemy depots enemy satellite microwave receiving

enemy command posts stations

enemy transportation facilities

enemy communication facilities

enemy power operation facilities/lines

enemy C3 positions

4Your consideration of weather should include the following:

visibility data humidity data

wind data precipitation data

temperature data

W 5-13
OPERATIONAL HPF-GROUP WORKSHEET ~HRTES ,,,,,,,.ouw,,,,

SYSTEM FUNCTION

SP,

HPF-GROUP Z -

REPRESENTATION OF STATUS OF FORCES

Sz

HPft z

1. Indicate location(s) of forces

2. Indicate composition (number and type) of forces

3. Indicate availability of forces

4. Indicate peculiarities/weaknesses of forces

5. Indicate recent significant tactical events in which specific units

were involved

6. Indicate actions which forces are currently pursuingl

7. Indicate the enemy commander(s)' previous behavior in similar

situations

8. Indicate combat effectiveness of forces

A 9. Indicate relative combat power of enemy to friendly units

10. Indicate relevant threat potentials of enemy forces

11. Identify important missing information

12. Identify important information which is internally inconsistent

or probably inaccurate

* 1See page W5-16 for footnote

(CONTINUED ON NEXT PAGE)

0- SYSTEM TEST - DATE PAGE

NAME _____________________TELEPHONE ____________

.W S14 ' i............................................................"-"."........--".."...."':
H RTES OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

I4PFGOUPI~

L.ILJREPRESENTATION OF STATUS OF FORCES

(CONT INUED) -

HPFbs

13. Develop alternate sources of information

.J.14. Prioritize information according to the user(s) needs and probability of its accuracy

15. Prioritize list of information user(s) for receipt of information

based on their functions in this specific operation and their

* requirements

4

r, NAME __________________________TELEPHONE

WS-'15
FOOTNOTE FOR OPERATIONAL HRTES HPF-GROUP WORKSHEET

11. REPRESENTATION OF STATUS OF FORCES

1

Your consideration of these actions should include:

direction of movement

speed of mozvement

apparent purpose(s) of movement

6%.

W51
HRTE OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SM

L LJPROJECTION OF BATTLEFIELD OPERATIONS

HPF's

1. Determine observable indicators of possible changes in the operational situation

2. Prioritize indicators of operational changes

-23. Assign intelligence collection tasks to maximize receipt of

ndicators according to their priorities

4. Monitor intelligence collection and reassign tasks based on

updated information

5. Display pertinent information

6. Identify important missing information

7. Identify important information which is internal ly inconsistent

or probably inaccurate

8. Develop alternate sources of information

V9. Determine which model(s) of expected enemy behavior best fits

collected information

*10. Assign confidence levels to the projection(s)

11. Make recommendations about the effects of projected operations

*112. Prioritize information according to user(s) need and probability

of accuracy

(CONTINUED ON NEXT PAGE)

SYSTEM _________________________TEST-__ DATE _______PAGE

a NAME _____________________TELEPHONE

W5-17

~~~%~~ * q * Vd ~ j -.. .,
HRTESOPERATIONAL HPF-GROUIP WORKSHEET

SYSTEM FUNCTION

SPI

HPF-GROUPl~

Li~J PROJECTION OF BATTLEFIELD OPERATIONS

(CONTINUED)

w z

HPF'S

13. Prioritize list of information users for receipt of information

based on their functions in this specific operation and their

requirements

SYSTEM _________________________TEST-__ DATE PAG

NAME TELEPHONE__________

W5-1 8
HRT'ESOPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

HPF-GROUP 1

L JPROJECTION OF WEATHER CONDITIONS

HPF's Z

1. Collect relevant weather information for the applicable area(s)

2. Develop alternative weather projections and their indicators

3. Assign probabilities to weather projections

4. Determine effects of alternate weather projections on operation(s)

5. Prioritize indicators of weather projections '-

6. Assign weather indicator collection tasks

7. Monitor weather indicator collection and reassign tasks based on

updated information

8. Update projection probabilities

9. Collect, order and display pertinent information

10. Identify important missing information

11. Identify important information which is internally inconsistent

or probably inaccurate

12. Develop alternate sources of information

13. Prioritize information according to user(s) needs and probability

* of accuracy

(CONTINUED ON NEXT PAGE)

SYSTEM TEST-_ DATE PAGE

NAME TELEPHONE

W5-19

_ , " " ,, .-. . . . ,, - -. . . . .: . - . . . . .N . . -. . .. . . . . .
HRTE S OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

HPF-GROUP

LJ. .JPROJECTION OF WEATHER CONDITIONS

(CONT INUED)

HPF'S

14. Prioritize list of information users for receipt of information

based on their functions in this specific operation and their

requ irements

SYSTEM ________________________TEST-....... DATE PAGE

NAME _________________________TELEPHONE

WS-20

%,%-
HRTESOPERATIONAL HPF-GROUP WORKSHEET ~HRTES

SYSTEM FUNCTION

SMI

HPF-GROUP #'-

1141 SELECT THE MOST APPROPRIATE FRIENDLY "

UNIT(S) TO ENGAGE IN OPERATION a .

HPFIS z

1. Determine the requirements the operation will make on the friendly

unit

2. Order these requirements based on commander's priorities

6

3. Identify friendly unit(s) with the appropriate mix of attributes

to match the prioritized requirements

4. Determine which friendly units, with the correct attributes, can be

removed from their present operations without unacceptable consequences.

5. Determine ;he transportation systems required to move each friendly

unit to the operational area

6. Determine the availability of each transportation system required

to move each friendly unit and the time required for it to perform

its function

7. Determine the logistics required by each friendly unit to perform

its functions in the operation in question

8. Determine the availability of the supplies and delivery systems to

the operations area for the required logistics of each friendly unit

9. Display all significant information and order it in some logical

and helpful manner

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

W5-21
HRTESOPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

IIPF-GROUP

15 SELECTION AND ORDERING OF APPROPRIATEZ

TARGETS

HPF's Z

1. Locate potential targets

2. Identify type and number of potential targets

3. Determine threat potentials of targets

4. Determine availability of appropriate friendly weapon system

5. Determine the probability of eliminating target(s)

6. Prioritize targets

7. Select targets to attack

SYTM ET - DTEPG

NAE ELPHN

W.-2
HRTES ,OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

HPF-GROUP r, 1 Z

L',, CONTROL OF FRIENDLY FORCES ON THE

BATTLEF I ELD -,

<

HPFS , Z

1. Determine commanders' desired outcome and priorities

2. Determine the tactics to be followed

3. Select the most appropriate friendly unit(s) to engage in operation1

(See Select the Most Appropriate Friendly Unit(s) TO Engage in

Operation, page W5-21.)

4. Determine travel routes for friendly units

5. Determine departure and projected arrivaltimes for friendly units

6. Prepare contingency plans and the situations in which each is to

be implemented (See Projection of Battlefield Operations,

page W5-17.)

7. Prepare plans, orders, maps and other required documents

8. Prepare materials for briefing commanders and staffs

9. Monitor units' compliance with orders and their progress

10. Identify critical situations which indicate significant changes in

battlefield operations

11. Update plans/orders as battlefield situation changes

1See page W5-24 for footnote

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W5-23
FOOTNOTE FOR OPERATIONAL

HPF-GROUP WORKSHEET

16. CONTROL OF FRIENDLY FORCES ON THE BATTLEFIELD

The following types of units should be considered in this selection

process:

(1) first echelon

(2) reserve

(3) intelligence

(4) counter-intelligence

(5) maintenance

(6) logistics

6 

4

W5-24
HRTESOPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

HPF-GROUP i 71 LOG IST ICS Z cm

LJu

HPn z

1. Maintain information on current status of supplies

2. Maintain information on maintenance status of equipment needed

for mission

3. Recommend location of rear boundary bases

5. Determine throughput unit supply requirements

6. Recommend movements which are consistent with logistics considerat ions

7. Develop policies for area damage control operations

SYSTEM ________________________TEST-__ DATE _______PAGE

14NAME _______________________TELEPHONE______________

W5-25
OPERATIONAL HPF-GROUP WORKSHEET HRwcE

SYSTEM FUNCTION

SPI

I4PF-GROUP 1-

LJiPERSONNEL PLANNING

-at

HPFI

-. 1. Prepare personnel estimnate based on requirements of operation

2. Estimate casualty rates of friendly forces and projected POW's

3. Prepare evacuation contingency plans

4. Coordinate personnel replacement plans with appropriate

organ izat ions

NJSYSTEM __________________________TEST-__ DATE _______PAGE

NAME _____________________________TELEPHONE

W5-26
OPERATIONAL HPF-GROUP WORKSHEET ~HRTES

SYSTEM FUNCTION

HPF-GROUP#-

RECONNAISSANCE/FIRE CONTROL Z

.'

! HPFI 2 z

1. Determine target type/number/size/direction/speed/elevation

i' 2. Determine weather conditions effecting weapons delivery

3. Determine target coordinates

4. Mark target locations; this may be done by physical, chemical,

radiological or electronic means

5. Handoff target(s) to attack units

6. Determine effects of fire on target

7. Relocate target(s)

8. Adjust fire of attacking unit(s)

16.

or

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W5-27
HRTES OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SII

HPF-GROUP I 1

i21BATTLEFIELD RECONNAISSANCE Z

: - a U-.

HPFI S z

1. Identify key environmental features

2. Identify current weather conditions

3. Identify key elements of threat force

4. Identify essential information for evaluating NBC contamination

hazard outer limits

5. Identify/select routes

6. Present information about routes which could influence movement

7. Identify hazards to movement

8. Identify early warning of enemy threat

- 9. Report map changes

L%

SYSTEM TEST- DATE PAGE

NAME _TELEPHONE

V . WS-28
OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

IP-RU~~j ESTABLISHMENT AND MAINTENANCE z 0

OF COMMvUNICATIONS

IL

HPF's z

1. Assemble communications device(s)

2. Assemble/erect/orient antenna

*3. Establish communications net

4. Enter coniun ications net

5. Transmit messages

6. Receive messages

SYSTEM _________________________TEST-__ DATE _______PAGE

NAME _____________________TELEPHONE ____________

r. K.*......W5-29 . ~ 
OPERATIONAL HPF-GROUP WORKSHEET

riRTuE

SYSTEM FUNCTIO

SPI

HPF-GROUP f~ [ J PREVENTION OF INTERCEPTION/JAMMING Z

L U .

HPF'sz

1. Encode messages

2. Authenticate transmissions

6, 3. Decode messages

* 4. Apply anti-jamming procedures

* 5. Apply transmission security procedures

SYSTEM ________________________TEST-___ DATE _______PAGE

NAME __________________________TELEPHONE_______________

VV,5.30
OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI1

HPF-GROUP# FIT! INFORMATION ROUTINGZ

Cw Z

HPFIS

1. Identify appropriate recipients of information

2. Prioritize recipients for the delivery of information

3. PriToritize pieces of information for delivery

4. Assign security classification and method for maintaining that

classi fication

5. Determine call signals/frequencies

SYSTEM ________________________TEST-___ DATE PAGE

NAME _________________________TELEPHONE

W5-31

*~~~- . 11. 
HRTES HRTESOPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTIO

S I

HPF-GROUP

24 VEHICLE MANEUVERING--GROUND Z . VEHICLES

<

HPF s z

1. Observe environment for obstacles, landmarks, etc.

2. Read and use instruments appropriate to vehicle maneuvering

3. Perform the following, moving backward (B) and/or forward (F).

Circle B or F as appropriate.

3.1 Tight turn(s) B F

3.2 Wide turn(s) B F

3.3 Accelerating turn(s) B F

3.4 Decelerating turn(s) B F

3.5 Rapid acceleration B F

3.6 Gradual acceleration B F

3.7 Rapid deceleration (no stop) B F

3.8 Gradual deceleration B F

3.9 Sudden stop B F

3.10 Maintain constant speed B F

II

SYSTEM TEST__ DATE PAGE

NAME ,_TELEPHONE

W5-32

• V,,.zr . / Y .I;.. , . . , • , ,\ ,.' ,: ;, ..-.... ..- .. ... .. . -. . - .....
- . - I.- - ' J 7. ~ - . - , -- Il'. 

H R TE OPERATIONAL HPF-GROUIP WORKSHEET

SYSTEM FUNCTION

SPI

HPF-GROUP 1

VEHICLE MANEUVERING--HELICOPTERS z

- a.

HPFs z Z

1. Perform takeoff to hover

2. Perform instrument takeoff

3. Perform hover checks

4. Perform hovering turns

5. Perform hovering flight

6. Perform normal takeoff

7. Perform maximum performance takeoff

8. Perform straight and level flight

9. Perform climbs and descents

10. Perform turns

11. Perform instrument turns

12. Perform aceleration/deceleration

13. Perform traffic pattern flight

14. Perform high speed flight

15. Perform hovering autorotation

16. Perform standard autorotation

17. Perform standard autorotation with turn

(CONTINUED ON NEXT PAGE)

SYSTEM TEST__ DATE PAGE :4

NAME TELEPHONE_

W5-33
HRTES OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

HPFGROUPf~

25FGU VEHICLE MANEUVERING--HELICOPTERS Z

(CONTINUED) a

U6U.

HPF's z

18. Perform holding procedures

19. Perform unusual attitude recovery

20. Perform before-landing check

21. Perform shallow approach to a running landing

22. Perform landing from hover

23. Perform normal landing approach

24. Perform shallow landing approach

25. Perform steep landing approach

26. Perform instrument approach

27. Perform GCA approach

28. Perform IFR helicopter recovery procedure

29. Perform tactical instrument approach

30. Perform go around

SYSTEM TEST- DATE , _ PAGE

NAME _ TELEPHONE

WS-34 :.:. !,... .... .. ...:.. ,:. .,-. ... :..-.- ...... .. .:..- .... .. ... ..- ..,.=,. ..: . . . ...... 1 ... . .., .,- .........
OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

HPF-GROUP F-G TACTICAL VEHICLE MANEUVERING-- Z

HELICOPTERS

HPFs z

1. Perform terrain flight takeoff

2. Perform hover out of ground effect

3. Perform terrain flight navigation

4. Perform contour flight

5. Perform NOE flight including masking and unmasking

6. Perform confined area operations

7. Perform slope operations

8. Perform pinnacle/ridgeline operation

9. Perform evasive maneuvers

10. Perform low-level flight

11. Perform circling approach from terrain flight

12. Operate radar warning receiver

13. Perform visual glide slope approach and landing

14. Perform ski landing

15. Perform amphibious operations

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W5-35

,.." . ,v ...",.'. ,; , ,,..'.", .. .., "..,.", ''', ; e ' , '":". ..,.... .,.' ..,. ',"-.. ',- .,.." ,",","k,"..,
OPERATIONAL HPF-GROUIP WORKSHEET

SYSTEM FUNCTION

SPI

HP-R~NAVIGATION -Z 

HPFs

-' 1. Select appropriate maps and/or navigation aids

2. Identify present location

3. Identify destination

4. Select travel route

5. Estimate time of arrival and fuel requirements

6. Travel designated route

7. Identify position or route at specified times/locations

SYSTEM_____________________TEST-___ DATE _______PAGE

NAME ______________________TELEPHONE_____________

WS5-36
OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

HPF-GROUP[ ]

[jJ VEHICLE LOADING/UNLOADING Z 09

U

Sz

HPF's z

-1. Load and position cargo/passengers in/on vehicle

2. Secure cargo/passengers

*3. Unload vehicle

4. Fuel vehicle

5. Load ammunition

SYSTEM ________________________TEST-___ DATE PAGE

NAME _____________________TELEPHONE

W5-37
9'

~HRTES OPERATIONAL ,, HPF-GROUP 0w WORKSHEET ..

SYSTEM FUNCTION

SP

HPF-GROUP fl -

VEHICLE RECOVERY z

WA

U.

=

HPF's

1. Position recovery vehicle(s)

2. Prepare recovery vehicle(s)

4 3. Prepare system to be recovered

4. Attach cables between system to be recovered and recovery vehicles

5. Reconnoiter recovery area

6. Tow/lift/push system to be recovered

7. Disassemble/stow recovery equipment

TII

Il"SYSTEM _________________________TEST-___ DATE PAGE

NAME __________________________TELEPHONE_______________

W -38
HRTES HRTESOPERATIONAL HPF.GROUP 0WORKSHEET

SYSTEM FUNCTION

SP,

IPF-GROUP j-- -

SELF-RECOVERY i

- I

W a

HPF's ; z

1. Prepare system for self-recovery

2. Reconnoiter for appropriate anchor points and recovery path

4 3. Position anchors

4. Attach cables to anchors/winches

5. Pull system to safe area

6. Disassemble/stow self-recovery components

'II

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W5-39
HRTE HRTESOPERATIONAL HPF-GROUP oowo WORKSHEETo

SYSTEM FUNCTION

SPI

HPF-GROUP -

ESCAPE FROM SYSTEM HARDWARE Z

uC

HPF z

1. Destroy or alter critical components of communication and other

sensitive equipment/documents

2. Take personal weapon, ammunition, and survival equipment

3. Position system hardware for escape, if possible under the

conditions imposed

4. Open escape path out of system hardware

5. Escape from system hardware

A

SYSTEM TEST- DATE PAGE

NAME _ _ _ _ _ __ TELEPHONE

WS-40
HRTES OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

HPF-GROUP Fl] SYSTEM PROTECTION FROM THREAT Z W

HPFIS

1. Identify threat to system; e.g., onboard fire, flooding,

imminent crash, NBC, enemy attack

42. Activate hardware protective device(s)

3. Put on protective gear/clothing

4. Secure material/cargo for protection against threat

5. Assume protective position for crew/passengers

6. Maneuver to protect from threat

7. Deactivate hardware protective device(s)

SYSTEM _________________________TEST-__ DATE _______PAGE

NAME ______________________TELEPHONE_____________

W-41
H RTES OPERATIONAL HPF-GROUP WORKSHEET2

SYSTEM FUNCTION

I4PF-GROUP#-

L!LJPREVENTION OF DETECTION/L-OCATION

OF SYSTEM

Sz

HPFIS

1. Detect threat warning(s) which indicate either search or attack

modes

2. Identify the nature of the threat(s) from which detected threat

warnings emanate

3.' Take appropriate countermeasures to reduce the probability of

identification of location1

4. Camouflage system 2

L12See page W5-43 for footnotes

SYSTEM __________________________TEST-__ DATE _______PAGE

NAME __________________________TELEPHONE

WS-42
. . . . . . . . .. .... . . ,4 j - r-r. -,- f -,'V l 2-- =7 _ - 

 

- - - ---.---- -- * -.'-, - - : -, . _ ,r

FOOTNOTE FOR OPERATIONAL

M.I HPF-GROUP WORKSHEET

33. PREVENTION OF DETECTION/LOCATION OF SYSTEM

'These countermeasures include:

jamming

smoke

flares

chaff

powered decoys

signature alteration

electronic attack of threat-sensing equipment

2 System camouflage includes:

physical

-* infrared

radar signature reduction

W5-43

1_1 -. . . . . . .
OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

( HPF-GROUP #- Z ac

ENGINEERING--OBSTACLE REMOVAL/ 

BREACHMENT

HPFIS E z

1. Acquire obstacle to be dealt with

2. Prepare system hardware for obstacle removal/breaching. The nature

of this preparation is entirely dependent upon the sort of system

under consideration. It may involve preparation for bulldozing,

gun firing, demolition, etc.

3. Decide on placement of fire, charge, or pressure in relation to

obstacle

4. Remove/breach obstacle

5. Remove/displace remains of obstacle

SYSTEM TEST-__ DATE PAGE

',.. NAME TELEPHONE

W5-44

r. 7 .!.I
OPERATIONAL HPF-GROUP WORKSHEET

SYSTEM FUNCTION

SPI

'a HPFGROUP

ENGINEERING-BRIDGING Z at

ac

HPF's z

1. Prepare bridge site

2. Excavate foundations

3. Construct bridge abutments

4. Construct bridge span

5. Construct/assemble bridge

6. Prepare bridge for launching

7. Position bridge transporter for launching

8. Launch/drive bridge into water

9. Connect bridge

10. Recover bridge

11. Disassemble bridge

I .

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W5-45

, - .- ., . -,-,. .. - - - . . ..
GUIDELINES FOR DEVELOPING M• :, MAINTENANCE HUMAN PERFORMANCE FUNCTIONS

System Performance issues (SPI's) are major activities which must be

performed by a system. Human Per'ormance Functions (HPF's) are those

" human activities which are required to carry out each SPI of a system.

There are two general types of HPF's: those required for the actual

performance of an SPI--called Operational HPF's, and those required for

the continued performance of an SPI--called Maintenance HPF's. You are

being asked to aid in developing Maintenance HPF's for specific SPI's.

a Maintenance HPF's for a given SPI may be scheduled or unscheduled.

Scheduled and unscheduled Maintenance HPF's may be performed by system

operators or by designated maintenance personnel.

A Maintenance HPF should start with an action verb and give a specific

object. For example, "Purge Turret Hydraulic Lines" or "Clean Engine

Intake Filters." The following list of action verbs should prove helpful

- to you in writing the HPF's.

Inspect Change/Replace

Lubricate Troubleshoot/Diagnose

Fill/Drain Remove

Purge Disassemble/Assemble

Paint Install

Clean Adjust/Align

Test

Each of the "Maintenance Worksheet" which you have been given contains the

name of the system, the cfass In which that system falls, the system function,

and the SPI for which you are to provide Maintenance HPF's. Read the W

WS-46
GUIDELINES FOR DEVELOPING

MAINTENANCE HUMAN PERFORMANCE FUNCTIONS

-"T E S (Continued)

following instructions and complete the Worksheets. Use your expertise

about the maintenance of this system class or specific system, and any

other relevant documentation to develop the HPF's.

." (1) For each SPI, record on the "Maintenance Worksheet" all those

HPF's which meet either of the following:

d

(a) HPF is necessitated by a hg probability of breakdowns

in that part of the system which is involved in the performance of the SPI. Consider the probable conditions

in which this system will be actually operated, including

any specific conditions contained in the SPI statement.

(b) If the HPF is performed poorly, it will result in a

breakdown or poor system performance of the SPI.

(2) For each HPF, indicate on the Worksheet:

(a) Who will perform it (i.e., maintenance personnel, system

operators, or both.) (b) What type of Maintenance HPF it is (i.e., scheduled,

unscheduled, or both.)

(3) Return the completed forms to the sender.

.. W 5 -4 7
HRTESMAINTENANCE WORKSHEET

SYSTEM CLASS

SYSTEM FUNCTIONI

SPI

SYSTEM~(m TET AEPG

NAMEZ 0ELEHON

W-5-48
H HRTES R n -S TEST sCONDITION WORKSHEET

SYSTEM FUNCTION

SPI

HPFs PERFORMED

UNDER THE SAME

CONDITIONS

RELEVANT

CONDITION CATEGORIES SELECTED CONDITION(S) FROM EACH CATEGORY

4

o

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W5-49
HRTES FINAL CONDITION SET WORKSHEET

SYSTEM FUNCTION

SP,

HPFs

A PERFORMED

TOGETH ER

SET # CONDITION SET(S) UNDER WHICH EACH HPF IS TO BE TESTED

SYSTEM TEST___ DATE PAGE

NAME ____________________________TELEPHONE________________

-% W5-50
GUIDELINES FOR DEVELOPING

PERFORMANCE CRITERIA

HRTESI

You have received a set of "Criterion Worksheets." Each one corresponds

to a specific Human Performance Function (HPF) which will be measured in

the Operational Test. In addition, you have received "Final Condition

Set Worksheets" for the appropriate HPF's. To determine if an HPF trial

has been performed successfully, it is necessary to define what a successful p -formance means, or to define what we call the performance

criterion of the HPF. Usually, this can be done by determining the maximum acceptable time to perform the HPF and/or by specifying a minimum

level of accuracy. HRTES distinguishes between three types of criteria:

(a) time criterion, (b) accuracy criterion, and (c) combined time and

accuracy criterion. It is expected that the third type will be used most

frequently.

As an example: "The time for performing a specific HPF should not exceed

30 seconds is a time criterion." "Number of errors while performing this

HPF should not exceed 10 errors is an accuracy criterion." "The HPF

should be done in less than 10 seconds with no more than 5 errors is a

combined time and accuracy criterion."

Development of a time criterion for an HPF is quite straightforward. If

the MENS, ROC, or LOA provides you with an appropriate SPI time criterion,

your task will then be to allocate that time to each of the HPF's of

the SPI. Otherwise, each HPF time criterion will have to be developed

according to your own expertise.

Development of a criterion which includes accuracy is more complicated.

For each HPF, you will have to determine the various significant errors

which can occur, and decide whether you want to distinguish between

different kinds of errors in your criterion.

W5-51

_,L-
GUIDELINES FOR DEVELOPING

PERFORMANCE CRITERIA (Continued)

To develop an appropriate performance criterion for each HPF, you have

to consider the condition set under which the HPF is going to be tested.

If an HPF has more tht one condition set, you may have to determine a

different criterion for each condition set of the HPF.

Each of the "Criterion Worksheets" is attached to appropriate "Final

Condit;Dn Set Worksheets." Both Worksheets contain the name of the

system, the System Function, the SPI, and the HPF.

On the "Criterion Worksheet" the numbers corresponding to condition sets

are recorded in the top row.

The following instructions will aid you in developing the performance

criterion for each HPF under each of the condition sets:

(1) Decide what type of criterion is most appropriate, i.e., time,

accuracy, or combined time and accuracy.

(2) If your criterion includes accuracy, you have to specify all

the significant errors in the appropriate place on the Worksheet.

ERROR CLASSIFICATION FOR ACCURACY CRITERION DEVELOPMENT

If you already know which errors are important and should be used to define

the accuracy criterion for each HPF, thc following is unnecessary. However,

if you find the identification of the appropriate errors difficult, applyinr

the following classification scheme may prove helpful.

W5-52

P"
.

HRTES

TYPE OF HPF (TASK) TYPE OF ERROR EXAIP1E

perceptual a Associated I. Task or task segment omitted. 1.1 Target not detected.

mental Processes 1.2 4essage/key word not heard.

2. Noise (extraneous obJect ./iformAtior) or 2.1 Rock identified as target.

nothing identified as signal (otject/in- 2.2 Static identified as message.

forwetion needed for HPF performance).

3. Signal identified as noise. 3.1 Target identified as rock.

3.2 Message Identified as static.

4. Signal recognized as such, but no ident- 4.1 Signal recognized as non-noise.

IfIcatton or classification made. but cannot be deciphere.

4.2 Message can be reed, but not

onderstood (rather then misunderstood).

S. Signal nisclassified or misunderstood. 5.I Friendly classified as enamy.

MisclassificatIon can be perform In a nuier S.2 Enam classified as friendly.

of cateories. Each category produces a diff- 5.3 High risk classified as Io risk.

erent possible error. 5.4 tadium tank classified as tank

destroyer.

5.5 T72 classified as T6.

5.6 Platoon Bravo classified as

Platoon Alpha.

5.7 Moving target classified as

stationary target.

5.8 One key word of message understood as other w do which alters

message maning.

6. Incorrect maning attributed to signals which 6.1 Incorrect target prioritization.

have been correctly class fied/understood. 6.2 Enemy In attack thought to be in

These are errors of thinking ad decision defense.

mking based on Perceptual input. 6.3 Error in location of potential

eneiy breakthrough point.

04

SYSTEM TEST - DATE PAGE

NAME TELEPHONE

W5-53
HRTES

TYrPEOF MPV(TASK) TYrPb OF EWADA

Meniulaory(Moor) 1. askor askse~t iittd. .1 ehcle brake nt Applied. Raniolatoy . Tak (Ator Ortasksaga1.2 Eaient fat t1qhtered following

2. Incare t control or object mannipulated. 2.1 Inco,:t input key activAted.

Z.2 wrong a .nition loaded.

3. Control or 00Ject Manipulated incorrectly. 3.1 Distance *rm target to anmanit3.2 Distanca fvma desired ven1L1e

Path (to maneuver) to actual

'ehilie path Mare than x at spec4 Ified OASurinft point6.

3.3 4mean error of contral Manipulation,

electrically maasured. greater

than I during maneuver.

3.4 Controls activated Out Of eqUence.

C~sancation Output 1. Entire massage Or segmnt of easaigitted. 1.1 pessg not spoken or sent.

1.2 Identified key word 'Ut spokn Or

Sent.

2. Incorret or inappropriate infovimtion 2.1 Incorrect location sent.

communicated. 2.2 Shopping list sen1t.

3. Garbled (not understandable) mteri 3.1 Entire massage garbled.

comunicated. 3.2 Identified We word garbled.

4. Mssage sent to inappropriate reciplent. 4.1 Message sent to wrong friendly unit.

a .2 Message sent to efi1Y ani t.

S. Message sent in inappropriate format. 6.1 Message order wrong.

5.2 Message not coded properly.

5.3 inappropriate sywibls used.

SYSTEM TES -..... DATE -PAG -..

NAME TELEPHONE____________

W5-5
HRTES

You must be able to define if an error has occurred. The

definition of some errors require no physical measurements for

their identification; for example, loading the wrong type of

ammunition. The definition of other errors is more arbitrary

and requires physical measurement. In this case, you must

specify the cutoff point which defines the error's occurrence.

.4 For example, in the HPF, "Aim Weapon," the distance between

the hit and the target would be considered an error when it

surpassed a specified size. Otherwise, it would not be defined

as an error (i.e., hit outside one meter from the target would

be an error).

(3) If you selected a time, or time-accuracy criterion, record the

maximum acceptable criterion in the appropriate space on the

worksheet.

(4) Now you are ready to write the actual performance criterion.

You can write only one of the following criteria in each column

of the Worksheets:

Time Criterion.

Accuracy Criterion.

Time-Accuracy Criterion.

4 (a) Time Criterion: Copy the maximum acceptable criterion

time into the "Performance Criterion Box."

(b) Accuracy Criterion: Specify the maximum number or percentage of errors allowed in the performance of one trial of

~J. the HPF in each condition set. You may distinguish between

different errors or consider them all together. Record

this in the "Performance Criterion Box."

K SYSTEM _______________________TEST-__ DATE__________

NAME _______________________TELEPHONE

-S ~ ~ ~ c ~ .. ~ ,W5-55:
GUIDELINES FOR DEVELOPING

H Rl ES PERFORMANCE CRITERIA (Continued)

(c) Time-Accuracy Criterion: Do (a) and (b) above, and

record combination in the "Performance Criterion Box."

See Sample "Criterion Worksheet.")

(5) Do not fill in the bottom two rows of the Worksheets.

(6) Return all materials to sender.

4

W5-56
- - - - -

4~ SAMPLE

CRITERION WORKSHEET HRTES

SYSTEM FUNCTION

77Arp1SirAegJ /) RILZ. ~SaO3UHr

QffOPR. /1 4PeT5 C3 MAINT [Z6jW AAA 7

__ __ __ __ CONDITION SET WCON DITION SET ] ERRORS /~~#

SMAXIMUMWMA

ACCEPTABLE TIME 2o ldeaD$ 30 ::AA:

CRITERION R4 i4M94Md-5h

AW a atmocoF~ve 0Q aQIoA.5 I a4 2 O~4~

SVIR6 W4 46DC, eLP j2& 6e2 3, 4) tm

IX 7X4L 74-VZe5 MOL 6 1-A"ceqol l

1&-W 20 5C4oa.D!5i ~.4 7q4$,~O

IMA4 JO JZC2 D

STATISTIC

STATISTIC CRITERION

SYSTEL~~h2fAi ~A% A/FA#3A/ 7f TES2M DATE AnWLAGE

* ~NAME _________________________TELEPI4ONE______________

W5-57

I-
SAMPLE

CRITERION WORKSHEET

SYSTEM FUNCTION Z

SPI

20 OPER. WPF

] MAINT % L-La_ 7'4er A M0 47-/rz &r 

CONDITION SET CONDITION SET

ERRORS -J-

,%,A

MAXIMUM ACCEPTABLE TIME /

PERFORMANCE 7 9 .- /

CRITERION

,4J4R w ea R. ..

-.J 2ox i/imevom,9 A.c.

.,.et ZC 11,-' 5 ",A,,, 7 C M ?X.OR

STATISTIC

STATISTiC CRITERION

SYSE~~~9 ~ i(/JJ% A.4~AIY/5744TfSTQ2E OAT:AndfhLPAGEL

* ~NAME _____________________TELEPHONE____________

, W5-58

V... , , _ * _ ,, , - ' . . , . . ' ' % ,, ". - , . - [ , . ': , . . .. , >, '., - ' ; , .,
CRITERION WORKSHEET

HRTEw

SYSTEM FUNCTION

0OPER. HPF oMAINT.

__________CONDITION SET LICONDITION SET Ll

ERRORS

4 MAXIMUM

ACCEPTABLE TIME

PERFORMANCE

CRITERION

STATISTIC

STATISTIC CRITERION

SYSTEM _______________________ ___TEST____ DATE _ ______PAGE

NAME _____________________TELEPH4ON E ___________

-L A -.
GUIDELINES FOR DEVELOPING M ln" STATISTICS AND STATISTIC CRITERION

You have received "Criterion Worksheets" and "Final Condition Set Worksheets" for each HPF. In each, sets of conditions under which the HPF

will be tested are specified. For each HPF under each condition set,

the definition of one successful trial is already listed in the "Performance Criterion" row.

To evaluate the performance of an HPF, more than one trial should be

performed and all the measure outcomes from such trials should be

considered for evaluation. To do so, the outcomes have to be aggregated

to produce what in HRTES is call a statistic.

Mainly, there are two ways for aggregating the outcomes: (a) by taking

the average of all the measure outcomes for the specific HPF; and (b) by

calculating the percentage of successful performances of the HPF. A

successful trial is defined by the "performance criterion."

These are two basic statistics: the average, and the percentage can be

expressed by the following formulas:

Sum of Total Outcomes

AVERAGE N

Number of Trials

PERCENTAGE 100 x Number of Trials

To evaluate the performance of an HPF, it is necessary to have a criterion

for each statistic that is employed. HRTES refers to this criterion as

a statistic criterion. For example, a statistic criterion for a percentage

statistic might be: "A minimum success percentage of 80%." A statistic

criterion for an average statistic might be: "At most an average time of

30 seconds."

W5-60
,I,.,',,.

GUIDELINES FOR DEVELOPING rI-( e STATISTICS AND STATISTIC CRITERION (Continued)

The procedure suggested is to first determine the appropriate statistic

for each measure, and from it to define the statistic criterion. In

most cases, percentage is preferable since it enables us to combine

several measure dimensions into one. The average statistic may be used

when an HPF is measured by only one kind of data, i.e., only time or only

one type of error.

Another determination that should be made at this point is whether the

aggregation procedure, percentage or average, should be made for an HPF

under each separate condition set, or combined across all condition sets

for the HPF in question. (This, of course, is not a problem when an HPF

is tested under only one condition set.) There is a trade-off between

the number of trials for the HPF and the information to be gained. If

one wants to determine the effect of different condition sets on HPF

performance, enough trials under each of the condition sets must be

performed, and the statistics must be calculated and treated separately

under each condition set. However, if one wants to evaluate the HPF in

general, and is interested in including conditions only to insure

representation and doesn't need to make reliable statements of the effects

of each condition set on the HPF, then the aggregation should be made

across condition sets, and thus will require fewer trials for the HPF.

For each HPF:

(I) Determine the appropriate statistic (percentage or average) for

each HPF, and record it in the "Statistic Row" of the Worksheet.

W5-61

I. . . . . . . - . . ..- - -~IA ~ . ~~*-. 2 ,
GUIDELINES FOR DEVELOPING Il- I STATISTICS AND STATISTIC CRITERION (Continued)

(2) Determine whether the statistics will be aggregated across all

condition sets of a given HPF or for each condition set

separately. This decision will affect the following procedure.

(3) Determine the statistic criterion for each statistic developed

in (1), and record the information in the appropriate place

on the "Statistic Criterion" row of the Workshcot.

If you have decided on separate aggregation for each condition

4set then you have to define a separate statistic criterion for

each, and record it in the appropriate space in each "Condition

Set" column. If you decided to aggregate across all condition

sets for an HPF, record the statistic criterion in one column,

and write "Across Conditions" in the other(s). (See "Sample

Worksheet." )

(a) When the statistic is a percentage, the criterion associated

with it is the minimum percentage of HPF trials which are

to be performed successfully to meet operational requirements. To determine this criterion you have to consider

the definition of a successful performance of a trial for

each condition set very carefully. There is a tradeoff

between the performance criterion and the statistic criterion.

If the performance criterion is extreme, you might consider

a smaller percentage of success as a statistic criterion

and vise versa.

W5-62
GUIDELINES FOR DEVELOPING I I I STATISTICS AND STATISTIC CRITERION (Continued)

-9..

(b) When the statistic is an average, the defintion of statistic criterion is quite straightforward. If the statistic

is aggregated for one condition set, th, criterion, in

most cases, is the same as the performance criierion. If

you decided to aggregate over all condition sets, it is

suggested that the statistic criterion wil l be the average

of the performance criterion for the different condition

sets.

(4) Return the completed Worksheets to the test planner.

W5-63
r.

SAMPLE

CRITERION WORKSHEET

H~u~RTE

SYISTEM FUNCTION

* -~OPEN. HPF

rl MAINT. ~ ~ 7A)/tJ7Te~~

____________ CONDITION SET WCONDITION SET

E RRORS ~ Z7O~)AI~ld 746~ G4~%£L.,7( '

47we6r m7)doh4TX7,,J~L.

MAXIMUM

ACCEPTAtL TIME ;20 cetDd's

PERFORMANCE Tt.pi.sp* Fi6/F

CRITERION 7'o. islw7&1,Ff6fr

7P.mi- 744 A4o~ez 71.44.) 414 azo. m

hSTATISTIC 0= %u~~PqL. n &77e a-Aes$&W

STATISTIC CRITERION ~~l7CF4/:4~ ~jgwJ..

SYT TS ATtE AILeiPAGE-....

d ~NAME _________________________TILEPIONE______________

A,. W5-64
SAMPLE

CRITERION WORKSHEET

SYSTEM FUNCTION

OPER. WPP eF ~r ~e

C3MAINT

__________ CONDITION SET WCON DITION SET

ERRORS j~ ,*e-74A/eT QeDSF

2)AMV4PU~ 4*AeAPT

MAXIMUM

* ACCEPTABLE TIME

PERFORMANCE 7'4j9jrJF CRITERION (rizere

'am= ZD~s A.07 -Cc.d?

STATISTIC Ayawoo &ua44s if r,

STATISTIC CRITIERION .157PS77k-.41LS4 jpr.

NAME ____________________TELP4ONE____________

W5- 65
6. HUMAN PERFORMANCE MEASUREMENT HRTES

CONTENTS

1. Performance Data Collection Worksheet

2. Beginning and End Point Worksheet

*3. Planning Data Collection Worksheet (8 pages)

4. Guidel ines for the OT Training Data Collection Worksheet

5. OT Training Data Collection Worksheet

6. Guidelines for Col lecting Data for Diagnosis During OT (2 pages)

7. HPF Difficulty Worksheet for OT Observers

8. HPF Difficulty Worksheet for OT Participants

A 9. Performance Difficulty Questionnaire for OT Observers

1O. Performance Difficulty Questionnaire for OT Participants

11. Critical Incident Report

12. Opinion Sunmmary Data Worksheet

13. Statistic Worksheet

W6-1
PERFORMANCE DATA COLLECTION WORKSHEET

V., HRTES

SYSTEM FUNCTION

N SPI

HPF

0 OPER CONDITION SET(S)

Q~lMAINT

ONE PERFORMANCE UNIT

NUMBER OF TRIALS PER PERFORMANCE UNIT RECOMMENDEDI

NUMBER OF PERFORMANCE UNITS RECOMMENDED I TRIAL 1

PERFORMANCE UNIT DESIGNATIONF

LU<L SPECIFY IF

LzU UNSUCCESSFUL

* 0=0 AND~ EXPLAIN

DATA TO BE TAKEN* OUTCOME <0< REASON

* If time is to be measured, specity time units

SYSTEM ______________________ ___TEST____ DATE _______PAGE

NAME TELEPHON_______

K W6-2
H -R iE S BEGINNING AND END POINT WORKSHEET

SYSTEM FUNCTION

SPI

HPF-GROUP__

~OPER CONDITION SET

0J MAINT

BEGINNING' END

HPF's POINT POINT UNIT

SYSTEM __________________________TEST____ DATE _ ______PAGE

iNAME -_____________________ __TELEPHONE ______________

W6 -3

- )i:K~K§&:2-?-~ :~- 2k9 -
WORKSHEET FOR PLANNING

DATA COLLECTION

7.HRTES

Consider the Performance Criterion of the HPF's and ask:

(1) Are measures best taken by an:

Observer Instrumentation Combination of Both

S[I [E

If you selected Observer, or Combination of Both, continue

with 2.

(2) Is there space for an observer without significantly disturbing

the performance you want to measure?

YES NO

If the answer to this question is no, you will prbably have to

collect your data with instrumentation; turn to S" p 18.

(3) What sort of background (previous training, experience, MOS,

4 etc.) will be required of the observer(s)?

W6-4
• "RWORKSHEET FOR PLANNING HRTE DATA COLLECTION (Continued)

(4) How many observers, with this background, will be required to

measure the performance?

(5) What is the source of observers with appropriate backgrounds?

(6) How long, in advance of the OT, must you begin to arrange for

the availability of these observers?

(7) What date will this be?

(8) What sort of training will be required for the observers?

W6-5
WORKSHEET FOR PLANNING

.ii-~ ie! DATA COLLECTION (Confinued)

(9) Who will provide this training? The answer to this question

may be obvious if there are OT personnel who have been dedicated to observation training. If the answer is not obvious,

you should consider repeating Steps 2-8 substituting the words

"lobserver trainer" for the word "observer."

(10) What sort of materials, equipment, and information will be

required for the observer training?

(11) Who will supply observer training material?

(12) How much lead time is required for the development of observer

training material?

W6-6

"-----'--------------.--.- ----- ,.-..-.-,-,-.,.-" . ..-.- "- .- ,..4 .- - .- -.- .- . ... - -.. ,.., .- .. • -. -f .. ..- ,f ", " m" ,4" ," ." , w " ," , , "•" .". • •" . . .".- - , . -- a
WORKSHEET FOR PLANNING

HRTES DATA COLLECTION (Continued)

Date development must beginDate all material must be completed

(13) Where will observer training take place?

(14) How long will observer training take?

(15) What kind of Data Collection Forms (Checklists, etc.) will be

required?

(16) Who will produce these forms?

I

W6-7
.m7

WORKSHEET FOR PLANNING

DATA COLLECTION (Continued)

. (17) By what date must these forms be completed?

If you selected Instrumentation or Combination of Both continue

with Step 18.

(18) What kind(s) of instrumentation is required to obtain the

necessary data?

(19) Is there space for the instrumentation without significantly

disturbing the performance you want to measure?

YES NO

If the answer to this question is no, and there is also

inadequate space for an observer, you will have to either:

(1) Switch to another variety of instrumentation,

or

(2) Collect this information through debriefing.

i W6-8
WORKSHEET FOR PLANNING

DATA COLLECTION (Continued) HRTES

(20) Is there adequate power for the device?

YES NO

FD El

If the answer to this question is no, you will have to either:

(1) Switch to another variety of instrumentation,

or

(2) Provide another source of power,

or

(3) Use an observer to collect data,

or

(4) Collect this information through debriefing.

(21) Is the instrumentation available to you? To answer this

question adequately, you will first have to find out:

(1) If it already exists

YES NO

(2) Where it can be obtained

W6-9

i- - - - -
WORKSHEET FOR PLANNING

DATA COLLECTION (Continued)

HR.

(3) The lead time for obtaining it4. (4) How long it takes to install it in your System

If the answer is no, you will have to

=(1) Switch to another variety of instrumentation,

or

(2) Use an observer to collect data,

or

(3) Collect this information through debriefing.

(22) Are installation and maintenance of the instrumentation going

to require technicians dedicated to this project?

YES NO

VThe answer to this question may be obvious if there are OT

personnel who have already been dedicated to this function.

If the answer is not obvious, you should consider repeating

* the most applicable of Steps 2-8 substituting the word

technician for observer.

U3

W6-1 0
WORKSHEET FOR PLANNING rii~i~~DATA COLLECTION (Continued)

If you selected Combination of Both, all questions from 2-22

apply to you. In addition answer:

(23) Is there enough space, for both the observer and the instrumentation, without significantly disturbing the performance

you want to measura?

YES NO

If the answer to this question is no, you will have to:

(1) Switch to another form of instrumentation,

or

(2) Remove either the observer or the instrumentation,

or

(3) Collect this information through debriefing.

W6-11
GUIDELINES FOR COMPLETING

,RT-I OT TRAINING DATA COLLECTION WORKSHEET

You are asked to record the amount of time required for training.

This package includes the Guidelines you are reading; a list of Human

Performance Functions (these are the tasks which you trained); and the

"OT Training Data Collection Worksheet." Immediately following OT Training,

fill out the "OT Training Data Collection Worksheet." The following

" instructions will aid you in completing the Worksheet:

(1) List the tasks (HPF's) you trained in the left-hand column of the

Worksheet. Examine the enclosed list of tasks (HPF's and select

those you have trained.

(2) Potential training/practice methods are listed on the matrix

edge. If you used a method not listed, add it.

(3) Each cell should be filled in with the number of hours or

fraction of hours used to train each task according to each

training method.

(4) Add across each row to determine the "sum" of total training

and practice time for a given task.

(5) Return the Worksheet to the sender to be included with other

test documentation.

LW

K - W6-12

i .- .. , -_. ,. , . ' . * ., - ' ' . , . .'. ..- .I " - - _ ' . . .. , . %
HRTES OT TRAINING DATA COLLECTION WORKSHEET

TRAINING METHODS

In each cell, record the training

time for each training method z

listed, in hours or fractions of 0

an hour z Z

0 0U

TA KCH,,)I AIE < ,,, -U

,.- 0 - z

0 %<

z. U -. V....0.. -3:

x 00a

J 2 <, z (L

0 0

TASKS (HPF'S) TRAINED < < Lx< > 8 u

SYSTEM _______________________TEST-___ DATE _______PAGE

* NAME ______________________TELEPHONE

W6-1 3
HRTES

The "Detailed Test Plan" for this OT divides the performance of the

system to be tested into System Functions. It then divides each System

Function into System Performance Issues (SPI's). It then divides each

SPI into generalized tasks called Human Performance Functions (HPF's)

which are performed under condition sets.

Following the completion of testing of a group of tasks (HPF's), it is

necessary that data be taken as to the difficulty of performing those

tasks. This should be done immediately following completion. There are

two sources of this data: the actual participants In the OT (players), and

the observers of the task performance.

This package contains (1) "Task (HPF) Difficulty Worksheets" for both

participants (player) and observers, in which the task to be performed

have been recorded; (2) "Performance Difficulty Questionnaires" for both

participants and observers; and (3) " Crftlcaf Incident Reports." "Critical

Incident Reports" should be distributed to all participants and observers

to be completed when an accident or near-accident occurs. The use of the

other contents of this package will be explained in the following

guidelines:

(I) Administer the "Task (HPF) Difficulty Worksheet" to each

participant (player) and fill the appropriate one yourself

immediately following completion of testing of each group of

tasks (HPF's) performed together. This administration should

take place as soon as possible. The longer the time between

-j completion and administration, the more information that is

lost.

SYSTEM TEST_ DATE PAGE

NAME TELEPHONE

W6-14

* -7;v.
GUIDELINES FOR COLLECTING

HRTES DATA FOR DIAGNOSIS DURING OT_

This administration consists of each participant and observer

* rating the difficulty of performance of each task on a 0-100

scale: A rating of 50 or above means that the rater considers

the task reasonably difficult. When this is the case, it is

.4 necessary to find out the cause of the difficulty.

-~(2) When a task is rated 50 or above by any participant (player)

or observer, that individual then completes either the "Performance

Difficulty Questionnaire" for that task. To prepare this questionnaire, fill in the information at the top of the first page and

- the appropriate conditions for #19.

(3) Return all completed questionnaires, worksheets, and "Critical

Incident Reports" to the sender.

SYSTEM _________________________TEST____ DATE _______PAGE

NAME W15 TELEPHONE
4 

    .  4, T. _ . .   

HRTES I.JD1'~~TASK (HPF) DIFFICULTY WORKSHEET

FOR OT PARTICIPANTS (PLAYERS)

SYSTEM FUNCTION

SPI

"-OPER CONDITION SET

M] I NT

DIFFICULTY

TASKS (HPF's) PERFORMED TOGETHER SCORE

Rate each task, listed above, for performance difficulty from 1 to 100. A

rating of 1 means you think that a task was extremely easy to perform. A

rating of 100 means you think that a task was extremely difficult to perform.

If you rate a task 50 or above, you are concerned about Its difficulty. None

of these ratings mean you could not perform a task. You may choose any score

from 1-100.

1 50 100 I !

EXTREMELY DIFFICULT ENOUGH EXTREMELY

EASY TO CAUSE SOME DIFFICULT

TO PERFORM CONCERN TO PERFORM

SYSTEM TEST DATE PAGE

NAME TELEPHONE

W6-16
'JD" TASK (HPF) DIFFICULTY WORKSHEET

FOR OT OBSERVERS

.J..E

SYSTEM FUNCTION

SPI

OOPER CONDITION SET

r7 MA I NT

DIFFICULTY

TASKS (HPF's) PERFORMED TOGETHER SCORE

.

Rate each task, listed above, for performance difficulty from 1 to 100. A

rating of I mears you think that a task was extremely easy to perform. A

rating of 100 means you think that a task was extremely difficult to perform.

If you rate a task 50 or above, you are concerned about its difficulty. None

of these ratings mean a task could not be performed. You may choose any

score from 1-100.

4 1 50 100 I - II

EXTREMELY DIFFICULT ENOUGH EXTREMELY

EASY TO CAUSE SOME DIFFICULT

TO PERFORM CONCERN' TO PERFORM

SYSTEM ______________________TEST-___ DATE ______PAGE

' -' - NAME7 W 6 - 1 7 TELEPHONE -.",
- .. - : 4-r : : , , Zr: -'- " rv- ' r-. • - v ----v----.-_' -. -- o- r c

SPERFORMANCE DIFFICULTY QUESTIONNAIRE 1-i ~ (FOR OBSERVERS) (CONTINUED)

NAME: , _TASK

DATE:

CONDITION SET: SPI:

SYSTEM FUNCTION:

You have just observed:

and have said that it was difficult to do. Answer the following questions,

about this task by assigning rating scores to them.

1. UNDERSTANDING PROCEDURE

How difficult was understanding what participants (players) were

supposed to do and how they were supposed to do it for the specific

task listed above?

D

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Understanding was It was moderately It was so difficult

no problem, at all difficult to under- that it was not

stand possible to adequate

ly understand

2. READING/HEARING DISPLAYS

How well could participants (players) read and/or hear the displays which

were required for the performance of this task?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Readable/hearable Moderate effort Impossible to adewithout ef fort needed for displays quately read and/or

hA~r dicrpys

W6-18

............ .................
EEJ H R T "C PERFORMANCE DIFFICULTY QUESTIONNAIRE R T"l (FOR OBSERVERS) (CONTINUED)

3. UNDERSTANDING DISPLAYS

How well could participants understand the information which was

presented by the displays during this task performance?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Extremely easy Moderately difficult Presentation of infcr

to understand to understand motion so difficult

-* that it could not be

adequately understood

4. USEFULLNESS OF DISPLAY INFORMATION

How effectively did the display(s) used during this task deliver the

right information and in a timely way?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

All information needed The majority of the Information delivered

for this performance required information was either completely

was provided at the was delivered, usually inadequate, incorrect

riqht time in time or so late as To be

useless

5. MANIPULATION DIFFICULTY

Check any problems encountered when Irying to manipulate the control(s),

or any other piece of equipment, during the performance of this task:

m Too hard to move, too much effort required.

E7Movement required unreasonable amount of dexterity.

0 Too many other thinks required at the same time.

FZToo easy to make a mistake.

-Movement different than what is reasonable to expect.

--IMovement requires unavailable tool(s).

-Other, specify

W6-19

- . .'. ~ -7
,7

DPERFORMANCE DIFFICULTY QUESTIONNAIRE

H.T, (FOR OBSERVERS) (CONTINUED)

Nr

5. MANIPULATION DIFFICULTY (Continued)

How effectively could participants actually make the required movements

with either the controls or any other piece of equipment involved in

the performance of this task?

COMPLETELY COMPLETELY

SAT I SFACTORY IN BETWEEN UNSATISFACTORY

S100 75 50 25 0

Control/equipment move- Movements required were

% ments required caused so difficult that they

absolutely no difficulty could not be made

of any kind adequately

6. REACH/ACCESSIBILITY

Check any problems encountered when trying to reach the control(s), or

any other piece of equipment which had to be manipulated, during this

task:

Too far away to reach resonably.

D7 Angle to it was such that it could not be reasonably reached.

iIt was fully or partially blocked by another object.

It was fully or partially blocked by another person.

. Reaching it forced exposure to hazardous or highly uncomfortable

objects (excessively hot, excessively cold, sharp, etc.)

," Other, specify

How effectively could participants reach and get at the control(s) or any

other piece of equipment which had to be manipulated for the performance

of this task? II

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Controls/other pieces Controls/other pieces Notaccessible fromeither

of equipment were of equipment were my assignod position or

accessible without accessible with any other position which

effort moderate effort did not interfere with

my performance

I2

~W6-20

-1- -7
SR H T - S PERFORMANCE DIFFICULTY QUESTIONNAIRE r~u(FOR OBSERVERS) (CONTINUED)

7. CONTROL CONFIGURATION

Check any problems encountered wth the configuration of the control(s),

or any other piece of equipment which had to be manipulated, during

this task:

-Too hard to find.

i Too hard to determine what it was.

ED Too close to other control/equipment.

E Too far from other control/equipment used in same performance.

--Used without looking at it much, and it felt too much like others.

E-Too hard to tell when it was activated or moved to correct position.

[]Other, specify

How usefAl was the actual configuration of the control, or other piece

of equipment which had to be moved, for performance of this task?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

-onfiguration caused Configuration had prob- Configuration so poor

absolutely no diffi- lems, but caused only it made performance

culty of any kind moderate difficulty impossibly difficult

8. DECISION DIFFICULTY

How difficult was it to make the decisions which were required for

performance of this task?

COMPLETELY COMPLETELY SATISFACTORY N BETWEEN UNSATISFACTOPY

100 75 50 25 0

Required decisions Required decisions Required decisions we -

were very easy to were moderately so difficul> tn - m~ks di+ficult to mke could not ho

adeauateiv

IE-

,-"-146-21
LI ~ PERFORMANCE DIFFICULTY QUESTIONNAIRE

* (FOR OBSERVERS) (CONTINUED)

9. TARGET/TERRAIN VISIBILITY

How well could participants see targets or any other elements of the

external environment which were required for performance of this task?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Visibility was excel- Visibilitywasade- Visibility was unacceplent. It was easy to quate. Enough could table. Targets and/or

see all reauired Darts te seen to permit critical parts of the -4f the environment, the perfnrmance environment could not

including targets be seen

10. WORKSTATION DESIGN FOR VISIBILITY

. Check any visibility problems encountered during this task caused by the

work station design:

El Not enough light on outside of workstation.

IZ- Window/port not big enough.

El Window/port not in right place.

El Window/port too dirty or distorted.

EM Equipment/people in the way of window/port.

El Not enough light inside work station.

-- Too much glare.

El Important equipment behind other equipment or people.

El Viewing angle from seat to equipment not good.

El Other:

SYSTEM TEST_ DATE PAGE

NAME TELEPHONE_

W6-22
Li ~ PERFORMANCE DIFFICULTY QUESTIONNAIRE HRTES (FOR OBSERVERS) (CONTINUED)

10. WORKSTATION DESIGN FOR VISIBILITY (Continued)

The design of some parts of the work station probably had an impact on

participant's ability to see. What was the effect of those parts of

the work station on the performance of this task?

COMPLETELY D: COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

*Visual parts of Visual parts of work Visual parts of work

work station pro- station produced station so poor that

duced no difticulty moderate difficulty performance impossibly

of any kind in performance difficult

11. NOISE

Check any noise problems encountered during this task.

IjCould not hear radio or other device which had to be heard.

EDCould not hear other crew members.

SNoise produced fatigue.

jJNoise disturbed concentration.

EJNoise produced discomfort.

f~Noise gave away location.

SOther:___________________________

What was the effect of noise in the workstation on the performance of

this task?m

COMPLETELY M COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

difficulty of any difficulty in perfor- performance impossibly

ki nd mance difficult

SYSTEM _________________________TEST-___ DATE _______PAGE

NAME 14-3 TELEPHONE
PERFORMANCE DI FF1ICULTY QUESTI ONNAI RE HRTES (FOR OBSERVERS) (CONTINUED)

12. MOT ION

Check any motion problems encountered during this task:

IJVibration affected accurate use of controls.

L~Vibration affected accurate reading of displays.

V EJ Constant vibration produced fatigue.

j~Vibration affected detection/identification of objects outside the

workstation.

MJ Acceleration too great for the kind of seat support.

C] Acceleration prevented reaching control.

IJAcceleration prevented seeing display.

j~Motion produced sickness.

EJOther: ___________________________

What was the effect of motion at the workstation on the performance of

this task? 

F

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Motion produced Motion produced Motion made the perforno difficulty of moderate difficulty mance impossibly diffianv kind in Derformance cult

SYSTEM TEST____ DATE PAGE

NAME W-4 TELEPHONE__________
PERFORMANCE DIFFICULTY QUESTIONNAIRE

(FOR OBSERVERS) (CONTINUED) HRT.

13. VENTILATION

Check any ventilation problems encountered during this task:

~]Much too hot.

EJMuch too cold.

r7 Much too humid.

0j Not enough fresh air flow.

71 Exhaust fumes too strong.

r7 Gun/rocket fire products too strong.

jJBad odors produced nausea.

M Other:_______________________ ___

What was the effect of ventilation in the work station on the

performance of this task?

COMPLETELY ' COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 Z5 0

Ventilation pro- Vent ilIat!on produced Ventilation so inadeduced no difference moderate difficulty quate that performance

of any kind in performance imDossiblp

SYSTEM _____________________TEST-___ DATE ______PAGE

I NAME TELEPHONE___________

V W6-25
PERFORMANCE DIFFICULTY QUESTIONNAIRE HRTS (FOR OBSERVERS) (CONTINUED)

14. WORKSTATION DIMENSIONS

Check any problems with the dimensions of the workstation encountered

during this task:

r-I Work surface too small.

Work surface in wrong place.

rl Work surface at wrong height or angle.

r- Not enough space to work because of equipment, or space allowed.

El Not enough space to work because of crowding with other crew members.

El Poor arrangement of equipment.

El Hatches too small.

El- Hatches in wrong places.

El Othere:

What effect did the dimensions of the work station have on the performance of this task?

COMPLETELY 7 COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Dimensions pro- Dimensions produced Dimensions so poor duced no difficul- moderate difficulty that performance

ties of any kind in performance impossibly difficult

III

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W6-26
PERFORMANCE DIFFICULTY QUESTIONNAIRE H R TIS (FOR OBSERVERS) (CONTINUED)

.

15. SEATING

Check any seating problems encountered during this task:

E- Seat too narrow.

- Seat at wrong height.

- Not enough back support.

E Seat back angle not right.

r7l Needs arm supports.

Needs foot supports.

r7 Not enough head space.

M-l Not enQugh shoulder space.

E Not enough leg space.

Ml Not enough foot space.

M- Seat does not absorb vibrations well enough.

r7 Seat uncomfortable and makes you tired.

- Seat needs to move or move more.

Other:

What effect did the seating have on the performance of this task?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 Z5 0

Seating produced Seating produced Seating so poor that

no difficulty of moderate difficulty performance impossibly

any kind in performance difficult

I

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W6-27

. N-7 %*. v. -L -e
LJDFC~PERFORMANCE DIFFICULTY QUESTIONNAIRE H RE (FOR OBSERVERS) (CONTINUED)

16. SAFETY HAZARDS

Check any safety hazards encountered at the workstation during this task:

: Sharp, jagged, pointed object(s).

C3j Dangerous lack of head clearance.

jJDangerously hot material exposed.

j~Source of electric shock exposed.

ElPoisonous material exposed.

ElMoving machinery exposed.

ElSo little light that accident could result.

1~Glare so Dri ght that accident could result.

ElDangerously high noise level.

ElDangerous lack of ventilation.

ElAnchoring of equipment not adequate.

fJPadding of equipment not adequate.

El Crew seat belts/restraints not adequate.

El Slippery walking or climbing surface.

ElHandholds for lifting or climbing not adequate.

ElFootholds for climbing not adequate.

f~No adequate signal when equipment operation becomes dangerous.

ElNo adequate signal when outside situation becomes dangerous.

El Oth er __ _ __ __ _

Safety hazards can have two possible effects on performance--(l) they can

produce actual injury which keeps performance from being adequate, and

(2) they can produce worry about injury which keeps performance from

being adequate. Complete the Safety Hazard scale on the next page.

SYSTEM _________________________TEST____ DATE _______PAGE

NAME TELEPHONE_____________

W6-28
L I ~ 1 ~ PERFORMANCE DIFFICULTY QUESTIONNAIRE

(FOR OBSERVERS) (CONTINUED)

16. SAFETY HAZARDS (Continued)

What was the effect of safety hazards on the performance of this task?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Safety hazards pro- Safety hazards pro- Safety hazards so

duced no difficulty duced moderate diffi- extreme that perforof any kind culty in performance mance impossible

17. TRAINING TIME

To what extent did participants spend adequate time training for this

* task?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Did not require any Got almost enough Got no training time

imore training time training time for for t-he performance of

at all +his performance; a this task

little more would

have been helpful

18. PRACTICE CCDITIONS

To what extent did participants practice for this task in

(condition)

COMPLETELY i N T NCOMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 2)5 0

Had an adequate Practiced this task Got no practice of this

amount of practice in this condition, task*n this condition

of this task in or a very similar

this condition one. Could have used

more trainina time

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE_

W6-29

.t . . # . . j-,, , ". .. .- , . . _, .. ,.,., .. . ,.- . . ....- .- , , . , , - - . ,L . .. . r,. i 'P.. " ' :-, '- . - 4 ' ' ' ' , ' :"'' ,%. ""' -"' .- "V"" / . - , "
E EU CPERFORMANCE DIFFICULTY QUESTIONNAIRE H RT.S (FOR OBSERVERS) (CONTINUED)

19. TRAINER

How effective was the trainer In training this task?

COMPLETELY L COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Trainer did as Trainer did a res- Trainer was unable

good a job train- ponsible job of to teach this task

ing this task as training this task

was necessary

20. TRAINING METHOD(S)

How was this task trained?

CE] Lecture

C3 Film or other audio-visual method

F Reading printed material

" Paper and pencil workbook

Practice in a simulator

Watching someone doing it

] Doing it yourself with the actual hardware

r Other (specify):

How effective do you think this kind of training is for this task?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

The best method for Could learn the task Method provided no help

training this task with this method, but in learning how to actualit could have been irm- ly do this taqk

proved a little

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE-__

W6-30

/ ..
ERFORMANCE DIFFICULTY QUESTIONNAI RE (FOR OBSERVERS) (CONTINUED)

21. WORKLOAD

To what extent was there too much work to do In the time allotted

considering everything being done at the time of this task performance?

This includes other activities that were being performed at the same

time.

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Workload perfectly Moderate performance Totally inadeadequate during difficulty caused by quate workload

performance workload. Player made task

fully loaded, performance

impossible

".

."

SYSTEM _ TEST_ DATE PAGE

NAME TELEPHONE

W6-31

', w .i%....--"%....... ~~~~~~~~~~~~~. .°.. .. . ,. .,. ... ., .......... .
L D J T C C PERFORMANCE DIFFICULTY QUESTIONNAIRE

(FOR OBSERVERS) (CONTINUED)

TO THE TEST OBSERVER, OR OTHER APPLICABLE OT PERSONNEL:

If there are other places of information which you believe are applicable

and important to this field test, write them here.

W6-3

.I
-PERFORMANCE DIFFICULTY QUESTIONNAIRE FOR PARTICIPANTS (PLAYERS)

NAME: TASK (HPF):

DATE:

CONDITION SET: SPI:

_ _-_SYSTEM FUNCTION:

You have just completed:

4 and have said that it was difficult to do. Answer the following questions,

about this task, by assigning rating scores to them.

1. UNDERSTANDING

How difficult was understanding what you were supposed to do and how

you were supposed to do it for the specific task listed above?

COMPLETELY [- COMPtETELY

SATISFACTORY IN BETWEEN L1 UNSATISFACTORY

100 75 50 25 0

Understanding was It was moderately It was so difficult

no problem, at all difficult to under- that it was not

stand possible to adequately understant

4

2. READING/HEARING DISPLAYS

How well could you read and/or hear the displays which were required

for the performance of this task?

COMPLETELY L2 COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Readable/hearable Moderate effort Impossible to adequately

without effort needed for displays read and/or hear displays

SYSTEM TEST_ DATE PAGE

NAME ..- .. - TELEPHONE - - --

W6-33

LL A%'~ .
W DT~C PERFORMANCE DIFFICULTY QUESTIONNAIRE H R T ES- FOR PARTICIPANTS (PLAYERS) (CONTINUED)

3. UNDERSTANDING DISPLAYS

How well could you understand the information which was presented by

the displays during this task performance?

COVIPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 Z5 0

Extremely easy Moderately difficult Presentation of

to understand to understand information so difficult that it could

not be adequately

understood

4. USEFULLNESS OF DISPLAY INFORMATION

How effectively did the display(s) used in this task deliver the

right information and in a timely way?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

All information The majority of the Information delivered

needed for this required information was either completely

performance was was delivered, utuil ly inadequate, incorret +,

prbovided at the in time or so late as to be

right time useless

5. MANIPULATION DIFFICULTY

Check any problems encountered when trying to manipulate the control(s),

or any other piece of equipment, during the performance of this task:

C3 Too hard to move, too much effort required.

j- Movement required unreasonable amount of dexterity.

.Too many other things required at the same time.

-r Too easy to make a mistake.

C3 Movement different than what is reasonable to expect.

-- Movement requires unavailable tool(s).

- Other, specif J

SYSTEM TEST_ DATE ,PAGE

NAME TEL PHONE

W6-34

.i .... -- . ,. -. ',- .. .- .- 
SPERFORMANCE DIFFICULTY QUESTIONNAIRE FE FOR PARTICIPANTS (PLAYERS) (CONTINUED)

5. MANIPULATION DIFFICULTY (Continued)

How effectively could you actually make the required movements with either

the controls or any other piece of equipment involved in the performance

of this task?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Control/equipment It was possible to Movements required

movements required make the required were so difficult

caused absolutely movements or controls/ that they could not

no difficulty of equipment with moder- be made adequately

any kind ate difficulty

6. REACH/ACCESSIBILITY

Check any problems encountered when trying to reach the control(s), or

any other piece of equipment which had to be manipulated, during this

task:

Too far away to reach reasonably.

[ Angle to it was such that it could not be reasonably reached.

j It was fully or partially blocked by another object.

C3 It was fully or partially blocked by another person.

Reaching it forced exposure to hazardous or highly uncomfortable

objects (excessively hot, excessively cold, sharp, etc.)

- Other, specify:

How effectively could you reach and get at the control(s) or any other

piece of equipment which had to be manipulated for the performance of

this task?

STEM TEST_ DATE PAC

AME TELEPHONE

W6-35

L ,"-. " ---'-- " -: '.." - -. "- .--.' " -' "-,-'." -- ,. -,-----," ... -- • .. ... --. -.- . . . . .
SPERFORMANCE DIFFICULTY QUESTIONNAIRE H R T E S FOR PARTICIPANTS (PLAYERS) (CONTINUED)

6. REACH/ACCESSIBILITY (Continued)

COMPLETELY L COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Controls/other pieces Controls/other pieces Not accessible fromeither

or equipment were of equipment were my assigned position or

accessible without Pccessible with moder- any other pnoitinn which

effort ate effort did not interfere with

my performance

7. CONTROL CONFIGURATION

Check any problems encountered with the configuration of the control(s),

or any other piece of equipment which had to be manipulated, during

this task:

E- Too hard to find.

C-] Too hard to determine what it was.

-- Too close to other control/equipment.

IZI Too far from other control/equipment used in same performance.

0 Used without looking at it much, and it felt too much like others.

Q-'Too hard to tell when it was activated or moved to correct position.

-- Other, specify:

How useful was the actual configuration of the control, or other piece

of equipment which had to be moved, for the performance of this task?

COMPLETELY L COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Conf iguration caused Configuration had prob- Configuration so poor absolutely no diffi- lems, but caused only it made performance

cultvof any kind moderate difficulty imno-ihIv d iffirjlt

SYSTEM TEST__ DATE PAGE

NAME ., W6-36 .TELEPHONE

:7 .% %V ~~ ~ .rrS
LJD TC ~ PERFORMANCE DIFFICULTY QUESTIONNAIRE

H R TE-5 FOR PARTICIPANTS (PLAYERS) (CONTINUED)

* 8. DECISION DIFFICULTY

Hwdifficult was it to make the decisions which were required for

the performance of this task? f

COMPLETELY COMPLETELY

SAT ISFACTORY IN BETWEEN UN SAT ISFACTORY

100 75 50 25 0

Required decisions Required decisions Required decisions

were very easy to were moderately were so difficult

make difficult to make that they could not

be made adecuately

9. TARGET VISIBILITY

How well could you see targets or any other elements of the external

,environment which were required for the performance of this task?

COMPLETELY D] COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Visibility was Visibility was ade- Visibility was unacexcellent. It was quate. Enough could ceptable. Targets

easy to see all be seen to permit and/or critical

required parts of the performance parts of the environthe environment, ment could not be

including targets seen

SYSTEM _________________________TEST____ DATE _______PAGE

w NAME TELEPHONE_______________

W6 -37

W ..
PERFORMANCE DIFFICULTY QUESTIONNAIRE FOR PARTICIPANTS (PLAYERS) (CONTINUED)

10. WORKSTATION DESIGN FOR VISION

Check any visibility problems encountered during this task caused by

the workstation:

EJ Not enough light on outside of work station.

j J Window/port not big enough.

CJ Window/port not in right place.

Er Window/port too dirty or distorted.

: r-] Equipment/people in the way of window/port.

rJ Not enough light inside workstation.

EJ Too much glare.

'-E Important equipment behind other equipment or people.

EJ Viewing angle from seat too equipment not good.

j Other, specify:

The design of some parts of your workstation probably had an impact on

your ability to see. What was the effect of those parts of the workstation on the performance of this task? m

COMPLETELY Li COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Visual parts of Visual parts of work- Visual parts of workworkstation pro- station produced moder- station so poor that

duced no diffinultv ate difficulty in per- performance imposof any kind formance sibly difficult

I.

SYSTEM TEST_ DATE PAGE

V.r NAME TELEPHONE

:.- W6-38
r 4. -6

LIDT~CPERFORMANCE DIFFICULTY QUESTIONNAIRE jfl~*~FOR PARTICIPANTS (PLAYERS) (CONTINUED)

11. NOISE

Check any noise problems encountered during this task.

r-JCould not hear radio.

SCould not hear other crew members.

SNoise produced fatigue.

SNoise disturbed concentration.

SNoise produced discomfort.

r7J Noise gave away location.

IJOther, specify: __________________________

What was the effect of noise in the workstation on the performance of

this task?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Noise produced no Noise produced moder- Noise so extreme that

difficulty of any ate difficulty in performance impossibly

kind Derformanrp difficult

12. MOTION

Check any motion problems encountered during this task.

SVibration affected accurate use of controls.

ElVibration affected accurate reading of displays.

ElConstant vibration produced fatigue.

0~ Vibration affected detection/identification of objects outside the

workstation.

EJAcceleration too great for the kind of seat support.

~JAcceleration prevented reaching control.

EJAcceleration prevented seeing display.

EJKind of motion nausea.

SOther, specify: _______________________

SYSTEM _________________________TEST-___ DATE _______PAGE

NAME TELEPHONE

W6 -39

-A -Ap
PERFORMANCE DIFFICULTY QUESTIONNAIRE

FOR PARTICIPANTS (PLAYERS) (CONTINUED)

12. MOTION (Continued)

What was the effect of motion at your workstation on the performance

of this task? r--

COMPLETELY COMPLETELY

" SATISFACTORY IN BETWEEN UNSATISFACTORY

130 75 50 25 0

Motion produced Motion produced moder- Motion made the perno difficulty ate difficulty in formance Impossibly

of any kind performance dlffit-ul+

13. VENTILATION

Check any ventilation problems encountered during this task:

,i rMuch too hot.

.Much too cold.

rMuch too humid.

r"Not enough fresh air flow.

IExhaust fumes too strong.

MZI Gun/rocket fire products too strong.

M Bad odors produced nausea.

-]Other, specify:

What was the effect of ventilation in the workstation on the performance

4' of this task? 1

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Ventilation pro- Ventilation produced Ventilation so inadeduced no difficulty moderate difficulty quate thatperformance

of any kind in oerformance impossible

SYSTEM TEST_ DATE __PAGE

NAME TELEPHONE

W6-40
LE R TSPERFORMANCE DIFFICULTY QUESTIONNAIRE

*H R T EFOR PARTICIPANTS (PLAYERS) (CONTINUED)

14. WORKSTATION DIMENSIONS

Check any problems with the dimensions of the workstation encountered

during this task:

r] Work surface too small.

M "Work surface in wrong place.

r- Work surface at wrong height or angle.

I-l Not enough space to work because of equipment, or space allowed.

Not enough space to work because of other crew members.

r- Poor arrangement of equipment.

r Hatches too small.

E- Hatches in wrong places.

1- Other, specify:

What effect did the dimensions of your workstation have on the performance

of this task?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Dimensions pro- Dimensions produced Dimensions so poor

duced no diffi- moderate difficulty that performance

cultips of iny kind in Derformance impossibly difficult

SYSTEM , TEST_ DATE _ PAGE

NAME TELEPHONE

W6-41
PERFORMANCE DIFFICULTY QUEST IONNAI RE

FOR PARTICIPANTS (PLAYERS) (CONTINUED)

15. SEATING

Check any seating problems encountered during this task:

[]Seat too narrow.

L- Seat at wrong height.

LNot enough back support.

EliSeat back angle not right.

E Needs arm supports.

ENeeds foot supports.

F -Not enough head space.

[-7 Not enough shoulder space.

[-Not enough leg space.

[:]Not enough foot space.

E-Seat does not absorb vibrations well enough.

E--Seat uncomfortable and makes you tired.

ElSeat needs to move or move more.

-- Other, specify:

What effect did the seating have on the performance of this task?

COMPLETELY - COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Seating produced Seating produced moder- Seating so poor thal

no difficulty of ate difficulty in per- performance impossibly

any kind formance difficult

SYSTEM TEST__ DATE _PAGE

6 . NAME TELEPHONE

W6-42

"-,--,..-.
HRTCS PERFORMANCE DIFFICULTY QUESTIONNAIRE

FOR PARTICIPANTS (PLAYERS) (CONTINUED)

17. TRAINING TIME

To what extent did you spend adequate time training for this task?

COMPLETELY 1I] COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Did not require any Got almost enough train- Got no training time

more training time ing time for this per- for the performance

at All formance; a little more of this task

would have been helpful

18. PRACTICE

To what extent did you practice for this task in

(condition)

COMPLETELY H COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Had an adequate Practiced this task Got no practice of

amount of practice in this condition, or this task in this

of this task in a very similar one. Could condition

this condition have used more trainina

time

19. TRAINER

How effective was the trainer in training this task?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Trainer did as good Trainer did a respon- Trainer was unable

a job training this sible job of training to teach this task

task as was necessarv this task

SYSTEM TEST_ DATE PAGE

NAME TELEPHONE

_ .- W6-4 -
PERFORMANCE DIFFICULTY QUESTIONNAIRE

FOR PARTICIPANTS (PLAYERS) (CONTINUED)

16. SAFETY HAZARDS

Check any safety hazards encountered at the workstation during this task:

-Sharp, jagged, pointed object(s).

r--Dangerous lack of head clearance.

C3 Dangerously hot material exposed.

Er Source of electric shock exposed.

E-Poisonous material exposed.

[- Moving machinery exposed.

r-- So little light that accident could result.

EJ Glare so bright that accident could result.

E Dangerously high noise level.

E-Dangerous lack of ventilation.

r- Anchoring of equipment not adequate.

Padding of equipment not adequate.

E"-Crew seat belts/restraints not adequate.

-Slippery walking or climbing surface.

r3 Handholds for lifting or climbing not adequate.

r Footholds for climbing not adequate.

F--No adequate signal when equipment operation becomes dangerous.

M-No adequate signal when outside situation becomes dangerous.

rl Other, specify:

Safety hazards can have two possible effects on performance--(l) they can

produce actual injury which keeps performance from being adequate, and

(2) they can produce worry about injury which keeps performance from

being adequate. What was the effect of safety hazards on the performance

of this task? H I

COMPLETELYI COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

Safety hazards pro- Safety hazards produced Safety hazards so exduced no difficulty moderate difficulty in treme that perfor- nv kind oerformance mance impossible

SYSTEM TEST-__ DATE _PAGE ....

NAME TELEPHONE

W6-44
LJD E'~ ~ PERFORMANCE DIFFICULTY QUESTIONNAIRE

FOR PARTICIPANTS (PLAYERS) (CONTINUED)

20. TRAINING METHOD

How was this task trained?

j~Lecture.

rIT! Film or other audio-visual method.

UReading printed material.

CD Paper and pencil workbook.

~Practice in a simulator.

~JWatching someone doing it.

UDoing it yourself with the actual hardware.

riOther, specify: _________________________

How effective do you think this kind of training is for this task?

COMPLETELY COMPLETELY

SATISFACTORY IN BETWEEN UNSATISFACTORY

100 75 50 25 0

The best method Could learn the task Method provided no

*for training with this method, but help in learning how

this task it could have been to actually do. this

improved a little task

SYSTEM ______________________ ___TEST____ DATE _______PAGE

NAME _______________________TELEPHONE -

W6-45
L ~ r W ~ PERFORMANCE DIFFICULTY QUESTIONNAIRE

FOR PARTICIPANTS (PLAYERS) (CONTINUED)

21. WORKLOAD

To what extent was the work load adequate while this task was being

performed? This should include considering all tasks which were

performed at the same time as this task.

COMPLETELY COMPLETELY

SAT ISFACTORY IN BETWEEN UNSAT ISFACTORY

100 75 50 25 0

Workload perfectly Moderate performance Total ly inadequate

adequate during difficulty caused by workload made task

performance workload. You were performance impossible

fully loaded

*4~.SYSTEM ______________________TEST - DATE PAGE

NAME_________________ -- TELEPHONE --- ____

W6-46
LJDT~PERFORMANCE DIFFICULTY QUESTIONNAIRE [1F~I~FOR PARTICIPANTS (PLAYERS) (CONTINUED)

TO THE TEST PARTICIPANT (PLAYER):

If there are other pieces of information which you believe are applicable

and important 3Dout this field test, write them here.

SYSTEM __________________________TEST____ DATE _______PAGE

NAME ______- -TAELEPHONE-___________

W6 -47
H RTESCRITICAL INCIDENT REPORT

HPF

CONDITIONS

WHAT HAPPENED?

WHAT PRODUCED THIS PROBLEM?

HOW DID YOU DISCOVER THIS PROBLEM?

HOW DID YOU, OR WOULD YOU. SOLVE THIS PROBLEM?

WHAT DID IT, OR COULD IT, HAVE CAUSED?

0 PARTICIPANT

0 OBSERVER

LSYSTEM TEST- DATE PAGE

6 NAME ___________________TELEPHONEW6-48
HRTES OPINION SUMMARY DATA WORKSHEET

HPF

SYSTEM FUNCTION

'>CONDITION SET # DIFFICULTY SCORE

OPINION SCALES 0 10 20 30 40 50 60 70 80 90 100

1. Understanding

Proced u res

2. Display Readability7

Hearabi I ity Measurement

3. Display Information

Understandinq

4. Usefulness of Display

Information5. Manipulation Difficulty

6. Reach/Accessibility

7. Control Configuration

8. Decision Difficulty

9. Target/Terrain

Visibility

10. Workstation Design for

Visibility 11. Sound

7 112. Motion

13. Ventilation

14. Workstation Dimensions

15. Seating

16. Safety

17. Training Time

18. Practice Condition

0. Training Method

-; I 1. Wo rk load '

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

* NAME. W6-49
HRTESSTATISTIC WORKSHEET

i HRTE5

SYSTEM FUNCTION

SPI

HPF

CONDITION SET(S)

E OPER TYPE OF STATISTIC

EJMAINT

UNITS

TRIALS 2 3 4 5 6 7 8 9 10

1

2

3

4

5

6

7

8

9

10

sums GRAND SUMSSU

SUMS/

TRIALS

STATISTIC OUTCOME

CEVEL OF CONFIDENCE

UPPER CONFIDENCE LIMIT

LOWER CONFIDENCE LIMIT

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

4W6-50

4 = . J'4", " .- . ." .- -- ." . w" . ." . . . . A .
HRTES 7. EVALUATION

CONTENTS

1. Guidelines for Defining Value Functions (Including Example)

2. Value Fuinction Worksheet

3. Sample Function Worksheet

W7-1
GUIDELINES FOR DEFINING

VALUE FUNCTIONS

You have received a package of worksheets. Each package consists of a

set of "Criterion Worksheets," "Value Function Worksheets," "Final

Condition Sets Worksheets," and these Guidelines. Your task is to assist

in developing Value Functions by which results from the field test will

be evaluated. For each statistic, you will be asked to develop a Value

Function. By means of these Value Functions the level of performance of

the various HPF's will be evaluated. The value assigned to each statistic

* outcome is a number between 0 and 100. 0 - means very bad performance;

100 - means very good performance. The value scale will look as follows:

Very Bad Bad Borderline Good Very Good

0 25 50 75 100

On the "Criterion Worksheet," is specified what constitutes one

successful trial, the type of the statistic, and the statistic criterion.

One point on each Value Function is determined in advance: the statistic

criterion point. This is done by assigning to the statistic criterion of

each HPF the value 50 (borderline). This preassignment may aid you in

assessing other points on the Value Function. You will be asked to

determine an outcome with a value of 0 (very bad) and an outcome with a

value of 100 (very good) for each statistic. From those determinations

and from the criterion point, an approximated Value Function for each

statistic will be developed.

Before you go through the instructions, consider the following examples:

W~7-2

MI
GUIDELINES FOR DEFINING

HVALUE FUNCTIONS (Confinued)

The HPF is "Target Detection and Identification." The statistic developed

for this HPF is "Percentage of Successful Trials." The definition of the

performance criterion of one trials and the condition sets are specified,

and the statistic criterion is 70%. After considering the performance

criterion and condition set, you and some other experts together decided

that 40% of successful trials is very bad performance and 95% of successful

trials is very good performance of this HPF. Plotting straight lines

between the given points, the approximated Value Function would look as

4 follows:

VALUE SCALE

VERYGOOD 100

GOOD 75

BORDERLINE 50

BAD 25

VERY BAD 0

STATISTIC SCALE 7,Y

VERY SAD VERY GOOD

STATISTIC STATISTIC

OUTCOME OUTCOME

W~7-3
GUIDELINES FOR DEFINING

HR TES VALUE FUNCTIONS (Continued)

Using this Value Function, the value of the statistic outcome would be

assessed. For example, the value of the outcome - 85% of successful

trials would be 80, and would be determined as follows:

VALUE SCALE

VERY GOOD 100 --

AI so

GOOD 75

BORDERLINE 50 -

BAD 25

VERY BAD 0 .

STATISTIC SCALE7Oo

VERY BAD VERY QOOD

STATISTIC STATISTIC

OUTCOME OUTCOME

In the following pa. agraphs, specific Guidelines for selecting the "very 4

good" and "very bad" outcome of each statistic are given:

(1) Determine the "very good" outcome for the statistic and record

it in the appropriate space on the Worksheet.

%

rJ

W7-4
GUIDELINES FOR DEFINING

VALUE FUNCTIONS (Continued)

For each statistic, there is a range of plausible or conceivable

performance which you consider to be very good. As the goodness

of performance increases, usually the effectiveness of the

system increases. This relationship between increased performance goodness and increased system effectiveness continues

until a point is reached at which the increase in performance

goodness produces only negligible additional system effectiveness.

That point in the range of plausible performance is the "very

good" outcome. In the previous example, 95% is the smallest

percentage of success which you still considered to be very good.

Selecting the "very good" outcome - Determine the poorest outcome

of the statistic in question, which you still consider to be

very good. This statistic outcome is given the value of 100.

This may be done using any strategy with which you feel comfortable. If you want some aid, the following is one possible

strategy for selecting the "very good" outcome:

(a) For each statistic, identify some clearly unacceptable

outcome according to the statistic type (percentage or

average), and then identify successively better statistic

outcomes. As you consider these better outcomes, ask

yourself the following two questions:

(1) Is this outcome plausible; could it really be expected

to take place?

(2) Does this outcome producP additional appreciable system

effectiveness as compared with the last previous

outcome I considered?

W7-5

S[tf'*-
GUIDELINES FOR DEFINING

VALUE FUNCTIONS (Coninued)

(b) If the answers to the two questions above are both "yes,"

you have not yet located the "very good" outcome. Identify

the next better statistic outcome. If the answer to either

of these two questions is no, the last previous performance

outcome is the "very good" outcome.

(2) Determine the "very bad" outcome, and record it in the appropriate space on the Worksheet.

For each statistic there is a range of plausible or conceivable

performance which you consider to be very bad. As the goodness

of performance decreases, usually the effectiveness of the system

decreases. This relationship between decreased performance and

decreased system effectiveness continues until a point may be

reached at which the decrease in performance goodness produces

only a negligible decrease in the system's effectiveness. That

point, in the range of plausible performance, is the "very bad"

outcome.

Selecting the "very bad" outcome - Determine the best outcome of

the statistic in question which you still consider to be very

bad. This statistic outcome is given the value of zero. Once

again, use any strategy for selecting this outcome which seems

reasonable to you. If you want some aid, the following strategy

is one possible technique:

W7-6
GUIDELINES FOR DEFINING II VALUE FUNCTIONS (Continued)

HRTE

(a) For each performance, start at the "very good" outcome,

which you recorded in (1a), and identify successively

-~ worse statistic outcomes which could be obtained from

that statistic. As you identify these worse outcomes,

ask yourself the following questions:

(1) Is this outcome plausible; could it really be

expected to take place?

4(2) Does this outcome product additional appreciable

reduction in system effectiveness as compared with

the last previous outcome I considered?

(b) If the answers to the two previous questions are both "yes,"1

you have not yet located the "very bad" outcome. Generate

the next worse statistic outcome. If the answer to either

of these two questions is no, the last previous performance

outcome is the "very bad" outcome.

(3) Return the completed Worksheets to sender.

W7-7

%. %.4
VALUE FUNCTION WORKSHEET HRTES

SYSTEM FUNCTION

HPF

CONDITION SET

[ OPER. STATISTIC

[ MAINT.

VALUE SCALE

VERY GOOD 100

GOOD 75

BORDERLINE 50

BAD 25

VERY BAD 0 F__

STATISTIC SCALE

VERY BAD VERY GOOD

STATISTIC STATISTIC

OUTCOME OUTCOME

STATISTIC CRITERION

SYSTEM TEST.- DATE PAGE

NAME TELEPHONE ,,

W7-8

'-: -" ," ',7-,,." ,".,''-.''..' " ,' 7.,,il , ". ...."-".',." ,..,,-" " ."',v.... 4"..'.''.-: , , :".,. . *,. " * .-.- -,,, ,
SAMPLE

VALUE FUNCTION WORKSHfET

SYSTM - r e FUNCON "Moo")

1A r~~w 7A&4&E /tJult-fe 

CONDImON SET

,,OPI. STATISIC r

SMAINt.

VALUE SCALE

VIERY GO= ic

GCCO 75

&SA 25

STAlS11C SCAU

VERY SAD VERY 000 STATISTIC STATISTIC

OUTCOME OUTCOME

STATISTIC CRITIR'ON7170

SYSTEMA"keaUtw Adt 3 4C'A) 5/ TIS OAT! 2UNi( B, 'AGL....

NAME TILIP4ONE

W7-9

• . '. . . ~~ "', . .- . . .. -- . . . .. .. ". .. . . , ... , .. . (.. .. , -, ,.. . . -. .,....._...,.
11 ..

HRTES

CONTENTS i 

~PAGE

1. HPF Diagnostic Worksheet W8-4

2. Training Time Allocation Measure (Alternative 1) W8-11

3. HPF Difficulty Rating Worksheet W8-19

4. HPF Difficulty Rating Worksheet, Example for Measure W8-20

(Alternative 2)

5. Training Time Allocation Measure, Example for Measure W821

(Alternative 2)

6. Practice Condition Worksheet W8-24

7. Training Methods Worksheet #1, First Example W8-30

8. Training Methods Worksheet #2, First Example W831

9. Training Methods Worksheet #3, First Example W832

10. Training Methods Worksheet #1, Second Example W8-33

11. S1. Training Training Methods Methods Worksheet Worksheet #2,3 Second Example Example W8-34

.-

12. Training Methods Worksheet #3, Second Example 

W8-35

13. Training Methods Worksheet #1 W8-36

14. Trainng Methods Worksheet #2 W8-37

15. Training Methods Worksheet #3 W8-38

16. Utility Estimate Worksheet W8-39

17. Index of Trainer Adequacy Worksheet W8-43

18. Summary Worksheet for Training Diagnosis W8-44

19. Procedure Understandability Worksheet #1 W8-56

20. Procedure Understandability Worksheet #2 W8-57

21. Decision Difficulty Rating Worksheet #1 W8-61

22. Rating Scales for Decision Difficulty Worksheet #2 W8-64

23. Decision Difficulty Worksheet #2 W8-66

24. Display Information Adequacy and Timeliness Worksheet W8-71

25. Display Readability/Hearability Worksheet #1 W8-75

26. Display Readability/Hearability Worksheet #2 (Visual) W8-76

27. Display Readability/Hearability Worksheet #3 (Auditory) W8-77

28. Rating Scales for Display Information Understandability W8-80

Worksheet

29. Display Information Understandability Worksheet W8-82

30. Accessibility Adequacy Worksheet W8-86

31. Static Characteristics Worksheet W8-91

SYSTEM TEST___ DATE _PAGE

NAME TELEPHONE

W8-1

i , ", ' ". ', ' " " % ". '. ". .' .' .° " ""%' _"-' ', - - . - .. o'- . -. 

.

- " - : - , °' . . "- . ' ' ' -- , - '-
* HRTES

PAGE

32. Dynamic Characteristics Worksheet W8-96

33. HFE Measure #9--Workstation Dimensional Characteristics W8-97

34. HFE Measure #10--Workstation Seating Characteristics W8-98

35. HFE Measure #11--Workstation/Environment Visual W8-99

Characteristics Adequacy Worksheet

36. HFE Measure #12--Workstation/Environment Sound W8-100

Characteristics Adequacy Worksheet

37. HFE Measure #13--Workstation Motion Characteristics W8-101

Adequacy Worksheet

38. HFE Measure #14--Workstation/Environment Ventilation W8-102

Characteristics Adequacy Worksheet

39. HFE Measure. #15--Workstation/Environment Safety W8-103

Characteristics Adequacy Worksheet

:I

40. Summary Worksheet for Human Factors Engineering Diagnosis W8-104

41. Personnel Selection Measure #1--Background That Bears On W8-117

Cognitive Functioning Adequacy Worksheet

42. Personnel Selection Measure #2--Aptitude/Ability That Bears W8-118

On Cognitive Functioning Adequacy Worksheet

43. Personnel Selection Measure #3--Vision Display Use Adequacy W8-119

Worksheet

44. Personnel Selection Measure #4--Anthropometry for Visual W8-120

Display Use Adequacy Worksheet

45. Personnel Selection Measure #5--Audition for Auditory W8-121

Displays Adequacy Worksheet

46. Personnel Selection Measure #6--Anthropometry for Auditory W8-122

Display Use Adequacy Worksheet

47. Personnel Selection Measure #7--Length/Reach Anthropometry W8-123

Characteristics for Accessibility Adequacy Worksheet

48. Personnel Selection Measure #8--Joint Motion for Accessibility W8-124

Adequacy Worksheet

49. Personnel Selection Measure #9--Size Anthropometry for W8-126

Accessibility Adequacy Worksheet

50. Personnel Selection Measure #10--Vision for Manipulation W8-127

Adequacy Worksheet

51. Personnel Selection Measure #11--Anthropometry for Static W8-128

Characteristics of Controls/Equipment to be Manipulated

Adequacy Worksheet

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE_

:- 4- - , -*. .- - .... - -.. -. -* W8-2 - ,-.. , . - . . .
HRTES

PAGE

52. Personnel Selection Measure #12--Strength for Manipulation W8-129

Adequacy Worksheet

53. Personnel Selection Measure #13--Range of Movement for W8-130

Manipulation Adequacy Worksheet

54. Personnel Selection Measure #14--Coordination for W8-131

Manipulation Adequacy Worksheet

55. Personnel Selection Measure #15--Anthropometry for Work- W8-132

station/Environment Dimensions Adequacy Worksheet

56. Personnel Selection Measure #16--Anthropometry for Seats W8-134

Adequacy Worksheet

57. Personnel Selection Measure #17--Vision for Workstation/ W8-136

Environment Adequacy Worksheet

58. Personnel Selection Measure #18--Audition for Workstation/ W8-137

Environment Adequacy Worksheet

59. Personnel Selection Measure #19--Central Nervous System W8-138

Functioning for Compatibility with Workstation Motion

Adequacy Worksheet

60. Personnel Selection Measure #20--Characteristics Required W8-139

for Workstation Ventilation and Air Filtration Adequacy

Worksheet

61. Personnel Selection Measure #21--Physiological Indices of W8-140

Workload Tolerance Adequacy Worksheet

62. Summary Worksheet for Personnel Selection Diagnosis W8-141

SYSTEM TEST-__ DATE PA____

NAME TELEPHONE

W8-3

*, ~ b 6; - ., <:'- ,:. .,, -, ,, ' ,,. ,, .,.. ... .. , , '-- .,. - ,- ,,.-<
-! HRTES HPF DIAGNOSTIC WORKSHEET

SYSTEM TESTED:

OT: DATE OF TEST: EVALUATOR:

TEL OF EVALUATOR:

TYPE OF DIAGNOSIS: TRAINING ; HFE ; PERSONNEL SELECTION

CONDITIONS IN WHICH EACH

HPFIS TO BE DIAGNOSED HPF PERFORMED INADEQUATELY .i

SYSTEM TEST_ DATE PAGE

,W NAME TELEPHONE

W8-4
H R T E S GENERAL INSTRUCTIONS FOR TRAINING MEASURES

DESCRIPTION: An operational test (OT) has been completed recently.

For the specifics of this OT see "HPF Diagnostic Worksheet", page W8-4

of this submission. Various operator and maintainer tasks were measured

during this OT. One or more of these tasks was evaluated as having been

performed inadequately. In the Human Resources Test and Evaluation System

(HRTES), operator and maintainer tasks have been defined at a general level

which is not dependent upon the specific types of equipment involved. To

avoid confusion with traditional tasks they have been named Human Performance Functions (HPF's). The "HPF Diagnostic Worksheet" on page W8-4

that lists the specifics of the operational test also lists the HPF's which

were performed inadequately.

Operational testing and evaluation personnel have determined that those

HPF's that are listed are of significant importance to the overall evaluation of the system that was tested. They need to know why these HPF's

were performed inadequately. One possible reason is that the training

of these HPF's was in somd way inadequate. To aid in determining if this

was the case, HRTES contains the following training measures:

.PAGE

* MEASURE NAME MEASURE FUNCTION W8:

1. Training Time Allocation Adequacy of training time 9-21

of HPF.

2. Practice Conditions Adequacy Adequacy of practice of HPF. 22-24

3. Compatibility of Training Adequacy of method used to 25-39

Methods and Required Skills train HPF.

4. Adequacy of personnel who Adequacy of Operational Test 40-43

trained HPF Trainers.

Each of these measures has its own specific instructions and worksheets.

The first measure has an alternative training time measure.

SYSTEM TEST_ DATE PAGE

NAME TELEPHONE

W8-5
HRTESGENERAL INSTRUCTIONS FOR TRAINING MEASURES

Your first problem will be to dc~cide which of these measures to take of

each HPF. During the OT, players and observers filled in questionnaires

in which they gave their opinions of the difficulty of each HPF and the

reasons for significant difficulty. If the questionnaires indicated significant difficulty, they were reduced and used to fill out an "Opinion

Summary Data Worksheet."1 Scales 17-20 of this Worksheet correspond to the

training measures listed earl ier. If any player or observer thought that

performing a given HPF was difficult and that HPF is one of those being

diagnosed now, you will have an "Opinion Summary Data Worksheet" for it

with this submission. In this case, the scale scores listed may be helpful

to you in deciding which training measures to take. If a score indicates

N significant difficulty, it is reasonable to take the corresponding training

4 measure for that HPF. It is, of course, possible that players and observers

were not able to judge whether there was something about training which was

inadequate and produced inadequate HPF performance. Therefore, these scores,

if they are available, can only be a guide for you to use as you think best.

However, it is possible that players and observers did not believe that an

HPF was difficult. In this case, you will have no "Opinion Summary Data

Worksheet" for that HPF, and you will have to fall back on your own

resources to decide which of these training measures to take.

This submission should also include copies of: "Evaluation Tree," "OT

Training Data Collection Worksheets," and "HPF Difficulty Worksheets."

The specific instructions for the various training measures will call for

one or more of these additional documents. The final document you should

have is "Sunmmary Worksheet for Training Diagnosis" which will be described

* in the following general procedure.

GENERAL PROCEDURE:

(1) Read through the specific instructions for the training

measures and familiarize yourself with their worksheets.

SYSTEM _________________________TEST____ DATE _______PAGE

NAME TELEPHONE

WS-6
H R TES GENERAL INSTRUCTIONS FOR TRAINING MEASURES

(2) Examine the "HPF Diagnostic Worksheet" to familiarize

yourself with information about the OT and the specific

HPF's which are to be diagnosed.

(3) Examine the "Opinion Summary Data Worksheet" for each HPF

(if there is one). Use their scores as an aid to selecting

parallel training measures. If you do not have one or more

such worksheets, use your best judgment for deciding which

measures to take of each HPF.

(4) When you are finished taking the measures you have selected

for each HPF, make as many copies of the "Summary Worksheet

for Training Diagnosis as you need for the HPF's you have

diagnosed (one per HPF).

(5) Fill in the information at the top and extreme bottom of

each worksheet.

(6) Record the Indices of Adequacy for each training measure you

have taken for each HPF being diagnosed. This is to be done

in the appropriately labeled boxes on the worksheets.

(7) If you have not taken a specific training measure for a given

HPF, and if you have an "Opinion Summary Data Worksheet" for

that HPF, use the appropriate questionnaire scale score as

an Index of Adequacy. Record this questionnaire based score(s)

in the appropriately labeled box.

(8) If you have not taken a specific training measure for a given

HPF, and if you do not have an "Opinion Summary Data Worksheet"

for that HPF, record an "X" in the appropriate box.

J

SYSTEM TEST- DATE PAGE

NAME - TELEPHONE

W8-7

< ., .. -.. . . .., .. . .. . .. . .. .. ... . . .. . . . . . .
H R T E S GENERAL INSTRUCTIONS FOR TRAINING MEASURES

(9) Next to each Index of Adequacy record an "EXP" or "QUEST" in

the third column of the worksheet. "EXP" Ts recorded next to

an Index which was based on an expert measure you have taken.

"QUEST" is recorded next to an Index which was based on a

questionnaire scale from the "Opinion Summary Data Worksheet"

for that HPF.

(10) Record the specific training problem(s) which caused any Index

of Adequacy to be significantly below 100. This is to be done

in the first column of the worksheet.

(11) Compute the mean of Indices of Adequacy for each HPF diagnosed.

If you have recorded an "X" in any box, leave it out of the

computation. Record the mean in the Training box at the extreme

right of the worksheet.

(12) When you have completed the training measures and the "Summary

Worksheet for Training Diagnosis" return all materials to

the sender.

.J.

SYSTEM .TEST__ DATE PAGE

NAME -.TELEPHONE-- - -

W8-8

Lr J' -V,,""~~~...-...... - '................. ...... ..... ". .. . . .,..........-...............
HRTES

TRAINING MEASURE #1

MEASURE OF TRAINING TIME ALLOCATION (ALTERNATIVE 1)

DESCRIPTION: This measure compares the length of time devoted to

training the HPF that is being diagnosed with the length of time devoted

*to training a baseline HPF. To use this measure the following requirements must be met:

(1) You must have access to a task list for a functionally

similar system.

(2) This list must contain a similar task (or HPF). Usually this

will be the system being replaced by the one which has been

tested.

(3) You have no reason to suspect that the baseline task is significantly more difficult to perform than the HPF being diagnosed.

(4) You have access to data which includes the length of time

devoted to training this baseline task.

(5) You have no reason to suspect that this baseline task was

performed in an unsatisfactory manner.

(6) You have no reason to suspect that the personnel who performed the

baseline task had inferior aptitudes to those who performed the

HPF being diagnosed.

(7) The training of the HPF being diagnosed has not improved in

a way that would require less training time than the baseline

task.

If you have this information, the task can be used as a baseline for training

time. Under these circumstances it would be plausible to assume that the

HPF being diagnosed should have received at least as much training time as

the baseline task. However, this required information will probably not

be available in the early tests in which HRTES is used. As HRTES continues

to be used, this required data should become available.

SYSTEM - TEST__ DATE PAGE

II NAME TELEPHONE____--- _

W8-9
H RTES

PROCEDURE:

(1) Determine if you can meet all seven requirements for the use of

this measure. If not, read alternative #2. If you can meet them,

* copy "Worksheet for Training Time Allocation Measure (Alternative

1)" on page W8-11 for each HPF to be diagnosed.

(2) Fill in the required information on your copy of the worksheet.

(3) Divide the training time of the HPF being diagnosed by the

training time of the baseline task (or HPF), and record it.

If the resulting quotient is greater than 1.0, record it as

1.0. A number larger than this provides no additional diagnostic

information.

(4) Multiply the resulting quotient by 100, and record it on

the worksheet. This is what HIRTES refers to as the Index of

Adequacy for this measure of training time. The further this

time was devoted to training the HPF.

Y SYSTEM _________________________TEST____ DATE _______PAGE

NAME~ TELEPHONE

W8-10
WORKSHEET FOR TRAINING TIME

ALLOCATION MEASURE (ALTERNATIVE 1

HPF BEING DIAGNOSED:_______________________

SIMILAR BASELINE SYSTEM:_____________________

BASELINE HPF/TASK:________________________

TRAINING TIME FOR DIAGNOSED HPF:_________________

TRAINING TIME FOR BASELINE HPFz__________________

DIAGNOSED HPF/BASELINE HPF (1.0 MAXIMUM)

0 INDEX OF ADEQUACY FOR TRAINING TIME

* (MULTIPLY QUOTIENT ABOVE BY 100)

SYSTEM ____________________TEST-__ DATE ______PAGE

aNAME -TELEPHONE____________

W8- 11
HRTES

TRAINING MEASURE #1

MEASURE OF TRAINING TIME ALLOCATION (ALTERNATIVE 2)

DESCRIPTION: The amount of time spent training an HPF ought to be

related to its criticality and difficulty. This measure requires the

determination of the criticality and difficulty of an HPF that is being

diagnosed and of five randomly selected HPF's that were successfully

performed. Criticality of the HPF's is derived from weights on the

"Evaluation Tree" which has been included in this submission. Difficulty

of the HPF's has already been estimated by operational test players and

observers and is recorded on "HPF Difficulty Worksheets" which have been

included in this submission.

Once you have determined the criticality (C) and difficulty (D) of each

of the six HPF's, you calculate the training time per unit of criticality

X difficulty (T/CXD) for each. You then compare this statistics for the

* HPF being diagnosed with the mean of this statistic for the five success-

-~ fully performed HPF's. If the training time of the HPF being diagnosed

was insufficient, there should be a significant difference between its

statistic and the mean statistics. If such a significant difference does

not exist, you cannot assume a training time insufficiency. In this

measure a significant difference is defined as one standard deviation.

PROCEDURE:

(1) Examine the "Evaluation Tree" which is part of this submission.

It was used to determine the value of human and human-machine

performance in the OT. It consists of levels of nodes connected

by branches. At least the following levels should be present

on the "Evaluation Tree":

SYSTEM _________________________TEST____ DATE _______PAGE

NAME -TELEPHO NE_____

W8-1 2
H R I E S GENERAL INSTRUCTIONS FOR TRAINING MEASURES

(a) System Level (at the top of the tree);

(b) System Function Level (the second level);

(c) System Performance Issue or SPI Level (the third level);

(d) Human Performance Function Group or HPF-Group Level (the

fourth level);

(e) Human Performance Function or HPF Level (the fifth level);

(f) There may be one or two levels below the fifth level.

They are not used in this measure.

Notice that each node consists of a main rectangle containing

1-3 numbers and a smaller square, which sits on top of the

rectangle, and contains one number. The number(s) in the main

rectangle of each node is the performance value and is not

used in this measure. The number in each small square is the

criticality weight of that node in relation to other related

notes at that level of the "Evaluation Tree." These numbers

will be used in this measure.

(2) Select five successfully performed HPF's from the HPF Level of

the tree. You can tell that they are successfully performed

by the value numbers in the main rectangle of each node. If

there is only one number in each rectangle, any HPF with a value

number above 50 is successful. If there are three numbers in

each rectangle, any HPF with a central and left-hand numbers

above 50 are successful. To the greatest extent possible select

these HPF's so that each one is connected by a branch to a

different HPF-Group in the level immediately above. You now

have a sample consisting of one unsuccessfully performed HPF

(to be diagnosed) and five successfully performed HPF's.

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

W8-13
HRT-- -2; 

H R T E S GENERAL INSTRUCTIONS FOR TRAINING MEASURES

(3) Compute the criticality of each of these six HPF's. This is

done for each HPF by returning to the "Evaluation Tree" and

performing the following:

(a) multiply the criticality weight (in the small square)

of each HPF selected by the criticality weight of its

HPF-Group;

(b) multiply each resulting product by the criticality

weight of its System Performance Issue;

(c) multiply each resulting product by the criticality

weight of its System Function.

The final products are the criticality weights of each of the

six HPF's.

(4) Make a copy of the "Training Time Allocation Measure Alternative

2 Worksheet," page W8-2T for each HPF to be diagnosed. Fill

in the names of the HPF's and the criticality weight for each

(in column 2). Write small; you will need space for a difficulty weight and a product in each cell of this column.

(5) Retrieve the "Opinion Summary Data Worksheets" for the six

HPF's. In the box marked "Difficulty Score" you will find

the difficulty weight of that HPF. Write these weights next

to the criticality weights on the "Training Time Allocation

Measure Alternative 2 Worksheet."

(6) It is possible that you do not have "Opinin Summary Data Worksheets" for some or all of the six HPF's. In this case, retrieve

the "HPF Difficulty Worksheets" for each such HPF, and compute

the mean difficulty for each.

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W8-14

- .
HRTES

(7) It is possible that you do not have the "HPF Difficulty

Worksheets" for some or all of the six HPF's. In this case,

copy the "HPF Difficulty Rating Worksheet," page WS-19,

write in the six HPF's, and rate them for difficulty on the

scale given. If you feel another individual may be better at

this than you, also copy the Guidelines, page W8-17, and

have them use the worksheet and guidelines to determine HPF

diifficulty.

(8) One way or the other, you now have six HPF's, and each one

has a criticality and difficulty weight. Multiply these

two weights for each HPF, and record the products in the

appropriate cells of the "Training Time Allocation Measure

Alternative 2 Worksheet."

(9) Retrieve the "OT Training Data Collection Worksheets" completed

by the Trainers during this operational test. Copy the training

time for each HPF from this worksheet on to your "Training

Time Allocation Measure Alternative 2 Worksheet."

(10) Divide each HPF's training time by its criticality X difficulty

product, and record the resulting quotient on the worksheet.

(11) Compute the standard deviation of the last (fourth) column for

only the successfully performed HPF's. Enter it in the standard

deviation box.

Standard Deviation Formula:

SD = (

N-i

SYSTEM TEST- DATE PAGE

NAME _ _ __TELEPHONE--- - -

W8-15
HRTES

Where:

X = the values in column 4 of the worksheet for the successfully performed HPF's.

= column 4 mean of the successfully performed HPF.

N = number of successfully performed HPF's listed on the

worksheet.

4

i'

SYSTEM _________________________TEST____ 

DATE _______PAGE

NAME_____________________ -- TELEPHONE- - -- _______

WB-16

. * . *-

AtS ' - -.
k

GUIDELINES FOR THE HPF DIFFICULTY

IIITIS RATING WORKSHEET

The purpose of this procedure, and the accompanying worksheet, is to

determine your estimate of the performance difficulty of a series of tasks

which were performed during an operational test.

EXPLANATION:

An OT, of the system listed on the attached worksheet, has taken place.

In this OT, a series of generalized tasks were performed. In HRTES, these

are called Human Performance Functions of HPF's. When an HPF has been

judged to have been performed inadequately and to be a significant HPF,

the causes for this inadequate performance are diagnosed. One possible

cause is that insufficient training time was provided, considering the

HPF's criticality and its difficulty. To determine this, it is necessary

to compare the criticality and difficulty of performance of adequately and

inadequately performed HPF's with the amount of training time devoted to

them.

Your task is to rate each listed HPF, or task, on a performance difficulty

scale from 1-100. This package consists of: the guidelines you are

currently reading and one or more "HPF Difficulty Rating Worksheets."

There is one worksheet for each group of HPF's containing one HPF which

was performed inadequately. You are being asked to complete all the worksheets and return them to the sender.

INSTRUCTIONS:

(1) Rate each of the HPF's (or tasks) on the following scale from

1--100. You can assign any number from 1-100.

1 25 50 75 100

HPF extremely HPF moderately diffi- HPF extremely

easy to perform cult to perform difficulty to

perform

SYSTEM _TEST- DATE PAGE

NAME ______ _TELEPHONEW-17 L
HRTES

(2) Record your ratings in the appropriate cells of the Rating column

(3) When all worksheets are completed, return to sender.

, i.

SYSTEM TEST_ DATE PAGE

NAME TELEPHONE

W8-18
HRTESHPF DIFFICULTY RATING WORKSHEET

SYSTEM UNDER TES

1 100

EXTREMELY EXTREMELY

EASY DIFFICULT TO PERFORM TO PE RFORM

TASKS (HPF'S) RATING

SYSTEM TEST___ DATE PAGE

* NAME TELEPHONE_- _ __

W8-19
HPF DIFFICULTY RATING WORKSHEET

*" EXAMPLE FOR MEASURE ALTERNATIVE 2

SYSTEM UNDER TEST Mercury Air Defense Weapon System

1 100

-I I I t

EXTREMELY EXTREMELY

EASY DIFFICULT

TO PERFORM TO PERFORM

TASKS (HPF'S) RATING

1. Detect and identify target. P0,

2. Select target and target order. 30.

3. Perform misfire procedure. 70,

4. Fire weapon. /0

5. Perform ground vehicle maneuvers (specified). 60.

6. Fuel ground vehicle /01

SYSTEM Mercury Air Defense Weapon System TESTOT IIDATE 6/14/81 PAGE

NAME TELEPHONE

W8-20
TRAINING TIME ALLOCATION MEASURE M~inI~bALTERNATIVE 2WORKSHEET

H RE EXAMPLE FOR MEASURE ALTERNATIVE

CRITICALITY TRAINING

4x DIFFICULTY TIME

SUCCESSFULLY PERFORMED HPF's (2) (3) (3) (2))

1. Select target and target order. /YJ

2. Perform misfire procedure. ______. ~'C2/ JJs.'

3. Fire weapon. .5iC:. 5, ___

4. Perform ground vehicle maneuvers. XP-t___________

5. Fuel ground vehicle. 2LfZL _____

UNSUCCESSFUL HPF_______

1. Detect and identify target. kpo XJ p9 /

r MEAN

STANDARD DEVIATION

INDEX OF ADEQUACY

SYTMMercury Air Defense Weapon System TEST OT I I DATE 6Y21 /81 PG

NAME- ________________TELEPHONE__________

W8-21
HRTES

TRAINING MEASURE #2

MEASURE OF THE ADEQUACY OF PRACTICE CONDITIONS

DESCRIPTION: The amount and nature of practice is likely to have a

considerable affect on the adequacy of HPF performance. If an HPF were

performed inadequately under a given condition or set of conditions, and

if you discovered that it had not been trained under these conditions, you

might suspect that this practice had been inadequate. Further, you might

suspect that such an inadequate practice was a cause of the inadequate

performance of the HPF. This measure is based on expert opinion of the

adequacy of practice which took place for the HPF being diagnosed. The

4 individual who produces this expert opinion should know:

(1) what conditions were in force during HPF practice;

(2) the amount of time devoted to practicing various HPF's;

(3) the number of practice trials for each HPF; and

(4) how the practice was carried out in terms of realism.

You will need to use the "Evaluation Tree" in this measure.

PROCEDURE:

(1) Make one copy of the "Practice Condition Worksheet," page W8-24,

for every HPF you are going to diagnose using this measure.

(2) Examine the "Evaluation Tree" giving particular attention to

the lowest level of the tree. This is the Statistics Level.

At this level each HPF has an individual node either for all

the conditions under which it was performed, or under one

condition that was varied. Using these nodes, determine the

conditions under which each HPF to be diagnosed was performed

inadequately (value score below 50).

4, SYSTEM _______________________TEST - DATE _______PAGE

NAME W-2 TELEPHONE

W8-2
HRTES

(3) For each HPF, determine how many conditions are to be rated,

and make the appropriate number of copies of the "Practice

Condition Worksheet."

(4) Each worksheet should have the name of the HPF being diagnosed

and one condition under which it was performed inadequately.

(5) Complete all "Practice Condition Worksheets," by answering

the questions and determining the appropriate rating.

(6) If more than one condition was in force for an inadequately

performed HPF, make an additional copy of the blank "Practice

Condition Worksheet." Write "Mean" in the "Condition Box."

(7) Compute the mean ratings of all conditions rated for each HPF

being diagnosed. Record this in the "Rating Box" of the Mean

Worksheet. This is the Index of Adequacy of Practice Conditions

for this HPF. The further it is below 100, the less adequate

the total practice for this HPF.

(8) If any condition received a rating of zero because both

questions 1 and 2 were answered "NO," it should be specifically

noted on the Mean Worksheet. Even though adequate practice

of a number of other conditions may raise the final Index, the.

presence of any zero could point to the actual cause of inadequate performance. Therefore, when the overall Index is

reported, the total absence of a condition in practice or its

"good replacement" should also be reported as a possible cause.

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

W8-23
HRTES HRTESPRACTICE CONDITION WORKSHEET

HPF

CONDITION

I Was the above HPF practiced

under the above condition? 01 YES 0 NO

2 If the answer to number I was

"NO:' was there a condition that

was a good substitute? E YES E NO

If the answer to this question is

"YES" list the substitute condition

here

3 If the answer to either questions I

or 2 was "YES' fill out the rating

form below, and return the

complete worksheet to sender.

If the answer to both questions I

and 2 was "NO:'ignore the rating

form below, and return it to

sender

PRACTICE CONDITION RATING FORM

Rate fhe quality of the practice of HPF

under this condition (or substitute

condition].

This rating should include your

consideration of the adequacy of:

(I) Practice time.

(2] Number of practice trials.

(3) Realism of practice.

(4) Realism of practice hardware/

software 0 50 100

Your rating is to be made on the I I I

scale, as indicated here. Any number PRACTICE PRACTICE

between 0 and 100 can be given. TOTALLY FULLY

INADEQUATE ADEQUATE

ENTER YOUR RATING HERE--oSYSTEM TEST- DATE PAGE

NAME TELEPHONE .

W8-24
-. ~~~~~ - -7r~~ v- V--- 

HRTES

TRAINING MEASURE #3

MEASURE OF COMPATIBILITY OF TRAINING METHODS

AND SKILLS REQUIRED FOR THE HPF

DESCRIPTION: When someone performs an HPF, he or she is simply exercising

one or more skills. The level of the skills will have a significant effect

on the HPFts level of performance. Skill level is the outcome of a combination of training and the characteristics of the individual. Training to

enhance skill level is, itself, a combination of previous formal and informal

training and current training directed toward the specific system being

tested.

All training methods are not equally good at training all types of skills.

Each type of skill has one or more particularly applicable training methods.

The less appropriate the training method used, the higher the probability

that the skill will not be enhanced. If an HPF being diagnosed required

skills which were trained by inappropriate methods, you would have reason

to suspect that these skills were not adequately enhanced. Further, you

might suspect that this was a cause of inadequate HPF performance. To aid

you in understanding this measure, two complete sets of examples have been

included on pages W8-30 through W8-35 of this submission.

PROCEDURE:

(1) Retrieve the "O0T Training Data Collection Worksheets" for

the HPF's being diagnosed.

(2) Make one copy of "Training Methods Worksheets #1, #2, and #3"'

for each HPF to be diagnosed by this measure.

SYSTEM _________________________TEST____ DATE _______PAGE

4NAME TELEPHONE

W8- 25 V..
HRTES

(3) Fill in the names of the HPF's being diagnosed, etc., on each

set of these worksheets. From this point on, these procedures

will apply to each HPF being diagnosed.

(4) Examine the appropriate "OT Training Data Collection Worksheet"

for the HPF. Copy the percentages of training time devoted

to each training method from the above worksheet to the righthand column of Worksheet #1.

(5) Examine Worksheet #2 for the HPF being diagnosed, and determine

which of the six global skill types listed are required for

the performance of this HPF.

(6) When you have decided which skill types are required, estimate

the percentage of each required skill that must be present in

the performance of this HPF. These percentages must sum to 100.

Record the percentages in the appropriate column of Worksheet #2.

(7) Next, you must estimate the utility of each each training method

that was actually used in the training of each required skill

(for this HPF). Training methods not actually used and skills

not required will not play a part in this utility rating

procedure. There are two alternative methods for making this

estimate of training method utility for skills:

(a) Complete the "Utility Estimate Worksheet," page W8-39,

for the system which was tested in the OT. This will be

time consuming and somewhat difficult, but it will

represent your thinking (or the thinking of some other

individual who you get to complete this worksheet).

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W8-26

m - " . ' + . % " . + - % ,- .- ., -', - ... ,+. .... . - +, .-. -.- ., -A- -
HRTES

(b) Obtain utility ratings from Table 8-1, on page W8-29

of this submission. The utility ratings in this table

.%' were made by training experts, and were based on synthesis

of a large body of applicable research.

(8) One way or the other, you now have determined the utility of

each training method, actually used, for training each

required skill. Enter these utility ratings in the appropriate

cells of Worksheet #1 for the HPF being diagnosed. Only enter

the utility ratings for those skills actually required (from

Worksheet #2), and for those training methods actually used.

(9) Copy the percentages required for the performance of the skills

(from Worksheet #2) into the appropriate cells of the bottom

row of Worksheet #3. Skills which received no rating or a

zero percentage are to be left blank.

(10) Return to Worksheet #1. Multiply each number in the right-hand

column of this worksheet by each of the ratings by each of

the ratings in the row to which that first number belongs.

You are now multiplying the percentages of training time

of each training method by the utility rating of each skill

required for the performance of the HPF.

(11) Record the products of the multiplication in procedure 10

in the appropriate cells of Worksheet #3. You may find it

helpful to examine the various example worksheets at this point.

(12) Sum the products in each column of Worksheet #3, and record

each column's sum in the second to the last row of this

worksheet ("Sum ol Column" row).

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

W8-27
HRTES

(13) Compute the correlation coefficient between the last two

rows of Worksheet #3. These are the "Sum of Column" row and

the "% of HPF Involving Skill" row. If you have to do this

computation by hand, use the following formula:

Computational Formula for Correlation Coefficient:

r= NXY- C X) (jY)

V[N X2 - (X)2J[Ny 2 - (1y)2]

Where: 4

r = correlation coefficient.

N = number of skills listed in Worksheet #3.

X = column sum (second to last row in Worksheet #3).

Y = percent of HPF involving skill (last row of Worksheet #3).

I = sum over the skills in Worksheet #3.

(14) Record the resulting correlation coefficient in the appropriate

box of Worksheet #3. This will be either a positive or

*negative number from 0 to 1.0. The closer it is to 1.0, the

more appropriate were the training methods and times alloted

to them in the training of the HPF.

(15) Multiply the correlation coefficient by 100, and record the

resulting product in the Index of Adequacy box of Worksheet #3.

SYSTEM TEST- DATE PAGE

NAME -TELEPHONE W..8-2

-,..-.
LJDFC~TABLE 8-1

EXPERTS' UTILITY ESTIMATES

SKI LLS

z z

z

- -

u zH 0 < 3: Q D z 0 1-1 R 0 u C) .j 0 a- -

Li < Lo0

o 0 r >

z z wi U) Lu Lu TRAINING METHODS CL a.

ORAL/WRITTEN DRILL PRACTICE 1.0 .5 .1 .1 .1 .1

LECTURE .7 .7 .3 .1 .1 .1

GROUP DISCUSSION.4 9 .7 2 1 7

EXPERT DEMONSTRATION/VISUAL AIDS .5 .7 .2 .2 .7 .3

SIMULATION .2 .6 1.0 .9 .8 .8

HANDS ON PRACTICE--REAL HARDWARE .5 .6 1.0 1.0 1.0 .6

SYSTEM_____________________ TEST____ DATE _______PAGE

-= NAME-- _ _ __ _ _ _ _ __ _ _ _TELEPHONE - -__ - -.

W8-29
TRAIN ING METHODS WORKSHEET #1

HRTES FIRST EXAMPLE

HPF SKILLS

• Detect and identify target

0

z 0u 0z uj 0

0 z 0 z z

EDGES o 0 o uiC 0, / u 0 u O o ZTRAINING METHODS/UA, , 0 $ -

ORAL/WRITEN DRILL/PRACTICE

LECTURE ,i / __ __

INDIViDUAL DISCUSSION

GROUP DISCUSSION

READING TEXTS / ,~9

EXPERT DEMONSTRATION/VISUAL AIDS / 5~

PROGRAMMED INSTRUCTION

GAMES

* SIMULATION

HANDS ON PRACTICE - REAL HARDWARE

SYSTEM Mercury Air Defense Weapon System TEST 0TH DATE 6/23/81 PAGE

NAME ,.-TELEPHONE

W,-30

-•. * .-... -..... ........... . ......... : ... """:,z:'
TRAINING METHODS WORKSHEET #2

A EU FIRST EXAMPLE

I HPF Detect and identify target

Enter the percentage of each of

the following skills required for the

performance of HPF above.

The performance of all skills must sum

to 100. % REQUIRED

SKILLS FOR PERFORMANCE

KNOWLEDGE

*,4 

0

"-:- UNDERSTANDING

VERBAL/WRIT"EN

PSYCHOMOTOR

PERCEPTION

DECISION MAKING

".;--''.... SUM /

'.0

.4

SYSTEM Mercury Air Defense Weapon System TEST OTII DATE6/2 5 /81 PAGE

NAME TELEPHONE

.1-7 W8-31

' , '.. ', .*',:'.,'..-,,, -,,.-" ,-, .... .. .. ...; . .... ., ° .,. ,,, , , , .. . . . . . . . . . . . . . .
mTRAINING METHODS WORKSHEET #3

HRTE FIRST EXAMPLE

""HPF SKILLS

I Detect and identify target

C- ( Z , 0

W" 

uul 0 u

CD ~ z 2

__j , 0 0 0< -

TRAINING METHODS > a . "

ORAL/WRITrEN DRILL/PRACTICE

LECTURE4 1

INDIVIDUAL DISCUSSION

GROUP DISCUSSION

READING TEXTS

EXPERT DEMONSTRATION/VISUAL AIDS /c __

PROGRAMMED INSTRUCTION

GAMES

SIMULATION

HANDS ON PRACTICE - REAL HARDWARE

CORRELATION SUM OF COLUMN .. /

ORINDEX OF % OF HPF INVOLVING SKILL

ADEQUACY

SYSTEM Mercury Air Defense Weapon System TESTOTI_DATE 6/27/1 PAGE

NAME TELEPHONE

W8-32

.1."- .-.. 

... 

.

". -. . -' . , " ' " . - . - '- . - " ' .' -,- ' .' ' ' ' - . .- ,' . . . / ' , " . ' ' . . • " t ' , " - . - " '
TRAINING METHODS WORKSHEET #1

HRTES SECOND EXAMPLE

HPF SKILLS

Detec arge andidenify 

0

(D z & 0 M ;

0 ;5 z W60F

0. o 0

TRAINING METHODS >

ORAL! WRITTEN DRILL/PRACTICE Al-1

LECTURE

INDIVIDUAL DISCUSSION

a GROUP DISCUSSION

READING TEXTS

EXPERT DEMONSTRATION/VISUAL AIDS

PROGRAMMED INSTRUCTION

GAMES

SIMULATION keb p -Z 4

HANDS ON PRACTICE -REAL HARDWARE X/

SYSTEM Merc ury Air Defense Weapon System TESTOTI I DATE 6/ 2 3 / 8 1 PAGE

NAME ______________________TELEPHONE_____________

a W8- 33

.. .. .. . . . . .
TRAINING METHODS WORKSHEET #2

HSECOND EXAMPLE

HPF

Enter the percentage of each of

the following skills required for the

performance of HPF above.

The performance of all skills must sum

to 100. % REQUIRED

SKILLS FOR PERFORMANCE

KNOWLEDGE do

UNDERSTANDING 0

VERBAL!WRITEN

PSYCHOMOTOR

PERCEPTION 4O

* DECISION MAKING cl 0

SUM / 00

"4,

SYSTEM Mercury Air Defense Weapon System TESTOTI I DATE 6/25/81 PAGE

NAME TELEPHONE

W8-34
TRAINING METHODS WORKSHEET #3

F1RXIS SECOND EXAMPLE

rHPF SKILLS

0 z z

LL 0 ! Q I. - <

TRAINING~~ MEHD ~ ~ 2 

ORAL/WR~~~F~EN DRL/RCTC t

EXPERT DEOSRTINVSA AIDS.

GRAMES MTOD

SIMULATN RL/RCIE14 1

HANDCONURACIERA ADWR _ __

RADIN EXT

SYSET EMONercuAIONIS DefeSWpnSytm TTOTIDAE/7/1PG

NRAM E INSTRUCTION__________________TLEHN

GAMES5 -

. .. . . . . . .. . . . . . . . . . . . .

HAD ON PATC REA HARDWARE-
H RTES TRAINING METHODS WORKSHEET #1

/HPFO SKILLS

0

CD z 6-z

CD z <

0 z

> L0

ORAL! WRIFTEN DRILL/PRACTICE

LECTURE

4 INDIVIDUAL DISCUSSION

GROUP DISCUSSION

READING TEXTS

EXPERT DEMONSTRATION/VISUAL AIDS

PROGRAMMED INSTRUCTION

GAMES

SIMULATION

* HANDS ON PRACTICE - REAL HARDWARE

SYSTEM _________________________TEST-__ DATE _______PAGE

NAME ________________________TELEPHONE______________

WB-36
* HRTES TRAINING METHODS WORKSHEET #2

HP11

Enter the percentage of each of

the following skills required for the

performance of HPF above

The performance of all skills must sum

to 100 % REQUIRED

SKILLS FOR PERFORMANCE

- KNOWLEDGE

UNDERSTANDING

VERBAL/WRITTEN

PSYCHOMOTOR

PERCEPTION

DECISION MAKING

sum

[. SYSTEM _________________________TEST____ DATE _______PAGE

NAME -- _ _ _ ______ --- TELEPHONE.__-________

w8-37
"H RTES TRAINING METHODS WORKSHEET #3

HPF SKILLS

C z " 0 Sz2

0J z U, z Lu En > Lu ,,

TRAINING METHODS l D > a. a.

ORAL/WRITfEN DRILL/PRACTICE

LECTURE

INDIVIDUAL DISCUSSION

GROUP DISCUSSION

READING TEXTS

EXPERT DEMONSTRATION/VISUAL AIDS

PROGRAMMED INSTRUCTION

GAMES

SIMULATION

HANDS ON PRACTICE - REAL HARDWARE

CORRELATION 1 SUM OF COLUMN

COEFFICIENT m J % OF HPF INVOLVING SKILL

INDEX OF

ADEQUACY L j

SYSTEM TEST- DATE __,PAGE

NAME TELEPHONE

W8-38

-" j- h : .N. , * . . . . .
HRTE5 UTILITY ESTIMATE WORKSHEET

Estimate the utility of each listed

Training Method in the matrix below

for the training of each skill, according to the current technology. Your SKILLS

Utility ratings should fall between 0

and 1 . Zero means that this method

has absolutely no utility for training this

skill. 1.0 means that this method is the

best possible for training this skill. The

Utility ratings do not have to sum to 1.0

for a given skill. (S

Return to sender upon z "' 0

completion. z & 0 <

0 0

<<

, O Z C 0: W C10 >. LU U'

TRAINING METHODS Z Z > CL

ORAL/WRITTEN DRILL 'PRACTICE

4LECTURE

INDIVIDUAL DISCUSSION

GROUP DISCUSSION

READING TEXTS

EXPERT DEMONSTRATION/VISUAL AIDS

PROGRAMMED INSTRUCTION

GAMES

SIMULATION

HANDS ON PRACTICE - REAL HARDWARE

I.

SYSTEM TEST - DATE PAGE

NAME W8-39 TELEPHONE
HRTES

TRAINING MEASURE #4

MEASURE OF THE ADEQUACY OF OPERATIONAL TEST TRAINERS

DESCRIPTION: One of the major variables of training which can produce

sub-criterion performance of a Human Performance Function (HPF) is inadequate trainer functioning. Trainers' styles vary considerably. This

variation makes it difficult to take meaningful measures of trainer

functioning by observation. Two other alternatives remain:

(1) measuring attitudes toward trainer performance (carried

out in HRTES questionnaires); and

4 (2) measuring and evaluating trainer background experiences.

This latter measure is based on the supposition that the level of a trainer's

bakcground will have a significant effect on ability to effectively train

an HPF.

In this measure, you develop a list of background experiences which are

desirable for training an HPF which is being diagnosed. You, or some other

training expert you select, rates each of these background experiences on

a utility scale. You also determine, or obtain, estimates of the minimum

amount of time required for each of these background experiences. You

then determine which of these background experiences the appropriate

trainer(s) had and the amount of time for each one. Finally, you compare

actual trainer experiences with those which were selected as being

desirable for training the given HPF.

PROCEDURE:

(1) Make one copy of the "Index of Trainer Adequacy Worksheet,"

page W8-43, for each HPF to be diagnosed using this measure.

The rest of these procedures apply to only one HPF at a time.

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W8-40
HRTES

However, much of the information developed for the first HPF

should be applicable to all the others being diagnosed.

(2) In the first column of the worksheet, list the specific background experiences which a trainer should have to effectively

train the HPF being diagnosed. This should include: experiences

as a trainer, if any; specific operational or maintenance

experiences, if any; specialties held, if any; and educational

experiences, if any.

(M' For each background experience listed estimate the minimal

* amount of time required in the second column of the worksheet.

4 These amounts of time should be listed as months.

(4) Rate each listed background activity on the following scale.

Select any number from 0-100. It is understood that since

you have already stated that these activities are required,

you will never rate any of them "10.2 The lower anchors of

this scale are presented to make clearer the meaning of the

scale. When you have rated a given background activity record

the rating in the third column of the worksheet.

* ABSOLUTELY

NONE MODERATE REQUIRED

1 25 50 75 100

No utility for Moderately useful for Absolutely required

training this HPF training this HPF for training this

HPF

(5) Multiply the time and utility weight of each background

experience. Record the resulting prdouct in the fourth column

of the worksheet.

(6) Add the products in the fourth column of the worksheet, and

record the resulting sum in the Sum (A) box of the worksheet.

SYSTEM _________________________TEST____ DATE _______PAGE

NAME TELEPHONE______________

W8-41
-- 

 

 

 

WW O R R90

-~~~ "'1- . 77NJVrw - *

HRTES

(7) Determine if the trainer(s) of the HPF being diagnosed

had each of these background experiences (or others which

were functionally identical). If the trainer(s) did not

have a given experience, record a zero. If a trainer

did have an experience, determine how many months were

devoted to it. If more than one trainer trained the

personnel, who performed this HPF inadequately, compute

th e means of the months of the experiences. If the actual

trainer time for any given background experience is

greater than the minimum acceptable ti me (which has been

recorded), record the minimum acceptable time. Do not

record the actual trainer time. Without this truncation

it would be possible for large amounts of experience in one

S. area to entirely obscure a total absence in another. If

the actual trainer time is less than the minimum acceptable

time, record it directly.

(8) Multiply the utility weight of each background experience

(from the second column) by the actual trainer time of that

experience (from the fifth column). Record the resulting

products in the sixth column of the worksheet.

(9) Add these products, and record the resulting sum in the

Sum (B) box on the worksheet.

(10) Divide Sum (B) by Sum (A). Multiply the resulting quotient

by 100. Record the resulting product in the Index box of

the worksheet. This is the Index of Adequacy of Trainer

Background for the HPF. If the trainer's background is

entirely appropriate for training this HPF, the Index will

be approximately 100. The less adequate the background,

4 the further the Index will be below 100.

SYSTEM _________________________TEST____ DATE _______PAGE

NAME TELEPHONE__________

W8-42
INDEX OF TRAINER ADEQUACY WORKSHEET

HRTI HPF

TRAINER

BACKGROUND EXPERI ENCE TIME WEIGHT PRODUCT TIME PRODUCT

SUM (A) SUM (B)

SUM (A) I

SUM(B) INDEX

SYSTEM TEST_ DATE ,PAGE

NAME TELEPHONE

W8-43
UDTC~SUMMARY WORKSHEET FOR TRAINING DIAGNOSIS

HRTES

HPF:

CONDITIONS (If applicable):

. SPI:

SYSTEM FUNCTION :

EXP TRAINING

SPECIFIC TRAINING PROBLEMS TRAINING MEASURE OR INDEX OF

CONTRIBUTING TO INDICES INDICES OF ADEQUACY QUEST ADEQUACY

I TRAINING TIME

ALtOCAT ION

2 PRACTICE CONDITIONS

ADEQUACY

D -TRAINING

3 TRAINING METHODS

ADEQUACY

4 OT TRAINER

ADEQUACY

SYSTEM TEST__ DATE PAGE

NAME --- TELEPHONE

-WB-44

, :','- ..v :'. -.... ,,-., '.- ., ,, , - . .-. -.. ".... "..- . ... . ....- .. . . .. .. . . .". . ..'. ', .. ,...9 , ".." ..." --.
LEN GENERAL INSTRUCTIONS FOR HUMAN FACTORS

EH E E S ENGINEERING (HFE) MEASURES

DESCRIPTION: An operational test (OT) has been completed recently.

For the specifics of this OT, see "FHPF Diagnostic Worksheet," page W8-4

of this submission. Various operator and maintainer tasks were measured

during this OT. One or more of these tasks was evaluated as having been

performed inadequately. In the Human Resources Test and Evaluation System

(HRTES) operator and maintainer tasks have been defined at a general level

which is not aependent upon the specific types of equipment involved. To

avoid confusion with traditional tasks they have been named Human Performance

Functions (HPF's). The "HPF Diagnostic Worksheet" on page W8-4 that lists

the specifics of the operational test also lists the HPF's which were

performed inadequately.

4

Operational testing and evaluation personnel have determined that those

HPF's that are listed are of significant importance to the overall evaluation of the system that was tested. They need to know why these HPF's

were performed inadequately. One possible reason is that the human-machine

interface, or the actual procedure itself, was inadequate in some way, and

this inadequacy was a cause of the level of performance. To aid in determining if this was the case, HRTES contains the following HFE measures:

" MEASURE NAME MEASURE FUNCTION PAGE

W8:

1. Understandability of Procedure Adequacy of complexity of HPF 54-57

procedure.

2. Difficulty of Decisions Difficulty of making decisions 58-66

required by HPF.

3. Display Information Adequacy Presentation of required infor- 67-71

and Timeliness mation on time by displays used

in HPF.

4. Display Readability/ Adeauacy of presentation charac- 72-77

Hearability teristics of information

required ir HPF.

SYSTEM TEST__ DATE PAGE

NAME ____ _ TELEPHONE W8-45
HRTES

MEASURE NAME MEASURE FUNCTION PAGE

'.. W8:

" 5. Display Information Under- Understandability of information 78-82

standability required for HPF as presented by

displays.

6. Control Accessibility Accessibility of controls or 83-86

other equipment manipulated in

HPF performance.

7. Control Static Charac- Adequacy of control characteristics 87-91

teristics other than those for actual manipulation or accessibility (includes

4any equipment to be manipulated in

HPF performance.

8. Control Dynamic Adequacy of control manipulation 92-96

Characteristics characteristics (includes any

equipment to be manipulated in HPF

performance

9. Workstation Dimensional Adequacy of physical dimensions of 97

Characteristics the workstation for HPF performance

(does not include seat dimensions

or dimensions involved in control

accessibility.

10. Workstation Seating Adequacy of seating dimensions and 98

Characteristics other related characteristics for

HPF performance.

11. Workstation/Environment Adequacy of workstation charac- 99

Visual Characteristics teristics which affect vision both

within and outside the workstation

for HPF performance.

12. Workstation/Environment Adequacy of workstation and environ- 100

Sound Characteristics mental sound characteristics which

affect HPF performance.

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W8-46
HRTES

PAG

MEASURE NAME MEASURE FUNCTION W8:

* 13. Workstation ..... Motion Adequacy of workstation motion 101

Characteristics characteristics which affect

HPF performance.

14. Workstation/Environment Adequacy of workstation/environ- 102

Ventilation Characteristic! ment ventilation characteristics

which affect HPF performance.

15. Workstation/Environment Evaluation of safety hazards which 103

Safety Characteristics might affect HPF performance. From

16. Workload Adequacy of workload during the Question

• ', n a ires

performance of the HPF being

diagnosed.

This section includes a set of "General Procedures" which applies to all

of the listed HFE measures. Each of the first 8 measures has its own

specific procedures which accompany the measure worksheet. Measures 9-15

have a common set of procedures. These procedures apply to each of these

measures. They are listed in this section and are entitled "Common

Procedures for Measures 9-15." Measure 16, "Workload" is entirely based

on the "Workload Scale" found in the "Opinion Summary Data Worksheet" for

the HPF being diagnosed.

Your first problem will be to decide which of these measures to take of each

HPF. During the OT, players and observers filled in questionnaires in which

they gave their opinions of the difficulty of each HPF and the reasons for

significant difficulty. If the questionnaires indicated significant diffi-

- culty, they were reduced and used to fill out an "Opinion Summary Data

Worksheet." Scales 1-16, and scale 21 of this worksheet correspond to the

. 1..HFE measures listed earlier. If any player or observer thought that

performing a given HPF was difficult and that HPF is one of those being

diagnosed now, you will have an "Opinion Summary Data Worksheet" for it

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE_

WB-47
HRTES

with this submission. In this case, the scale scores listed may be helpful

to you in deciding which HFE measures to take. If a score indicates

significant difficulty (50 or below) it is reasonable to take the corresponding HFE measure for that HPF. It is, of course, possible that players

and observers were not able to judge whether there was something which was

inadequate and produced inadequate HPF performance. Therefore, these scores,

if they are available, can only be a guide for you to use as you think best.

However, it is possible that the players and observers did not believe that

an HPF was difficult. In these case, you will have no "Opinion Summary

Data Worksheet" for that HPF, and you will have to fall back on your own

resources to decide which of these measures to take.

In addition to the "Opinion Summary Data Worksheets," this submission should

include a copy of the "Summary Worksheet for HFE Diagnosis" that will be

described in the following general procedure, and a copy of the previously

described "HPF Diagnostic Worksheet."

-- GENERAL PROCEDURE (APPLIES TO ALL HFE MEASURES):

(1) Read through the specific instructions for the HFE measures,

and familiarize yourself with their worksheets.

(2) Examine the "HPF Diagnostic Worksheet" to familiarize yourself

with information about the OT and the specific HPF's that are

to be diagnosed.

(3) Examine the "Opinion Summary Data Worksheet" for each HPF (if

there is one). Use their scores as an aid to selecting

parallel HFE measures. If you do not have one or more such

worksheets. use your best judgment for deciding which measures

to take of each HPF.

SYSTEM TEST__ DATE ,_ PAGE

NAME TELEPHONE 4 W8-48
HRTES

(4) When you have finished taking the measures you have selected

for each HPF, make as many copies of the "Summary Worksheet

for the HFE Diagnosis" as you need for the HPF's you have

diagnosed (one per HPF).

(5) Fill in the information at the top and extreme bottom of

each worksheet.

(6) Record the specific HFE indices of adequacy for the measures

you have taken for each HPF being diagnosed. This is to be

done in the appropriately labeled boxes on the worksheets.

* (7) If you have not taken a specific HFE measure for a given HPF,

and if you have an "Opinion Summary Data Worksheet" for that

HPF, use the appropriate questionnaire scale score as an

Index of Adequacy. In the case of "Workload," this will

always be the case. Record the questionnaire based score(s)

in the appropriate labeled box.

(8) If you have not taken a specific HFE measure for a given

HPF, and if you do not have an "Opinion Summary Data Worksheet"

for that HPF, record an "X" in the appropriate box.

(9) Next to each specific index of adequacy record an "EXP" or

"QUEST" in the third column of the worksheet. "EX" is

recorded next to an Index which was based on an expert measure

you have taken. "QUEST" is recorded next to an index which

was based on a questionnaire scale from the "Opinion Summary

Data Worksheet" for that HPF.

(10) Record the specific HFE problem(s) which caused any specific

index of adequacy to be significantly below 100. This is to

be done in the first column of the worksheet. If necessary,

SYSTEM TEST DATE PAGE

NAME WS-49 TELEPHONE

Wa- 49
HRTES

append an addition sheet for this explanatory purpose, and

reference it in the first column.

(11) Compute the means of the specific indices of adequacy according

to the branching structure on the worksheet. Means are to be

computed of Indices: 1 + 2 + 3 + 4 + 5 + 6 + 7 + 8 + 9 + 10 +

11 + 12 + 13 + 14 + 15. Measure 16, Workload, is simply

* transfered to the next box. If you have recorded an "X" in

any box, leave it out of the computation. Record the resulting

means in the appropraite boxes for Collective Indices.

(12) If all of the specific indices are absent, for a given

collective index, record an "X" in the box for that

collective index.

(13) Compute the mean of the collective indices. If you have

recorded an "X" in any collective index box, leave it out

of the computation. Record the mean in the Human Factors

Engineering Box at the extreme right of the worksheet.

(14) When you have completed the HFE measures and the "Summary

Worksheet for HFE Diagnosis" return all materials to the

sender.

COMMON PROCEDURES FOR MEASURES 9 THROUGH 14:

(1) Make sufficient copies of the Measure Worksheet so that you

have one for each HPF to be diagnosed.

(2) Study the characteristics listed on the worksheet. If you

think that a significant characteristic is missing, add it

in the "Other" category.

SYSTEM TEST_ DATE .,_PAGE

NAME W8-50 TELEPHONE

*~~~~~~~ z>~~ '** * ***
HRTES

(3) Decide If each characteristic on the worksheet is relevant

to the performance of the HPF being diagnosed in this system.

If it might have a significant effect on HPF performance in

* this system, it is relevant. In this case, record an "1X1 in

the appropriate ceil of the Relevance Column. If a characteristic is not relevant, record a "10" in the cell.

(4) Rate each characteristic that you have selected on the

criticality scale which follows. Select any rating from

1-100. Record the ratings in the appropriate cells of the

Rating Column.

LOW CRITICALITY MODERATE CRITICALITY HIGH CRITICALITY

1 25 50 75 100

Just important enough Criticality moderate Criticality

to be measured. Criti- for this HPF. extremely high

cality low for this HPF. for this HPF.

(5) Obtain appropriate measurements of each characteristic you

4. have selected. This may be done in the following ways:

(a) Obtaining appropriate measurements from previous

OT's, DT's, HFE tests, or other reasonably reliable

sources;

(b) Physical ly taking the necessary measurements from

the actual system;

(c) Taking some version of the necessary measurements from

system documentation.

(6) Compare each measurement with the standard or specification

which applies to it. This may be done in the following ways:

SYSTEM _________________________TEST____ DATE _______PAGE

NAME TELEPHONE

W8-51
HRTES

(a) Comparison with reasonably valid specifications such

as those found in MIL STD-1472, HEDGE, and HFTEMAN--

this is, of course, preferable.

(b) Evaluation based on expert judgment--in the absence

of an applicable standard, your judgment may be

substituted.

(7) If a given characteristic meets its standard, record a

"1" in the appropriate cell of the 0/1 column. If it

does not meet its standard (or your judgment), record a

"0" in this cell.

(8) Record the source of each comparison in the appropriate

cell of the Source Column. This should be information

as to the source of the measurement itself and the standard.

If there is insufficient space to record all the required

source information, append a page and use the space to refer

to it.

(9) Multiply the 0 or I for each characteristic by the 1-100

rating of its criticality. Record the resulting products

in the appropriate cells of the Product Column.

(10) Add all the products, and record the resulting sum in

the Product Sum Cell.

(11) Add all the 0 or 1 ratings in the Rating Column, and record

the resulting sum in the Rating Sum Cell.

(12) Divide the Product Sum by the Rating Sum, and multiply the

resulting quotient by 100. Record the resulting product

in the Index Cell. This is the Index of Adequacy for this

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W8-52
VW

HRTES

measure. If the measures of the significant characteristics

just met their standards, the Index would be approximately

100. The less adequate the characteristics that are measured,

considering their criticality, the farther below 100 will

be the Index.

.,

C

SYSTEM ,_TEST_ DATE PAGE

NAME TELEPHONE

W8-53
HRTES

HFE MEASURE #1

UNDERSTANDABILITY OF PROCEDURE

DESCRIPTION: When an HPF has been performed inadequately, one possible

cause is that its procedure was too difficult for the performers. This

measure requires an analysis of the performance of the HPF being diagnosed

into its component performance elements. These elements are then used as

the basis for a multi-attribute rating process. Therefore, to use this

measure, one must either fully understand the procedure for this HPF, or

have access to an individual who understands it and will decompose the

procedure into its elements for you.

PROCEDURE:

(1) Make sufficient copies of "Procedure Understandability

Worksheets #1 and #2" for the HPF's to be diagnosed (pages

W8-56 and W8-57.

(2) Flll in the background data on each worksheet. The rest of

these procedures will apply to only one HPF.

(3) On Worksheet #1, list the elements required to perform the

HPF being diagnosed. These elements should be analyzed to

the smallest level of detail possible. This analysis should

be made for the specific system tested in the OT.

(4) On Worksheet #1, specify the sequence of performance of the

listed elements. This is done by recording sequence numbers

in the appropriate Performance Sequence Cells of the worksheet

(first element performed is numbered 1, etc.). In general,

these sequence numbers should be recorded in the left-hand

column under the heading, "Performance Sequt'nce." However,

SYSTEM TEST___ DATE PAGE

NAME TELEPHONE ~W3-54
HRTES

sometimes an element may be performed more than once in an

HPF procedure. In this case, record the second sequence number

for that element in the next column, the third number for that

element in the third column, etc. If two elements are performed

at the same time, give them the same sequence number.

(5) When you have finished recording the elements and their sequence

numbers, add the total number of elements. Record the sum

in the box at the bottom of the worksheet.

(6) On Worksheet #2, rate the HPF procedure which you have analyzed.

Use all three scales, and assign any rating from 0-100 to

each. Record the three ratings in the appropriate boxes of

this worksheet. Two of the three scales are based on the

material you developed in Worksheet #1.

(7) Compute the mean of the three rating scales, and record it

In the Mean Box at the top of Worksheet #2.

SYTMTS - AEPG

NAETLEHN

W85
33 PROCEDURE UNDERSTANDABILITY

HRTESWORKSHEET #1

HPF:

PERFORMANCE

ELEMENTS REQUIRED FOR HPF PERFORMANCE SEQUENCE

SYSTEM~ TET DAT PAGE

NAE ELPHN

WB-5

.6 A
PROCEDURE UNDERSTANDABILITY

WORKSHEET #2

HPF:

Assign a rating of 0-100 to each of the following attributes of understanding of procedures for the HPF listed above.

MEAN RATING = 7

(INDEX)

1. What is the degree of similarity between the procedure for performing

this HPF and the procedure for a similar HPF which the OT participants

have actually performed, previously?

0 25 50 75 100

. Totally unrelated Moderately related to 100% identical to

to any previous a previously performed previous procedure

procedure. procedure.

2. What is the effect of this HPF's number of elements (shown on the

proceding worksheet) on the difficulty of understanding the procedure?

0 25 50 75 100

Number so large, it Number of elements This number of

makes understanding produces moderate elements would not

impossibly difficult. difficulty in under- increase the understanding procedure. standing difficulty

at all.

3. What is the effect of the complexity of the sequence of performance

of the HPF elements (shown on the preceding worksheet) on the difficulty of understanding the performance? 1-7

0 25 50 75 100

Sequence so complex, Sequence complexity Sequence sosimple

understanding of perfor- produces moderate and linear would

mance is impossible. difficulty in under- not increase under

standing procedure standing difficult

at all.

SYSTEM TEST_ DATE __PAGE

NAME TELEPHONE - W8-57
tV -

HRTES

HFE MEASURE #2

DIFFICULTY OF DECISIONS

DESCRIPTION: One possible cause of inadequate HPF performance is that

* the required decisions were too difficult for the performers. This measure

requires an analysis of the HPF being diagnosed into its decisions and those

decisions into their alternative responses. These decisions and responses

are then used as a basis for a multi-attribute rating process. Therefore,

to use this measure one must either fully understnad the HPF in the system

that was tested, or have access to an individual who does.

PROCEDURE:

(1) Make sufficient copies of "Decision Difficulty Rating

Worksheet #1 and #2" for the HPF's to be diagnosed (pages

W8-61 and W8-66

(2) Fill in the background data on each worksheet. The rest of

these procedures will apply to only one HPF.

(3) On Worksheet #1, list all the decisions which must be made

to perform this HPF in this system. Then list them on

Worksheet #2.

(4) On Worksheet #1, for each listed decision, record the

realistic alternative responses. These are the actual

outcomes among which the individual making the decision

must choose.

(5) On Worksheet #1, for each decision, add the total number of

alternative responses, and record the resulting sums.

SYSTEM TEST__ DATE ._PAGE

NAME TELEPHONE

1Wa-58
HRTES

(6) On Worksheet #1, add the total number of decisions required

for the performance of the HPF, and record the resulting sum in the box at the top of the first page of the worksheet.

(7) On Worksheet #2, apply "Rating Scales for Decision Difficulty

Worksheet #2" to the material you have developed on Worksheet

#1. The first scale of the Rating Scales applies to all

decisions required for the HPF taken together. Record your

rating for this first scale in the Rating for Scale One box

at the top of Worksheet #2. All other rating scales apply to

each decision listed on Worksheet #2. So, apply each rating

scale (from 2-4) to each listed decision, and record the

resulting ratings in the appropriate cells of Worksheet #2.

(8) On Worksheet #2, for each decision, add the ratings of all

scales plus the rating of scale one (scale one rating is

located in the box at the top of the worksheet). Record the

-: resulitng sums in the appropraite cells of the left-hand

column of the worksheet.

(9) Add all the sums in the left-hand column of Worksheet #2.

Divide this grand sum by the total number of decisions

(from Worksheet #1) multipled by six (the number of rating

scales). Record this mean rating in the appropriate box at

the bottom of Worksheet #2.

(10) For clarity, the rating scales of this measure were designed

so that the higher the rating the greater the difficulty.

To make the Index of Adequacy comparable to other Indices,

this direction must be reversed. Therefore, the final step

in this computation Is to subtract the product computed in

step 9 from 100. Record the resulting number in the Index

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

X4W8-59
HRTES

Box on the bottom of Worksheet #2. If this Index of

Adequacy is approimately 100, decision difficulty for the

HPF is entirely adequate. The farther below 100 In this

Index, the less adequate is decision difficulty.

SY'M______________________ TEST____ DATE ______PAGE

NAME_____________ TELEPHONE____________

W86
I..ID1~~DECISION DIFFICULTY RATING

HRTEWORKSHEET #1

HPF:

First, list all the types of decisions which must be made to perform the

HPF above in this system. Second, for each type of decision listed,

specify alternative responses among which each decision selects. Third,

record the total number of decisions required for this HPF and the number

of alternative responses for each decision. Fourth, complete the rating

scales, on the attached worksheet, which apply to the information you

have just developed. If there is insufficient space on this worksheet,

A photocopy it.

TOTAL NUMBSER OF DECISIONS REQUIRED FOR HPF: LI

DECISIONS REQUIRED FOR HPF ALTERNATIVE RESPONSES TO EACH DECISION

'SUM

SUM

SUM=

SYSTEM _________________________TEST____ DATE _______PAGE

NAME TELEPHONE_______________

WB-61
DECISION DIFFICULTY RATING mu E WORKSHEET #1 (CONTINUED)

DECISIONS REQUIRED FOR HPF ALTERNATIVE RESPONSES TO EACH DECISION

-SUM

SUM =

SUM =

SUM =

v , SUM

SYSTEM __TEST__ DATE PAGE

NAME TELEPHONE__ _ W8-62
DECISION DIFFICULTY RATING HRTESWORKSHEET #1 (CONTINUED)

DECISIONS REQUIRED FOR HPF ALTERNATIVE RESPONSES TO EACH DECISION

SUMSUMSUM

SUM

SYSTEM _________________________TEST- DATE _______PAGE

NAME -TELEPHONE_______

34. - ~ %~'WB-63
RATING SCALES FOR DECISION i-1i-~I~~ DIFFICULTY WORKSHEET #2

HPF:

Rating scale number one applies to all decisions required for this HPF,

taken together. All other rating scales apply to each required decision,

independently. Recrod your rating from the rating scale number one in

the box at the top of Worksheet #2, and all other ratings in the appro-

* priate cells of the worksheet.

1. How difficult would it be to make the number of decisions required

for the performance of this HPF in this system?

0 25 50 75 100

No difficulty Moderately So difficult

at all. difficult. that it could

not be done.

2. How significant would this decision be when made as part of the HPF

in this system?

0 25 50 75 100

No significance Moderately Extremely signiat all. significant. ficant. Affects

mission success,

system survivabilIity.

3. Under realistic conditions, how much time will be likely to be

available to make this decision and still permit the HPF to be

performed successful ly?

0 25 50 75 100

Time is not an issue Moderate amount of Only a very

at all. Any amount 

time can be taken 

small amount of

SYSTEM ________________________TEST____ DATE _______PAGE

WB-64
iirn~RATING SCALES

WORKSHEET #2 (CONTINUED)

4. To what extent is this decision irreversible if made during the

performance of this HPF in this system?

0 25 50 75 100

Not an issue. Small number of Irreversibility

Decision may be reversals possible. total. Decision

reversed as many must stand asmade.

times as desired.

5. How difficult would it be to make this decision considering the

number of alternative responses possible?

0 25 50 75 100

No difficulty Moderately So difficult that

at all. difficult. this decision

could not be made

successfully.

6. How similar are the alternative responses which must be considered

in making this decision?

0 25 50 75 100

No similarity at Moderately Responses are

all. Responses similar. extremelysimilar.

are completely Hard to separate.

different from

each other.

SYSTEM TEST- DATE PAGE

NAME TELEPHONE __

W8-65?
- - -. -. -- - - - -. w - .- '.,--

H R T E 5 DECISION DIFFICULTY WORKSHEET #2

HPF:

RATING FOR SCALE ONE:<zli- <

z

0u <j LJ Cl)

z -i

< ..

->. LUJ c +

NAETEEHOE.

I8-6

GRAND SUM:

GRAND SUM 100

TOTAL # OF DECISIONS X 6 =L.. NE FAEUC

SYSTEM ______________________ ___TEST -__ DATE _______PAGE

NAME TELEPHONE__________

W8-66
HRTES

HFE MEASURE #3

ADEQUACY AND TIMELINESS OF DISPLAY INFORMATION

DESCRIPTION: One possible cause of inadequate HPF performance is that

required information was not available in time for its use. This measure

requires the identification of the information required for the performance

of the HPF being diagnosed. In addition, it requires the judgment of

whether each piece of required information is time sensitive. If a piece

of information is so judged, it then requires the judgement of the maximum

*length of time that can occur before the useful appearance of that

information. Therefore, to use this measure, one must thoroughly understand the information requirements for the HPF, have access to detailed

documentation about these requirements, or have access to an individual

who thoroughly understands these requirements.

PROCEDURE:

(1) Make sufficient copies of "Display Information Adequacy and

Timeliness Worksheet" (p. W8-71) for the HPF's to be diagnosed.

(2) Fill in the background data on each worksheet. The rest

of the procedures will apply to only one HPF to be diagnosed.

(3) Record all the information which is absolutely required for

the successful performance of the HPF being diagnosed. This

includes information which would be produced visually or

auditorily. It does not apply to one display only. It applies

to all the displays which produce such required information.

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

4.4. . .*~4 WB-67 .. .
- - - - - - - - - - - - - - - - . .- 

WWI 

HRTES

(4) Next, deter-mine if each piece of listed information is

time sensitive and if the display which produces that

information could be a significant factor when the information was presented. For example, target range may be a

piece of information which is absolutely required. Further,

it is likely to be time sensitive. However, if it is produced

by a radio, the radio cannot affect presentation time

(except by malfunctioning). In this case, target range

produced by radio would not meet the time sensitivity

criteria.

(5) For each recorded information requirement that meets both

of these criteria, record an 11X" In the appropriate cell

of the X Column.

(6) For each information requirement with an adjacent "X"

estimate the maximum length of time permissible between

some fixed point in time and the appearance of that

information. Frequently, the fixed point in time will

be the start of the HPF. However, it really depends upon

the data available.

(7) Record each permissible time in the appropriate cell of

the Time Column. It is possible that it will be impossible

to make certain time estimates. If this cannot be done,

replace its "X" with an

(8) Compare the information requirements listed on the worksheet

with the information actually produced by the display(s)

used in HPF performance. This may be done with the actual

physical equipment, or detailed specifications of that

4 equipment.

SYSTEM _________________________TEST____ DATE _______PAGE

rzNAME TELEPHONE____________

W8-68
HRTES

(9) If a given piece of required information is actually produced,

record a "I" in the appropriate cell of the 1/0 column. If

it is not produced, record a "0".

(10) For each piece of information that has both a "1" (from step

9) and an "X" (meaning it is time sensitive), determine the

length of time between the fixed start time (see step 6) and

the appearance of that information. If you are unable to

obtain this time data, record an asterisk "*" in the appropriate cell of the 1/0 TIME column.

(11) If a piece of required information appears on or before the

listed time limit, record a "1" in the appropriate cell of

the 1/0 TIME column. If it does not, record a "0".

(12) For each listed piece of required information, multiply the

contents of its 1/0 and 1/0 TIME Cells. An 1/0 Cell can

contain a "0", or a "I". An 1/0 TIME Cell can contain a "0"

a "I", an asterisk "*", or nothing. Clearly, you only multiply

zeroes and ones. For each piece of information, record the

product of multiplying the zeroes and ones in the appropriate

cell of the PRDCT column. If an 1/0 TIME Cell has an asterisk

or nothing as its content, record the content of the parallel

1/0 Cell in the PRDOT column.

(13) Add the contents of the PRDCT column, and record the resulting

sum in the Sum box at the bottom of the worksheet.

(14) Count the number of pieces of required information for the

HPF. Divide the number in the Sum box (from step 13) by the

total number of pieces of required information. Record the

resulting quotient at the bottom of the worksheet.

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

............................................
HRTES

(15) Multiply the quotient by 100, and record the resulting

product in the Index box at the bottom of the worksheet.

This is the Index of Adequacy of this measure. If it is

approximately 100, all required information is present and

has been presented soon enough to be useful. The further

below 100 this Index, the less adequate and timely the

information presented.

4

.6

SYSTEM TEST__ DATE ._PAGE

NAME TELEPHONE

W8-70 - , . . . .' ' ." ~ .','Z . .- '" ... ' . ,,' ... .' , . .' . " . . "... L . "/ :
DISPLAY INFORMATION ADEQUACY H R T E S AND TIMELINESS WORKSHEET

HPF:

INFORMATION WHICH IS ABSOLUTELY REQUIRED X /0TIME 10PRDCTS F 71/oTIME x 

kVSUM/# PIECES OF INFORMATION ____X 100 = ___INDEX

SYSTEM ________________________TEST____ DATE _______PAGE

NAME TELEPHONE_____ ______

W-71
HRTES

HFE MEASURE #4

DISPLAY READABILITY/HEARABILITY

DESCRIPTION: HFE Measure #4 (Adequacy and Timeliness of Display Information) results in a list of pieces of information which are both absolutely

required for HPF performance and presented by system display(s) in time to

to be used. Other information that is not absolutely required and that is

also presented by displays may have some utility for HPF performance.

However, such information is, by definition, not required for this performance. Therefore, the only significant reason for studying this nonrequired information is to determine the "clutter" and overload produced

by the display(s).

Even if required information'Is presented (and presented in time for use),

the nature of its presentation may vary in adequacy. If such Information

is presented, but in an entirely inadequate manner, It may be usable. The

nature of presentation is, therefore, a possible cause of inadequate HPF

performance.

This measure Is based on the list of Information developed in HFE Measure

#3. It includes three worksheets. Worksheet #1 provides a format for

assigning required pieces of information (from HFE Measure #3) to their

originating displays. This Is necessary since these pieces of information

are measured Independent of their displays in Measure #3. Worksheet #2

provides the format for measuring visual displays. Worksheet #3 provides

the format for measuring auditory dipslays. In both Worksheets #2 and #3,

the formats of required Information provided by a single display are rated,

measured, and compared to standards.

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

W8-72 . )
H RTES

PROCEDURE:

(1) Make sufficient copies of "Display Readability/Hearability

Worksheet #1"1 so that you have at least one for each HPF

to be diagnosed. It may be necessary to make more than

one copy per HPF, depending upon the amount of visual and

* auditory displays used.

(2) Fill in the background data on each worksheet.

(3) On each Worksheet #1 list all the visual and auditory

displays which produce required information for the

HPF being diagnosed. Also record the required information.

This information should be available from the completed

Measure #3.

(4) Record "X's" in the appropriate cells of Worksheet #1

to indicate the display(s) that produce each piece of

required information. The remainder of this procedure

applies to any single HPF being diagnosed.

(5) Examine your completed Worksheet #1, and determine how

many visual displays are listed. Make as many copies of

Worksheet #2 as you need for measuring visual displays

(one worksheet per display). Do the same for auditory

displays (copying Worksheet #3).

(6) Fill in the background information on each worksheet.

(7) For each Worksheet #2 and #3, apply the "Common Procedures

for Measures 9 through 14"1 found on page W8-50. Since

you have already made copies of the Measure Worksheets, LSYSTEM TEST - DATE PAGE

NAME TELEPHONE_____________

W8-73
HRTES

it is not necessary to respond to the first step of

the Common Procedures. When you apply the steps of the

Common Procedures for a given display, refer to your

"Display Readability/Hearability Worksheet #1." In general,

the characteristics being rated, measures, and compared

to standards should be applied to the Required Information

which that display produces. Therefore, keeping Worksheet

#1 in front of you should prove helpful in completing the

Common Procedures.

(8) If more than one display were rated in this Measure,

compute the mean of the various Indices of Adequacy which

resulted, and record this Mean Index in the appropriate

box of Worksheet #1.

.

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W8-74
U DFCCDISPLAY READABILITY/HEARABILITY

11 ESWORKSHEET #1

HPF:

CONDITIONS (if applicable):

IF MORE THAN ONE DISPLAY IS USED

FOR THIS HPF, RECORD MEAN INDEX Lo

OF ALL DISPLAYS IN BOX WHICH

FOLLOWS (COMPUTED FROM WORKSHEETS

#1 AND/OR #2):

MEAN READABILITY/HEARABILITY

INDEX FOR HPF: m ' LJ z

-j

REQUIRED INFORMATION FOR HPF

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

W8-75 - ., . , .,,. ., ....,, ,., . .- ,. o, ,., .. , . q- . , . - .- -. . . .. . . .- . . . . . . .. .. . . . .
D F "~ C DI SPLAY READABI LITY/HEARABI LITY HR E WRSHE #2 (VISUAL)

DISPLAY: __________________________________________

CONDITIONS (If applicable): _____________ _____________

CHARACTERISTICS m SOURCE

SIZE OF SYMBOL(S)

SHAPE/STYLE OF SYMBOL(S)____________

DEFINITION

BRIGHTNESS

FIGURE-GROUND CONTRAST

COLOR

4 ~~~~~~PLACEMENT OF SYMBOL(S)____________

MOTION (in relation to

realworld motion)- -

RESOLUTION

JITTER

GREY SCALE GRADATION

FLICKER FREQUENCY

SIGNAL TO NOISE RATIO

REFLECTIVITY

SIZE OF DISPLAY

VIEWING ANGLE

VIEWING DISTANCE

PLACEMENT

FUNCTIONAL CLUSTERING

OTHER:

RATING SUM: INDEX:

PRDCT

SLIM

SYSTEM TEST-...... DATE___________

NAME ____________________________TELEPHONE________________

WB-76
Li D F"~~ DISPLAY READABILITY/HEARABILITY

.'E Z WORKSHEET #3 (AUDITORY)

DISPLAY:

lIP F:

CONDITIONS: ,',.

LJ

" FCHARACTERISTICS " -"' " . a=SOURCE .

VOLUME

FREQUENCY RANGE

DYNAMIC RANGE

SIGNAL TO NOISE

RATIO -

HARMONIC DISTORTION

CLIPPING

DISCRIMINABILITY

ALERTING CAPABILITY

MASKING

SPURIOUS SIGNALOTHER:

RATING SUM: INDEX:

PRDCT

SUM

SYSTEM TEST__ DATE PA___

NAME TELEPHONE

W8-77

- - : , ' " , 'w" <, " ' " h - ", ," -''-'-" <'-, ./,-.:',:' ", ';- , ' ' "V'Q' '3" 
HRTES

HFE MEASURE #5

DISPLAY INFORMATION UNDERSTANDABILITY

DESCRIPTION: The purpose of this measure is to determine the adequacy

of that subset of a display(s) presentation of required information which

leads to the understanding of that Information. This is In some contrast

to HFE Measure #4 which deals with the subset of display presentation which

leads to perception of required information. Apart from this distinction,

this HFE Measure is basically quite similar to Measure #4. It can be used

without direct reference to the specific pieces of information which are

4required for HPF performance. However It should result in more valid and

reliable findings if It is based on a completed "Display Visibility/Hearability Worksheet #1" from HFE Measure #4. In this measure, you rate

display understandability on a multi-attribute scale, specific to each

HPF being diagnosed.

PROCEDURE:

(1) Make sufficient copies of "Display Information Understandability Worksheet" so that you have one for each HPF to

be diagnosed.

(2) Fill in the background on each worksheet. Further procedural

steps are for diagnosing one HPF.

(3) If you have completed HFE Measure #4,. retrieve the filled

in "Display Visibility/Hearability Worksheet #1."

(4) Record the names of the appropriate displays, used in

HPF performance.

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE L . W8-78
pHRTES

(5) Rate the understandability of the presentation of the

required information for each display on the six scales

found in "Rating Scales for Display Information Understandability Worksheet," (page W8-80.

(6) Add all ratings for each display, and record the resulting

sums in the appropriate cells of the Sum column.

(7) Divide each sum (from Step 6) by six--the number of scales

used. Record the resulting quotients in the appropriate

cells of the Sum/6 Column. These are the Indices of Adequacy

4for each display used in the HPF. If a given display was

completely adequate, its Index should be approximately 100.

The less adequate the display, the further below 100 will

be the Index.

(8) If an HPF used only one display, the measure will now be

complete. If the HPF used more than one display, compute

the mean of the Indices (from Step 7). Record this Mean

Index in the appropriate box at the bottom of +he worksheet.

w.

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

, WB-79
HRTnS RATING SCALES FOR DISPLAY INFORMATION

H S UNDERSTANDABILITY WORKSHEET

1. How adequate is the level of simplicity (as opposed to complexity)

of the vocabulary and/or symbols used by this display to impart

information for this HPF?

TOTALLY MODERATELY COMPLETELY

INADEQUATE COMPLEX ADEQUATE

0 25 50 75 100

So complex they May cause Should cause

will be impossible some problems. no difficulty.

to understand.

2. How unfamiliar is the vocabulary and/or symbology used by this display,

for this HPF, likely to be to the user population?

TOTALLY MODERATELY ADEQUATELY

UNFAMILIAR UNFAMILIAR FAMILIAR

0 25 50 75 100

No transfer of Some transfer Sufficient transtraining possible. fer of training

possible. should take place.

3. To what extent are the symbols and/or vocabulary used by this display,

for this HPF, similar to others, known by the users, but having a

different meaning?

TOTALLY MODERATELY COMPLETELY

CONFUSING CONFUSING ADEQUATE

0 25 50 75 100

Identical to other Moderate confusion Symbols/vocabusymbols/vocabulary, between this symbology/ lary either

but with a radically vocabulary and meaning adequately

different meaning. of similar one. different from

other, or with

adequateTy

similar meaning.

I

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

• -' -.-.-. ,-.- - "/. / .-" . " " , B- 80 -.- . . .. .- -.-. . ..-. . . -. . .
E.JDI'S RATING SCALES (CONTINUED)

4. How adequate is the total amount of information presented, at any

given time by this display, for the understanding of that information

for this HPF?

TOTALLY MODERATELY COMPLETELY

INADEQUATE INADEQUATE ADEQUATE

0 25 50 75 100

So much infor- Moderately understanable Understandable

mation presented amount of information amount of inforat once that it presented at one time. mation presented

cannot be understood, at one time for

or so little that understanding.

' Fe key relationships

* are lost.

5. How adequate is the amount of time in which required information is

presented by this display for this HPF, for the understanding of that

information?

TOTALLY MODERATELY COMPLETELY

INADEQUATE INADEQUATE ADEQUATE

0 25 50 75 100

Presentation time Presentation time a Adequate amount

totally much too little too short. of presentation

short, time.

6. How adequate was the rate of presentation of information by this

display, for this HPF, for the understanding of that information?

TOTALLY MODERATELY COMPLETELY

INADEQUATE INADEQUATE ADEQUATE

0 25 50 75 100

Presentation rate Moderately Inadequate Presentation rate

much to rapid. presentation rate. completely

adequate.

SYSTEM ___________________________TEST-___ DATE ________PAGE

NAME TELEPHONE______________

W8-81
DISPLAY INFORMATION ** .S UNDERSTANDABILITY WORKSHEET

HPF:

z z < Lu

X H 0

z m z L

Lu 0 I UJ )L -

xzL L/) C

- - IL x

C) Z I Lu

+ cn -- o -JJ (LI

"4".LL a-..

ii

SUM =

# OF DISPLAYS =

MEAN INDEX =

I liL I-I

SYSTEM TEST- _ DATE PAGE

1

". NAMEANELENDON

;% ..... wB-82

.. . . ........... . .. . .. - ', - :. ...... ' ' ..,- .": V''"""-,""" -. .''L-. . "- - • .
HRTES

HFE MEASURE #6

CONTROL ACCESSIBILITY

DESCRIPTION: If the performance of an HPF requires the manipulation

of a control (or some other piece of equipment), the adequacy of its

accessibility may affect that performance. The harder it is to access a

piece of equipment that must be manipulated, the greater the likelihood

that the manipulation may be ineffective. The first problem in the measure

is to identify those controls and other pieces of equipment that must be

manipulated for the adequate performance of the HPF being diagnosed. The

second problem is to determine whether each control or other piece of

manipulated equipment is adequately accessible to it user. Therefore, to

take this measure you must have access to the actual hardware, detailed

specifications of that hardware, or similar HFE tests results from an

earlier test.

PROCEDURE:

(1) Make sufficient copies of "Accessibility Adequacy Worksheet"

so that you have one copy for each HPF to be diagnosed.

(2) Fill in the background data on the worksheets. The remaining

procedures will be directed toward a single HPF.

(3) On the worksheet, list all the controls and other equipment

that must be manipulated for adequate performance of the

HPF being diagnosed. They should be listed at the most

detailed level possible (for example, remove screws A and B,

and then remove Component C).

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE

W8-83
4.

HRTES -. (4) If possible, after listing the control/equipment list

the title of the crew member who is supposed to perform

the manipulation and the hand or foot with which the

manipulation should be done.

(5) Either take appropriate accessibility measurements for each

control/equipment listed, or take measurements from detailed

specifications or previous tests. In this measure, accessibility is determined by:

(a) Reach distance;

(b) Diameter/circumference of restricted reach envelope;

(c) Reach angle to work location of appropriate individual;

(d) Absense or presence of potentially obscuring object(s)

or people.

(6) Compare each measure with its appropraite standard (from

MIL-STD-1472, HEDGE, HFTEMAN, etc.). In the absense of

such objective standards, you may substitute your expert

judgment, though this is substantially less desirable.

(7) If a given control/equipment meets all accessibility standards

(or your judgment) record a "I" in the appropriate cell of

the 0/1 column or the worksheet. If it does not meet all

such standards, record a "0".

(8) Record the source of your standard and measurement in the

appropriate cell of the Source column. If there is insufficient

space in a cell, record the source information on an appended

sheet, and reference it in the cell.

SYSTEM TEST__ DATE , _ PAGE

NAME TELEPHONE

W8-84
HRTES

(9) If a given control/equipment is given a "0", it is suggested

that you append a sheet, and describe the nature of the accsssibility problem in some detail on this sheet.

(10) Add the contents of the cells of the 0/1 column, and record

the resulting sum in the Sum box.

(11) Count the number of controls and pieces of equipment to be

manipulated for the HPF. Record this number in the # Controls/

Equipment box.

(12) Divide the sum by the number of controls/equipment, and

multiply the resulting quotient by 100. Record this product

in the Index box. This is the Index of Adequacy of Accessibility. If all controls and other equipment to be manipulated

are fully accessible, this index will be approximately 100.

The less adequate their accessibility, the further below 100

will be the Index.

SYSTEM TEST__ DATE PAGE

NAME TELEPHONE_

*, .~~:W8-85 1 
-~ ACCESSIBILITY ADEQUACY WORKSHEET

HPF: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

CONDITIONS:

CONTROLS/EQUIPMENT; JOB TITLE; HAND/FOOT 0/1 SOURCE

4

# CONTROLS/EQUIP sum1 1

INDEX

I

SYSTEM TEST_ DATE ,PAGE

NAME- TELEPHONE

W8-86
HRTES

~ HFE MEASURE #7

CONTROL STATIC CHARACTERISTICS

DESCRIPTION: in HRTES static characteristics, dynamic characteristics,

and accessibility have been separated into categories of measures of control

and other equipment to be manipulated. Static characteristics are those

that affect: location, identification, and individual activation of controls

or other equipment to be manipulated In the performance of an HPF that is

being diagnosed. When an HPF has been performed inadequately, one possible

cause is that the control(s) or other equipment which had to be manipulated

could not be: identified in time by touch or vision; or activated independently of adjacent controls. This measure uses the "Accessibility Adequacy

Worksheet" from HFE Measure #6. On this previous worksheet you identified

* those controls and other equipment to be manipulated for the HPF. These

same controls/equipment will now have their static characteristics measured

and compared to objective or subjective standards. The steps of this

measure are lreyidentical to those described in Common Procedures.

PROCEDURE:

(1) Make sufficient copies of the Measure Worksheet so that you

.. fthave one for each HPF to be diagnosed.

(2) Fill in the background data.

(3) Retrieve your completed copy of "Accessibility Adequacy

Worksheet" from HFE Measure #6, and copy the controls and

other equipment to be manipulated. If Measure #6 has not

been completed, you will have to develop this list now. It

consists of those controls and other pieces of equipment to

be manipulated in the performance of the HPF that are

absolutely necessary.

SYSTEM _________________________TEST____ DATE _______PAGE

NAME TELEPHONE______________

.~% - - - . ~ -S. - - - f
HRTES

(4) Study the characteristics listed on the worksheet. If you

think that a significant characteristic is missing, add it

in the "Other" category.

(5) For each control/equipment listed decide if each characteristic

on the worksheet is relevant to the performance of the HPF

being diagnosed in this system. If it might have a significant

effect on HPF performance in this system, it is relevant.

In this case record an "X" in the appropriate cell of the

Relevance row. If a characteristic is not relevant, record

a "0" in the cell.

(6) Rate each characteristic that you have selected for each

control/equipment on the criticality scale which follows.

Select any rating from 1-100. Record the ratings in the

appropriate cells of the Rating row.

LOW CRITICALITY MODERATE CRITICALITY HIGH CRITICALITY

1 25 50 75 100

Just important enough Criticality moderate Criticality

to be measured. Criti- for this HPF. Extremely high

cality low for this HPF. for this HPF.

(7) Obtain appropriate measurements of each characteristics you

have selected. This may be done in the following ways:

(a) Obtaining appropriate measurements from previous OT's,

DT's, HFE tests, or other reasonably reliable sources;

(b) Physically taking the necessary measurements from the

actual system;

(c) Taking some version of the necessary measurements from

system documentation.

69 SYSTEM ._TEST- DATE PAGE

NAME TELEPHONE

W8.._88
HRTES

(8) Compare each measurement with the standard or specification

which applies to it. This may be done in the following ways:

(a) Comparison with reasonably valid specifications such as

those found in MIL STD-1472, HEDGE, and HFTEMAN--this is

of course, preferable;

(b) Evaluation based on expert judgment--in the absense of an

applicable standard your judgment may be substituted.

(9) If a given characteristic meets its standard, record a "1"

in the appropriate cell of the 0/I row. If it does not meet

its standard (or your judgment), record a "0" in this cell.

(10) Record the source of each comparison in the appropriate cell

of the Source row. This should be information as to the

source of the measurement itself and the standard. If there

is insufficient space to record all the required source

information, append a page and use the space to refer to it.

(11) Multiply the 0 or I for each characteristic by the 1-100

rating of its criticality. Record the resulting products

in the appropriate cells of the Product row.

(12) Add all the products, and record the resulting sum in the

Product Sum Cells.

(13) Add all the 0 or I ratings in the Rating column, and record

the resulting sum in the Rating Sum Cells.

SYSTEM TEST- DATE PAGE

NAME TELEPHONE

W8-89 NAME- .
HRTES

(14) Divide each Product Sum ~yits Rating Sum, and multiply the

resulting quotient by 100. Record the resulting products in

the Control Index Cells. These are the Indices of Adequacy

for this measure of controls/equipment. If the measures of

the significant characteristics just met their standards, a

given Index would be approximately 100. The less adequate the

characteristics that are measured,- considering their criticality,

the farther below 100 will be the Index.

(15) Compute the mean of the Control Indices. Record it in the

Mean Index box of the worksheet. This is the Index of Adquacy

static characteristics of all controls and equipment to be

manipulated in the performance of the HPF being diagnosed.

SYSTEM _________________________TEST____ DATE _______PAGE

NAME TELEPHONE__ ______
H RTE STATIC CHARACTERISTICS WORKSHEET

HPFCONDITIONS (if applicable):

-j

CONTROLS AND OTHER EQUIPENT~

TO BE MANIPULATED FOR HARDWARE a

RELEVANCE

RATING

PRCT

RELEVANCE

RATING

PRDCT I

RELEVANCE

RATING

0/1

PROCT

RELEVANCE

RATING

PRDCT

RELEVANCE

RATING

' 0/1

PROCT

'- RELEVANCE

RATING

?' 0/1

PRDCT- - - - - -

RELEVANCE

RATING

0/1

PROCT

RELEVANCE

IATND G

O/I

,pp,

PRDCT

RATING

SOURCE

MEAN '

~INDEX

SYSTEM TEST - DATE PAGE -__

NAME TELEPHONE

WB-91

-- Al
HRTES

HFE MEASURE #8

CONTROL DYNAMIC CHARACTERISTICS

DESCRIPTION: In HRTES static characteristics, dynamic chracteristics,

and accessibility have been separated into categories of measures of controls

and other equipment to be manipulated. Dynamic characteristics are those

that affect control movement and sensing of that movement. This measure

uses either the "Accessibility Adequacy Worksheet" from HFE Measure #6, or

the "Static Characteristics Worksheet" from HFE Measure #7. On these previous Worksheets you identified those controls and other equipment to be

manipulated for the HPF. These same controls/equipment will now have their

dynamic characteristics measured and compared to objective or subjective

standards. The steps of this measure are identical to those in HFE Measure

#7 and similar to those described in Cormmon Procedures.

PROCEDURE:

(1) Make sufficient copies of the Measure Worksheet so that you

have one for each HPF to be diagnosed.

(2) Fill in the background data.

(3) Retrieve your completed copy of "Accessibility Adequacy

Worksheet" from HFE Measure #6, or "Static Characteristics

Worksheet" from HFE Measure #7. Copy the controls and other

equipment to be manipulated. If Measures #6 or #7 have not

been completed, you will have to develop this list now. It

consists of those controls and other pieces of equipment to

be manipulated in the performance of the HPF that are

absolutely necessary.

SYSTEM TEST - DATE ._PAGE

NAME TELEPHONE

w8-92 r :', '. 'Z .d¢.,t.# 11 w r'" I.. ",...,.,r'.:..: '.:-. ''..''."..'.' . / .'.'. .': ,".d, .A .,, 
HRTES

(4) Study the characteristics listed on the Worksheet. If you

think that a significant characteristic is missing, add it

in the "Other" category.

(5) For each control/equipment listed decide if each characteristic

on the Worksheet is relavant to the performance of the HPF being

diagnosed in this system. If it might have a significant effect

on HPF performance in this system, it is relevant. In this case

record an "X" in the appropriate cell of the Relevant Row. If

a characteristic is not relevant, record a "0" in the cell.

(6) Rate each characteristic that you have selected for each control/

equipment on the criticality scale which follows. Select any

rating from 1-100. Record the ratings in the appropriate cells

of the Rating Row.

LOW CRITICALITY MODERATE CRITICALITY HIGH CRITICALITY

1 25 50 75 100

Just important enough Criticality moderate Criticality

to be measured. Criti- for this HPF. extremely high

cality low for this HPF. for this HPF.

(7) Obtain appropriate measurements of each characteristic you

have selected. This may be done in the following ways:

(a) Obtaining appropriate measurements from previous OT's,

DT's, HFE tests, or other reasonably reliable sources.

(b) Physically taking the necessary measurements from the

actual system.

(:) Taking some version of the necessary measurements from

system documentat ion.

(8) Compare each measurement with the standard or specification

which applies to it. This may be done in the following ways:

SYSTEM TEST_ DATE PAGE

NAME TELEPHONE

W8-93
HRTES

(a) Comparison with reasonably valid specifications such

as those found in MIL STD-1472, HEDGE, and HFTEMAN -- this

is, of course, preferable.

(b) Evaluation based on expert judgement -- in the absence of

an applicable standard your judgement may be substituted.

(9) If a given characteristic meets its standard, record a "I" in

the appropriate cell of the 0/1 Row. If it does not meet its

standard (or your judgement), record a "0" in its cell.

(10) Record the source of each comparison in the appropriate cell

of the Source Row. This should be information as to the source

of the measurement itself and the standard. If there is insufficient space to record all the required source information, append

a page and use the space to refer to it.

(11) Multiply the 0 or I for each characteristic by the 1-100 rating

of its criticality. Record the resulting products in the

appropriate celIs of the Product Row.

(12) Add all the products, and record the resulting sum in the

Product Sum Cells.

(13) Add all the 0 or 1 ratings in the Rating Column, and record

the resulting sum in the Rating Sum Cells.

(14) Divide each Product Sum by its Rating Sum, and multiply the

resulting quotient by 100. Record the resulting products in

the Control Index Cells. These are the Indices of Adequacy for

this measure of controls/equipment. If the measures of the

significant characteristics just met their standards, a given

Index would be approximately 100. The less adequate the

characteristics that are measured, considering their criticality,

the farther below 100 will be the Index.

SYSTEM ,._TEST- DATE PAGE

K NAME TELEPHONE

W8-94

Lo , • . • . . , . ...9 .
HRTES

(15) Compute the mean of the control Indices. Record it in the

Mean Index Box of the Worksheet. This is the Index of

Adequacy of Dynamic Characteristics of all controls and

I. equipment to be manipulated in the performance of the HPF

being discussed.

The procedures for taking HFE Measures 9 through 14 are identical. They are

the "Common Procedures for Measures 9 through 14."' These common procedures

are found on Pages W8-50.

SYSTEM __________________________TEST - DATE _______PAGE

NAME W-5 TELEPHONE_____________
-u -- ----------- ~-.- - -

rn

H r~ uDYNAMIC CHARACTERISTICS WORKSHEET

CONDITIONS (if applicable): ______________________________

II L6~ ~ 0 !R R - - 02

U 0- C, C=

CONTROLS AND OTHER EQUIPMENT TO- 4O U (

BE MANIPULATED FOR HARDWARE -- j w,

RELEVANCE

RATING

PROCT

4," RELEVANCE

RATING

%' o/1

PROCT

RELEVANCE

RATING '.-- 1- - - - - - -- • . PRCTI

RELEVANCE.

"" RATING

PRDCT - - - - - -

RELEVANCE

RATING

0/1

PRDCT

RELEVANCE I I

RATING _

PRDCTI

RELEVANCE

RATING

0/1

PRDCT

RELEVANCE

RATING

_ _ _ _°_ CT

RELEVANCE

RATING

0/1

PRDCT

SOURCE

MEAN II

INDEX

SYSTEM TEST__ DATE PA___

NAME TELEPHONE

W8-96
1.1 F"~C HFE MEASURE #9--WORKSTATION DIMENSIONAL **-. CHARACTERISTICS ADEQUACY WORKSHEET

HPF:

CONDITIONS (If applicable):

CHARACTERISTICS SOURCE

WORK SURFACE DEPTH

WORK SURFACE HEIGHT SITTING

WORK SURFACE HEIGHT STANDING

WORK SURFACE HEIGHT KNEELING

WORK SURFACE WIDTH

WORK SURFACE AREA

WORK SURFACE SLOPE (ANGLE)

WORKSPACE DEPTH

WORKSPACE HEIGHT SITTING

WORKSPACE HEIGHT STANDING

WORKSPACE HEIGHT KNEELING

WORKSPACE UNUSUAL POSITION CLEARANCE

WORKSPACE LATERAL AREA

WORKSPACE VOLUME

FREE FLOOR SPACE

DOOR/HATCH HEIGHT

DOOR/HATCH WIDTH

TREAD DEPTH

qRISER HEIGHT

RISER WIDTH

OTHER:

RATING SUM: INDEX:

PRDCT

SUM

SYSTEM TEST- DATE PAGL

NAME TELEPHONE

W8-97
P . 'y" yo Y"r 0Y,.77-7 7

:HRTES * LI ~HFE MEASURE #10--WORKSTATION SEATING ri* ~ ~ HRACEITICS ADEQUACY WORKSHEET

HPF:

CONDITIONS (If applicable):__________________________ - E

CHARACTERISTICS SOURC

HEA CLEARANCE SITING-VERTICAL

HEAD LLARANCE SITTING-LATERAL

SHOULDER CLEAAANCE-VERTICAL

ESHOULDR CLEARANCE-LTECAL

KNU CLEARNC-VRTICIL

KNEE CLEARANCE-LATERAL

THIGH CLEARANCE-VERTICAL

THIGH CLEARANCE-LATERAL

HIP CLEARANCE-LATERAL

KICK SPACE

FOOT SUPPOrr LIGTH

FOOT SUPPORT WIDTH

FOOT SUPPORT SLOPE (ANG.E)

FOOT SUPPORT TO SEAT SURFACE

SEAT SURFACE TO AM SWPOASLPPOR7IIm___________

AM SUPPORT WIDTH

AN SUPPORT SLOPE (ANGLE)

SEAT LEbGTH

4 SEAT WOTh-IP

SEAT uIlI-T hI

SEAT SLOP E-ANGLE

SEAT SURFACE HEIGHT

SEAT BACK LENGTH

SEAT BACK WIDTH-SHOULDER

SEAT/BACK SLOPE (ANGLE)

SEAT NOTION CAPABILITY

SEAT/BACK COIFOWANCE TO BOO

SEAT/SA&K SHOCK ASORP TIO

,* OTHER:

RATING SUN: 1UnEL

9PRDCT sum

SYSTEM TEST_ DATE PAGE.-

NAME TELEPHONE

W8-98

" " ",' ' " " ": ".. . ." ." ' . • - - ." ' . : ". - . "" . . .. . . - • . . . .• .. .
HE MEASURE #11--WORKSTATION/ENVIRONMENT VISUAL CHARACTERISTICS ADEQUACY

HRTES WORKSHEET

HPF:

CONDITIONS (If applicable):

iu

VISUAL" -"

CHARACTERISTICS - SOURCE

EXTERNAL ILLUMINATION

EXTERNAL WARNING ILLUMINATION

WORKSTATION AMBIENT ILLUMINATION

WORKSTATION DIRECT ILLUMINATION

EXTERNAL FIELD OF VIEW

VIEWING ANGLE TO TARGET(S)

VIEWING ANGLE TO SIGNIFICANT PARTS

OF WORKSTATION (OTHER THAN DISPLAYS)

VISUAL DISTORTION FROM WORKSTATION

VISUAL OBSCURATION FROM WORKSTATION

VISUAL OBSCURATION WITHIN WORKSTATION

REFLECTIVITY WITHIN WORKSTATION

VISIBILITY OF WORKSTATION EXTERIOR

OTHER:

INDEX

RATING PRDCT

* SUM' SUM

SYSTEM TEST - DATE PAGE___

NAME TELEPHONE

W8-99

. " ". P' " ... +" 'l" < "' - +" "' +" "++"- " " """' -. ' ' .' +, , _.,,:,," " ' " ' ", '-",'-'.,i' ' .' m'"

% - i " II.U '+: ' ,•• .. +k , : J
HFE MEASURE #12--WORKsTATIoN/ENvIRON- flE I~MENT SOUND CHARACTERISTICS ADEQUACY

HRTESWORKSHEET

HPF:

CON4DITIONS (If applicable):

SOUND

CHARACTERISTICS -' ~ -SOURCE

SOUND FREQUENCY WITHIN WORKSTATION

SOUND AMPLITUDE WITHIN WORKSTATION

4 SOUND FREQUENCY OUTSIDE WORKSTATION - - - -

SOUND AMPLITUDE OUTSIDE WORKSTATIO14

OTHER:

INDEX:

RATING PRDCT

SUN sum

SYSTEM J_______________________EST-___ DATE___________

NAME ________________________TELEPHONE 4

W8-IO00
LI D1"C C HFE MEASURE #J3--WORKSTATION MOTION

H RECHARACTERISTICS ADEQUACY WORKSHEET

v ~ HPF:

CONDITIONS (If applicable):

A C-,

MOTION,,

CHARACTERISTICS e" .

VIBRATION AMPLITUDE IN WORKSTATION

VIBRATION FREQUENCY IN WORKSTATION

.4AMOUNT OF ACCELERATION IN WORKSTATION_

DIRECTION OF ACCELERATION

IN WORKSTATION ..

CHARACTER OF MOTION IN WORKSTATION

OTHER:

INDEX:

RATING PRDCT

SUNI SUM

SYSTEM TEST-__ DATE _______

NAME TELEPHONE

W8-I01

., , ., , .4 .J-'., - " . - . . - , . , " '. - " - - " " , " " - ""e" " " " - " i- | m k " K

-

'

- - " " - ", "' "' " . ' , ' % % % ",% " " ' "" ,% ' -
HFE MEASURE #14 --WORKSTATION/ENVIRQNMENT

VENTILATIO CHARACTERISTICS ADEQUACY

HPF:

CONDITIONS (if applicable):

VENTILATION J I -

CHRATEISDC 0. SOURCE

AIR FLOW/TIME_____ ______

WORKSTATION TEMPERATURE

WORKSTATION HUMIDITY

EXTERNAL WORKSTATION TE1MPERATURE

PREVENTION OF ENTRANCE OF

TOXIC SUBSTANCEIRADIATION____________

PREVENTION OF ENTRANCE OF

NOXI OUS SUBSTANCES

OTHER:

RATING SUM: LiIUDEX:

PRDCT SUMj

SYSTEM ________________________TEST-__ DATE__________

NAME TELEPHONE____________

w8-102
A HFE MEASURE t,'1.5--WOPKSTATIO!/E!VI RO!IMENT H RTES SAFETY CHAkPACTERISTICS ADEQUACY WIORKSHEET'

CmoIToNS (If applicable):

OMARMTUIsTCs snuf omIF

SWAPam____

PO"T 0&=C

uIL OWMTU P"1EtIU

DANY=LY 1NA~IVA

"t. ~URN WLY 11WON1SUI

NOT A0EGUAT11Y HIDIWT

* lUIZT C WIUALMAIATION CUTACThal

113O3 MTUZM CMCTNU

SOM~~ PWM fOANIin LEVIL

IATIO AT 0WW A I 15Rj- -

-ST~ -

DL%@MLSI IPMIAM WWISIMTIU

ONwomy Eumi IlWUMTU

IAIAUITE EWIHW ANOIZN

G9INGU ShIAN WrcZ

OJJZN SIWCE WflOU

DOE9URY IGAT!YSESE__

DAIUNOIJ TACTICA COMMONO NN

0131

-YM - - A -PGE

NAME ________________________TELPHONE
SUMMARY WORKSHEET FOR HUMAN FACTORS H RTES ENGINEERING DIAGNOSIS

IHPF:

CONDITIONS (if applicable)-

SPI:

SYSTEM FUNCTION:

SPECIFIC HFE PROBLEMS SPECIFIC NFE INDECES E P COLLECTIVE NFE INDEX OF CONTRIBUTING TO INDECES OF ADEQUACY OF IIDECES ADEQUACY

I JW DERST rMDABILITY

L O RDESIGN ',; COITIONFOR

2 [ DECISION DIFFICULTY 

C I

:4 _ _ _ _ _ _ _ _ _ _ _

3 I1 /DISPLAY INFOMATION L ADEQUACY & TIIELINESS

4 D DISMLAY READABILITY/ DISPLAYS HEARABILITY

5 DISPLAY INFORMATION I] D iUDERSTANIABILITY

SLCONTROL ACCESSIBIL ITY

CONTOL SATICCONTROLS/OTIIER

L....J STTICEQUIP9EIIT CVSTRL TO

CHARACTERISTICSKMAIUTE

a lCONTDL DYNAMIC [ 87CHARACTERISTICS

mNUIMA FACTORS

ENGINEERING

9 L WORKSTATION CHARAC TRISTICS DIMESIONAL.

WORKSTATION SEATING 10 7 CHARACTERISTICS

r- WORKSTATION VISUAL

.. CHARACTERISTICS

S ORKSTATION SOUND WORKSTATION/

12 EIHAAATEAJTICSENVIRONMENT

13[ WORKSTATION MOTION [ CHARACTERI STI CS

LI. 14 [ WRKSTATION VENTILATION ___ ___CHARACTERISTICS

EWORKSTATION SAFETY

ICHARACTERISTICS

16 [JWORK LOAD WORK LOAD--j

SYSTEMI TEST DATE PAGE

MX _____________ TELEPHONE______

[%'

SYSTEM TEST - DATE -PAGENAME TELEPHONE

7 ;-'2 W8-104
GENERAL INSTRUCTIONS FOR PERSONNEL

H RT..,SELECTION MEASURES

DESCRIPTION: An operational test (OT) has been completed recently.

*: For the specifics of this OT, see "HPF Diagnostic Wor1 sheet" on page W8-4

of this submission. Various operator and maintainer tasks were measured

during this OT. One or more of these tasks was evaluated as having been

performed inadequately. In the Human Resources Test and Evaluation System

(HRTES) operator and maintainer tasks have been defined at a general level

which is not dependent upon the specific types of equipment involved. To

avoid confusion with traditional tasks, they have been named Human Performance Functions (HPF's). The "HPF Diagnostic Worksheet" on page W8-4

* that lists the specifics of the operational test also lists the HPF's which

were performed inadequately.

Operational testing and evaluation personnel have determined that those

HPF's that are listed are of significant importance to the overall evaluation of the system that was tested. They need to know why these HPF's

were performed inadequately. One possible reason is that the individual

or individuals who performed inadequately has significant characteristict

that interacted with the system hardware/software ard that fell outside

the fifth to ninety-fifth percentile envelopes for the appropriate population. In the case of measures of central nervous system functioning,

one possible reason is that the individual or individuals fell below the

fifth percentile for the characteristics in question.

It is not necessary to take any personnel selection measures if you can

be sure that all the personnel who performed inadequate were "representative soldiers" in all their significant characteristics. Being a

representative soldier implies that these individuals fell within the

fifth to ninety-fifth percentiles for those significant characteristics

* which would affect HPF performance. Since system hardware and software

were supposed to be designed for "representative soldiers" if the soldiers

.' were representative, this could not be the cause of inadequate performance.

However, the random selection of military units to act as players in an

OT does not guarantee the representativeness of the soldiers involved.

SYSTEM ________ ________________TEST-___ DATE _______PAGE

NAME TELEPHONE

W8-I05
HRTES

Further, you must deal with the question of whether a "representative

soldier" is supposed to represent the specific military population, or

the appropriate age group of the general population.

If you decide to take one of more Personnel Selection Measures, HRTES

contains the following:

MEASURE NAME MEASURE FUNCTION PAGE W8:

1. Background that Bears on Adequacy of those background 117

Cognitive Functioning characteristics which affect

mental work.

l 2. Aptitude/Ability that Bears Adequacy of those aptitude/ 118

on Cognitive Functioning ability characteristics which

bear on cognitive functioning.

3. Vision for Display Use Adequacy of vision character- 119

istics.

4. Anthropometry for Visual Adequacy of anthropometric 120

Display characteristics required for

visual display use.

5. Audition for Auditory Display Adequacy of audition character- 121

Use istics required for auditory

display use.

6. Anthropometry for Auditory Adequacy of anthropometric 122

Display Use characteristics required for

auditory display use.

7. Lqngth/Reach Anthropometry Adequacy of length-reach 123

for Accessibility characteristics required for

control/equipment assessibil ity

8. Joint Motion for Accessibility Adequacy of joint motion char- 124-125

acteristics required for control/equipment accessibility.

SYSTEM TEST- DATE PAGE

NAME TELEPHONE E: . W8- 106
u. 

HRTE5 I

MEASURE NAME MEASURE FUNCTION PAGE

W8:

9. Size Anthropometry for Adequacy of size characteristics 126

Accessibility required for control/equipment

accessibility (in limited space).

10. Vision for Manipulation Adequacy of vision characteris- 127

tics required for detection and

use of controls/equipment to be

man ipulated.

11. Anthropometry for Static Adequacy of anthropometric char- 128

Characteristics of Con- acteristics required to interact

trols/Equipment to Be with static characteristics of

Manipulated controls/equipment to be manipI ated.

12. Strength for Manipulation Adequacy of strength character- 129

istics required for manipulation.

13. Range of Movement for Adequacy of range of movement 130

Manipulation characteristics required for

man i pu I at ion.

14. Coordination for Adequacy of coordination charac- 131

Manipulation teristics required for Manipulation.

15. Anthropometry for Work- Adequacy of anthropometric 132-133

station/Environment characteristics required for

Dimensions compatibility with workstation/

environment dimensions.

16. Anthropometry for Seats Adequacy of anthropometric char- 134-135

m m. acteristics required for compatibility with seating arrangements.

17. Vision for Workstation/ Adequacy of vision characteristics 136

Environment required for compatibility with

the workstation/environment.

SYSTEM TEST- DATE PAGE

NAME W- TELEPHONE "W8- 10
HRTES

MEASURE NAME MEASURE FUNCTION PAGE

W8 :

18. Audition for Workstation/ Adequacy of audition characteristics 137

, Environment required for compatibility with the

~~wor kstat ion/env ironment.

19. Central Nervous System Adequacy of central nervous system 138

p.'- Functioning for Compati- characteristics (other than vision

bility with Workstation and audition) required for compatiMotion bility with workstation motion.

20. Characteristics Required Adequacy of personnel character- 139

by Workstation Ventila- istics required to interact with

tion and Air Filtration workstation/environment ventilation

and air filtration.

- 21. Physiological Indices of Adequacy of personnel character- 140

of Workload Tolerance istics that relate to workload

tolerance.

This section includes a set of "Common Procedures" which apply to all of

the listed Personnel Selection Measures. If you have also received the

HRTES HFE Measures, you will notice that the Personnel Selection Measures

"Common Procedures" are largely identical to the HFE Measures "General

Procedures" plus their "Common Procedures."

Your first problem will be to decide which Personnel Selection Measures to

take of each HPF to be diagnosed. During the OT, players and observers

filled in questionnaires in which they gave their opinions of the difficulty

of each HPF and the reasons for significant difficulty. If the questionnaires indicated significant difficulty, they were reduced and used to fill

out an "Opinion Summary Data Worksheet" for that HPF. Scales 1-16 and

scale 21 of this Worksheet correspond to the Personnel Selection Measures

listed earlier just as they correspond to the HFE Measures. The reason

for this parallelism is that performance difficulty can have been caused

by an inadequate interface and/or inadequate user characteristics. For

example, if an individual indicates a difficulty in reaching a control to II__ _ _ _ _ _ _ _ _ _II_ _ _ _ _ _ _ _

* SYSTEM TEST- DATE PAGE

NAME TELEPHONE -

. .. 10 .. .. .. 
HRTES

manipulate it, that control could have been located inappropriately for

the normal user population, or that individual could have arms which are

shorter than the normal population's fifth percentile. This parallelism

appl ies to all HFE and Personnel Selection Measures.

If any player or observer thought that performing a given HPF was difficult

and that HPF is one of those being diagnosed now, you will have an "Opinion

Summary Data Worksheet" for it with this submission. In this case the

scale scores listed may be helpful to you in deciding which Personnel

Selection Measures to take. If a score indicates significant difficulty

(50 or below), it is reasonable to take the corresponding Personnel Selection

Measure(s) for that HPF. In some cases several Personnel Selection Measures,

taken together, correspond to one "Opinion Summary Data Worksheet" scale.

It is, of course, possible that players and observers were not able to

judge whether there was something which was inadequate and produced inadequate HPF performance. Therefore these scores, if they are available, can

only be a guide for you to use as you think best. However, it is possible

that the players and observers did not believe than an HPF was difficult.

In this case you will have no "Opinion Summary Data Worksheet" for that HPF,

and you will have to fall back on your own resources to decide which of

these measures to take.

Since the scales of the "Opinion Summary Data Worksheet" and the Personnel

Selection Measures do not always equal each other on a one scale to one

measure relationship, the following table is presented.

NUMBERS OF PERSONNEL

OPINIONS SCALES SELECT ION MEASURES

1. Understanding Procedures 1+2

2. Display Readability/Hearability Measurement 3+4 34ado and/or 5+6+

3. Display Information Understanding 1+2

4. Usefulness of Dsplay Information None

SYSTEM TEST__ DATE PAGE

NAME 8 9 TELEPHONE

;"" . . ..X :." . .". .' .'."." ".'." " ". , "..". 109'.. ".-.,- .'.'.'.'W8. ..-.... <
% HRTES

NUMBERS OF PERSONNEL

OPINION SCALES SELECTION MEASURES

5. Manipulation Difficulty 12+13+14

6. Reach/Accessibility 7+8+9

7. Control Configuration 10+11

8. Decision Difficulty 1+2

9. Target/Terrain Visibility 17

10. Workstation Design for Visibility 17

11. Sound 18

12. Motion 19

13. Ventilation 20

14. Workstation Dimensions 15

15. Seating 16

16. Safety None

17. Training Time See Training Measures

18. Practice Condition See Training Measures

19. Trainer(s) See Training Measures

20. Training Method See Training Measures

21. Workload 21

You can use these scale scores as an aid in deciding which Personnel

Selection Measures to take. However, you cannot use them in place of

Personnel Selection Measures. The reason for this is as follows:

(1) Scale scores are parallel to both Personnel Selection and

HFE Measures.

SYSTEM TEST__ DATE PAGE

NAME NAM W8- .TELEPHONE 110

-' . ." . '. , % %" .'. . .' '"' ,' "b d",. "' ' . . . . . . -. .......u , = - " " " ." , ' :: : : . ... - i : :: .,, • ': . . : . ,-' , ,--. :. . . - ... ., ,
HRTES

(2) If a given scale score were used to replace both its parallel

Personnel Selection and HFE Measures, one would not be able

to diffe entiate between Personnel Selection and HFE causes

of inadequate performance.

(3) One could use a given scale score to replace one of a parallel

measure pair-- if the other parallel measure indicated no

difficulty, or if the other parallel measure were considered

fixed and therefore not taken.

(4) It is considerably more likely that Personnel Selection will

be considered fixed than will HFE. Further, personnel characteristics are more likely to require specific documentation

as causes of inadequate performance than are HFE.

(5) Therefore, scale scores can only be used as replacements for

HFE Measures, not Personnel Selection Measures, and even this

replacement is discouraged in HRTES.

In addition to the "Opinion Summary Data Worksheet," this submission should

include a copy of the "HPF Diagnostic Worksheet" (described earlier) and a

copy of the "Summary Worksheet for Personnel Selection Diagnosis" that will

be described in the following "Common Procedures."

COMMON PROCEDURES (APPLICABLE TO ALL PERSONNEL SELECTION

MEASURES):

(1) Read through these common procedures and the Worksheets for

the Personnel Selection Measures to familiarize yourself with

them.

(2) Examine the "HPF Diagnostic Worksheet" to familiarize yourself

with information about the OT and the specific HPF's that are

to be discussed.

SYSTEM TEST- DATE ,_PAGE

NAME TELEPHONE
N1HRTES

(3) Examine the "Opinion Summary Data Worksheet" for each Hl

(if there is one). Use their scores as an aid to selectina

parallel Personnel Selection Measures. If you do not have one

or more such Worksheets, use your best judgement for deciding

which measures to take of each HPF.

(4) Make sufficient copies of the Personnel Selection Measure

Worksheets so that you have as many as you need for each HPF

to be diagnosed.

(5) Fill in the background information on each Worksheet. Procedures 6-16 are directed toward taking any single Measure of

any HPF to be diagnosed.

(6) Study the characteristics listed on the worksheet. If you think

that a significant characteristic is missing, add it in the

"Other" category.

(7) Decide if each characteristic on the Worksheet is relevant to

the performance of the HPF being dia gnosed in this system. If

it might have a significant effect on HPF performance in this

system, it is relevant. In this case record an "X" in the

appropriate cell of the Relevance Column. If a characteristic

is not relevant, record a 110"1 in the cell.

(8) If there is a column for designating specific part of body,

complete it for each selected characteristic.

(9) Rate each characteristics that you have selected on the

criticality scale which follows. Select any rating from 1-100.

* Record the ratings in the appropriate cellIs of the Rating Column.

SYSTEM ________________________TEST____ DATE _______PAGE

NAME TELEPHONE

W8- 112

-p - . - * - * .. *.2.
HRTES

LOW CRITICALITY MODERATE CRITICALITY HIGH CRITICALITY

1 25 50 75 100

Just important enough Criticality moderate Criticality

to be measured. Criti- for this HPF. extremely high

cality low for this HPF. for this HPF.

(10) Obtain appropriate measurements of each characteristic

you have selected. This may be done in the following ways:

(a) Obtaining appropriate measurements from previous OT's,

DT's, HFE tests, or other reasonably reliable sources.

(b) Physically taking the necessary measurements from the

actual system.

(c) Taking some version of the necessary measurements from

system documentation.

(11) Compare each measurement with the standard or specification

which applies to it. This may be done in the following ways:

(a) Comparison with reasonably valid specifications such

as those found in MIL STD-1472, HEDGE, and HFTEMAN --

this is, of course, preferable.

(b) Evaluation based on expert judgement -- in the absence of an

applicable standard your judgement may be substituted.

(12) Remember, this procedure applies only to those individuals

who performed the given HPF below criterion. If a given characteristic, for one individual, falls inside the fifth to

ninety-fifth percentile envelope, or exceeds the appropriate

standard, or your judgement, assign (do not record) a 1. If

it does not, assign a 0. If only one individual performed

this HPF inadequately, then the 1 or 0 assigned that individual's

SYSTEM ___ TEST_ DATE ,-PAGE

NAME_ _TELEPHONE__ ___

* ---. -.-.--..- . W8-113
HRTES

characteristic is recorded directly in the appropriate

cell of the (0/1) column. However, if more than one individual

performed this HPF inadequately, then you will have to compute

the mean of the zeros and ones for this characteristic. Once

this has been computed, record 'the miean of the zeros and ones

.: assigned to the given characteristic in the appropriate cell

of the (0/1) column.

(13) Record the source of each comparison in the appropriate cell of

the Source Column. This should be information as to the source

of the measurement itself and the standard. If there is insufficient space to record all the required source information, append

a page and use the space to refer to it.

(14) Multiply the 0, 1, or mean for each characteristic by the 1-100

rating of its criticality. Record the resulting products in the

appropriate cells of the Product Column.

(15) Add all the products, and record the resulting sum in the Product

Sum Cell.

(16) Add all the 0 or 1 ratings in the Rating Column, and record the

resulting sum in the Rating Sum Cell.

(17) Divide the Product Sum by theRating Sum, and multiple the

resulting quotient by 100. Record the resulting product in the

Index Cell. This is the Index of Adequacy for this measure. If

the measures of the significant characteristics just met their

standards, the Index would be approximately 100. The less adequate

the characteristics that are measured, considering their

criticality, the farther below 100 will be the Index.

SYSTEM TEST- DATE PAGE

NAME ,A TELEPHONE •. -" - N. 4
HRTES

(18) When you have finished taking the measures you have selected for

each HPF, make as many copies of the "Summary Worksheet for

Personnel Selection Diagnosis" as you need for the HPF's you have

diagnosed (one per HPF).

(19) Fill in the information at the top and extreme bottom of each

Worksheet.

(20) Record the specific Personnel Selection indices of adequacy for

the measures you have taken for each HPF being diagnosed. This

is to be done in the appropriately labeled boxes on the Worksheets.

(21) If you have not taken a specific Personnel Selection Measure for

a given HPF, record an "1X' in the appropriate box of the Worksheet.

(22) Record the specific characteristic(s) which caused any specific

Index of Adequacy to be significantly below 100. This is to be

done in the first column of the Worksheet. If necessary, append

an additional sheet for this purpose, and reference it in the

first column.

(23) Compute the means of the specific Indices of Adequacy according

to the branching structure on the Worksheet. Means are to be

computed of Indices: 1+2; 3+4; 5+6; 7+8+9; 10+11; 12+13+14; 15-21.

Record the resulting seven means in those boxes to which the

branching structure leads. Next, compute the means of the following means from the previous step: (3+4)+5+6) and (7+8+9)+(10+11)+

(12+13+14). Finally, take these two newly computed means, and

compute the means of the following: (1+2); (3+4+5+6); (7-14);

(15-21); and (22). Record the resulting means in those boxes on

the Worksheet appropriate for them.

SYSTEM _______________________TEST - DATE _______PAGE

NAME TELEPHONE
HRTES

(24) If all the specific indices are absent, for a given collective

index, record an "1X" in the box for that collective index. If

you have recorded an "X" in any individual box, leave it out

of the computation.

N(25) When you have completed all the Personnel Selection Measures and

the "Summary Worksheet for Personnel Selection Diagnosis" return

all materials to sender.

SYSTEM _________________________TEST-...... DATE _______PAGE

NAME TELEPHONE______________

WB-1 76
PERSONNEL SELECTION MEASURE #- H rc BACKGROUND THAT BEARS ON COGNITIVE

".E FUNCTIONING ADEQUACY WORKSHEET

HPF:

CONDITIONS (If applicable):

CHARACTERISTICS SOURCE

CIVILIAN EDUCATION LEVEL

AMOUNT OF APPROPRIATE

CIVILIAN EXPERIENCF

LENGTH OF MILITARY SERVICE

MILITARY RANK

NOS ______________

MOS SKILL LEVEL

AMOUNT OF APPROPRIATE

MILITARY EXPERIENCE

SPECIFIC MILITARY TRAINING

IN SYSTEM TYPE

QUALIFICATION LEVEL WITH SYSTEM

TIME SINCE QUALIFICATION WITH SYSTEM

OTHER:

RATING S14: INDEX:

PRDCT

sum

SYSTEM TEST - DATE -PAGE -

NAME TELEPHONE

W8-1 17
~ PERSONNEL SELECTION MEASURE #2-- I1I'(I~APTITUDE/ABILITY THAT BEARS ON H R T E S COGNITIVE FUNCTIONING ADEQUACY WORKSHEET

CONDITIONS (if applicable): ______________ _____________

CHARACTERISTICS SOURCE

READING APTITUDE/ABILITY

VOCABULARY ABILITY

MATHEMATICS/NUMERICAL APTITUDE

ABILITY________ ___

SPATIAL ORIENTATION

APTITUflE/ABILITY

MEMORIZATION APTITUDE/ABILITY

REASONING APTITUDE/ABILITY

OTHER:

RATING SUM:LCTL INDEX:

SYSTEM TEST-......... DATE___________

NAME TELEPHONE

W8-1 18
I.JDF'~CPERSONNEL SELECTION MEASURE #3-- EUITES VISION DISPLAY USE ADEQUACY WORKSHEET

CONDITIONS (if applicable): ______________________________

SI- a*

CHARACTERISTICS Ix L j c. .SUC

VISUAL ACUITY-NEAR (AT DISPLAY DISTANCE)

VISUAL DISCRIMINATION (RETINAL PERIPHERY)

COLOR DISCRIMINATION

DEPTH DISCRIMINATION

MOVEMENT DISCRIMINATION

VI SUAL SEARCH

DARK ADAPTATION

LIGHT ADAPTATION

EYE DOMINANCE x

FATIQUE TOLERANCE FOLLOWING-LONG TERM

USE OF DISPLAY(S) x

OTHER:

RATING SU[ 541 INDEXT

SYSTEM TEST___ DATE_________

NAME TELEPHONE___________

W8-1 19
SPERSONNEL SELECTION MEASURE #4-- I I ANTHROPOMETRY FOR VISUAL DISPLAY USE

HRTES ADEQUACY WORKSHEET

HP, "HPFN: ___________________________________________

CONDITIONS (If applicable):

LU'

CHARACTERISTICS U SOURCE

NECK FLEXION-RIGHT

NECK FLEXION-LEFT

NECK FLEXION-DORSAL

NECK FLEXION-VENTRAL

NECK ROTATION-RIGHT

NECK ROTATION-LEFT

FOOT TO EYE HEIGHT-STANDING

BUTTOCKS TO EYE HEIGHT-SITTING ( PERPNDCULR LINE TO WIKSPACE FLOOR/DECK)

INTERPUPILLARY DISTANCE

ANGLE OF SIGHT AT EXPECTED HEAD POSITION

OTHER:

RATING SLIM: INDEX:

PRDCT

SUm

SYSTEM TEST -. DATE__ __ PAGE

NAME TELEPHONE

W8-120
SPERSONNEL SELECTION MEASURE #5-- W DT, AUDITION FOR AUDITORY DISPLAYS

ADEQUACY WORKSHEET

CONDITIONS (if applicable):

" .

CHARACTERISTICS w . C " = SOURCE

cc~ w ____ CD___________

AUDITORY ACUITY AT ELECTRONICALLY

MODULATED SPEECH FREQUENCY RANGE

AUDITORY ACUITY AT FREQUENCIES OF APPROPRIATE ELECTRONIC/MECHANICAL SIGNALS

ABILITY TO DISCRIMINATE ELECTRONIC/MECHANICAL SIGNALS FROM APPROPRIATE MASKING

ABILITY TO DETECT FREQUENCY CHANGE OF

APPROPRIATE ELECTRONIC/MECH. SIGNALS

ABILITY TO DETECT SOUND PRESSURE CHANGE

OF APPROPRIATE ELECT/MECH. SIGNALS

HEARING RECOVERY FOLLOWING-ELECTRONICALLY

MODULATED SPEECH FREQUENCY RANGE

HEARING RECOVERY FOLLOWING-ELECTRONIC/

MECHANICAL SIGNAL(S)

FATIGUE TOLERANCE FOLLOWING-LONG TERM,

ELECT. MOD. SPEECH FREQUENCY RANGE x

FATIGUE TOLERANCE FOLLOWING-LONG TERM

ELECTRONIC/MECHANICAL SIGNALS x

OTHER:

PROCT

RATING SUN suN.- INDEX

SYSTEM TEST - DATE_________

NAME ________________________TELEPHONE

W8-121

;,%
S PERSONNEL SELECTION MEASURE #6-- I.-I ANTHROPOMETRY FOR AUDITORY DISPLAY H EE E S USE ADEQUACY WORKSHEET

HPF:

CONDITIONS (if applicable):

CHARACTERISTICS i z cc

uj _jSOUIRCE

BIAURICULAR BREADTH x

HEAD BREADTH X

HEAD HEIGHT-TRAGION TO TOP

EAR BREADTH

EAR LENGTH

EAR PROTRUSION

OTHER:

9 PROC

RATING Sll SUM- INDEX

SYSTEM TEST- DATE PAGL

NAME TELEPHONE

W8-122

.: : :. ::.. .... :* ..-.-...... :, . . ..-... . .. ..... ..
HRTE5 PERSONNEL SELECTION MEASURE #7--

LENGTH/REACH ANTHROPOMETRY

CHARACTERISTICS FOR ACCESSIBILITY

ADEQUACY WORKSHEET

liPF:

CONDITIONS (if applicable):

CtARACTERISTICS SOURCE

FORWARD ARM REACH-STANDING

FORWARD ARM REACH-SITTING

FORWARD ARM REACH-SQUATTING

FORWARD ARM REACH-SUPINE

FORWARD ARM REACH-PRONE

LATERAL ARM REACH-STANDING

OVERHEAD ARM REACH-STANDING

OVERHEAD R REACH-SITTING

OVERHEAD ARM REACH-SQUATTING

OVERHEAD R REACH-SUPINE

FOREARM-HAN LENGTH

BUTTOCK-HEEL LENGTH

POPLITEAL HEIGHT

FOOT LENGTH

OTHER:

v

~PRDCT

RATING SUM SUM- INDEX

SYSTEM TEST - DATE PAGE..

NAME TELEPHONE

6W8-123
 . . . 

.

EH RS PERSONNEL SELECTION MEASURE #8-- El : JOINT MOTION FOR ACCESSIBILITY

.- hE S ADEQUACY WORKSHEET

HPF :

CONDITIONS (if applicable):

- .. .

I. - ,

CHARACTERISTICS Cr SOURCE

p WRIST FLEXI10

WRIST EXTENSION

P . WRIS 

WRIST ADOUCTION

WRIST ABUCT ION

FOREARM SU3INATION

"' FOREARM PROMATI ON

ELBOW F1EXTION

SHOULDER FLEXION

SHOULDER EXTENSION

SHOULDER ADOUCTION

SHOULDER ABDUCTION

SHOULDER MEDIAL ROTATION

SHOULDER LATERAL ROTATION

ANGULAR LIMITS OF WHOLE ARM HORIZONTAL

MOTION (SPEC. HAND HEIGHT ABOVE SEAT)

ANKLE FLEXION

ANKLE EXTENSION

ANKLE ADDUCTION

ANKLE ABDUCTION

KNEE FLEXION

KNEE MEDIAL ROTATION

Continued on Following Page

PROCT

RATING SUM SUM- INDEX

r SYSTEM TEST- DATE _ PA__ 

NAME TELEPHONE

W8-124

' .. .--..
FlRl'ES PERSONNEL SELECTION MEASURE #8--CONT,

HPF: ______________________________________________

CONDITIONS (if applicable):

CHARACTERISTICS w -j -j 0 0.SOURCE

KNEE LATERAL ROTATION

HIP FLEXION

NIP ADDUCTION

NIP ABDUCTION

HIP MEDIAL ROTATION

HIP LATERAL ROTATION

OTHER:

RATING SUM PEW4. INDEXL

SYSTEM TEST- DATE PAGENAME TELEPHONE____________

- W8-125
PERSONNEL SELECTION MEASURE #9--SIZE

ANTHROPOMETRY FOR ACCESSIBILITY

IIETES~ADEQUACY WORKSHEET

HPF:

CONDITIONS (if applicable): __________________________________

wC

CHARACTERISTICS w :SOURCE

SHOULDER (BIDELTOID) BREADTHx

CHEST DEPTH x

WAIST DEPTH x

BUTTOCK-ABDOMEN DEPTH

HIP BREADTH (STANDING) x

HIP BREADTH (SQUATTING) x

HAND BREADTH

HAND THICKNESS

HAND LENGTH

FOREARM DIAMETER/CIRCLI4FERENCE

BICEP DIA4ETER/CIRCNFERENCE

THIGH CLEARANCE

THIGH CIRCUM~FERENCE

OTHER:

PRDCT V1RATING SLIM 5LM14 INDEX

SYSTEM TEST___ DATE PAGENAME _________________________ELEPHONE______________ r W8-126
PERSONNEL SELECTION MEASURE#1-

VISION FOR MANIPULATION ADEQUACY

HRTESWORKSHEET

CONDITIONS (if applicable): __________________________________

CHARACTERISTICS SOURCE

VISUAL. ACUITY-NEAR (AT CONTROL DISTANCE)

VISUAL DISCRIMINATION (RETINAL PERIPH.)

COLOR DISCRIMINATION

DARK ADAPTATION

LIGHT ADAPTATION

EYE DOMINANCE x

OTHER:

RATINW-ROC INDEX

leSYSTEM _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _TEST -_ _ DATE . - PAGE-...

NAME TELEPHONE___________

WB-127
..,, , I C o------s/ ou..

PERSONNEL SELECTION MEASURE#1-

ANTHROPOMETRY FOR STATIC CHARACHRTES TERISTICS OF CONTROLS/EQUIPMENT

TO BE MANIPULATED ADEQUACY WORKSHEET

HPF:

CONDITIONS (if applicable):

CHARACTERISTICS d SOURCE

FOOT TO EYE HEIGHT (STANDING) X

BUTTOCK TO EYE HEIGHT (SITTING) X

HANDEDNESS X

HAND BREADTH

INDEX FINGER TIP DIAMETER/CIRCU4FERENCE

MIDDLE FINGER TIP DIAIETER/

CIRCUMFERENCE

RING FINGER TIP DIANETER/CIRCUMFERENCE

THUMB LENGTH TIP-FIRST JOINT

THUMB DEPTH

FOOT BREADTH

NECK FLEXION-LEFT X

NECK FLEXTION-RIGHT x

NECK FLEXTION-DORSAL X

NECK FLEXION-VENTRAL X

' NECK ROTATION-RIGHT X

NECK ROTATION-LEFT X

ANGLE OF SIGHT AT EXPECTED HEAD

POSITION

OTHER:

iPO"

I

RATING SUM4 SUM- INDEXL

SYSTEM TEST__ DATE _ PA__ 

NAME TELEPHONE

W8-128
PERSONNEL SELECTION MEASURE#2-

STRENGTH FOR MANIPULATION

H RE' ADEQUACY WORKSHEET

CONDITIONS (if applicable):

Lu

z w 

CHARACTERISTICS n ti u Z.- LI 

THULB-INDEX FINGER GRASPING

STRENGTH

EXTENDED INDEX FINGER STRENGTH IN

FLEXION

EXTENDED MIDDLE FINGER STRENGTH IN

FLEXION

GRIP STRENGTH

ARM STRENGTH PULLING STRAIGHT BACK

(SPECIFY ELBOW FLEXION)

ARM STRENGTH PUSHING STRAIGHT FORWARD (SPECIFY ELBOW FLEXION)

ARM STRENGTH MOVING TO THE RIGHT

(SPECIFY ELBOW FLEXION)

ARM STRENGTH MOVING TO THE LEFT

(SPECIFY ELBOW FLEXION)

ARM STRENGTH MOVING UP, VERTICALLY

(SPECIFY ELBOW FLEXION)

ARM STRENGTH MOVING DOWN, VERTICALLY

(SPECIFY ELBOW FLEXION)

ARM STRENGTH MDVING CLOCKWISE

(SPECIFY ELBOW FLEXION)

ARM STRENGTH MOVING COUNTERCLOCKWISE (SPECIFY ELBOW FLEXION)

LEG STRENGTH PUSHING FROM SEATED

POSITION (SPECIFIY KNEE ANGLE)

LEG STRENGTH IN A VERTICAL UPWARD

PULL

BACK STRENGTH IN A VERTICAL UPWARD

PULL

WHOLE BODY STRENGTH IN A VERTICAL

UPWARD PULL

WHOLE BODY STRENGTH IN A HORIZONTAL PUSH (FROM A SQUAT)

WHOLE BODY STRENGTH IN A HORIZONTAL PUSH (STANDING)

FATIQUE TOLERANCE FOLLOWING-LONG

TERM USE OF REQUIRED STRENGTH

OTHER:

PRDC

RATING S SN INDEX

SYSTEM TEST - DATE -PAGL

NAME TELEPHONE

W8-129

.Z, l-.
TSPERSONNEL SELECTION MEASURE #13-- W.-T" RANGE OF MOVEMENT FOR MANIPULATION

ADEQUACY WORKSHEET

CONDITIONS (if applicable) :

CHARACTERISTICS SOURCE

WRIST FLEXION

WRIST EXTENSION

WRIST ADDUCTION

WRIST ABDUCTION

FOREARM SIPINATION

FOREARM PRONAT ION

ELBOW FLEXION

SHOULDER FLEXION

SHOULDER EXTENSION

SHOULDER ADDUCTION

SHOULDER ABDUCTION

SHOULDER MEDIAL ROTATION

SHOULDER LATERAL ROTATION

'.""ANKLE ADDUCTION

ANKLE ABDUCTION

ANKLE FLEXION

KNEE ROTATION

KNEE FLEXION

OTHER:

.4 PRDCT

RATING SUM SUM. INDEX

SYSTEM TEST -. DATE -PAGE -

NAME TELEPHONE

W8-130

" ". "i - ",', "
PERSONNEL SELECTION MEASURE #14--

COORDINATION FOR MANIPULATION

ADEQUACY WORKSHEET

-:F

CONDITIONS (IF APPLICABLE)

CHARACTERISTICS ww cc SOURCE

GROSS BODY COORDINATION X

MULTI-LIMB COORDINATION

HAND-EYE COORDINATION

MANUAL DEXTERITY

FINGER DEXTERITY

PEDAL DEXTERITY

CONTROL PRECISION

RATE CONTROL

FATIGUE TOLERANCE FOLLOWING-LONG TERM PER.

FORMANCE OF APPROPRIATE MOVEMENTS

OTHER:

4-

PRDCT

RATING SUM SUM-L INDEX

SYSTEM TEST - DATE -PAGLE

NAME TELEPHONE

W8-131
S PERSONNEL SELECTION MEASURE#1-

ANTHROPOMETRY FOR WORKSTATION/ENVIRON- UUr.{ MENT DIMENSIONS ADEQUACY WORKSHEET

CONDITIONS (If applicable):

CHARACTERISTICS SOURCE

STATURE

SHOULDER HEIGHT (STANDING)

SHOULDER BREADTH

CHEST DEPTH

CHEST BREADTH

WAIST DEPTH

ELBOW HEIGHT (STANDING)

HIP BREADTH (STANDING)

BUTTOCK-ABDOMEN BREADTH (STANDING)

SPECIFY LEFT KNEE BREADTH RIGHT OR

HEAD CIRCUMFERENCE

SPECIFY LEFT OR

FOOT LENGTH RI rHT--

SPECIFY LEFT FOOT BREADTH RIGHT OR TA_ _ _

PRONE LENGTH

PRONE HEIGHT

CRAWLING LENGTH

CRAWLING HEIGHT

KNEELING LENGTH

KNEELING HEIGHT (CROUCHING)

KNEELING HEIGHT (UPRIGHT)

CONTINUED ON FOLLOWING PAGE

_ RATING SUM: INDEX:

PRDCT

sum

SYSTEM TEST - DATE _ PA__ 

NAME TELEPHONE V__

k." W8-132 W $ *~'~U* 

..' -j '. -. . . , -> .,. .

.-- v . , .,,, ., -, "------------ . .-. . . . ... , :r ,.,. ,,,..,, .. .,,. ,.,:, . ..¢. ...... ........ -. '," -- -L ', :.- .-.:'** '":.,..' -,.*'.-'.- .- .. ." "; ,'- -- ' .- ,
L" H.. RE PERSONNEL SELECTION MEASURE #5-OT

CONDITIONS (If applicable):

CHARACTERISTICS SOURCE ____________________ ... ~.. 1 o SOURCE

MINIMUM SQUATTING HEIGHT

r', SQUATTING HEIGHT (UPRIGHT)

[" VERTICAL TRUNK CIRCUMFERENCE (STANDINGI

BUTTOCK-EYE HEIGHT (SITTING)

BUTTOCK-EYE HEIGHT (STANDING)

NECK FLEXION-LEFT

NECK FLEXION-RIGHT

NECK FLEXION-DORSAL

NECK FLEXION-VENTRAL

NECK ROTATION-RIGHT

NECK ROTATION-LEFT

ANGLE OF SIGHT AT EXPECTED HEAD POSITION

OTHER:

RATING SUM: INDEX:

PRDCT

SLIM

SYSTEM TEST - DATE -PAGE__-_

NAME -.... TELEPHONE W8-133

,,,,
SPERSONNEL SELECTION MEASURE #16-- HRTES ANTHROPOM ETRY FOR SEATS ADEQUACY

WORKSHEET

CONDITIONS (if applicable):

CHARACTERISTICS W OIC

SITTING HEIGHT (ERECT) X

SITTING HEIGHT (RELAXED) X

SHOULDER HEIGHT (SITTING)

ELBOW REST HEIGHT (SITTING)

ELBOW-FINGERTIP LENGTH

* .HEAD LENGTH

BUTTOCK-KNEE LENGTH

POPLITEAL HEIGHT

BUTTOCK-POPLI1TJA. LENGTH

~BUTTOCK-HEEL LENGTH

FOOT LENGTH

BUTTOCK-HEEL LENGTH (DIAGONAL)

HEAD BREADTH X

SHOULDER (BIDELTOID) BREADTH X

.4

FOREARMLFOREARM BREADTH X

WAIST BREADTH (SITTING) X

HIP-HIP BREADTH (SITTING) X

THIGH CLEARANCE HEIGHT (SITTING) X

THIGH BREADTH (SITTING)

KNEE-KNEE BREADTH (SITTING)

Continued on Following Page

PRDCT

RATING SUN S11. ImDExL

SYSTEM TEST- DATE PA___

NAME __TELEPHONE

W8-134

, '4.'Z 'j"t, ". '." ",1 " " ,,,' , • " .. " " ' f .,',. ',,.,'.''',,,'"'''.' " . , . , :" ,." .- . . , . - . ",. . . . .,,
IR lE S PERSONNEL SELECTION MEASURE #16--CONT.

CONDITIONS (if applicable):

CHARACTERISTICS___SLC

FOOT-FOOT BREADTH

WEIGHT

OTHER:

i €DC,

9j.

."I

*1

•NAME TELEPHONE

" W8- 135

."9- 4- , , .: ; : : : . . , . -., ., : , . . . , . . : . : . . : . . , , , . , . , .: , - . . . . . . . . . . . . . ; . . . , . . . . - - . . , .
S PERSONNEL SELECTION MEASURE #17--

VISION FOR WORKSTATION/ENVIRONMENT

ADEQUACY WORKSHEET

HPF" "_

~i.CONDITIONS (If applicable): __.

CHARACTERISTICS .. SOURCE

VISUAL ACUITY-NEAR (AT DISTANCE FROM

SIGNIFICANT PART OF WORKSTATION)

VISUAL ACUITY-INTERMEDIATE (AT DISTANCE FROM ENVIRONMENT FEATURE)

VISUAL ACUITY-FAR (AT DISTANCE FROM

TARGET)

VISUAL DISCRIMINATION .(RETINAL PERIPH)

COLOR DISCRIMINATION

- DARK ADAPTATION

LIGHT ADAPTATION

DEPTH DISCRIMINATION

MOVEMENT DISCRIMINATION

VISUAL SEARCH

EYE DOMI NANCE

OTHER:

RAIG U PROCT

RATIG 554sum1- INDEX

SYSTEM. TEST- DATE PAL

NAME TELEPHONE

W8-136
S PERSONNEL SELECTION MEASURE 8- H R TE- AUDITION FOR WORKSTATION/ENVIRONMENT

"RT" ADEQUACY WORKSHEET

CONDITIONS (if applicable):

uj

CHARACTERISTICS W _ J 0 SSOURCE

AUDITORY ACUITY AT NATURAL SPEECH

FREQUENCY RANGE

ABILITY TO DISCRIMINATE NATURAL SPEECH

FREQ. RANGE FROM APPROPRIATE MASKING

HEARING RECOVERY FOLLOWING-IMPULSE NOISE

APPROPRIATE TO SYSTEM FUNCTIONS

HEARING RECOVERY FOLLOWING-BLAST

APPROPRIATE TO SYSTEM FUNCTIONS

HEARING RECOVERY FOLLOWING-LONG TERM,

HIGH LEVEL STEADY-STATE NOISE

FATIGUE TOLERANCE FOLLOWING-IMPULSE

NOISE APPROPRIATE TO SYSTEM FUNCTIONS X

FATIGUE TOLERANCE FOLLOWING-BLAST

APPROPRIATE TO SYSTEM FUNCTIONS X

FATIGUE TOLERANCE FOLLOWING-LONG TERM,

HIGH LEVEL. STEADY-STATE NOISE X

FATIGUE TOLERANCE FOLLOWING-LONG TERN,

LOW LEVEL, STEADY-STATE NOISE X

OTHER:

RATING SUN P LT NDEX

SYSTEM TEST__ DATE PAG__

NAME TELEPHONE

W8-137

V %
~ PERSONNEL SELECTION MEASURE #19--

CENTRAL NERVOUS SYSTEM FUNCTIONING

i' FOR COMPATIBILITY WITH WORKSTATION

MOTION ADEQUACY WORKSHEET

IIPF I

CONDITIONS (if applicable):

CHARCTERISTICS $ =SOURCE

MOTION SICKNSS/VERTIGO TOLERANCE TO VIBRATION OF APROP. H AND AMLITUDE

VOLUNTAY MUSCULAR CONTROL TOLERACE TO VIBRATION OF APPROP. Hz AND AMLITUDE

i REACTION TIME TOLERANCE TO VIBRATION OF

APPROP. Nz AND AMIPLITUDE

PERCEPTUAL TOLERANCE TO VIBRATION OF

" APPROP. NZ AND AMPLITUDE

COGNITIVE TOLERANCE TO VIBRATION OF APPROP. Hz AND AMPLITUDE

FATIGUE TOLERANCE FOLLOWING LONG TERM

VIBRATION OF APPROP. Nz AND AMPLITUDE MOTION SICKNESS/VERTIGO TOLERANCE TO

ACCELERATION OF APPROP. ONSET/DURATION

VOLUNTARY MUSCULAR CONTROL TOLERANCE TO

ACCELERATION OF APPROP. ONSET/DURATION

REACTION TIME TOLERANCE TO ACCELERATION

OF APPROP. ONSET/DURATION

PERCEPTUAL TOLERANCE TO ACCELERATION

OF APPROP. ONSET/DURATION

COGNITIVE TOLERANCE TO ACCELERATION OF

APPROP. ONSET/DURATION

POSTURAL TOLERANCE TO ACCELERATION OF

PPROP. ONSET/DURATION

COMMUNICATIONSS/ERTI TOLERACE TION

AF APPROP. ONSET/DURATION

FATIGUE TOLERANCE FOLLOWING SUSTAINED

ACCELERATION OF APPROP. ONSET

OTHER:

PROCT

O R O DRATING SUM SUM INEx

SYSTEM TEST -_ DATE PAGE

NAME TELEPHONE

.w/-/18
PERSONNEL SELECTION MEASURE #20--

CHARACTERISTICS REQUIRED FOR WORKSTATION

VENTILATION AND AIR FILTRATION ADEQUACY

WORKSHEET

i HPF:

CONDITIONS (If applicable):

CHARACTERISTICS .S a. SOURCE R

NIGH TENPERATURE+HIGH HUMIDITY TOLERANCE IN

APPROP. CLOTHING/GEAR OVER APPROP. TIME

HIGH TEMPERATURE+LOW HUMIDITY TOLERANCE IN

APPROP. CLOTHING GEAR OVER APPROP. TIME

LOW TEMPERATURE TOLERANCE IN APPROP.

CLOTHING GEAR OVER APPROP. TIME

ENGINE COMBUSTION PRODUCTS TOLERANCE

OVER APPROP. TIME

GUNFIRE PRODUCTS TOLERANCE OVER APPROP. TIME

ROCKET FIRE PRODUCTS TOLERANCE OVER

APPROPRIATE TIME

TOLERANCE TO REDUCED OXYGEN SUPPLY

OVER APPROPRIATE TIME

TOLERANCE TO CHEMICAL WARFARE

PRODUCTS OVER APPROP. TIME

TOLERANCE TO BIOLOGICAL WARFARE

PRODUCTS OVER APPROP. TIME

TOLERANCE TO NUCLEAR WARFARE

PRODUCTS OVER APPROP. TIME

OTHER:

- 4

RATING SUM: INDEX:

PRDCT

Sum

SYSTEM TEST- DATE PAGL.

NAME TELEPHONE

W8-739
SPERSONNEL SELECTION MEASURE #21--

PHYSIOLOGICAL INDICES OF WORKLOAD H R-" TOLERANCE ADEQUACY WORKSHEET

HPF:

CONDITIONS (If applicable):

.U.'

CHARACTERISTICS cc__ SUC

LEVEL OF SECONDARY TASK PERFORMIANCE

SIZE OF PUPIL DILATION

RATE OF RHYTHMIC CONTRACTION AND

DILATION OF PUPIL

EYE MOVEMENT RATE

RATE OF SINUS ARRHYTHMIA

LEVEL OF PERIPHERAL VASOCONSTRICTION

LEVEL/RATE OF ALTERATION IN

SKIN CONDUCTANCE

LEVEL OF EEG DESYNCHRONIZATION

OTHER:

"----.- 

RATING SUM: INDEX:

PRDCT

/# SUM

-, SYSTEM TEST- DATE PAGE.-

NAME TELEPHONE

S~W8-140

,'JJ"
IE--z7 7 7

H R.SSUMMARY WORKSHEET FOR PERSONNEL HRTES SELECTION DIAGNOSIS

HPF:

CONDITIONS (if applicable):

SPI:

SYSTEM FUNCTION:

SPECIFIC PERSONNEL CHAR- SPECIFIC PERSONNEL COLLECTIVE l COLLECTIVE PERSONNEL

ACTERISTICS INADEQUACIESISELECTION INDICES INDICES INDICES SELECTION

CONTRIBUTING TO INDICES IOF ADEQUACY 1 2 INDEX

I = BACKGROUND Cf O

1 - COGNTI_ 2 m APTITUDE/ABILITY -

3_ VISION FOR DISPLAYS Th DISPLAY

4= AN"HROPOMETRY FOR REAILITY

VISUAL DISPLAYS DISPLAYS5 E AUDITION FOR DISPLAYS DISPLAY

46 ANTlIROPOPETRY FOR HEARAILITY

AUT__ DISPLAYS

Li LENGTH/REACH ANTHROPOMETRY L J FOR ACCESSIBILITY

8= JOINT NOTION ANTHROPONETRY FOR ACCESSIBILITY CONTROL

9 = SIZE ANTHRPOMETRY ACCESSIBILITY

FOR ACCESSIBILITY

1= VISION FOR MANIPULATION STArIC

CONTROL - -- CONTROLS11 ANTHROPOMETRY FOR STATIC STATIC

CHARS. OF MANIPULATION

12 STRENGTH FOR MAIPULATION PERSONNEL

13 F RANE OFSELECTION

' ' 13 ANTHROPOVETRY FOR WORK1 STAT A IONNAOMIEC

ANTHROPOETRY FOR SEATING

17 -- VISION FOR WORKSTATION/

L. JENVIRONMENT

18 AUDITION FOR WORKSTATION/ WORK

_.ENVIRONENT STATION/ -ENVIORN--

19 NERVOUS SYSTEM CHARACTERISTICS _ENT

ASSOCIATED WITH NOTION

20 r CHARACTERISTICS ASSOCIATED • WITH VENTILATION/FILTRATION

21 t IWORKLOAD TOLERANCE

_- CHARACTERISTICS

SYSTEM TEST__ DATE PAGENAME TELEPHONE

F W8-141