Approved For Release 2000/08/10
: CIA-RDP96-00789R003800020001-8
(S/NF/SS-2)
EVALUATION
PROCEDURES;
1.
(S/NF/SS-2)
Operational
Phase:
(S/NF/SS-2)
The Project Manager will
assess
the value of
the operational
phase
of
the
SUN STREAK program by requiring
all
data consumers
(i.e.,
operational
task
originators)
to furnish
him with
data accuracy
and
data
utility assessments.
Table
illustrates
the general
format
and
assessment
scale
(0-3)
for
this evaluation.
Specific data categories may
vary depending
on
the nature
of
the
task
or
on
specific objectives;
however,
the overall
approach will
remain
the
same.
(S/NF/SS-2)
The
Project Manager will
enter results
of the accuracy
and
utility assessment
into the project data
base.
He will
make periodic
reviews
(quarterly)
of this
data
to assess
overall
effectiveness.
(S/NF/SS-2)
The Project Manager,
in coordination with
the task
originators
and
the
Intelligence Community Task
Coordinating Group,
will
develop
an
additional
measure
of program value.
This measurement
(overall
program value)
is designed
to measure
the
net worth
or total
contribution
of the
task
in relation
to other tasks
and
to the
overall
intelligence mission.
Data accuracy and utility may be high for
a
particular consumer,
but the results may not have
a significant overall
impact.
This program value
scale
is
similar
to the utility scale;
however
it
is based
on
specific measures
of over-all
benefit.
This value
scale
is
as follows:
*
Program Value
Scale
-
Little or
no over-all
program value.
-
Some program value
(e.g.,
helped refine estimates).
-
Moderate value
(e.g.,
identified
new data,
narrowed down
possibilities).
-
High
value
(e.g.,
led
to
significant cost
savings,
identified critical
high priority S&T or operational
activities).
-
Exceptional
value
(e.g.,
predicted major
events/activities,
located
lost/missing resources
or personnel).
The value evaluation will
be used
in conjunction with other program
evaluation parameters
(accuracy,
utility)
for determining program accom-
plishments
and
for defining future program directions.
Afiowfr
NOT RELEASABLE TO FOREIGN NATIONALS
Approved For Release 2000/08/10
: CIA-RDP96-00789R003800020001-8
'll)
For
the
sunonary
evaluation,
please
check
the
following
boxes
as
to
the
accuracy
of
the
submitted
material
roved For Release 2000/08/10
: CIA-RDP96-00789R003800020001-8
4J
U
O
--
* 1
C-<
c
c
S3
co
ciuX
ua
g
to
0uc
CI X
«-<
c
4J
o
4J
C-
—i
wo
ft-
ft-ou
I
e-
l-
u
u ^
tr
c
&x
ft-
o
c
e
c
c
u
»-
•w
ft.
X
c
a
*-
cc
w
c
-
O
E
O
C
f-H
4Jco
od
•x
ca
i
i
c
cc
ft-^ c
Io>
C*
CC
CC'
a>
cu
^ c
o
cc ^
«S
too —
E
C
C
X
•
« X
«C
U
EH O w
•H P
ft)
d
»-H
«-* X
~
«c
«
cc
o
w x
CC
CC
*~l
•
oi
* o
r-l
O
C>
4J
C>
«c
E
COuo
*
4J
cc
Cl
a u
v
E
U X
c «
CI
ft-
^
c:
«
c
v
CI
**H
H
ti
fij 2
«
4J
Cl
U
o
«0
ft-
ftl *H
tt
bC C
tf>
4J ^
W-
*-*4
cc
#s
«
cc
c
o
C
•—<
X c
E O
-s
CO
-W
ci
4-1
6C
4J O
CO
Cl
3 U
CC X
o
ft- O
i-l
CUn
4J
pu
>
«c
4-> C
u
o
q a
r*
Cl
«
*
*r4 m
U2
ti n
U
^4
< E
oi
CC'
U
* «
y-s
•p-4 M
ft-
•
w- c O O
cco
cO R
4i
^
C
"*H
44 O H
Cl
C
* X o
•
^
C
>s
O
-H
ft- V
Appro\fed Fdrfcgl&sS SoDO/BSlS)
X ^ X
CC
CO w £
CJ
tc
v -H
>
U
4J
Cl
a c
:*
^
O
41 cc
be
u c
41 h
C
*
*s u
Cl
CC O
>
C
4J
E
41 x
C C-H
O
*w
tt
W-
1-
C
coo
—l
c
c.
C
/~s
Xx
Cl
•
4J
l-i
a
H
K
^
Cl
CD
U
C ^
C
^
4J
ft) U «H
*H
£OA^RDlS9|
E
Q
E
O
c
e:
c
0lDieS9RD03
P-i ^ «
C-
to
to
to
to
to
to
i
X
I
4J
ClX
4J
cc
oX X&
4J
C
o
-W
I
I
C
Cl
U
4-4
o
>s
u
Cl>
CNI
Cl
SD
«C
CCu
c
c
c&
8(9)02
o
E-
O
ft
IM
>
C
*4
O
•«!
ft-c
EC
u
c
c
u
ft- X
o
c
u
«
c
Cl
o
c
x
i
c
4J
O
E
«
c
•5
gC
CI
*J c
• 2
Cl X
C
3X
^
*,x
ft ttc
C X
4J
«p4
u
Cl X
4-1
bC u
ft
ft
E
«
«
4J
E
c3
Cl
C"
X
4J
-H
4J
C
C
S D
ft
i
r
CD ^ p
ft
ft 6
Cl
D
O H
Dl
U
ft
-H
cc
ft- x
CI
E
•
>> >
c
c
H
t) C O
X
D ^
CC
4J
X X X
C
Xc
«c
O
4)
41 £
ft
-H
ft
a >
• u
>> V
U
U
O
ft-
4-1
O
c
u
c
ft
u-t
1-1
o
a
X
Cl
C
ft-3
»-H
X
O —
co r
ft
ft
ft
c
w
cc
u
u —
x
c
c
tq
C
C
4J
<c
C x x
o
H
u
c
c
c
ft- o
O
ft-
3 a
c-
ft.
O
ft
ft
c
ft
ft
ft
u
ft-
ft-
c
.
Cl
ft-
ft-
*H
4-1 O
C
cc u o
c
u
—
-4 X X
4J
X
O
O
4J
c
o
o —
^ o o —
odd
uc
•
cX X
C
4J
o
C- >
v.
o:
ft
JJ 4
ft-
u ^
ft-
C
C
4-1
U
C
C
O
ft-
C
V X
i4
c
C
--
4->
X
X
to
E
X
c
O
<j
O
X
o
u:
i
i
l-a
to
Approved For Release 2000/08/10
: CIA-RDP96-00789R003800020001-8
2.
(S/NF/SS-2)
Training
and Operational
Qualifying Phase ^
lr \
Thprp
, re tw0
0ther aspects
of this program that will
require evalu-
inonbv the Project Manager or by his representative; the basic training
phase and the operationaMual ifying
(or operational
training)
phase.
(S/NF/SS-2)
The basic training phase consists
of
a large variety of
easv-to-verify training tasks that
are designed
for various stages of
proficiency.
Overall
evaluations will
be based
on the accuracy scale
Esed for operational
projects
and on
an additional
q " a^
1 ‘*t ,^, vidual
. s
training
ItEges.
The quantitative proced ure
M
p
conceDt/element
analysis)
will
allow assessments
of degree
o
accuracy
and
P
will
provide the basis for determining what
general
classes
of operational
projects
a viewer can best perform.
(S/NF/SS-2)
The operational
qualifying phase follows satisfactory
projects! ^at^fronTthis^^
identify tKsi°types
of
operational
tasks for remote viewing
(RV)
applications.
ic, kif
?\
Farh
RV source will
perform several
hundred operational
LaWv^q tasks per yZ
These tasks will
include representative
operational
reliability
and utility will
be made
US1I
!J
9 quantitative
lTEE^^^E^?!r^u??r^^sEvTE
r
sE
management system for
storing
large amounts
of
information
and for
performing
appropriate
analyses.
/q/nf/ss
Tt
is
anticipated
that
a
limited operational
capability will
the proposed
task
and
on capability levels
of available RV sources.
NOT RELEASABLE TO FOREIGN NATIONALS
Approved For Release 2000/08/10
: CIA-RDP96-00789R003800020001-8
Approved For Releas^^gf^gg^^^RDP96-00789R003800020001-3
6.
Operational
Activity
(U):
a.
Tasking
(U) :
%
(S/NF/WN) All
operational
tasks will
be reviewed and prioritized by
DIA/DT.
These tasks can originate from DIA/DT and from elsewhere within the
Intelligence comnunlty or from other potential
users.
Although the methanl sm
for generating/receiving potential
tasks from
users has not yet been
finalized.
It
Is anticipated that the Intelligence Community Task Coordinating
Group may serve this
role.
These potential
tasks would then
be transmitted to
DIA/DT for disposition.
(S/NF) There
Is
an Important condition for accepting potential
operational
tasks:
It Is that feedback data must be provided to DIA/DT
so
that adequate evaluation of results can
be performed.
For sensitive projects,
special
caveats
and controls will
be established.
This procedure will
assure
the user comnunlty that details
of the sensitive task will
only be divulged to
those who have the need to know.
b.
Performing Operational
Tasks
(U):
(1)
Task Management
(U):
(S/NF)
To facilitate optlnum accomplishment of
all
routine and quick
reaction operational
tasks, DIA/DT will
establish
a detailed procedure to
Insure that all
operational
needs can be Immediately resolved and Implemented.
Activities/functions addressed would Include:
- 24 hr. availability of management approval
authority
Approved For Relefed#»2®Dttf0W'^:)CIA-RDP96-00789R003800020001-8
fYnnnnm
tfininvi
P96-00789R003800020001 -8
-
24 hr. availability of people who can perform
operational
tasks
(viewers. Interviewers);
- Resource allocation authority (people required,
specific assignments, travel);
- Procedures for Interface with the user community
(for
Intelligence and outside);
- Procedures
for Interface with others
(i.e.,
VO, HUMINT
Committee);
- Methods/procedures
for transmitting RV
data
to
users
(I.e.,
special
courier);
- Procedures
for preliminary evaluation of
data and
decision-making for follow-on actions;
- Procedures for maintaining security controls,
and
safeguarding viewer Identity;
These and others would be constantly refined to Improve over-all
responsiveness and effectiveness
of operational
activities.
Approved For Release 2000/
6-00789R003800020001 -8
96-00789R003800020001 -8
Approved For Release 2000/1
(2)
(S/MF/WN) Methodology : A consistent and scientlftcally-valld approach to
methods and procedures for active conduct of operational
sessions will
be
developed.
These will
be established as firm project requl rements , and any
exception (Ue., due to error, unforseen circumstances) will
be clearly noted.
The user cownunlty personnel
Involved In operational
tasks
(l.e., as
observers, or for data analysis) will
-be Informed of
all methods/ procedures In
advance of the conduct of any operational
task.
This
Is necessary for
operational
consistency,
for data evaluation,
and for making decisions on how
best to apply the RV data.
Specific methods/procedures will
be developed -for
each operational
task
In accordance with the nature of the task
(l.e., QRT,
long-term), type
of targeting methods
required,
and the type of training
program used for developing
the viewers'
capability.
(3)
Records
(U) :
(S/KF) Detailed records will
be maintained for
all
RV operational
sessions.
Specific data will
Include people Involved, chronology
of events,
data provided to the viewer, targeting methods
used, degree of knowledge of
target Information by those Involved
In the session,
or any other Issue
pertinent to performing the session and evaluating the results.
All
these
factors will
be Identified and clear documentation procedures will
be
established prior to Initiation of any operational
project.
The actual
RV
data will
also be carefully recorded and controlled,
and will
be entered Into
the appropriate data base.
Data format will
Include verbal
records
(tape
recordings)
as well
as raw data
(written description, sketches).
These
records will
be stored In such a way as to protect Identify of the user and
the viewers Involved, and will
be subject to
all
other security controls
est^l^^eWfbar R£l^e^0$OBmr
.a£l^
-8
available to any authorized Individual
or project review group as necessar^^
Approved For Release 200flgg^^^^P96-00789R003800020001-8
required by DIA/DT.
These reports *ould not contain sensitive data;
however
such data could be provided separately on a strict need-to-know basis pending
appropriate data release approval.
*
7.
Process Flow Chart
(U);
•
-
(C/NF )
All
project procedures and operational
activity Identified in
the section for training 'end for operational
projects will
be developed in
detail
in
a Project Operations Manual
.
A process flow chart will
also be
prepared.
Approved For Release 2000/MA!flofcl^ttP96-00789R003800020001-8