Approved For Release
f/0871 6 rCIA-RDP96-00789R001 1 00020001-7
£VALUAT/<7/l/
fyfCCbtf# cy
SECRET
or fs,wr/s9»H-EM&fctt&HnN
prrnrni
i ftt»r
1.
(S/NF/SS-2) Operational
Phase:
(S/NF/SS-2)
The Program Manager will
assess
the value of the operational
phase of the DRAGOON ABSORB/SUN STREAK program by requiring
all
data
con-
sumers
(I.e., operational
task originators)
to furnish
him with data ac-
curacy and data utility assessments.
Table
Illustrates
the general
format and assessment scale
(0-3)
for this evaluation.
Specific data
categories may vary depending on the nature of the task
or on specific
objectives;
however,
the overall
approach will
remain the same.
(S/NF/SS-2)
The Program Manager will
enter results of the accuracy and
utility assessment Into the project data base.
He will
make periodic
reviews
(quarterly)
of this data
to assess overall
effectiveness.
(S/NF/SS-2)
The Program Manager,
In coordination with the task
originators and the Intelligence Community Task Coordinating Group,
will
develop an additional
measure of program value.
This measurement
(overall
program value)
Is designed
to measure the net worth or total
contribution of the task
In relation to other tasks and
to the overall
Intelligence mission.
Data accuracy and utility may be
high for a
particular consumer,
but the results may not have a significant overall
Impact.
This "program value"
scale
is similar to the utility scale;
however
it
Is based on specific measures of over-all
benefit.
This value
scale
Is
as follows:
Program Value Scale
-
Little or
no over-all
program value
-
Some program value
(I.e., helped refine estimates)
-
Moderate value
(I.e.,
Identified new data,
narrowed down
possibilities)
-
High value
(I.e.,
led to significant cost savings.
Identified critical
high priority S&T or operational
activities)
-
Exceptional
value
(I.e., predicted major
events/activities,
located lost/missing resources or personnel).
The value evaluation will
be used
In conjunction with other program
evaluation parameters
(accuracy,
utility)
for determining program accom-
plishments
and for defining future program directions.
SECRET
NOT RELEASABLE TO FOREIGN NATIONALS
Approved For Release 2004/08/16
: CIA-RDP96-00789R001 100020001 -7
IS)
SUMMARY EVALUATION SHEET
(U)
<l»
rot
tire
Keutny o(
t(te wt|iIttrt MterIll ,
ACCURACY*
(S) Geographical locale descrip-
tion
(terrain,
water,
etc.)
(S) Large-scale manmade elements
(cities,
buildings,
silos,
docks,
railroad
lines,
airfields,
etc.)
(S)
Small-scale manmade elements
(antennas,
computers,
tanks,
missiles,
offices,
etc.)
(S) General target ambience
(re-
search,
production,
adminis-
tration,
storage,
troop move-
ments,
naval activity,
air
activity, weapons testing,
etc.)
'S)
Relevant specific activities
(nuclear testing, missile
firing, CBW storage, ELINT
monitoring,
etc.)
;s) Personality information
(physical descriptions,
actions,
responsibilities,
plans,
etc.)
Little
Correspondence
Site Contact,
"
with
1 Mixed Results
Good
n
D
a
D
.
Excellent
Unknown
Not
Applicable
a
o
"
a
a
S) Overall utility
^
U»"ul
V«7 Useful
Cannot
be de-
termined at
this time PI
^
Definitions
for the accuracy scale ?
" Little correspondence .....
Self
- Site eontarr
Site content »lth
Mixture
explanatory.
mixed results
-Good
^
C!!:/
Wirc
!
ha9 ProbablY accessed the target site.
Good correspondence with several elements
ft
i
H
For-Release 2004/^Pffe
incorrect
information.
little incorrect Infar^tlonT
1,U
"**IhrtU **"«"«•
rel.tiy.1.
°L'!ni^!.*rf-J
n
f?rr"1 *le**"te,
but enough of the former
- Excellent
•PAST V
T
SECRET
Approved For Release 2004/08/16
: CIA-RDP96-00789R001 100020001 -7
SECRET
2.
(S/NF/SS-2) Training and Operational
Qualifying Phase:
(C)
There are two other aspects of this program that will
require evalu-
ation by the Program Manager or by his representative;
the basic training
phase and
the operational
qualifying
(or operational
training)
phase.
(S/NF/SS-2)
The basic training
phase consists of
a large variety of
easy-to-verlfy training tasks
that are designed
for various stages of
proficiency.
Overall
evaluations will
be based on the "accuracy scale"
used for operational
projects
and on an additional
quantitative
procedure.
The accuracy scale will
permit assessment of an Individual's
progress through the six training stages.
The quantitative procedure
(l.e., concept/element analysis)
will
allow assessments of degree of
accuracy and will
provide
the basis
for determining what general
classes
of operational
projects
a viewer can best
perform.
(S/NF/SS-2)
The operational
qualifying phase follows satisfactory
completion of the training phase.
This phase consists of tasks
that
simulate operational
projects but differ
In that ground truth can
be
readily determined,
and there are
no operational
consumers.
The main
purpose of this phase
Is
to systematically quantify the operational
readiness of each viewer for
a wide variety of potential
operational
projects.
Data
from this phase will
also help Identify the best types of
operational
tasks
for remote viewing
(RV) applications.
(S/NF/SS-2)
Each RV source will
perform several
hundred operational
qualifying tasks
per year.
These tasks will
Include representative
examples
from DIA's Intelligence production codes and
from other
potential
operational
requirements.
Evaluation will
be
performed
by the
Program Manager or
his representative and will
be based on the accuracy
scale used
for operational
projects.
In addition, accurate estimates of
operational
reliability and utility will
be made using quantitative
methods
(l.e., concept/element analysis,
pattern evaluation).
These
evaluation procedures will
require extensive use of a dedicated data base
management system for storing large amounts of Information and
for
performing appropriate analyses.
(S/NF/SS-2)
It
Is anticipated
that
a limited operational
capability will
be achieved
by early to mid 1987.
Some operational
projects will
be
Initiated
in FY 1986;
however,
the type of task accepted will
depend on
the nature of the proposed task and on capability levels of available
RV
sources.
SECRET
NOT RELEASABLE TO FOREIGN NATIONALS
Approved For Release 2004/08/16
: CIA-RDP96-00789R001 100020001 -7
Approved For Release 2i
-00789R001 100020001 -7
APPENDIX Jfr
TARbtTS
\
PFFUr/TtO/0f
TRAINING RSR#RT
“
—
A
1.
(S/SK/WNINTEL)
(RV)
training
used
There
are
three
classes
of
Remote
Viewing
in
that
portion
of
the
in-house
training
which
was
modeled
after
the
SR] -I
subcontractor
program.
These
classes
deal
with
feedback
requirements
during
the
RV
session,
control
of
interviewer
patter,
trainee
skill
development,
and
motivation.
These
three
classes
(A,
B,
and
C)
below
.
i
'
are
discussed
2.
(S/SK/WNINTEL)
CLASS
C:
The
majority
of
the
training
sessions
for
novice
trainees
are
Class
C.
During
this
phase,
the
source
trainee
must
learn
to
differentiate
between
emerging
target
relevant
perceptions
and
imaginative
overlay.
To
assist
the
trainee
in
this
learning,
immediate
feedback
is
provided
during
the
session.
The
interviewer
is
provided
with
a
feedback
package which may contain
a
map,
photographs,
and/or
a
narrative
description
of
the
target.
During
Class
C
sessions
the
interviewer
provides
the
trainee
with
immediate
feedback
for
each
element
of
data
he
provides,
with
the
exception
that
negative
feedback
is
not
given.
Should
the
trainee
state
an
element
of
information
that
appears
incorrect,
the
interviewer
remains
silent.
Feedback,
in
order
(interviewer
overlay),
is
in
the
statements
made
by
the
interviewer
.
definitions
are
as
follows:
to
prevent
inadvertent
cuing
form
of
very
specific
These
statements
and
their
Correct
(C )
This
indicates
that
correct
in
context
with
the
site
sufficient
to
end
the
session.
*NOTE:
The
use
herein
of
the
terms
Class
from
the
definition
applied
and
published
B,
or
C Coordinate Remote Viewing
(CRV)
.
the
information
is
location,
but
is
not
A,
by
B
,
or
C
SRI - I
for
di f fers
Class
A
SECRET
Approved For Release 2004/08/16
: CIA-RDP96-00789R001 100020001 -7
Approved For Release 2
00789R001 100020001 -7
Probably
Correct
(PC )
This
statement
means
that
the
interviewer
,
h a v i hg
limited
information
about
the
target,
though
he
cannot
be
absolutely
sure,
believes
that
the
information
provided
is
correct.
Near
(N )
This
indicates
that
the
information
provided
is
not
an
element
of
the
specific
site,
but
is
correct
for
the
immediate
surrounding
area.
Can't
Feedback
(CFB )
This
statement
indicates
that,
due
to
limited
inf or mat ion
about
the
target,
the
interviewer
cannot
make
a
judgment
as
to
the
correctness
of
the
data.
It means
neither
correct
nor
incorrect.
Site
(S )
This
indicates
the
site
has
been
correctly
named
For
the
specific
stage
being
trained
(manmade
structure
for
Stage
1,
bridge
for
Stage
III,
etc.).
"Site"
indicates
that
the session
is
completed.
During
the
session
the
trainee
writes
the
abbreviation
(see
above)
of
the
feedback
next
to
the
data.
This
allows
the
trainee
to
review
the
correct
elements
and
produce
a
summary
which
describes
the
site.
The
training
session
continues
until
the
interviewer
responds
with
the
feedback
of
Site.
3.
(S/SK/WNINTEL)
CLASS
B:
Once
a
trainee
begins
to
demonstrate
his
ability
to
reliably
distinguish
imaginative
report
target
relevant
data
elements,
feedback
is
In
Class
B
training
sessions
the
interviewer
knows
he
desires
the
trainee
to
describe
but
does
not
trainee
with
any
direct
feedback
during
the
course
This
process
develops
the
trainee's
ability
to
awareness
of
relevant
(correct)
versus
overlay
and
withdrawn
.
what
target
provide
the
of
the
session,
internalize
his
extraneous
(incorrect)
cognitive
structures
(mental
perceptions).
During Class
B
sessions
the
interview may
ask
the
trainee
to
elaborate
on
specific
elements
of
data
provided,
thereby
guiding
the
trainee
to
describe
specific
areas
of
the
target.
The
interviewer
is
only
permitted
to
ask
the
trainee
to
elaborate
on
specific
elements
already
reported
by
the
trainee.
The
interviewer
may
not
introduce
new
elements
into
the
session
(cue
the
source)
in
an
attempt
to
encourage
the
trainee
to
properly
describe
the
site.
Class
B
sessions
are
especially
helpful
in
developing
refined
skills
in
the
trainee.
For
example,
when
the
interviewer
knows
that
a
particular
target
area
within
a
site may
be
of
interest
(i.e.,
a
specific
room
in
a
building),
he
can
guide
the
trainee's
attention
to
that
area
to
elaborate
on
specific elements
of
data
by
asking
the
trainee
which
the
interviewer
With
practice
in Class
own
perceptual
and operational
knows
to
pertain
to
B,
the
trainee
soon
faculties,
a
necessary
step
intelligence collection.
the
area
of
interest,
learns
to
control
his
for
further
training
SECRET
Approved For Release 2004/08/16
: CIA-RDP96-00789R001 100020001 -7