16-00789R001 800690001 -7
Approved For Release 2D02/11/
Coordinate Method —
In
this
cae,
the desired
target
is designated simply
as
"the
location
at
coordinate
and
",
or
by
some
other
means.
The
viewer
is
them
asked
to
describe
what
is
present
at
"Target
X",
o’"
at
the
specified
coordinates.
In
this
case,
a
beacon
person
is
not
necessary,
and
long
distance
experiments
become
practical
for
any
remote
location.
The
coordinate method
was
chosen
as
the
basic technique
for
the
RV
training
method
developed
at
SRI
during
the
GRILL
FLAME
project.
1-6
Approved For Release 2OO2/11/l85^!J0^^l6l^W89ROO18OO69OOO1-7
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
ULLM I
APPENDIX
II
STATISTICAL METHODS
Approved For Release 2002/11/18
:
L-00789R001 800690001 -7
APPENDIX
II
STATISTICAL METHODS
1.
Introduction
(U)
(U)
In
addressing
the remote
viewing
(RV)
evaluation question,
there
are
two
separate requirements:
o
Absolute evaluation of
a single response for
a single unknown target.
o
Relative evaluation of set of responses for
a series
of known targets.
(U)
The
first
of
these
is
of
the
most
interest
in
an
operational
setting.
This has been considered
in two ways.
First,
by conducting
an
operational
RV
session
between
two
calibration
RV
sessions
where
the
target
is
known, a
tentative
assessment
of
operational
efficacy
can
be
determined.
The
evaluation
is
made
on
the
basis
of
performance
during
the
calibration
sessions,
and on the basis
of adherence to
a predetermined session structure.
(U)
A
second
technique
for
an
a
prior
evaluation was explored
as
part
of
the
Fiscal
Yea*'
1982
program
in
an
audiolinguistic
task.
This
task
provided
indications
that
careful
linguistic
analysis,
when
coupled
with
technical
audio
anslysis,
could yield
an
assessment
of
probable
success
in
the
absence
of knowledge
about the target.
II-l
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
(U)
Various
techniques
have
been
used
in
the
past
in
an
attempt
to
solve
the
relative
eveuation
problem.
The
most
common
of
these
was
the
simple
rank
ordering
of
all
responses,
as
assessed
against
all
possible
targets
used
in
an
experimental
series.
In
this
procedure,
a
judge
is
presented
with
all
RV
transcripts
and
all
target
sites.
His
task
is
to
arrange
the
transcripts
in
order
of the
best to
least match for each of the targets.
A
simple
numerical
counting
procedure
is
then
used
to
estimate
the
likelihood
that
the
judge's
transcript
and
target
matches
are
by
chance
alone.
This
early
technique
contained
little
systematic
structure
for
determining
the
final
order
of
matches.
(S)
The first
step
toward
systematizing
the
rank
order
judging
procedure
was
to
preprocess
the
raw
data
in
the
transcript
by
"conceptualizing"
both
the
verbal
and
the
pictorial
responses.
Conceptualizing
a transcript
requires
an
analyst
to paraphase the transcript
into
a
list
of coherent
statements.
This
concept
list
is
then
compared
and
scored
concept-by-concept
to
each
of
the
targets.
The
resulting
scores
are
averaged
for
each
response,
and
all
responses are rank-ordered on the basis of these
scores.
(U)
The prcblem with
the
above
technique
is
that
there
are
no
guidelines
as
to
how
the
analyst
should
paraphrase
the
transcript;
furthermore,
the
method
in
which
the
concepts
are
to
be
assessed
against
the
targets
remains
undefined.
The
purpose
of
the
evaluation
task
in
FY
1982
was
to
identify
a
procedure that corrects these deficiences.
1 1-2
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
%n?vivLi
Approved For Release 2002/11/18
:6^I^^P^0789R001 800690001 -7
2.
Concept Analysis Procedure
(U)
(U)
In
this
analysis
procedure 1
,
there
are
four
separate
steps:
remote
viewer
response,
target/task
definition,
quality
assessment,
and
numerical
analysis.
(U)
The remote viewers response
is
prepared for
analysis by reducing the data
to
a
coherent
set
of concepts.
A concept
is defined
as
a
summary
of
a
single
idea
that
has
been
expressed
in
the
RV
verbal
or
drawing
response.
This
summary
is prepared by someone
not familiar with the target.
(U)
To
utilize
an
analysis
procedure
that
is
capable
of
quantitative
assessment,
it
is
necessary
to
define,
in
advance,
what
the
goals
of
the
assessment
are.
"Element
of
target"
and
"relevance"
are
provided
to
clearly
define
the goal
of
the analysis.
In
the
ideal
situation,
an
RV
target
should
be
completely
specified
in
advance.
A
target
typically consists
of
a
number
of
target
elements,
each
of
which
may
have
varying
relevance
with
regard
to
the
overall
RV
task.
For
any
given
target,
an
independent
list
of
target
elements
should
be
prepared.
The
selection
of
what
constitutes
a
target
element
is
left
completely
to
the
discretion
of
the
task
coordinator.
The
target elements must
be selected with
little regard to task relevance
Hee reference
l.b
in bibliography for details.
1 1-3
Approved For Release 2002/11/1
0789R001 800690001 -7
Approved For Release 2002/1 1 /18^C]/^Rg^g6-00789R001 800690001 -7
(target
elements
relevance
is
accounted
for
later).
Because
an
RV
target
consists,
in
principal,
of
an
essentially
infinite
number
of
possible
elements,
discretion
needs
to
be
exercised
in
the
selectic'
process
t:
rr.irinize
c'.alysis
time.
(U)
For
each
target
element
identified
for
the
site,
the
task
coordinator
must define
a
relevance
rating.
This
rating
allows
the
coordinator
to tailor
the
analysis
to
the
task
requirements.
Relevance
ratings
vary from
"trivaV
(1)
to "key"
(5).
(U)
The
quality
assessment
is
done
on
the
basis
of
how
well
the
single
concept
in
question
matches
the
selected
target
element.
The
judgement
is
made
without
regard
to
any
other
issues,
such
as
importance
of
the concept
to
the transcript,
and can range from poor
(1),
to excellent
(5).
(U)
An
intermediate
numerical
score
is
computed
for
each
concept
by
the
product
of
the relevance
and quality ratings.
(U)
To
determine
a
final
evaluation
of
the
complete
transc'ct
assesses
against
a given
target,
a weighted
average
of
concept
scores
is
computed.
At
this
point
in
the
evaluation
protocol,
the
following
options
a-e
available,
depending on the task requirement:
o
A
rank
ordering
of
the
targets
on
the
basis
of
the
weighted
averages
of concept scores.
11-4
Approved For Release 2002/1 1 /Ijk£l££RP3£-00789R001 800690001-7
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
-3-Ecnu.
o
A simple selection
of
the best match.
o
A
statistical
evaluation
on
a concept-by-ccncept
basis.
(S)
A
series
of
four
remote
viewings
that
were
performed
as
calibrations
during
operational
sessions
at
D1A
in
December
1981
are
used
to
illustrate
this
technique.
In
this
series
the
remote viewing products
were
of relatively
high
quality,
but
nonetheless
required
a
sensitive
technique
to
differentiate
because
of
the
similarity
of
the
targets
and,
hence,
of
the
descriptions.
Application
of
this
assessment
technique
resulted
in
the
correct
blind
matching
(highest
scoring
in
matches
versus
cross
matches)
of
th’-ee
of
the
four
calibration
targets.
This
result
indicated
that
remote
viewing
was
effective
during
this
session,
and
that
the
RV
data
generated
would
contain
some
valid
information
about
the operational
target
of
interest.
Approved For Release 2002/11/18
gA-RpP96-00789R001 800690001 -7
APPENDIX
III
FUNDING LEVELS
Approved For Release 2002/11/18
- Cl
-00789R001 800690001-7
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
SfCRCT
APPENDIX
III
FUNDING LEVELS
T v
* AL
FUNDS RECEIVED FDR THREE-YEAR PR03R-r
A.
FY
1981
-
$ 41B.5K
B.
FY
1982
-
518
-
C.
FY
1983
-
539
$1475. 5K
TOTAL
FUNDS RECEIVED BY SERVICE
A.
01 A
-
S962K
B.
ARMY INSCOM
-
$313. 5K
C.
DARPA
-
$200K
TOTAL
BY TASK
(BUDGETED AMOUNT
)
A
RY Enhancement
(training)
$
£75-
E
.
Intelligence Studies
267
c.
Data Base Management
16B
u
•
Countermeasures
E
Administration
97.5
F.
Audio Analysis
G.
Targeting
H.
Search Methodology
I.
RV Ops
J.
RV Evaluation
$1475. 5K
Approved For Release 2002/11/18
: C|AMd*>96-00789R001 800690001 -7
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
APPENDIX
IV
EXAMPLES OF REMOTE VIEWING DATA
Approved For Release 2002/1 1/18^^^^^D0789R001 800690001 -7
UNCLASSIFIED
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
i
ro
5 </’
t/
Li*,
. LTl 7
k)
io)°
3 7
'
3 .
unclassified
I
f\
.
p, eJiKhrtuif
(3
lu*<yS —
77«*<
>
fn)
SITE
lb>
RV RESPONSE
fin
RADIO
TT
I P SCOPE ARRAY; SOCORRO, NFW MEXICO
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
UNCLASSIFIED
UNCLASSIFIED
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
i
OJ
(U)
GLEN CANYON DAM. UTAH
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
UNCLASSIFIED
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
"if!
r
'
r
r-7?
r~^
UMCUASSirieo
<n)
5ITF
....
f=)«-
(h)
RV RESPONSE
(U)
ANTF.NNA ARRAY; LOST HILLS. CALIFORNIA
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
UNCLASSIFIED
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
H/en-
tr£
—-^r
cm^5
C_
UNCLASSiriro
(.,)
(h)
RV RESPONSE
(U)
SAHARA OILFIELDS
I
r
i
i
i
(
I
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
!
i
i
UNCLASSIFIED
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
SECRET
EXAMPLES
Of
RV
DATA FROM OPERATIONAL
SIMULATIONS
IV-6
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
SG1A Approved For Release 2002/11/18 : CIA-RDP96-00789R001800690001-7 Next 1 Page(s) In Document Exempt Approved For Release 2002/11/18 : CIA-RDP96-00789R001800690001-7
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
SECRET
SG1A
SG1A
SITE:
|
r-:ir
n r L r :
1 : ~ ION:
The-
site
is
e
r
sirf
i e T cJ
SG1A
o
-:'
-rovided to remote
viewer:
Cc-'j-'Z'' ties
of
the
site
( latitude
and
longitude
in
degrees,
r-n^es
end
seconds.;
no other
information
given.
RESULTS:
Viewer
correctly described
site
as
an
airport
adjacent
to
a
large
body
of
water,
end provided pasteup/drawing
shown
in following
page.
Approved For Release 2002/11/18
: CIA$Drt6-00789R001 800690001-7
SECRET
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
UNCLASSIFIED
UNCLASSIFIED
<U)
REMOTE VIEWER'S PASTEUP/DRAWING
SG1A
Approved For Release 2002/11/18
: CW«RDP96-00789R001 800690001 -7
UNCLASSIFIED
pole Approved For Release 2002/11/18 : CIA-RDP96-00789R001800690001-7 Approved For Release 2002/11/18 : CIA-RDP96-00789R001800690001-7
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
SECRET
SG1A
SITE:
SITE
Z‘i :
:
: 1PTJ0N:
Site
is
the
main
process":
plants
and
holding
tanks.
gathering
SGI A
I N r 0 :
PROVIDE:'
TO REMOTE
VIEWER:
Co: ^cinates
of
the
site
(latitude
and
longitude
in
degrees,
minutes
a-:
seccnds);
no other
information
given.
RESULTS:
Viewer
correctly
described
site
as
an
oilfield
with
blowoff
towers,
processing
equipment,
tanks,
and
provided
pasteup/drawings
shown
on
next
page
.
Approved For Release 2002/11/18
: CI^Rt^96-00789R001 800690001 -7
SECRET
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
UNCLASSIFIED
e
Llov-O::
Towctf
UNCLASSIFIED
(U)
REMOTE VIEWER'S PASTEUP/DRAWING OF
SG1A
Approved For Release 2002/11/18
:3^^DP96-00789R001 800690001 -7
i iKiri Accicicn
SG1C Approved For Release 2002/11/48 : CIA-RDP96-00789R001800690001-7 Next 2 Page(s) In Document Exempt Approved For Release 2002/11/18 : CIA-RDP96-00789R001800690001-7
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
SECRET
Examples of RV data from Operational
Tasks
(via
INSCOM viewers)
Approved For Release 2002/11/18
: CIWREff396-00789R001 800690001 -7
SG1A Approved For Release 2002/11/18 : CIA-RDP96-00789R001800690001-7 Next 3 Page(s) In Document Exempt Approved For Release 2002/11/18 : CIA-RDP96-00789R001800690001-7
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
j
X
Approved For Release 2002/11/18
: CIA-RDP96-00789R001 800690001 -7
Approved For Rele
-00789R001 800690001 -7
SPECIAL ACCESS REQUIRED
'If/18
:
Approved
1001800690001-7