SPECIAL REPORT - SUN STREAK EVALUATION
Document Type:
Collection:
Document Number (FOIA) /ESDN (CREST):
CIA-RDP96-00789R000700260001-6
Release Decision:
RIPPUB
Original Classification:
S
Document Page Count:
17
Document Creation Date:
November 4, 2016
Document Release Date:
May 16, 2000
Sequence Number:
1
Case Number:
Publication Date:
November 2, 1989
Content Type:
REPORT
File:
Attachment | Size |
---|---|
CIA-RDP96-00789R000700260001-6.pdf | 685.08 KB |
Body:
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
SPECIAL ACCESS PROGRAM
SPECIAL REPORT
SUN STREAK EVALUATION
WARNING NOTICEN THIS MATERIAL IS
RESTRICTED TO THOSE WITH VERIFIED
ACCESS TO SUN STREAK LEVEL
WOMMOW/NOFORN
SPECIAL ACCESS PROGRAM
2 NOVEMBER 1989
CLASSIFIED BYg DIA/ST
DECLASSIFY BY: OADR
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
PURPOSE
I BACKGROUND
II EVALUATION
UNCLASSIFIED
1. Data Base
2. Evaluation Techniques
3. Evaluation Results
III FINDINGS
APPENDIX
I. PROjECT RECORD DETAILS
2
II. DETAILED INSTRUCTIONS TO ANALYSTS/DATA REVIEWERS
UNCLASSIFIED
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
BACKGROUND
II EVALUATION
III FINDINGS
12
APP1.NDIX
I. HOW' CI kl.C:OkD Drrniu;
H. DI IAILID INSIkUCIIUNS 10 ANALYSIS/DAIA RLVILWI-kS
UNCLASSIFIED
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
LIST OF FIGURES
FIGURE
1.
Number of Projects as a Function
of
type
FIGURE
2.
Data Categories
FIGURE
3.
Evaluation Scales
FIGURE
4.
Summary Data Evaluation Sheet.
Example
FIGURE
5.
Overall Data Correlations
FIGURE
6.
Overall Averages for all Project
Types
FIGURE
7.
Expected Results +or Approximately
/0% Data
Accuracy Selected Personnel
UNCLASSIFIED
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
SUN STREAK EVALUATION
PURPOSE,J (S/NF/SS 2) Purpose o+ this report is to provide an
evaluation o+ the SUN STREAK operational projects conducted
since 1986.
Tip? IU..c,e(H
S tlA c 6,
SECRET
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
BACKGROUND (U)
11:9NO
Gixo-k" Gel)
(S/SF/SS 2) SUN STREAK is an in ..... house DIA project for
developing an operational psychoenergetics (i.e., remote viewing). - "j4. PZ
capability for the Intelligence Community. Tweive(1g6-1:9 billets, W
0'1
were authorized for DTA in 1986 for this activity. --Personnel
from the ARMY INSCOM CENTER LANE Project who had been examinihg
similar phenomenon were transferred to DIA to form the SUN STREAK
core group. DIA had earlier (1905) received operational control
from HO DA for this 6-persaa. rmy unit.
F/SS-2) In 1985, the DIA SUN STREAK Program Manager
(PM).7prepared an Action Plan thatg (1) detailed the steps
neCessary to transition the CENTER LANE unit to DIA!; (2)
identified SUN STREAK staffing and support nosdcii and (3) set
forth key programmatic requirements for the SUN STREAK activity.
The Action Plan anticipated that the time required +or achieving
a prototype operational capability would be approximately 3
years..
(S/NF/SS 2) Key aspects of this Action Plan, along with
additional procedural information, were sent to camgresisional
committees in 1986. The IC staff was also briefed at this time
on the Action Plan and on anticipated SUN STREAK operational
development and data evaluation procedures.
(S/NF/SS 2) Programmatic and operational requirements
identified in the Action Plan were to (1) gaiT pecial Akccess )
r*"X
V.)rogram (SAP) status (accornplished in March 1981: 1 .1f..2)gaIn"huffirawl.
I 't
us_approval ( grante d in Mar 1
ch 98,5 ) _i_ (3) se t C
up E, enior....------> / 47..
wEim?sighy-and a ask Cportti.nating eamnittee .(accomp.1ifli6d
,laugh -"hot curren.:ly actiat6-dIi---(4).-estab..1-sh tight project
controls along with an automated dat_pase management and records ---,
system (accomplished)g and (5) to estabjish an R/D link for
supporting operational capability development (accomplished via
HQ SGRD funding and a DARPA MIPR).
c.4
(S/NF/SS-2) The R/D link, via SRI int.ernational, has
yielded improved data evaluation procedures, has identified
potential personnel selection techniques, and has contributed to
training/development methods that are currently in project use.
The activity at SRI.has received and continues to receive
extensive review by a 9-member peer review panel to insure that
scientific rigor is maintained in all their activities.
,....1111.
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
FIGURE 1.
FIGURE 2. Data Categories
FIGURE 3. evaluation ales
EALtY
FIGURE 4. summary ata evaluation ZERW---Example
FIGURE 5. Overall data correlations
FIGURE 6. Overall averages for all project types
FIGURE 7. Expected results for approximately 70% data
accuracy---selected personnel
LIST OF FIGURES
Number of )projects as a function of type Cc115
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
'lest tor
SUN STREAK EVALUATION
PURPOSE: (S/NF/SS-2) Purpose of this report is to provide an
evaluation of the SUN STREAK operational projects conducted
since 1986.
#0101411,0
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
2. EVALUATION TECHNIQUES (U)
(6/NF/SS 2) Techniques used for evaluating the SUN STREY-W?4
operational -and simulated operational data lase depend on
nature of the task and type of project. T projects are the
most difficult to evaluate. This difficulty arises from the
general complexity existing at most S/T target sites, from
possible ambiguouS aspects of known ground truth about the- target
site, from the nature of the information desired, and in a few
cases, possibly from the remote viewing (RV) targeting method
employed. It is easier to evaluate data on S/T targets if only a
siF( le issue, such as presence or absence (of a particular
system, for cimarvle0 is desired, then it is to evaluate how well
a viewers' detailed but possibly fragmentary description
correlates with aspects of a complex .site. In this case a
considerable amount of subjectivity can be involved in evaluating
the degree of data /target correlation.
(S/NF/SS 2) To assist in reducing overall subjectivity of
evaluating complex S/T targets, the viewers' data is examined and
compared to ground truth with several data categories in mind.
These categories are shown in Figure and include geographic
descriptions, large and small scale objects, large and small
scale functions, personality data, and predictive data. Not all
these categories may be relevant to a specific project, and in
some cases may even be part of the RV targeting procedure used
(e.g., when a photo .of target building is used as an RV targeting
reference for accessing its unknown contents).
(S/NF/SS-':') After identifying the appropriate data
category, the next step is to examine the viewers' raw (or
summarized) data for comparison to known or estimated ground
truth and to make a best judgement on what approximate degree of
data correlation. actually exists. Figure 3 defines the scale
ratings used along with their approximate degree o+ data
correlation. (Appendix II contains detailed instructions for
analyst consideration when reviewing the data).
(S/NF/SS 2) Final evaluations and summaries are prepared by
the Program Manager and/or his project representative (who is not
v.( part of S(MN- STRVAK staff) in conjunction with the responsible
system cw_Ara Analyst or Intelligence Community point-o+
AenA?
-----Etact. Latest intelligence data and reports on that target
site are also reviewed during this process. In some cases, area
111.0141.11.
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
014111010***.
Mditi.onal data analysis is, of course, performed to determine.
how close to ground truth the data actually was. This may be of
value in understanding how to conduct future projects of this
nature.
3. EVALUATION RESULTS (U)
(S/NF/SS 3) Overall data correlations for all SUN STREAK
operational and operational simulation projects perforMed since c
1966 are shown in Figure 5. Thesexesujtswere,??obtaiged_tly
averaging the data entered on thec:liympary.kataj5Valuationets
for each project primarily for two data categories( i large -
scale and. small scale object and function). The top lines on the
bar charts reflect data averages obtained from the proven or
experienced viewers. For some projects, especially some of. the.
CN and CI projects, the distinction between large scale and small
scale is not clearcuty furthermore, this differentiation may not
be too important. For the predictive category and most of the CN
projects, data correlations were based mainly on a hit/miss
calculation.
(S/NF/SS 3) Figure 5 indicates that, on the average, data
from proven SUN STREAK viewers For' E3/ I" projects will tend to have
a '20 percent to 30 percent correlation with ground truth for
small scale targets, and a 30 percent to 50 percent correlation
with ground truth for large scale target features. Likewise, for
CT or CN projects, about 20 percent to 50 percent of SUN STREAK
data would be expected to correjate with ground truth. Caution
must be exercised in interpreting this data, however, since the
. datnase with known ground truth is quite low in these
catNloror CI and Document Reading projects, SUN STREAK data
voo8ce,- shows a 40 percent to 60 percent correlation level with ground
seAcAd truthy however the size of this daticlase is also quite low. The
K6Tt':00% Document Reading projects were, however, carefully isolated and
in a known or designated location. Predictive data o+ the
complex event type (e.g., political/military situations) shows a
very low data correlation (i.e., reliability) of about 10 percent
or less.
(S/NF/SS-3) If all SUN STREAK projects are averaged
together, as shown in Figure 6, data correlation would range from
about 20 percent +or small scale aspects to about 40 percent for
large scale aspects. While "averaging" such data may indicate
overall results in the long run, such averaging tends to washout
those results that have singular high mertt, such as. the
IMPOPPIP
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
SG1A
SG1A
SG1A
SG1C
SG1B
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
111111.101.11
analysts and the IC points of ..... contact provide written appraisals
to assist in the +inal evaluation process. These evaluations are
recorded on summary +orms and are maintained in the Program
Manager's.+iles.
(S/NP/SS 2) An example of an S/T target evaluation is in
/ 'his case the tarcet site was
Z. The project was completed in Juno 1987
and involved +our viewers (2 proven and 2 novice). In this
example, the bracket ( ) indicates a best estimate o+ data
validity was made +or that data category since ground truth is
not yet totally known for A "dash" means that data
category was not present in the viewers' data. One of the
viewers (#101) at to describe the site 6 months in the
+uture. In this case, the
Some o+ the
data categories-(i.e., geographic +eatures, large scale objects)
are not importara. from an intelligence data viewpoint since they
are known +rom conventional collection?assets. However, the
V iewers data in these categories are included in the evaluation
+or this project since they tend to provide confidence that other
(as yet unknown) details in the data may be correct.
(S/NF/SS-2) A more sophisticated analysis methodology has
been recently developed by SRI 4: or" use in evaluating complex
C r jt
'l Th m
is gotd m n a ag
hoai advnte is th a -a
t it llows
ivoy
0,4717-qu.an-tiTied esti ma.iis to be made +or each and every data element
Aio-criu9 generated. by the v)ewer with respect to both actual target
existence and -importance. This technique is currently being
Aft.7-4.%? examined for use in the SUN STREAK program and has been applied
to a +ew projects. However, it is a labor intensive technique
that will probably be used only +or select high interest projects
in the future.
(S/NF/SS 2) Most o+ the other SUN STREAK proiect types do
not require a complex analysis methodology. For example, due to
the nature of what type of data is desired (and availability_o+_
collection assets that can be cued), most of theCCT,
predictive projects where ground truth is known cali-be evaluated
in a "black or white" manner. The viewers' data, even i+ not
acted upon, either correlates with the subsequent location o+ the
fugitive or ship, or it does -not. The event predicted did, or
did not, happen. Thus, overall results +or many of these
projects are simply a matter of counting hits and misses. Hit
ratios or percentages o+ hits/misses' form the basis o+ overall
data correlations made in this report +or these tyw + projects.
SG1A
/
pj04).5.,
P114-
APrrit.
F""rt 0 c
01111111.?
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
kdx4dc,0---;
,oifk
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
identification several months in advance of a specific area in
the US where a fugitive was later found. In this case, SUN
STREAK data was not acted up on fortunately, the fugitive was
nevertheless abducted in this area due to the alertness of a
local law enforcement officia] -
(S/NF/SS-3) Another way of considering overall SUN .STREAK
project data correlation is to consider only the proven viewers.
This data is shown in Figure 7, for times when these experienced
viewers received a 2 or in the numerical ratings assigned to
their data correlations. Only two types o+ data are presented
hereg. S/T, and Personalityadata as Obtained from the various C.......
(1\I -and CI projects. For. 8/T projects, proven viewers would be
expected to receive a high 0-e. approx. 70 percent) data
correlation rating on about 20 percent of the S/T projects
attempted. For Personality projects (i.e., background, state-of
the-health, specific activities), around 50 percent to 60 percent
of the projects would yield high results. Essentially, this
chart indicates certain strengths/weaknesses of the present SUN
STREAK staff and suggests that more projects on foreign or CI
target personalities are warranted.
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
III FINDINGS (U)
(SiNF/SS 3) Although
the overall data correlations provided
in the previous section in some instances, have a low
overall average, the re. .s are unique enough to warrant further
attention and continued SUN STREAK activity. Even in the lowest
reI iability case (i.e., predictive), identification of even one
(i.-
importa ii 1: fut ure eve nt out of t en c out V )n fac e hi g hl
y. .
significant +or cost or life saving. 'rlese "averages" do not do
justice to the single unique cases that cost little to act upon,
as in the case of the fugitive location cited in section 3.
Specific findings that resulted from in-depth
review of the entire SUN STREAK data base includeg
o Individuals' performance correlates with pro'ect type.
This observation has already assisted in better task/prson
matching, and overall data correlations would be expe to
improve in the future.
o SUN STREAK has a distinct potential for direct
I ontribution to certain 1 I7 CN and CT cases, as born out by
specific instances over the past two years.
o Predictive chta is promising under certain conditions?
such as near term events or situations that do not involve
complex int.i.ons.
o 8/T data7 though having promise +or select tasks? does
not yield parametric data.
o SUN STREAK viewers work well under operational stress.
It may be that an environment o+ operational stress
generates a clear and immediate need. This situation seems
to foster conditions that enables RV to +unction better.
o Obtaining highly reliable RV data and then applying it to
real operational projects is difficult. However, it is
OV]. dent that continued work with RV data does result in
CII" eater insight on how best to use RV data and on how best
to utilize RV talent available. Thus, it is anticipated
that RV data utility will increase as experience of the SUN
STREAK team grows.
"IMO .WIMI!W..
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
VI
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
APPENDIX T
PROjECT RECORD DETAILS
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
APPENDIX IT
DETAILED INSTRUCTIONS TO ANALYST/DATA REVIEWERS
UNCLASSIFIED
CONTENTS
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
(S/NF/88-2) The basic approach employed by SUN STREAK
toward developing a prototype operational remote viewing (RV)
capability is to locate personnel with patentia RV capability
and to develop these abilities via appropriate
traning/development procedures. Once satisfactory progress
m n_.7wA- on sloDie-to-verify training tasks, these individuals are ?As PO
presenedwLcvanced training and operational simulation targets. ot 73 ,
_
n.---00eratIonal simulation targets are usually US military or US
scI entific targets where ground truth is totally known or can be
NO\ readily determined. Satisfactory performance on these tasks
qualify an individual +or operational projects of interest to the
intelligence community. In many of the operational projects,
however, ground truth is usually not known (or is only partially
I.:: nown). Consequently, complete evaluation of the viewer's data
cannot be made until a later time when ground truth does become
available. In the interim, reasonable estimates of the overall
validity of the viewer's data can be made for many of the
operational projects worked, based on what is generally known or
suspected about the target. These interim evaluation results are
updated whenever new ground truth is received.
(SINE/ SS 2) The operational projects pursued by SUN STREAK
are pproved by the Program Manager and 'Are, in part, based on
the P 1-ogram anagev's familarity with needs 1:1'd ai----------- 19
.0, 1 010
TO 1.-1
solicitation from others within the IC?wlo have been briefed into
the SUN STREAK program.
(S/NF/SS-2) The Evaluations performed for this report cover
all the operational and operational simulation projects
(approximately 20(i) that have been worked by SUN STREAK personnel
since 1986. A few of the special operations called upon
consultants from the SRI talent pool. These results are also
included in the overall evaluation.
criev-,s?lakia,
111.1111.1?P
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
/C.
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6
II EVALIJAT1(1q. ((j)
1. DATA 141, (LD
(S/NF/SS-2) The SUN STREAK project maintains an extensive
record o+ all project activity. Details include project. timing,
people involved (i.e., viewers, interviewers, and possibly
observers), and a variety o+ other data considered essential +or
good record keeping and 4or evaluating project results. This
data, along with project summaries, are maintained in an
automated data base +or convenient retrieval. Copies of project
summaries are also sent to the Program Manager for his review.
In addition, all raw data (i.e., sketches, viewer's notes) are
maintained in a separate +ile that is available +or review and
analysis (Idditjonal project record details are in appendix I).
-d (S/NF/SE 2) Evaluations conducted +or this report involved
a complete reexamination of the entire SUN STREAK operational
data base. Many o+ the earlier projects had only been partially
evaluated, or not evaluated at all, due to lack of suitable
ground truth at the time they were completed. These projects
were re-evaluated at this time to adjust for new intelligence
data that has since become available.
(S/NF/SS 2) For this evaluation, the data base was
subdivided into 6 main project types; (1) Scientific and
Technological (S/T); (2) Counterterrorist (CT)!; (3)
Counternarcotics (CN); (4) Counterintelligence (CI); (5) Document
Contents (Doc (ont); and (6) predictive (pred). Total projects
worked for these categories are shown in Figure 1.
(S/NF/SS 2) 04 the nearly 200 projects worked,
approximately one hal+ cannot be evaluated since ground truth is
not su4ficiently known at this time. For approximately one
+ourth of the projects, ground truth is totally known (or highly
certain), and +or the other one fourth, ground truth is only
partially known but considered suf+icient +or making a reasonable
interim evaluation.
(S/NF/SS 2) Some of these project categories can overlap.
For example, prediction data is also an aspect o+ most of the CN,
many of the CT and a +ew of the S/T projects. The prediction
category in .gure 1 refers primarily to predictions of a
polOACTVr military nature. In +uture analysis, predictive data
will be evaluated as a separate aspect of the these project
categories.
Approved For Release 2000/08/08 : CIA-RDP96-00789R000700260001-6