'FEEDBACK' AS A MECHANISM FOR THE EVALUATION OF AGENCY PERFORMANCE

• Document Type: CREST
• Collection: General CIA Records
• Document Number (FOIA) /ESDN (CREST): CIA-RDP80B01495R000900010004-1
• Release Decision: RIPPUB
• Original Classification: K
• Document Page Count: 4
• Document Creation Date: December 20, 2016
• Document Release Date: August 8, 2006
• Sequence Number: 4
• Publication Date: December 10, 1973
• Content Type: MF

Approved For Release 2006/08/08: CIA-RDP80B01495R90tf9000
MEMORANDUM FOR: Director of Central Intelligence
FROM Management Advisory Group (MAG)
SUBJECT "Feedback" as a Mechanism for the
Evaluation of Agency Performance
1. MAG recently completed a limited review of the
various formal and informal mechanisms used by consumers to
provide the Agency with feedback on the usefulness of Agency
intelligence reporting. During this review, we identified
certain problems and possible solutions which we believe have
a direct bearing on your current interest in feedback as a
mechanism for the evaluation of Agency performance. These
problem areas and possible solutions are summarized in this
memorandum.
2. We believe current feedback mechanisms are deficient
in the following respects:
a. There is a need for more formal direct, ar_
seci _ic feedbac]s_ rom ulti to consumers to t e
collectors and producers of finished an actionable,`
iritell_igence. Some informal feedback exists, but it
is deficient in that it does not necessarily represent
the views of the ultimate consumer nor does it lend
itself to formal analysis.
b. Inadequate use is being made of available
feedback data, particularly Publications Source Survey
(PSS) data, in assessing the actual and relative effec-
tiveness of the various collection methods and programs
directed against the same geographic or functional targets.
c. There is a need for greater articipation by
cons um . s t e forward planning of collection ac_vi ies,
particularly in the uman collection area, as a means
of improving requirements and tasking (one form of feed-
back) while concurrently developing a better understanding,
on the part of consumers, of the limitations of the various
collection methods.
MORI/CDF Pages
Approved For Release 2006/08/08: CIA-RDP80BO1495R000900010004-1
 Approved For Release 2006/08/08: CIA-RDP80B01495R000900010004-1
N
SUBJECT: "Feedback" as a Mechanism for the Evaluation
of Agency Performance
d. Increased use should be made of feedback far t.h.
identification of marginal collection programs and
efforts. -~-.- _
3. While we believe that your current efforts in the
establishment of the National Intelligence Officer (NIO)
program and management by objectives (MBO) may alleviate some
of these problems, there are other courses of action which may
contribute not only to the solution of these problems but also
to your desire to establish mechanisms for the evaluation of
Agency performance. Specifically, we believe the following
options are worthy of your consideration:
a. The PSS nomogram should be established on a
com Ln;ty-w.ide basis. The P, presently provides Agency
collectors with an assessment of the usefulness of their
intelligence reporting; and, at least within the DDO,
it is used as one indication of the actual and relative
effectiveness of particular collection programs. If
compiled on a community basis, this data could also
serve as a measure of the effectiveness of Agency collec-
tion programs vis-a-vis the rest of the community.
b. A program similar to the PSS -s_ au-ld-he estah1 i. hcd
the DDO. At present, 1 sthan 7 percent of DDO rapo_r 7
is used in the most important finis.
ed intellli2ence ubli-
-
__
catin-na; and, by informal estimates,
the amount of DOff
reporting which is directed towards actionable stems rather
than national intelligence needs is somet j -lag,
and increasing. It is essential, then, that specific,
dire back on the usefulness of this reporting be
made by the recipients of this reporting. Just as the PSS
assesses the contribution made by a report to the finished
intelligence product, this proposed program would assess the
contribution made by a report to the action finally taken.
c. The concept of the NIO structure should be
expanded to cover ac jQnabl reporting as well as finished
intelligence. While the concept of actlonae reporting
has particular application to the DDO, equivalent re-
porting occurs in the SIGINT and reconnaissance areas as
well.
I . . Approved For Release 2006/08/08: CIA-RDP80B01495R000900010004-1
 Approved For Release 2006/08/08: CIA-RDP80BO1495R000900010004-1
SUBJECT: "Feedback" as a Mechanism for the Evaluation
of Agency Performance
d. NI0's and analysts should participate, personally
and direr ly, In p anning and.... evaluation of collection
ro acts, including human collection project . -ln this
manner, we believe more specific and relevant require-
ments and tasking will result as well a9 better under-
standing of the limitations of the various collection
methods.
e. Feedback in the form of PSS data, feedback -from
NIO' S n W should alle `u`s e in_ a concerted effort
to identify marginal collection efforts and programs.
As a result of this effort, we would anticipate the
designation of certain countries _n.d tar.get.s_.aga.inst which
collection efforts will be discontinued, and the identifi-
cation--Of considerable community-level requirements and
tasking which are no longer valid.
4. If you desire, we would welcome the opportunity to
meet with you, or appropriate staff officers, to discuss this
memorandum in greater detail.
Approved For Release- 2006/08/08: CIA-RDP80BO1495R000900010004-1
 Approved For Release 2006/08/08: CIA-RDP80BO1495R000900010004-1
Approved For Release 2006/08/08: CIA-RDP80BO1495R000900010004-1