Improving CIA Analytic Performance: Analysts and the Policymaking Process
Sherman Kent Center for Intelligence Analysis
Occasional Papers: Volume 1, Number 2
Improving CIA Analytic Performance:
Analysts and the Policymaking Process
Sherman Kent Center
A host of reports have been written over the 50 years of CIA history evaluating analytic performance and recommending changes in priorities and tradecraft. These “post-mortem reports” have been issued by Agency leaders and components as well as by Congressional committees and commissions and non-governmental organizations concerned about intelligence performance. Starting with the 1990s, post-mortem reports increased in number, generated both by charges of specific intelligence failures and by general recognition that the post-Cold War period presented new challenges to intelligence.
The recent post-mortem reports have helped Directorate of Intelligence leaders to examine current doctrine and practice critically, and to address identified challenges in training programs. This Occasional Paper is one of a series of assessments of what recent critiques have said about the key challenges facing the DI in the new century.
Sherman Kent observed some 50 years ago that the most important relationship for analysts, that with the policy officials they seek to inform, does not fall naturally in place, but requires careful thought to set right and constant efforts to keep effective (Strategic Intelligence for National World Policy, 1949). Kent articulated the basic challenge to effective ties when he observed that if analysts get too close to their policymaking and action-taking clients, they would be in danger of losing the independence of mind and the substantive depth and analytic expertise that enabled them to make a distinctive professional contribution to national security. Yet if they stay too far apart from those they are charged to serve, they would be cut off from the feedback and other guidance essential for making that contribution.
The challenge of ensuring effective relationships has indeed endured. From its start, protecting the independence of the analytic process from policymaker influences became a central professional value of Agency analysts. But often at a high price. Analysts who kept their distance from the policymaking process learned to their sorrow that there is no way to get policy officials to pay serious attention to analytic assessments not judged to be helpful in getting their policymaking jobs done.
In recent decades, to redress the balance, the DI has relied on tough-minded analytic tradecraft to protect professionalism while moving closer to the policymaking action. In particular, the DI regularly tables assessments customized to take account of the specific questions and policymaking agendas of individual or small groups of policy officials. The DI has made a greater overall effort to provide analytic value-added to the policymaking process, especially via the more direct and informal venues of briefings, inter-agency meetings, teleconferences, telephone calls.
Nonetheless, post-mortem critiques of analytic performance issued during the 1990s that address the issue convey a general dissatisfaction with the effectiveness of analyst-policymaker relations. While the sharpness of the criticism and the recommendations for improved performance are not uniform, the main signals are—intelligence must improve both the quality and policy utility of analysis in order to be joined effectively to its designated consumers and thus effectively serve the national interest.
Case for Closer Ties to Policymaking
The report of the Twentieth Century Fund Task Force on the Future of Intelligence (1996), In from the Cold, presents in some detail the general indictment against analytic practice in the early 1990s as perceived by the critics. The Task Force included prominent representatives of the academic, policy, business, and intelligence communities, including former DDI Richard Kerr and former D/INR Morton Abramowitz.
1. Intelligence-Policy interactions “need to be vastly more productive and effective” in order to ensure that senior civilian and military officials receive the information and analysis they need when they need it. In short, better integration of intelligence into the policymaking process is needed.
2. Military clients make good use of analytic production, but outside of the Department of Defense, policymakers too often consider intelligence analysis to be unreliable, unhelpful, or irrelevant. Intelligence, by the “test of the marketplace,” is losing out to the growing competition for policymaker reliance for information and insight from the media, think tanks, advocacy groups, and the policy officials’ own expert staffs.
The recommendations for improvement are equally direct.
1. First, intelligence must improve the quality of analysis in order to motivate policymakers to share their issue agendas, their decision and action schedules, and their own analytic assumptions on what drives a priority issue and determines which US security interests are at stake—that is, essential guidance for providing analytic value-added to the policymaking process.
2. Second, intelligence must be prepared to lower the wall between it and the policymaking process. The report commends as a model the British system under which policy officials are integrated into the intelligence efforts to support effective decisionmaking “at every step, from writing to approving intelligence analysis.” Any concomitant danger of politicization of analysis is to be combated through reliance on high standards of analytic quality.
Also in 1996, an Independent Task Force of the Council on Foreign Relations (CFR) provided similar views in a report entitled Making Intelligence Smarter: The Future of U.S. Intelligence. Once again, former DDI Kerr and D/INR Abramowitz were among the broad-based prominent membership. If with somewhat less sharpness, once again the call went out that first the quality and then the actual policymaking value of analysis have to be improved in order for intelligence to fully carry its weight on behalf of national security.
Many current and former policymakers are critical of the analysis they receive, and both intelligence consumers and producers often share a frustration over its perceived lack of utility and hence impact.
Regarding improved analytic quality, the CFR report recommended more rigorous training, greater exposure of careerists via rotational assignments to other governmental and private sector organizations, and reduced intelligence isolation through greater recourse to the talents of outside experts.
The best way to ensure high-quality analysis is to bring high-quality analysts into the process. Analysis would be improved by increasing the flow of talented people into the intelligence community from outside the government. Greater provision should be made for lateral and mid-career entry of such analysts as well as for their short-term involvement in specific projects. Closer ties between universities and the intelligence community is desirable in this regard. Careerists would benefit from greater opportunities to spend time in other departments and nongovernmental organizations, including those involved in commerce and finance.
Regarding effective relations per se, the report insists the analytic and policymaking communities must become better informed on the other’s needs. Towards this end, a rotational assignment to a policymaking unit should be made a requirement for promotion to senior intelligence levels.
Closer ties could increase the danger of politicization—“the potential for the intelligence community to distort information or judgment in order to please political authorities.” Among the safeguards recommended are forceful defense by intelligence leaders of the practice of analytic independence on the part of their troops and competitive (deliberately non-consensual) analysis, especially on controversial and can’t-get-it-wrong issues.
In any case, the CFR report finds “irrelevance…[an]…arguably bigger problem for analysts than politicization.”
Intelligence analysis rarely impresses itself upon policymakers, who are inevitably busy and inundated with more demands on their time and attention than they can possibly meet. Intelligence officials must draw attention to their product and market their ideas. This is especially true in the case of any early-warning or intelligence-related development that has potentially significant consequences for important interests. A phone call, a personalized memorandum, a meeting—any and all are required if the situation is sufficiently serious.
Ambassador Richard Haas, Project Director for the CFR study, later in the decade put the issue directly in a presentation to senior DI analysts.
You in the intelligence community must not produce literature. You must produce results. And, in order to produce results, you have to get much closer to the policymakers.
A strong case can be made that most of the recommendations of the post-mortem reports to the intelligence side for improving relations with policymakers and increasing the general utility of analysis for the policymaking process were already being implemented in the early 1990s and have been employed more extensively since. DI analysts serving as personal briefing officers, sent on rotational assignments to policymaking units, and posted as intelligence liaison officers for executive branch departments are ever increasing in number. Though harder to quantify, DI analysts have increased their direct contact with the policy community generally—including one-on-one on the telephone and interacting with small groups at Interagency Working Groups and such. Opportunity or action analysis is regularly underscored as a central DI deliverable.
Yet the criticisms of the post-mortem reports were sincerely given by informed parties. And even as DI performance improves, the bar for effective policy support invariably rises, the competition from other providers of information and insight grows keener, and the sheer need of policymakers and action-takers for analytic support to deal with difficult national security issues ever increases. Moreover, frequent policymaker turnover and periodic broadening of the policy customer base (as with Homeland Defense after the terrorist attack of 11 September 2001) generate an ongoing need to establish access, credibility, and effective relations generally with new policy players. DI performance in support of the policymaking cannot rest on its laurels.
What follows are some summary recommendations to clarify the choices of DI analysts as they face what Sherman Kent so aptly depicted as a never-ending effort to keep intelligence-policy relations effective.
- Define the analysts’ mission realistically. The standard of “Delivering Truth to Power” is an essential but often symbolic standard. On complex issues where analysts are not fully informed on US intentions, much less those of adversaries and other players, the more realistic standard for analysts is to “Tell It like They Think It Is.” When estimative prediction is called for, remember the veteran policy official is also an analyst: make sure the argument made is transparent and sound, the supporting evidence is authentic and ample, and plausible alternative outcomes are given their due.
- Become well informed on policymaking in Washington. To get the DI’s job done, analysts must become expert on how the US government works as well as the foreign governments and groups they track abroad, especially regarding where key policy clients are on their decision cycles and learning curves. How? Debrief senior colleagues who attend interagency meetings and have other direct contacts. Read what the senior officials say and what is said about them in the media. Cultivate relations with their policy staff officers. As former DDI Bob Gates averred:
Unless intelligence officers are down in the trenches with the policymakers, understand the issues, and know what US objectives are, how the process works, and who the people are, they cannot possibly provide either relevant or timely intelligence that will contribute to better-informed decisions.
3. Place your trust in tradecraft. If the mission of intelligence analysis is to inform policymaking—to help the US government anticipate threats and seize opportunities—then customization of analysis is the essence of professional practice, not a defilement of it (i.e., politicization). In effect there is no such thing as an unprofessional policymaker question for intelligence to address so long as the answer reflects professional analytic tradecraft (e.g., tough-minded weighing of evidence and open-minded consideration of alternatives).
In the absence of explicit policymaker tasking, analysts should couch the assignment the way policy professionals would to get their jobs done, and then answer it like an intelligence professional—for example, a critical review of key foreign players and their stakes for and against a US policy initiative.
- Learn from the DI’s own “best practices.” The DI regularly engages in two kinds of transactions with policy officials that greatly increase the utility of the analysts’ specialized substantive and tradecraft expertise for the policymaking process. To the extent applicable, the approaches used to inform policymaking in crisis management and with orally delivered analysis should be adopted in all intelligence deliverables.
Crisis Management analysis. Like anticipation of hanging, a policy crisis focuses the mind. For policymakers as well as analysts, crisis shortens the line of communication regarding what analytic support is needed and whether the deliverable did the job. Drawing on personal experience, or that of a colleague or a case study, assess what kinds of questions policy officials ask and what kinds of answers experienced analysts find appropriate. If a US warfighter needs and appreciates the analysts best judgment on how the United States can put pressure on the enemy’s leadership during a military engagement, why cannot analysts address in cost-benefit terms US tactical alternatives in a broad number of non-crisis assessments.
Orally delivered analysis. Delivering analytic support to policy officials directly—telephone exchanges, teleconferences, briefings, interagency meetings—also adds the efficiencies of instant guidance, feedback, and follow-up. Not only can the analyst gain a better measure of what his client needs, but the policy official also gains a better measure of what the analyst knows that can help get the policy job done. If these exchanges are deemed both professional and effective when delivered orally, why not adopt when appropriate the underlying techniques for written assessments. For example, simulate an oral exchange by organizing the written assessment by means of thoughtful policymaker questions and professionally couched analyst answers.
- Balance estimative analysis with action analysis. DI analysts have an unqualified professional responsibility for comprehensive assessments, including—when justified by tradecraft standards—strategic warnings, delineation of perceived foreign obstacles to US objectives, and other forms of “bad news.” But a special effort should be made to ascertain whether the policy community has heard the message. If so, analysts should then supplement bottom-line estimating with action analysis; say, the opportunities in cost-benefit terms for incremental advancement of US interests. Policymakers are much more likely to pay serious heed to analysts’ assessments of what the United States “can’t do,” if these are balanced with assessments that address professionally what the United States “can do.”