Published Sources

Akin, Omer. Models of Architectural Knowledge. London: Pion, 1980.

Allen, Charles, Comments of the Associate Director of Central Intelligence for Collection at a Public Seminar on Intelligence at Harvard University, spring 2000. (< id+518>.)

Allison, Graham T. Essence of Decision: Explaining the Cuban Missile Crisis. Boston: Little, Brown and Company, 1971.

American Anthropological Association. Code of Ethics of the American Anthropological Association. Arlington, VA, 1998. (
———. Statement on the Confidentiality of Field Notes. Arlington, VA, 2003. (

American College of Radiology. Written communications between staff and Johnston, 2002.

Arvey, Richard D., and James E. Campion. “The Employment Interview: A Summary of Recent Research,” Personnel Psychology 35 (1982): 281–322.

Ashcraft, M.H. Fundamentals of Cognition. New York: Addison Wesley Longman, 1998.

Atkinson, R. C., and H. A. Wilson. Computer-Assisted Instruction: A Book of Readings, New York: Academic Press, 1969.

Au, Terry K. “Chinese and English Counterfactuals: The Sapir-Whorf Hypothesis Revisited,” Cognition 15 (1983): 155–87.

Barr, A., M. Beard, and R. C. Atkinson. “A Rationale and Description of a CAI Program to Teach the

BASIC Programming Language.” Instructional Science 4 (1975): 1–31.

Bayes, Thomas. “An Essay Toward Solving a Problem in the Doctrine of Chances,” Philosophical Transactions of the Royal Society of London 53: 370–418. (

Ben-Israel, Isaac. “Philosophy and Methodology of Intelligence: The Logic of Estimate Process,” Intelligence and National Security 4, no. 4 (1989): 660–718.

Ben-Zvi, Abraham. “The Study of Surprise Attacks,” British Journal of International Studies 5 (1979).

Berkowitz, Bruce D., and Allan E. Goodman. Best Truth: Intelligence in the Information Age. New
Haven, CT: Yale University Press, 2000.

———. Strategic Intelligence for American National Security. Princeton, NJ: Princeton University Press, 1989.

Bernard, Russell. Research Methods in Anthropology: Qualitative and Quantitative Approaches. Thousand Oaks, CA: Sage, 1994.

Betts, Richard K. “Policy-Makers and Intelligence Analysts: Love, Hate or Indifference,” Intelligence and National Security 3, no. 1 (January 1988): 184–89.

———. Surprise Attack. Washington, DC: The Brookings Institution, 1982.

Bickman, Leonard, and Debra Rog. Handbook of Applied Social Research Methods. Thousand Oaks, CA: Sage, 1997.

Bloom, Alfred. The Linguistic Shaping of Thought: A Study in the Impact of Language on Thinking in China and the West. Hillsdale, NJ: Lawrence Erlbaum Associates, 1981.

Bloom, Benjamin S., ed. Taxonomy of Educational Objectives: The Classification of Educational Goals: Handbook I, Cognitive Domain. New York: Longmans, Green, 1956.

———. “The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring,” Educational Researcher, 13 (1984): 4–16.

Boas, Franz. “An Anthropologist’s Credo,” The Nation 147 (1938): 201–4.

Bogdan, Robert. Participant Observation in Organizational Settings. Syracuse, NY: Syracuse University Press, 1972.

Boroditsky, Lera. “Does Language Shape Thought? Mandarin and English Speakers’ Conceptions of Time,” Cognitive Psychology 43 (2001): 1–22.

Bourdieu, Pierre. “The Forms of Capital” in John Richardson, ed. Handbook of Theory and Research for the Sociology of Education. New York: Greenwood Press, 1986.

Brei, William. Getting Intelligence Right: The Power of Logical Procedure. Washington, DC: Joint Military Intelligence College, 1996.

Brinberg, David, and Joseph McGrath. Validity and the Research Process. Beverly Hills, CA: Sage, 1985.

Brown, J.S., R.R. Burton, and J. DeKleer. “Pedagogical, Natural Language, and Knowledge Engineering in SOPHIE I, II, and III” in D. Sleeman and J.S. Brown, eds. Intelligent Tutoring Systems, New York: Academic Press, 1982.

Busse, Daniela, and Chris Johnson. “Using a Cognitive Theoretical Framework to
Support Accident Analysis,” Proceedings of the Working Group on Human Error, Safety, and System Development. Seattle, WA: International Federation for Information Processing, 1998, 36–43.

Butterfield, Alexander. The Accuracy of Intelligence Assessment: Bias, Perception, and Judgment in Analysis and Decision. Newport, RI: Naval War College, 1993, AD-A266.

Camerer, Colin, and Eric Johnson. “The Process-Performance Paradox in Expert Judgment: How Can Experts Know so Much and Predict so Badly?” in K. Anders Ericsson and Jacqui Smith, eds. Toward a General Theory of Expertise: Prospects and Limit. Cambridge: Cambridge University Press, 1991.

Cannon-Bowers, Janis, Eduardo Salas, and S. Converse. “Shared Mental Models in Expert Team Decision Making” in J. N. John Castellan, ed. Current Issues in Individual and Group Decision Making. Hillsdale, NY: Lawrence Erlbaum Associates, 1983.

Capra, Fritjof. “Criteria of Systems Thinking,” Futures, October 1985: 475–78.

Carbonell, J. R. “AI in CAI: An Artificial Intelligence Approach to Computer-Assisted Instruction” in IEEE Transactions on Man-Machine Systems, 11 (1970): 190–202; J. D. Fletcher and M. R. Rockway loc. cit.

Carmines, Edward, and Richard Zeller. Reliability and Validity Assessment. Newbury Park, CA: Sage, 1991.

Cartwright, Dorwin, and Alvin Zander. Group Dynamics: Research and Theory. New York: Harper & Row, 1960.

Cascio, Wayne F. Applied Psychology in Human Resource Management. 5th ed. Englewood Cliffs, NJ: Prentice Hall, 1998.

Cassirer, Ernest. “Le Langage et le Monde des Objets,” Journal de Psychologie Nomale et Pathologique 30, 1(4) (1933): 18–44.

Central Intelligence Agency. A Consumer’s Guide to Intelligence. Washington, DC: Central Intelligence Agency, 1993.

———. Factbook on Intelligence (
Chambers, Erve. Applied Anthropology: A Practical Guide. Prospect Heights, IL: Waveland Press, 1989.

Chase, William G. “Spatial Representations of Taxi Drivers” in Don Rogers and John Slobada, eds. Acquisition of Symbolic Skills. New York: Plenum, 1983.

———, and Herbert Simon. “Perception in Chess,” Cognitive Psychology 4 (1973): 55–81.

———, and K. Anders Ericsson. “Skill and Working Memory” in Gordon Bower, ed. The Psychology of Learning and Motivation. New York: Academic Press, 1982.

Chi, Michelene, Robert Glaser, and Ernest Rees. “Expertise in Problem Solving” in Robert Sternberg, ed. Advances in the Psychology of Human Intelligence. Hillsdale, NJ: Lawrence Erlbaum Associates, 1982.

———, Paul Feltovich, and Robert Glaser. “Categorization and Representation of Physics Problems by Experts and Novices,” Cognitive Science 5 (1981): 121–25.

Chu, Godwin, and Wilbur Schramm. Learning from Television: What the Research Says. Stanford, CA: Stanford University, Institute for Communication Research, 1968.

Clauser, Jerome K., and Sandra M. Weir. Intelligence Research Methodology: An Introduction to Techniques and Procedures for Conducting Research in Defense Intelligence. Washington, DC: US Defense Intelligence School, 1976.

Cline, Marjorie, Carla Christiansen, and Judith Fontaine. Scholar’s Guide to Intelligence Literature: Bibliography of the Russell J. Bowen Collection. Frederick, MD: University Publications of America, 1983.

Coch, Lester, and John French. “Overcoming Resistance to Change,” Dorwin Cartwright and Alvin Zander, eds. Group Dynamics: Research and Theory. New York: Harper & Row, 1960.

Cohen, Peter, James Kulik, and Chen-Lin Kulik. “Educational Outcomes of Tutoring: A Meta-Analysis of Findings,” American Educational Research Journal 19 (1982): 237–48.

Cushman, Philip. Constructing the Self, Constructing America. Reading, MA: Addison-Wesley, 1995.

Davis, Jack. “Combating Mindset,” Studies in Intelligence 35 (Winter 1991): 13–18.

Dawes, Robyn. Written communications between Dawes and Johnston, 2002.

———. “A Case Study of Graduate Admissions: Application of Three Principles of Human
Decision Making,” American Psychologist 26 (1971): 180–88.

———, David Faust, and Paul Meehl. “Clinical Versus Actuarial Judgment,” Science 243 (1989): 1668–74.

Dearth, Douglas, and R. Thomas Goodden, eds. Strategic Intelligence: Theory and Application, 2nd ed. Washington, DC: Joint Military Intelligence College, 1995.

Denzin, Norman, and Yvonna Lincoln, eds. Handbook of Qualitative Research. Thousand Oaks, CA: Sage, 1994.

Deutsch, Morton. “The Effects of Cooperation and Competition Upon Group Process” in Dorwin Cartwright and Alvin Zander, eds. Group Dynamics: Research and Theory. New York: Harper & Row, 1960.

Duffy, T. M., and D. H. Jonassen, eds. Constructivism and the Technology of Instruction: A Conversation. Hillsdale, NJ: Erlbaum, 1992.

Eco, Umberto. A Theory of Semiotics. Bloomington, IN: Indiana University Press, 1979.

Egan, D., and B. Schwartz. “Chunking in Recall of Symbolic Drawings,” Memory and Cognition 7 (1979): 149–58.

Elkins, Dan. An Intelligence Resource Manager’s Guide. Washington, DC: Joint Military Intelligence College, 1997.

Endsley, M.R. “Design and Evaluation for Situation Awareness Enhancement,” Proceedings of Human Factors Society 32nd Annual Meeting, Santa Monica, CA: Human Factors Society, 1988.

Ervin, Alexander. Applied Anthropology. Tools and Perspectives for Contemporary Practice. Boston: Allyn and Bacon, 2000.

Evans, Jonathan St. B. T. Bias in Human Reasoning: Causes and Consequences. Hove, UK: Lawrence Erlbaum Associates, 1989.

Fandt, Patricia, W. Richardson, and H. Conner. “The Impact of Goal Setting on Team Simulation Experience,” Simulation and Gaming 21, no. 4 (1990): 411–22.

Feder, Stanley. “FACTIONS and Policon: New Ways to Analyze Politics,” (1987), in H. Bradford Westerfield, ed. Inside CIA’s Private World: Declassified Articles from the Agency’s Internal Journal. New Haven, CT: Yale University Press, 1995.

Feldman, Daniel C. “The Multiple Socialization of Organization Members.” Academy of Management Review 6, no. 2 (1981): 309–18.

Feldman, Tine, and Susan Assaf. Social Capital: Conceptual Frameworks and Empirical Evidence. An Annotated Bibliography. Social Capital Initiative Working Paper No. 5. Washington, DC: The World Bank, 1999.

Festinger, Leon. “Informal Social Communication” in Dorwin Cartwright and Alvin Zander, eds. Group Dynamics: Research and Theory. New York: Harper & Row, 1960.

Fishburn, Peter. Utility Theory for Decision Making. New York. John Wiley, 1970.

Fitts, Paul, and Michael Posner. Human Performance. Belmont, CA: Brooks Cole, 1967.

Flavell, J.H. “Metacognitive Aspects of Problem Solving” in L. Resnick, ed. The Nature of Intelligence. Hillsdale, NJ: Lawrence Erlbaum Associates, 1976.

Fleisher, Craig, and Babette Bensoussan. Strategic and Competitive Analysis. Methods and Techniques for Analyzing Business Competition. Upper Saddle River, NJ: Pearson Education, 2003.

Fleishman, Edwin, and Marilyn Quaintance. Taxonomies of Human Performance. New York: Academic Press, 1984.

Fletcher, J. Dexter. “Computer-Based Instruction: Costs and Effectiveness” in Andrew Sage, ed. Concise Encyclopedia of Information Processing in Systems and Organizations. Elmsford, NY: Pergamon Press, 1990.

———. Effectiveness and Cost of Interactive Videodisc Instruction in Defense Training and Education. Alexandria, VA: Institute for Defense Analyses, 1990, IDA P-2372.

———. “Evidence for Learning From Technology-Assisted Instruction” in Harold F. O'Neil, Jr. and Ray Perez, eds. Technology Applications in Education: A Learning View. Hillsdale, NJ: Lawrence Erlbaum Associates, 2003.

———. Technology, the Columbus Effect, and the Third Revolution in Learning. Alexandria, VA: Institute for Defense Analyses, 2001, D-2562.

———, and Rob Johnston. “Effectiveness and Cost Benefits of Computer-Based Decision Aids for Equipment Maintenance,” Computers in Human Behavior 18 (2002): 717–28.

———, and M. R. Rockway. “Computer-based Training in the Military” in J. A. Ellis, ed. Military Contributions to Instructional Technology. New York: Praeger Publishers, 1986.

Folker, Robert D. Intelligence Analysis in Theater Joint Intelligence Centers: An Experiment in Applying Structured Methods. Washington, DC: Joint Military Intelligence College, Occasional Paper #7, 2000.

Ford, Harold. Estimative Intelligence: The Purposes and Problems of National Intelligence Estimating. Lanham, MD: University Press of America, 1993.

Freud, Sigmund. “A Philosophy of Life: Lecture 35,” New Introductory Lectures on Psycho-Analysis. London: Hogarth Press, 1933.

Fries, J., et al. “Assessment of Radiologic Progression in Rheumatoid Arthritis: A Randomized, Controlled Trial,” Arthritis Rheum 29, no. 1 (1986): 1–9.

Fuld, Leonard. The New Competitor Intelligence: The Complete Resource for Finding, Analyzing, and Using Information About Your Competitors. New York: John Wiley & Sons, 1995.

Galanter, E., ed. Automatic Teaching: The State of the Art. New York: John Wiley & Sons, 1959.

Gall, Meredith, Walter Borg, and Joyce Gall. Educational Research, Sixth Edition. White Plains, NY: Longman, 1996.

Garst, Ronald, ed. A Handbook of Intelligence Analysis, 2nd ed. Washington, DC: Defense Intelligence College, 1989.

Geertz, Clifford. The Interpretation of Cultures. New York: Basic Books, 1973.

Giddens, Anthony. Modernity and Self-Identity. Stanford, CA: Stanford University Press, 1991.

Glaser, Barney, and Anselm Strauss. Discovery of Grounded Theory: Strategies for Qualitative Research. Hawthorne, NY: Aldine de Gruyter, 1967.

———. Theoretical Sensitivity: Advances in the Methodology of Grounded Theory. Mill Valley, CA: Sociology Press, 1978.

———. Basics of Grounded Theory Analysis: Emergence vs. Forcing. Mill Valley, CA: Sociology Press, 1992.

Glass, Gene. “Primary, Secondary, and Meta-Analysis of Research.” Educational Researcher 5 (1976): 3–8.

———, and Barry McGaw. “Choice of the Metric for Effect Size in Meta-Analysis.” American Educational Research Journal 17 (1980): 325–7.

———, Barry McGaw, and Mary Lee Smith. Meta-Analysis in Social Research. New York: Sage, 1981.

Godson, Roy, ed. Comparing Foreign Intelligence: The U.S., the USSR, the U.K. and the Third World. Washington, DC: Pergamon-Brassey, 1988.

Goldberg, Lewis. “Simple Models or Simple Processes? Some Research on Clinical Judgments,” American Psychologist 23 (1968): 483–96.

———. “Man versus Model of Man: A Rationale, Plus Some Evidence, for a Method of Improving on Clinical Inferences,” Psychological Bulletin 73 (1970): 422–32.

Goldgeier, James M. “Psychology and Security,” Security Studies 6, no. 4 (1997): 137–66.

Gott, Sherrie, P.R.S. Kane, and Alan Lesgold. Tutoring for Transfer of Technical Competence. Brooks AFB, TX: Armstrong Laboratory, Human Resources Directorate, 1995,  AL/HR-TP-1995-0002.

Graesser, A.C., M.A. Gernsbacher, and S. Goldman, eds. Handbook of Discourse Processes, Mahwah, NJ: Lawrence Erlbaum Associates, 2003.

———, and Natalie Person. “Question-Asking During Tutoring.” American Educational Research Journal 31 (1994): 104–37.

Greenberg, Jerald, and Robert A. Baron. Behavior in Organizations: The Human Side of Work. Upper Saddle River, NJ: Prentice-Hall, 2002.

Grimes, Barbara, ed. Ethnologue, 14th ed. Dallas, TX: Summer Institute of Linguistics, 2000.

Gross, Jonathan. Measuring Culture: A Paradigm for the Analysis of Social Organization. New York: Columbia University Press, 1985.

Grove, William, and Paul Meehl. “Comparative Efficiency of Informal (Subjective, Impressionistic) and Formal (Mechanical, Algorithmic) Prediction Procedures: The Clinical-Statistical Controversy,” Psychology, Public Policy, and Law 2, no. 2 (1996): 293–323.

Gumperz, John, and Dell Hymes. Directions in Sociolinguistics: The Ethnography of Communication. Oxford: B. Blackwell, 1986.

———, and Stephen Levinson. Rethinking Linguistic Relativity. Cambridge: Cambridge University Press, 1996.

Hacker, D.J. Metacognition: Definitions and Empirical Foundations [On-line report]. Memphis, TN: The University of Memphis, 2001. Retrieved 30 May 2001 from the World Wide Web. (

Hammond, John, Ralph Keeney, and Howard Raiffa. “The Hidden Traps in Decision Making.” Harvard Business Review, September–October 1998, 47–58.

Harvey, J., and C. Boettger. “Improving Communication Within a Managerial Workgroup,” Journal of Applied Behavioral Science 7 (1971): 164–74.

Hayes, J.R. The Complete Problem Solver, Philadelphia: The Franklin Institute, 1981.

Hays, R. T., et al. “Flight Simulator Training Effectiveness: A Meta-Analysis.” Military Psychology
4, no. 2 (1992): 63–74.

Hedges, Larry. “Estimation of Effect Size From a Series of Independent Experiments,” Psychological Bulletin, 7 (1982): 119–37.

———, and Ingram Olkin. “Vote-Counting Methods in Research Synthesis,” Psychological Bulletin 88 (1980): 359–69.

———, and Ingram Olkin. Statistical Methods for Meta-Analysis. New York: Academic Press,

Helfrich, Hede. “Human Reliability From a Social-Psychological Perspective,” International Journal Human-Computer Studies 50 (1999): 193–212.

Hesketh, Beryl, and Stephen Bochner. “Technological Change in a Multicultural Context: Implications for Training and Career Planning” in Marvin Dunnette and Leaetta Hough, eds.

Handbook of Industrial and Organizational Psychology. Palo Alto, CA: Consulting Psychologists Press, 1994.

Heuer, Richards J., Jr. Psychology of Intelligence Analysis. Washington, DC: Center for the Study of Intelligence, 1999.

Hewitt, John P. Self and Society, 7th ed. Boston: Allyn and Bacon, 1997.

Hinchman, Lewis P., and Sandra K. Hinchman, eds. Memory, Identity, Community. Albany, NY: State University of New York Press, 1997.

Hoijer, Harry. “The Relation of Language to Culture” in Alfred Kroeber, ed. Anthropology Today. Chicago: University of Chicago Press, 1953.

Hollnagel, Erik. “The Phenotype of Erroneous Actions.” International Journal of Man-Machine Studies 39 (1993): 1–32.

Hopkins, R. Warnings of Revolution: A Case Study of El Salvador. Washington, DC: Center for the Study of Intelligence, 1980, TR 80-100012.

House, Ernest. Evaluating with Validity. Beverly Hills, CA: Sage, 1980.

Hubble, Edwin. The Realm of the Nebulae. New Haven, CT: Yale University Press, 1936.

Hulnick, Arthur S. “The Intelligence Producer-Policy Consumer Linkage: A Theoretical Approach,” Intelligence and National Security 1, no. 2 (May 1986): 212–33.

Hunt, David. Complexity and Planning in the 21st Century: Intelligence Requirements to Unlock the Mystery. Newport, RI: Naval War College, 2000.

Hunt, Earl, and Franca Agnoli. “The Whorfian Hypothesis. A Cognitive Psychology Perspective,” Psychological Review 98, no. 3 (1991): 377–89.

Hymes, Dell, ed. Language in Culture and Society: A Reader in Linguistics and Anthropology. New York: Harper and Row, 1977.

Iaffaldano, Michelle T., and Paul M. Muchinsky. “Job satisfaction and Job Performance: A Meta-Analysis,” Psychological Bulletin 97 (1985): 251–73.

James, William. Principles of Psychology: Volume I. New York: Dover Press, 1890/1950.

Janis, Irving. Groupthink, 2nd ed. Boston: Houghton Mifflin, 1982.

Janssens, Maddy. “Interculture Interaction: A Burden on International Managers?” Journal of Organizational Behavior 16 (1995): 155–67.

Jervis, Robert. Perception and Misperception in International Politics. Princeton, NJ: Princeton University Press, 1977.

Johnson, David, and Roger Johnson. “The Internal Dynamics of Cooperative Learning Groups” in Richard Slavin, et al., eds. Learning to Cooperate, Cooperating to Learn. New York: Plenum, 1985.
———, et al. “Effects of Cooperative, Competitive, and Individualistic Goal Structure on Achievement: A Meta-Analysis,” Psychological Bulletin 89, no. 1 (1981): 47–62.

———, et al. “The Impact of Positive Goal and Resource Interdependence on Achievement, Interaction, and Attitudes,” Journal of General Psychology 118, no. 4 (1996): 341–47.

Johnson, Edgar. Effects of Data Source Reliability on Inference. Alexandria, VA: Army Research Institute for the Behavioral and Social Sciences, Technical Paper #251, 1974.

Johnston, Rob. Decision Making and Performance Error in Teams: Research Results. Arlington, VA: Defense Advanced Research Projects Agency, 1997.

———. “The Effectiveness of Instructional Technology,” Proceedings of the Virtual Reality in Medicine and Developers’ Exposition. Cambridge, MA: VRS, 1995.

———. “Electronic Performance Support Systems and Information Navigation,” Thread 2, no. 2 (1994): 5–7.

———, and Sunil Bhoyrul. “A Preliminary Report of a Task Analysis of Laparoscopic Cholecystectomy Used to Assess the Effectiveness of a Virtual Reality Surgical Simulator,” Journal of Virtual Reality in Medicine 2, no. 1 (1996): 16–19.

———, et al. “Assessing a Virtual Reality Surgical Skills Simulator” in Suzanne Weghorst, Hans Sieburg, and Karen Morgan, eds. Health Care in the Information Age: Future Tools for Transforming Medicine. Washington, DC: IOS Press, 1996.

———, and J. Dexter Fletcher. A Meta-Analysis of the Effectiveness of Computer-Based Training for Military Instruction. Alexandria, VA: Institute for Defense Analyses, 1998.

———, J. Dexter Fletcher, and Sunil Bhoyrul. The Use of Virtual Reality to Measure Surgical Skill Levels. Alexandria, VA: Institute for Defense Analyses, 1998.
Jones, Morgan. The Thinker’s Toolkit: 14 Powerful Techniques for Problem Solving. New York: Times Business, 1998.

Jung, Carl. The Undiscovered Self. Translated by R.F.C. Hull. Princeton, NJ: Princeton University Press, 1990.

Kahaner, Larry. Competitive Intelligence. How to Gather, Analyze, and Use Information to Move Your Business to the Top. New York: Touchstone, Simon and Schuster, 1996.

Kahneman, Daniel, and Amos Tversky. “Prospect Theory: An Analysis of
Decision Under Risk,” Econometrica 47, no. 2 (1979): 263–91.

———, Paul Slovic, and Amos Tversky. Judgment Under Uncertainty: Heuristics and Biases. Cambridge: Cambridge University Press, 1982.

Kam, Ephraim. Surprise Attack. The Victim’s Perspective. Cambridge: Harvard University Press, 1988.

Kaufman, David L., Jr. Introduction to Systems Thinking. Minneapolis: Future Systems, 1978.

Kaufman, Roger. “A Holistic Planning Model: A Systems Approach for Improving Organizational Effectiveness and Impact,” Performance and Instruction Journal, October 1983: 3–10.

Kent, Sherman. Strategic Intelligence for American World Policy. Princeton: Princeton University Press, 1966.

———. “Words of Estimative Probability,” Sherman Kent and the Board of National Estimates: Collected Essays. Washington, DC: Center for the Study of Intelligence, 1994.

Kirk, Jerome, and Marc Miller. Reliability and Validity in Qualitative Research. Qualitative Research Methods, Volume 1. Newbury Park, CA: Sage, 1986.

Kirkpatrick, Lyman B., Jr. Captains Without Eyes: Intelligence Failures in World War II. London: MacMillan Company, 1969.

Klahr, D., and H.A. Simon. “What Have Psychologists (and Others) Discovered About the Process of Scientific Discovery?” Current Directions in Psychological Science 10.

Klein, Gary, Roberta Calderwood, and A. Clinton-Cirocco. Rapid Decision Making on the Fire Ground. Yellow Springs, OH: Klein Associates, 1985, KA-TR-84-41-7 (prepared under contract MDA903-85-G-0099 for the US Army Research Institute, Alexandria, VA).

Knight, Frank H. Risk, Uncertainty and Profit. Boston: Houghton Mifflin, 1921.

Knorr, Klaus. “Foreign Intelligence and the Social Sciences.” (Research monograph, Center of International Studies, Princeton University, 1964.)

Krizan, Lisa. Intelligence Essentials for Everyone. Washington, DC: Joint Military Intelligence College, 1999.

Krotow, Geraldine. The Impact of Cognitive Feedback on the Performance of Intelligence Analysts. Monterey, CA: Naval Postgraduate School, 1992, AD-A252.

Kuhn, Thomas. The Structure of Scientific Revolutions. Chicago: The University of Chicago Press, 1970.

Kulik, Chen-Lin, and James Kulik. “Effectiveness of Computer-Based Education in Colleges,” AEDS Journal, Winter/Spring 1986: 81–108.

———, and Barbara Shwalb, “Effectiveness of Computer-Based Adult Education: A Meta-Analysis,” Journal of Educational Computing Research 2, no. 2 (1986): 235–52.

Kulik, James. “Meta-Analytic Studies of Findings on Computer-Based Instruction” in Eva Baker and

Harold O'Neil, eds. Technology Assessment in Education and Training. Hillsdale, NJ: LEA Publishers, 1994.

Lacan, Jacques. Ecrits. Translated by Alan Sheridan. New York: W.W. Norton, 1977.

Laqueur, Walter A. The Uses and Limits of Intelligence. New Brunswick, NJ: Transaction Publishers, 1993.

Larkin, Jill. “The Role of Problem Representation in Physics” in Debra Gentner and Albert Stevens, eds. Mental Models. Hillsdale, NJ: Lawrence Erlbaum Associates, 1983.

Lee, Penny. The Whorf Theory Complex: A Critical Reconstruction. Amsterdam: Benjamins, 1996.

Leli, D., and S. Filskov. “Clinical-Actuarial Detection of and Description of Brain Impairment with the
Wechsler-Bellevue Form I,” Journal of Clinical Psychology 37 (1981): 623–29.

Lesgold, Alan, et al. “Expertise in a Complex Skill: Diagnosing X-Ray Pictures” in Michelene Chi, Robert Glaser and Marshall Farr, eds. The Nature of Expertise. Hillsdale, NJ: Lawrence Erlbaum Associates, 1988.

Levi-Strauss, Claude. Structural Anthropology. New York: The Penguin Press, 1968. (Originally published in 1958.)

Levine, George, ed. Constructions of the Self. Brunswick, NJ: Rutgers University Press, 1992.

Levinson, David, and Melvin Ember, eds. American Immigrant Cultures: Builders of a Nation. Vol. I and II. New York: Macmillan Reference, 1997.

Litwin, Mark. “How to Measure Survey Reliability and Validity” in Arlene Fink, ed. The Survey Kit. Volume 7. Thousand Oaks, CA: Sage, 1995.

Liu, Lisa. “Reasoning Counterfactually in Chinese: Are There Any Obstacles?” Cognition 21 (1985): 239–70.

Locke, Edwin A. “The Nature and Causes of Job Satisfaction” in Marvin Dunnette, ed. Handbook of Industrial and Organizational Psychology. Chicago: Rand McNally, 1976.

Lockwood, Jonathan, and K. Lockwood. “The Lockwood Analytical Method for Prediction (LAMP),” Defense Intelligence Journal 3, no. 2 (1994): 47–74.

Lowenthal, Mark. Intelligence: From Secrets to Policy. Washington, DC: CQ, 2000.

Luce, Duncan, and Howard Raiffa. “Utility Theory.” Paul Moser, ed. Rationality in Action. Contemporary Approaches. New York. Cambridge University Press, 1990.

Lucy, John. Grammatical Categories and Cognition. Cambridge: Cambridge University Press, 1992.

———. Language Diversity and Thought. Cambridge: Cambridge University Press, 1992.
MacEachin, Douglas J., et al. The Tradecraft of Analysis: Challenge and Change in the CIA. Washington, DC: Consortium for the Study of Intelligence, 1994.

Marrin, Stephen. CIA’s Kent School. A Step in the Right Direction. Paper presented at the International Studies Association Annual Convention, New Orleans, LA, 2002. (

———. “Improving CIA Analysis by Overcoming Institutional Obstacles” in Russell G. Swenson, ed. Bringing Intelligence About: Practitioners Reflect on Best Practices. Washington, DC: Joint
Military Intelligence College, 2003.

Mathams, Robert. “The Intelligence Analyst’s Notebook” in Douglas Dearth and R. Thomas Goodden, eds. Strategic Intelligence: Theory and Application, 2nd ed. Washington, DC: Joint Military Intelligence College, 1995.

Mauss, Marcel. The Gift: The Form and Reason for Exchange in Archaic Societies. Translated by W. D. Halls. New York: W. W. Norton, 2000.

Mayo, Elton. The Human Problems of an Industrial Civilization. New York: MacMillan, 1933.

McDowell, Don. Strategic Intelligence: A Handbook for Practitioners, Managers and Users. Canberra, Australia: Istana Enterprises, 1998.

McEvoy, Glenn M., and Wayne F. Cascio. “Strategies for Reducing Employee Turnover: A Meta-Analysis,” Journal of Applied Psychology 70, no. 2 (1985): 342–53.

McGuire, Hunter, et al. “Measuring and Managing Quality of Surgery: Statistical vs. Incidental Approaches,” Archives of Surgery 127 (1992): 733–37.

McKeithen, Katherine, et al. “Knowledge Organization and Skill Differences in Computer Programmers,” Cognitive Psychology 13 (1981): 307–25.

Mead, George. Mind, Self, and Society. Charles Morris, ed. Chicago: University of Chicago Press, 1967.

Meglino, Bruce M., et al. “Effects of Realistic Job Previews: A Comparison Using an Enhancement and a Reduction Preview.” Journal of Applied Psychology 71 (1988): 259–66.

Meister, David. Behavioral Analysis and Measurement Methods. New York: Wiley, 1985.

———. Human Factors: Theory and Practice. New York: Wiley, 1971.

Meister, Judith. “Individual Perceptions of Team Learning Experiences Using Video-Based or Virtual Reality Environments,” Dissertation Abstracts International, UMI No. 9965200, 2000.

Miller, Delbert. Handbook of Research Design and Social Measurement. Newbury Park, CA: Sage, 1991.

Miller, George, and Philip Johnson-Laird. Language and Perception. Cambridge: Harvard University Press, 1976.

Mills, Theodore. “Power Relations in Three-Person Groups” in Dorwin Cartwright and Alvin Zander, Group Dynamics: Research and Theory. New York: Harper & Row, 1960.

Min Qi, Zhongguo Zhengzhi Wenhua [Chinese Political Culture]. Kunming, China: Yunnan People’s Press, 1989.

Minsky, Marvin, and Seymour Papert. Artificial Intelligence. Eugene: Oregon State System of Higher Education, 1974.

Molm, Linda. “Linking Power Structure and Power Use” in Karen Cook, ed. Social Exchange Theory. Newbury Park, CA: Sage, 1987.

Moore, David. “Creating Intelligence: Evidence and Inference in the Analysis Process.” Unpublished Masters Thesis. Washington, DC: Joint Military Intelligence College, 2002.

Morris, C.D., J.D. Bransford, and J.J. Franks. “Level of Processing Versus Transfer-Appropriate Processing,” Journal of Verbal Learning and Verbal Behavior 16 (1977).

Morrison, J.E., and J.D. Fletcher. Cognitive Readiness. Alexandria, VA: Institute for Defense Analyses, 2001, IDA Paper P-3735.

———, and Larry Meliza. Foundations of the After-Action Review Process. Alexandria, VA: Institute for Defense Analyses, 1999.

Mullen, Brian, and Carolyn Copper. “The Relation Between Group Cohesiveness and Performance: An Integration,” Psychological Bulletin, 115 (1994): 210–27.

National Aeronautics and Space Administration. Astronaut Fact Book. NP-2000-09-008JSC. Washington, DC: NASA, 2000.

Neisser, U. Cognitive Psychology. New York: Appleton, Century Crofts, 1967.

Nieva, V., E. Fleishman, and A. Rieck. Team Dimensions: Their Identity, Their Measurement, and Their Relationships, RN 85-12. Alexandria, VA: US Army Research Institute for the Behavioral and Social Sciences, 1985.

Nijhof, W., and P. Kommers. “An Analysis of Cooperation in Relation to Cognitive Controversy” in Richard Slavin, Shlomo Sharan, Spencer Kagan, et al., eds. Learning to Cooperate, Cooperating to Learn. New York: Plenum, 1985.

Nisbett, Richard, and Ara Norenzayan. “Culture and Cognition” in Douglas Medin and Hal Pashler, eds. Stevens’ Handbook of Experimental Psychology, 3rd ed., New York: John Wiley & Sons, 2002.

Nolte, William. “Preserving Central Intelligence: Assessment and Evaluation in Support of the DCI, ” Studies in Intelligence 48, no. 3 (2005): 21–25.

Orasanu, Judith. “Shared Mental Models and Crew Performance.” Paper presented at the 34th annual meeting of the Human Factors Society, Orlando, FL, 1990.

———, and Lynne Martin. “Errors in Aviation Decision Making: A Factor in Accidents and Incidents,” Proceedings of the Working Group on Human Error, Safety, and System Development. Seattle, WA: International Federation for Information Processing, 1998: 100–107.

Orlansky, Jesse, and Joseph String. Cost-Effectiveness of Computer-Based Instruction in Military Training. Alexandria, VA: Institute for Defense Analyses, 1979. IDA P-1375.

———, et al. The Cost and Effectiveness of the Multi-Service Distributed Training Testbed (MDT2) for Training Close Air Support. Alexandria, VA: Institute for Defense Analyses, 1997.

———. The Value of Simulation for Training. Alexandria, VA: Institute for Defense Analyses, 1994. IDA P-2982.

Paige, Jeffery, and Herbert Simon. “Cognition Processes in Solving Algebra Word Problems” in Benjamin Kleinmuntz, ed. Problem Solving. New York: Wiley, 1966.

Patton, Michael. Qualitative Evaluation and Research Methods, 2nd ed. Beverly Hills, CA: Sage, 1990.

Perrow, Charles. Normal Accidents: Living with High Risk Technologies. Princeton, NJ: Princeton University Press, 1999.

———. Written communications between Perrow and Johnston, 2002.

Peterson, Marilyn. Applications in Criminal Analysis. Westport, CT: Greenwood Press, 1995.

———, Bob Morehouse, and Richard Wright, eds. Intelligence 2000: Revising the Basic Elements. Sacramento, CA: LEIU and IALEIA, 2000.

Phelps, Ruth, et al. “Effectiveness and Costs of Distance Education Using Computer-Mediated Communication,” American Journal of Distance Education 5, no. 3 (1991): 7–19.

Pierce, John. “Some Mathematical Methods for Intelligence Analysis,” Studies in Intelligence 21 (Summer 1977) (declassified): 1–19.

Popper, Karl. The Logic of Scientific Discovery. London: Hutchinson, 1959.

———. Conjectures and Refutations: The Growth of Scientific Knowledge. New York: Routledge, 2002 reprint.

Porter, Lyman W., Edward E. Lawler, and J. Richard Hackman. Behavior in Organizations. New York: McGraw-Hill, 1975.

———, et al. “Organizational Commitment, Job Satisfaction and Turnover Among Psychiatric Technicians,” Journal of Applied Psychology 59 (1974): 603-609.

Prescott, John, and Stephen Miller, eds. Proven Strategies in Competitive Intelligence. New York: John Wiley & Sons, 2001.

Price-Williams, Douglass. Explorations in Cross-Cultural Psychology. San Francisco: Chandler and Sharp, 1975.

Putnam, Robert. Bowling Alone: The Collapse and Revival of American Community. New York: Simon and Schuster, 2000.

———. “The Prosperous Community: Social Capital and Public Life,” The American Prospect 4, no. 13 (1993): 35–42.

Quirk, John, et al. The Central Intelligence Agency: A Photographic History. Guilford, CT:  Foreign Intelligence Press, 1986.

Reason, James. Human Error. New York: Cambridge University Press, 1990.

Reichenbach, Hans. Experience and Prediction. Chicago: University of Chicago Press, 1938.

Richelson, Jeffrey. The U.S. Intelligence Community, 4th ed. Boulder, CO:  Westview Press, 1999.

Roethlisberger, Fritz J., and William J. Dickson. Management and the Worker:  An Account of a

Research Program Conducted by the Western Electric Company, Hawthorne Works, Chicago.
Boston:  Harvard University Press, 1939.

Rosenberg, Marc J. “Performance Technology:  Working the System,”  Training, January 1990: 5–10.

Rossi, Peter, and Howard Freeman. Evaluation. A Systematic Approach, 5th ed. Newbury Park, CA: Sage, 1993.

Roth, P. L. ,and James E. Campion. “An Analysis of the Predictive Power of the Panel Interview and Pre-Employment Tests,” Journal of Occupational and Organizational Psychology 65 (1992): 51-60.

Sacks, H. “Promises, Performance, and Principles: An Empirical Study of Parole Decision-Making in Connecticut,” Connecticut Law Review 9 (1977): 349–422.

Salomon, G., and D.N. Perkins. “Rocky Roads to Transfer: Rethinking Mechanisms of a Neglected Phenomenon,” Educational Psychologist 24 (1998).

Sapir, Edward. Language. New York: Harcourt Brace, 1949.

Sapp, Edwin. “Decision Trees,” Studies in Intelligence 18 (Winter 1974) (declassified): 45–57.

Sarbin, Theodore. “A Contribution to the Study of Actuarial and Individual Methods of Prediction,” American Journal of Sociology 48 (1943): 593–602.

Saussure, Ferdinand. Course in General Linguistics. Translated by W. Baskin. New York: McGraw-Hill, 1959.

Sawyer, J. “Measurement and Prediction, Clinical and Statistical,” Psychological Bulletin 66 (1966): 178–200.

Schensul, Jean, and Margaret LeCompte, eds. Ethnographer’s Toolkit. Vol. I–Vol. VII. Walnut Creek, CA:  Alta Mira Press, 1999.

Schofield, W., and J. Garrard. “Longitudinal Study of Medical Students Selected for Admission to Medical School by Actuarial and Committee Methods,” British Journal of Medical Education 9 (1975): 86–90.

Schum, David. The Evidential Foundations of Probabilistic Reasoning. Evanston, IL:  Northwestern University Press, 1994.

Scriven, M. “Problems and Prospects for Individualization” in H. Talmage, ed. Systems of Individualized Education. Berkley, CA: McCutchan, 1975.

Seashore, S. Group Cohesiveness in the Industrial Workgroup. Ann Arbor: University of Michigan Press, 1954.

Segall, Marshall. Cross-Cultural Psychology: Human Behavior in Global Perspective. Monterey, CA: Brooks/Cole, 1979.

Senders, John, and Neville Moray. Human Error: Cause, Prediction and Reduction. Hillsdale, NJ: Lawrence Earlbaum Associates, 1991.

Shiels, Frederick L. Preventable Disasters: Why Governments Fail. Savage, MD:  Rowman and Littlefield Publishers, 1991.

Shiffrin, R.M. and W. Schneider. “Controlled and Automatic Human Information Processing: II. Perceptual Learning,” Psychological Review 84 (1977).

Shlaim, Avi. “Failures in National Intelligence Estimates: The Case of the Yom Kippur War,” World Politics 28, no. 3 (1976): 348–80.

Shweder, Richard. Thinking Through Cultures. Cambridge, MA: Harvard University Press, 1991.

Simmel, Georg. The Sociology of Georg Simmel. Translated by K. Wolff. Glencoe, IL: Free Press, 1950.

Simon, D., and Herbert Simon. “Individual Differences in Solving Physics Problems” in Robert

Siegler, ed. Children’s Thinking: What Develops? Hillsdale, NJ: Lawrence Erlbaum Associates, 1978.

Slavin, Robert. “Research on Cooperative Learning: Consensus and Controversy,” Educational Leadership 47, no. 4 (1989): 52–55.

———. Cooperative Learning. New York: Longman, 1983.

Slovic, P., S. Lichtenstein, and B. Fischoff. “Decision-Making” in R.C. Atkinson et al. eds. Steven’s Handbook of Experimental Psychology (2nd ed.), Volume 2: Learning and Cognition, New York: John Wiley & Sons, 1988.

Solomon, H. Economic Issues in Cost-Effectiveness Analyses of Military Skill Training. Alexandria, VA:  Institute for Defense Analyses, 1986, IDA P-1897.

Spencer, Herbert. The Study of Sociology. New York: D. Appleton. 1874.

Spencer, Ken. “Modes, Media and Methods: The Search for Educational Effectiveness,” British Journal of Educational Technology 22, no. 1 (1991): 12–22.

Spradley, James. Participant Observation. New York: Rinehart and Winston, 1980.

Stanton, Neville, and Sarah Stevenage. “Learning to Predict Human Error:  Issues of Acceptability, Reliability and Validity,” Ergonomics, 41, no. 11 (1998): 1737–56.

Stephenson, William. The Study of Behavior: Q-Technique and its Methodology. Chicago: University of Chicago Press, 1953.

Suppes, P., and M. Morningstar. Computer-Assisted Instruction at Stanford, 1966-68: Data, Models, and Evaluation of the Arithmetic Programs. New York: Academic Press, 1972.

Thompson, J. R., R. Hopf-Weichel, and R. Geiselman. The Cognitive Bases of Intelligence Analysis. Alexandria, VA:  Army Research Institute, Research Report 1362, 1984, AD-A146.

Tierney, William G., and Robert A. Rhoads. Faculty Socialization as Cultural Process: A Mirror of Institutional Commitment. Washington, DC: ASHE-ERIC Higher Education Report No. 6, 1993.

Tobias, Sigmund. “When Do Instructional Methods Make a Difference?” Educational Researcher 11, no. 4 (1982): 4–9.

———, and L. T. Frase. “Educational Psychology and Training” in S. Tobias and J. D.  Fletcher, eds. Training and Retraining: A Handbook for Business, Industry, Government, and the Military. New York: Macmillan Library Reference, 2001.

Treverton, Gregory F. Reshaping National Intelligence in an Age of Information. Cambridge:
Cambridge University Press, 2001.

Trier, Jost. Der deutsche Wortschatz im Sinnbezirk des Verstandes. Heidelberg: Carl Winter, 1931.

Trochim, William. The Research Methods Knowledge Base. Cincinnati, OH: Atomic Dog, 2001.

Tulving, E., and D.M. Thomson. “Encoding Specificity and Retrieval Processes in Episodic Memory,” Psychological Review 80 (1973).

Tversky, Amos, and Daniel Kahneman. “The Belief in the ‘Law of Small Numbers,’” Psychological Bulletin 76 (1971): 105–10.

———. “Judgment Under Uncertainty: Heuristics and Biases,” Science 185 (1974): 1124–31.

US Joint Forces Command. Department of Defense Dictionary of Military and Associated Terms.

USJFCOM Joint Publication 1-02.  Amended through June 5, 2003. (

von Humboldt, Wilhelm.Uber die Verschiedenheit des Menschlichen Sprachbaues” in B. Bohr, ed. Gesammelte Schriften. Berlin: Verlag, 1907.

Voss, James, and Timothy Post. “On the Solving of Ill-Structured Problems” in Michelene Chi, Robert Glaser and Marshall Farr, eds. The Nature of Expertise. Hillsdale, NJ: Lawrence Erlbaum Associates, 1988.

Vygotsky, Lev. Mind and Society, Cambridge: Harvard University Press, 1930.

Wanous, John P. Organizational Entry: Recruitment, Selection, Orientation, and Socialization. Reading, MA: Addison-Wesley, 1992.

———, et al. “The Effects of Met Expectations on Newcomer Attitudes and Behavior: A Review and Meta-Analysis,” Journal of Applied Psychology 77 (1992): 288–97.

Warner, Michael. “Wanted:  A Definition of ‘Intelligence,’” Studies in Intelligence 46, no. 3 (2002):15–22.

Weiser, M., and J. Shertz. “Programming Problem Representation in Novice and Expert Programmers,” Instructional Journal of Man-Machine Studies 14 (1983): 391-96.

Weisgerber, Leo. Vom Weltbild der Deutschen Sprache. Dusseldorf: Padagogischer Verlag Schwann, 1953.

White, Robert. Task Analysis Methods: Review and Development of Techniques for Analyzing Mental Workload in Multiple Task Situations. St. Louis, MO:  McDonnell Douglas Corporation, 1971, MDC J5291.

Whorf, Benjamin. Language, Thought, and Reality. New York: John Wiley, 1956.

Wirtz, James J. The Tet Offensive:  Intelligence Failure in War. Ithaca, NY:  Cornell University Press, 1991.

Wisher, R.A., M.A. Sabol, and J.A. Ellis. Staying Sharp: Retention of Military Knowledge and Skills. Alexandria, VA: US Army Research Institute for the Behavioral and Social Sciences, 1999, ARI Special Report 39. (<>.)

Wohlstetter, Roberta. Pearl Harbor: Warning and Decision. Stanford, CA: Stanford University Press, 1962.

Wolf, Eric. Pathways of Power. Building an Anthropology of the Modern World. Berkeley: University of California Press, 2001.

Yin, Robert. Case Study Research: Design and Methods 2nd ed. Thousand Oaks, CA: Sage, 1994.

Ziemke, Caroline, Philippe Loustaunau, and Amy Alrich. Strategic Personality and the Effectiveness of Nuclear Deterrence. Washington, DC:  Institute for Defense Analyses, 2000, D-2537.

Zlotnick, Jack. “Bayes’ Theorem for Intelligence Analysis” (1972) in H. Bradford Westerfield, ed. Inside CIA’s Private World: Declassified Articles from the Agency’s Internal Journal. New Haven, CT: Yale University Press, 1995.

Zou, Yali, and Enrique Trueba. Ethnic Identity and Power. Albany: State University of New York, 1998.


Web resources

Buros Institute of Mental Measurements (
Central Intelligence Agency main website (
Central Intelligence Agency Office of General Council (
Central Intelligence Agency Officer in Residence Program (
Defense Intelligence Agency (
Federal Bureau of Investigation ( or
Human Relations Area Files. Yale University. (
National Aeronautics and Space Administration-Johnson Space Center career astronaut biography. (
National Imagery and Mapping Agency (
National Reconnaissance Office (
National Security Agency (
US Air Force (
US Army (
U.S. Army Center for Army Lessons Learned (
US Coast Guard (
US Department of Energy (
US Department of Homeland Security (
US Department of State (
US Department of the Treasury  (
US Intelligence Community (
US Marine Corps (
US Navy (

Historical Document
Posted: Mar 16, 2007 08:49 AM
Last Updated: Jun 28, 2008 01:02 PM