[PHOTOGRAPHIC IMAGERY 'IS SOMETHING WRONG WITH C/M AND IF SO, WHAT?']

Document Type: 
Collection: 
Document Number (FOIA) /ESDN (CREST): 
CIA-RDP79B00314A000500040010-2
Release Decision: 
RIPPUB
Original Classification: 
K
Document Page Count: 
17
Document Creation Date: 
December 19, 2016
Document Release Date: 
December 13, 2005
Sequence Number: 
10
Case Number: 
Publication Date: 
January 13, 1964
Content Type: 
REPORT
File: 
AttachmentSize
PDF icon CIA-RDP79B00314A000500040010-2.pdf747.3 KB
Body: 
Approved Fost 2/ iDPI03W000500040010-2 Page 1 I. INTRODUCTION We were charged in essence with the problem "Is something wrong with C/M and if so, what?" The first step in coming to grips with this question is to agree to methods for evaluating the system. Since the end result is a photographic image we must construct an objective quantitative measure of image quality. Against this standard the performance of the system must be measured and the observed image compared with the one to which the system is designed - in- cluding effects of atmosphere, image motion and film processing and sensitivity in addition to the lens system. If all of these factors are fully understood and the design performance is achieved, then we conclude C/M is a satisfactory system in the sense we have given it a test and it has passed. There is a big question of course: have we given the right test, i.e., the most useful one from the viewpoint of the mission we want C/M to accomplish? In more specific terms we speak of the optical transfer function or the sine wave response curve t (k) as a function of spatial frequency k as the most convenient meeting ground between design and performance. In the engineering design of an optical system'one seeks maximum resolution in lines/mm by keeping t (k) as large as possible in the region of high k. It is the primary concern of this Committee to determine to what extent the design t (k) is achieved by the system in practice, On?the other hand, there are users' criteria of quality and one might benefit for intelligence purpose by trading off, for example, some resolution in order to achieve higher contrast - this is a human factor involving the PI's. This question Approved For Rele 0P / 2,23 : CIA-RDP79B00314A000500040010-2 ~ I SL~ Approved Forlease / A31 anuary -1964 Page 2 of the optimum design of a transfer function for the intelligence community is a corollary and also vital problem. The distinction between user criteria and engineering criteria cannot be overstressed. In the first case on typically asks, "Is photo- graphic sample A a better source of intelligence information than sample B and if so by how much?" In the second case one asks, "Is the equipment performing in actual use as it did under laboratory..test and if there is a difference what is the magnitude of the difference?"' We discuss first in this report the question of constructing an objective measure of image quality that is both useful and experimentally feasible. In practice, in the real world, there are many parameters affecting the performance which cannot be precisely specified. The transfer function t (k), is a product of four components:, t (k) = t (k) t (k) t (k) t (k) atmosphere image motion optics film, and uncertainties in these individual factors make it impossible for us to say that the system passes any test perfectly. We also recognize that this characterization of performance by t (k) is incomplete since granularity is not taken into account. In these discussions we assume the slow, fine grained film Ii-IiO+ now in use is a fixed parameter of the system. Rather we must content ourselves by reporting it to perform within a certain quality range. The more we can sharpen up the individual factors the more precise will be our understanding-of the system. This calls for a Measurement Program - which is the next main subject of discussion in this report. Engineering passes over known design targets in known weather conditions are one aspect. Another very important one is an in-flight measurement program to determine, for example, what the effect of the in-flight Approved For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 Approved Forlease 20TH 1 23 :~CIA~ARB00 1 00500040010-2 STAT 13 January 19 Page 3 environment is on the optical focus - one area of particular concern being the possible focal errors introduced by thermal gradients and transients in the camera barrel and lens system. We do not here attempt a detailed design study but we indicate. the types of measurements felt to be most desirable and which can be made on ground or in orbit without substantially conflicting with the operational goals of the C/M missions. As a general remark we add our very strong conviction of the need for instituting with great urgency a program of mission measurements and analyses to help identify the causes degrading most of the image quality obtained thus far - or to verify by establishing a lack of correlation between the image quality and the monitored parameters that the present quality is typical of what is to be expected. The measurement programs proposed in this report should be carefully prepared and not viewed as quick fixes. II. SUMMARY AND RECOMMENDATIONS A. Objective Measures of Image Quality 1. Edge measurement techniques for determining the optical transfer function. The aim here is to provide a reliable and reproducible "canonical" technique for accurately measuring t (k). parti cularly - for .high. spatial. frequencies (say 10 ft ground resolution or 100 L/mm). We want to know t (k) for two reasons. By comparing the measured t (k) with the value to which the system is designed we can hope to answer whether the photography obtained is all that can be expected from C/M or whether there is a loss of resolution due to shortcomings of the system. Since the atmosphere's transfer function enters into this comparison it too must be measured or calculated Approved For Release 2005/12/23 CIA-RDP79B00314A000500040010-2 Approved Foroease 2005/12123 : CIA-RDP79B0031000500040010-2 In view of the extremely limited technical feed back as to the performance of components in flight to the systems designers, it is amazing to those of us on the "outside" how well C/M has done so far. Nevertheless, there are major quality variations which follow.no understood pattern from one mission to the next. In its best moments C/M has performed very well, indicating that improvements to a higher level of relic"oility should be possible. The urgency of a measurement program and of timely systematic performance analyses to enable the designers to achieve possible improvements cannot, therefore, be overemphasized. Approved For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 7 Approved For~ease 2005//23 : CTA-F2D~T~B031 00500040010-2 13 January 1964 Page I+ in principle. As discussed further in Section D the only significant effect of atmospheric haze on C/M photography a.d tie f' c. resolwl-o' aIfi&o. kc.. c(r.. f is a DC reduction of contrast t (k) is independent of this and therefore of the atmosphere. The practicability of microdensitometric edge measure- ments for a routine evaluation of photography at high resolution in order to determine t (k) must still be established. As a relatively new technique it is still fraught with practical di:ficulties and potential dangers.,. It presents no theoretical problems, however. Suitable edges for the scale of C/ICI photography are found in nature in the form of large airfield landing strips and for special tests can be conveniently provided by a target,layout on the ground. In order to demonstrate practicability of edge measure- ments for 100 Lines/mm analysis a long-range industrial program is in progress and full support to continue and expand it is recommended. Its developm ent goals should be 1) Establish reliability by comparing recent measure- ments of t (k) f.rom edge scans to results from sine wave targets. The resulting modulation trans- fer function should be combined with a film modula- tion threshold curve to predict the resolution in Lines/mm for direct experimental comparison. Compare and standardize different p-densitometer slits, determining optimal dimensions and data handling methods.. Approved For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 Approved Forieas r/'F2/233 : Q RDP79B0031 W00500040010-2 My &b,G.,J~, 13 January 19 Page 5 3) Determine pract::cability of the method in terms of number of man-hours involved per edge.for a reliable scan. Toward these ends we recommend that there be 1) Initiated both at Westover and NPIC a program of selecting and measuring edge on new mission material (and on past material if warranted by success of the above program) both to advance the confidence in and reliability of edge measurements and to accumulated data on C/M performance. At this time we do not believe the edge scan method is ready for production use; and 2) Constituted a working group including representatives of principal laboratories to carry out a standardization study on edge measurement techniques. This activity should not be bound by security re- strictions but should operate as an industrial cooperation oriented by a work statement for such a study for this Committee. 2. Visual comparison of photography of unknown quality with photo- graphy of known quality as obtained by the same optical system. This technique of subjective quality comparators or "GENES" (Graded Estimated Measuring Samples) for judging image quality is of interest and potential value because there are no standard resolution targets in operational photography and the edge scan measurements are still of uncertain merit. Moreover comparative Approved For Release 2005/$1//3 . IA DPTOB0p314AQQ0500040010-2 Approved For iea & A 3 . A 'kPiiBi 1100500040010-2 13 January 1964 Page 6 analysis of properly prepared GEMS may provide some valuable input into a human equation for the optimum photography for use of the intelligence community. F--' Both the flexibility and quantitative value of GEMS are uncertain at this moment and experience in working with them will be important in evaluating this technique. The first use of such photographic comparators is for engineering evaluation. They will be designed with the aim of permitting the observer to identify the main characteristics of quality degradation in the actual picture - whether due to reduction of t (k) for high k leading to fuzzy edges of high contrast, or non-optimal processing to high or low average densities which affects graininess, or loss of contrast (due Su~~1 to the s of the effects of corona discharge, light leaks, haze, and thin clouds) but with edges remaining sharp. The observer will identify these quality characteristics by comparison with a library series of GEMS that can be brought to adjacent positions in sequence by a comparison eyepiece. He can also rate the photography by a resolution level in L/mm for 2:1 contrast targets as imaged in the GEMS. Approved For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 1?a 'i' ?? ii ai'r~i ja % :/, ,'rc\ m p r'O STAT' S P E C I A L HA N D L I N G Approved Forilea7s e-2OD5/17/23 CTA RDP79'B003 0050 20 January 1964 Page G_ The second use would be to determine the effects of the variables introduced into the GEMS on the value of photographic material for intelligence purposes. To reiterate an earlier point - our primary Committee concern is to determine how well the system produces its design transfer function, but the question of what the transer function to which the system is to be optimally designed is a longer-ranged and corollary question, and is discussed in the technical sections. A comparison technique: for assessing the photographic quality is presented and the basic elements of a GEM library are discussed in this report. As a first step.in implementing this program a simple dual microscope system with a comparison eyepiece and a small library of GEMS with varying resolutions has been prepared. 3. First results of Edge Scan Measurements and visual photographic comparators applied to operational photography. Edge scan measurement: on mission photography have been made with the Eastman Kodak; -densitometer as summarized in Figures 1, 2, and 3 where the resolution in L/mm is computed from the measured transfer function for 2:1 contrast targets. GEM measurements of the limiting resolutions of scenes in the close vicinity of these edge scans were made and the corre- lation with the edge scan results shown in Figure 4. That no better than a moderate degree of correlation was found indicates the extreme caution with which these first results must be viewed. SPECIAL- HAN DLI NG Approved For Release 2005/12/23 : CIA-RDP79BO0314A000500040010-2 Approved For ease 2005/12/23 : CIA-RDP79BOO31 13 January 1964 Page 6 The 77 frames of Mission 9056 which were given subjective MIP (Mission Information Potential) rating at NPIC and as discussed and plotted by caused very STAT great concern, were compared with the GEMS as shown on Figure 5. A lack of correlation is evident - as it is also with the RES (Reciprocal Edge Spread)measurements made at Westover (Figure 6). Furthermore, these two different subjective measures of quality, RES and MIP, fail to correlate with each other as shown by Figure 7. The conclusion from this is that-both MIP and RES measurements have a presently uncertain, if indeed any, quantitative value. The lack of correlation of RES with edge scan measurements can in part be attributE:d to the sensitivity of the RES results with the average density of exposure. At this time we see no quantitative -value to RES and therefore no reason for continuing a program of measuring RES values. In.assessing image quality by subjective standards we believe that variations in the illumination conditions contri- bute significantly to the observed spread of quality although we have not assessed the significance of these variations quantitatively. Figures 8 and 9 show two striking examples of this effect in technically equivalent pairs of photographs. Only the angle of solar illumination is different in Figures 8 and the angle between viewing directions and illumination in Figures 9. The actual shadows are the same in :Figs 9 which show two successive frames 10 seconds apart along a flight line but the extent to which they are viewed depends strikingly in the camera's angle of view. Approved For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 Approved For ease 2005/12/23: CIA-RDP79B0031A00500040010-2 13 January 1964 Page 7 It is also clear that, factors which reduce the relative brightness of the shadows such as haze and scattered clouds will tend to dilute the above effects, so as to make the photography generally drift in quality toward the low contrast of the subsolar point seen in Fig. 9. Indeed the---..i'i'___ moderate haze in scattering light into the shadows has a xgWe significant effect on overall quality 11vgft the DC back-scattering of light into the lens. Clouds can produce a similar effect even though a ground target is directly illuminated by the sun and directly visible by the camera. These factors which play an important role in subjective evaluations are not relevant in an engineering analysis of a system in terms of limiting resolution in L/mm. If one is to compare objective and subjective measure5of image quality such as NIP values then a way must be found to take into account the effect of variability of subject matter. The GEM and edge scan measures show some promise but conclusions at this time would be premature and the-question of C/M's performance is still to be decided by continued analyses by edges and scans and GEMS. Mission-9062 is now being analyzed by edge scan and GEM ratings and results obtained so far are summarized in Figures 10 and 11. Beyond determining a level of average performance in terms of limiting resolution in L/mm for 2:1 contrast targets we would like to determine :a mean spread in performance. about this Approved For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 Approved For?ease 2005/12/23 : CIA-RDP79B0031000500040010-2 -L-) 'Julmury-IYO-4 Page 8 average. Neither the edge scan nor GEM measurements have advanced yet to the level that we can with any confidence deduce this spread from observations. Moreover in the absence of a detailed measurement program on-in-orbit physical parameters the anticipated spread in performance cannot be computed accurately. The potential values of GEMS for relating the physical characteristics of the photographic image with its intelli- gence value to the PI remains to be explored and further work in this direction is recoimnended. Approved For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 Approved For Wease 2005/12/23: CIA-RDP79B00311W00500040010-2 29 January 1964 Page 9 B. Measurement Program 1. In-flight measurements for obtaining engineering data to check on system performance in the operational environment and to correlate with image quality. The C/M system is subjected to extensive laboratory tests on the ground in Boston, Palo Alto, and Vandenberg to check its operation both before and after thermal and .pressure changes, in different gravity orientations, and after vibrations. These tests are designed to cover the range of parameters anticipated during launch and orbital. phases and focal settings must still be within tolerances. There is no way of knowing, however, that focal errors resulting from thermal gradients and transients do not degrate actual system performance in flight. No in-flight measurement program exists for determining the temperature inhomogeneities during flight due to variable sun angles and camera barrel ex= posure to space, and furthermore, there is no in-flight verification that the focal point is at the film. Remedies for these deficiencies are proposed.. They require a continuing in-flight measurement program not seriously interfering with operational activities and designed to: a) locate the focal point relative to the film and b) measure local temperatures of the level. Furthermore, a vigorous and more thorough laboratory study with a theoretical model is encouraged to complement this program, providing more details as to where to put temperature 'sensors on board and pointing the way toward improved thermal control. Approved For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 Approved For.ease 2005/12/23 : CIA-RDP79B003100500040010-2 13 j anuary 19154 Page 10 Additional ground tests over a broader range of parameters for checking f:Llm.flatness are suggested. These- should include a broad temperature range and should be de- signed to test vibration and post acceleration effects. Another recurring plague of C/M photography is corona discharge. Laboratory tests suggest that if the film were maintain at a pressure of 20 to 100 instead of at ambient this condition would be controlled. Work is in progress to develop a light weight pressure system and should be pressed with full support. In view of the recurring serious corona problem a suitable system for maintaining pressures above 20 even if not at optimal on, should be introduced in C/M as soon as possible, along with periodic pressure monitoring. Direct tests on film properties and sensitometry are discussed in Section C. 2. Engineering passes with daylight photography of design aerial targets. It is recommended that these be carried out and the present program extended until one is driven to the conclusion that the system is.working up to its design potential. Simultaneous re- cording of component perfonnance in the measurement program described in the preceding section is necessary to permit degraded imagery to be correlated with faulty components. The resulting loss of operational coverage resulting from such a program i' is is 1 ~rtsignificant andaa very worthy investment. Approved For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 Approved Foreease 2005/12/23 : CIA-RDP79B00311000500040010-2 STAT 13 January 1964 Page 11 A minimal aerial tarE;et is designed which permits determination of the transfer function t (k) from edge measurements on the scale of C/M photography as well as for any system of comparable or superior resolution. This determination is independent of any DC reductions of contrast such as may be caused by light leaks, corona fogging, or atmospheric haze. Deployment and use of standard resolution targets is also encouraged. In order to determine the loss of contrast in C/M mission photography due to recurring serious corona difficulties and of other unwanted film expovre, it is desirable to remove the con- trast reduction due to atmospheric haze alone. This is best done by flying a calibrated camera, using identical film and pro- cessing, in an aircraft at high altitudes over targets of known ground contrast at approximately the same time as the satellite engineering pass. This is not envisaged as a continuing test program but one to be terminated as confidence is gained that extraneous light is not fogging the film. Relative merits of different filters and slit widths could also be assessed.by such a program once the airplane is flying. C. Film Processing and Sensitometric Strips 1. Film Processing No appreciable degradation of limiting resolution in the C/M photography was found to result from film processing. It does appear, however, that the processing has frequently been to a fuller level than that to which the mission is de- signed. Approved For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 Approved For?ease 2005/12/23: CIA-RDP79B0031'60-2 Page 12 The exposure criteria are based on two series of experimental data collected from aircraft and aerial reconnaissance cameras. These data are further reviewed in the light of analysis of current operational results. We recommend resumption of a program to review exposure criteria and chemical processing.and modification of procedures as found appropriate to maximize the final product quality. The exposure latitude of the film (higher D max). should be extended without adverse effect. ,2. Sensitometric Strips Sensitometric strips are controlled exposures which provide a calibration of the characteristics curve (density vs. log exposure) of the mission film. If desired as a monitor of film' processing uniformity throughout 'a mission sensitometric exposures should be placed frequently along the edges. This is done most conveniently after flight exposure and just prior to processing. At present in view of corona and other non-image forming light problems, sensitometric strips are of uncertain value for this monitoring function. However, they appear to be attractive as an adjunct for edge measurements since sensitometric step wedges on each frame can be. used conveniently f`or calibrating the microdensitometer and. film combination out of the edge trace. In view of present uncertainties in high resolution-edge scanning techniques and reliability, their trial evaluation is. recommended. D. Atmospherics 1. Calculation of Weather Effects The transfer function of the atmosphere plays an important role in the considerations of each of the three preceding sections. Approved For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 Approved For lease 2005/12/23 CIA-RDP79B003.000500040010-2 J_J anuary Jqb4 Page 13 For example, in designing: to a transfer function thereA~p limited value striving for a lens transfer function which achievesa resolution suxstantially dulled by turbulence. Likewise if the DC haze filtering presents only objects. of low contrast to the lens it is for such objects and not for high contrast ones that it is desirable to optimize the resolution. The effect of turbulence on the transfer function is .negligible on the scale cf 10 ft. ground resolution photography (2 x 10-5 rad angle). Hcwever, there is appreciable contrast reduction as a DC effect of haze. This is very sensitively dependent on local weather and its degree of preditability over hostile territory is undetermined. There are suggestions that it may be correlated usefully with atmospheric humidity, which can--be predicted with a measure-of reliability and this F study now in progress at Wright ield deserves ^,g sup- port and encouragement. Analysis. of atmospheric parameters in conjunction with the overflights discussed in B.2 will be useful in this study. Once it has been ascertained that the image con- trast is determined primarily by haze and not by corona or light leaks, GEMS as discussed in A.2 w ae-of value for somoting a measurr ' loss of contrast or modulation resulting from haze. 2. Prediction of Weather The extent to which world-wide weather data as available from Program 417 can be integrated into the mission orbit selection to reduce-, the present average of roughly 50% cloud cover in the photo- graphy is explored but no conclusion reached. Approved For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 1. Sine Wave Targets 2. Photometric Edge and Microdensitometers 3. Three Bar targets 4. RES Photographic comparitors GEMS Approved For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 . COMPARISON OF VARIOUS METHOD OF IMAGE QUALITY MEASUREMENT Static Laboratory Test of Instrument Dynamic Laboratory Test of Instrument Operational Evaluation of Technical Performance Less Convenient and precise but related to (1) and (3) Too much data compared to (3) Less convenient and precise but related to (1) and (3) Targets too large Good, more available than (3) But Less Precise Good but limited by available targets requires photo- metric data Convenient but MlleUlua aiiu accuracy not validated Possibly good Precision not validated Approved.For Release 2005/12/23 : CIA-RDP79B00314A000500040010-2 Operational Evaluation of Quality For Photo. Interpretation Value because Relationship to PI usefulness not known May be of use as experience is gained. Good Subjective Judgment includes scale, haze, subject matter, illumination,