MULTIPLE IMAGE INTEGRATION VIEWER-PRINTER PHASE I FEASIBILITY STUDY

Document Type: 
Document Number (FOIA) /ESDN (CREST): 
CIA-RDP78B04770A000200010048-8
Release Decision: 
RIPPUB
Original Classification: 
K
Document Page Count: 
63
Document Creation Date: 
December 28, 2016
Document Release Date: 
July 1, 2004
Sequence Number: 
48
Case Number: 
Publication Date: 
December 6, 1965
Content Type: 
STUDY
File: 
AttachmentSize
PDF icon CIA-RDP78B04770A000200010048-8.pdf2.74 MB
Body: 
STAT I Approved For Release 2004/07/29 : CIA-RDP78B04770 1 1 STAT w I 1 I 1 MULTIPLE IMAGE INTEGRATION VIEWER -PRINTER Phase 1-Feasibility Study STAT i Declass Review by NGA. I Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 t AT MULTIPLE IMAGE INTEGRATION VIEWER-PRINTER Phase 1-Feasibility Study Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 t t I 11 1 t 1 t This report discusses the results of an introductory study of the problems of multiple image integration and the details of the proposed design for an experimental three-input integration viewer-printer. Automatic image correlation is used in the proposed equipment for rapid and accurate registration of the three inputs. The outputs consist of a real-time electronic display for monitoring purposes, and a high resolution, slow scan readout onto 4- by 5-inch film that will reproduce image detail of up to 100 lines per millimeter on the original material. Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 e r t t 2. Technical Considerations . . . . . . . . . . . . . . . . . . . . . 5 2.1 Image Registration . . . . . . . . . . . . . . . . . . . . . . 5 2.2 Image Enhancement . . . . . . . . . . . . . . . . . . . . . . 19 2.3 Modulation Transfer Function . . . . . . . . . . . . . . . . . . 22 2.4 Comparison of Electronic and Optical Image Integration System . . . . . . . 29 3. General Description of Multiple Image Integration Viewer-Printer . . . . . . . 31 3.1 Control Panel . . . . . . . . . . . . . . . . . . . . . . . . 31 3.2 Input Platen . . . . . . . . . . . . . . . . . . . . . . . . 31 3.3 Optical System . . . . . . . . . . . . . . . . . . . . . . . 34 3.4 Correlation System . . . . . . . . . . . . . . . . . . . . . . 38 3.5 Video Processing . . . . . . . . . . . . . . . . . . . . . . 41 3.6 System Performance . . . . . . . . . . . . . . . . . . . . . 52 4. Bibliography . . . . . . . . . . . . . . . . . . . . . . . . . . 55 Appendix-Linear Superimposition of Multiple Images . . . . . . . . . . . . . 57 t 2-1 Maximum Tolerable Displacement Errors at 3 Percent Response . . . . . . . 7 2-2 Comparison of Electronic and Optical Image Integration Systems . . . . . . . 30 3-1 Input Magnification Ratios . . . . . . . . . . . . . . . . . . . . 52 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 1-1 Prime Transformations . . . . . . . . . . . . . . . . . . . . 2 1-2 Types of Terrain Relief Displacements . . . . . . . . . . . . . . . 3 2-1 Resultant Amplitude of Two Displaced Sine Waves . . . . . . . . . . . 6 2-2 Typical Modulation Transfer Functions for Aerial Photography . . . . . . . 7 2 -3 Effect of Image Displacement on Modulation Transfer Function . . . . . . . 8 2-4 Image Displacement Due to Tilt . . . . . . . . . . . . . . . . . . 9 2-5 Residual Second-Order Displacement Error Due to Tilt Angle . . . . . . . 10 2 -6 Residual Second-Order Distortion for 6-Inch Focal Length . . . . . . . . . 11 2-7 Residual Second-Order Distortion for 12-Inch Focal Length . . . . . . . . 12 2-8 Residual Second-Order Distortion for 24-Inch Focal Length . . . . . . . . 13 2-9 Residual Second-Order Distortion for 48-Inch Focal Length . . . . . . . . 14 2-10 Residual Second-Order Distortion for 100-Inch Focal Length . . . . . . . . 15 2-11 Residual Second-Order Distortion for 200-Inch Focal Length . . . . . . . . 16 2-12 Correlator Transfer Functions . . . . . . . . . . . . . . . . . . 18 2-13 Log Plot of Step Wedges in Sunlight and Shadow . . . . . . . . . . . . 23 2-14 Linear Plot of Step Wedges in Sunlight and Shadow . . . . . . . . . . . 23 2-15 Modulation Transfer Functions for Cathode-Ray Tube and Image Dissector, Linear Plot . . . . . . . . . . . . . . . . 26 2-16 Modulation Transfer Functions for Cathode-Ray Tube and Image Dissector, Logarithmic Plot . . . . . . . . . . . . . . . . . . . . . . 28 3-1 General Configuration of Multiple Image Integration Viewer-Printer . . . . . 32 3-2 Block Diagram of Multiple Image Integration Viewer-Printer . . . . . . . . 33 3-3 Control Panel . . . . . . . . . . . . . . . . . . . . . . . . 34 3 -4 Configuration of Input Platens . . . . . . . . . . . . . . . . . . 35 3-5 Diagram of Optical System . . . . . . . . . . . . . . . . . . . 37 3-6 Lissajous Scan Generator . . . . . . . . . . . . . . . . . . . . 39 3-7 One Channel of Video Correlator and Distortion Analyzer . . . . . . . . . 40 3-8 Block Diagram of Memory Unit . . . . . . . . . . . . . . . . . . 41 3-9 Block Diagram of Modulator Circuits . . . . . . . . . . . . . . . . 42 3-10 Block Diagram of a Single Image Dissector Channel . . . . . . . . . . . 43 3-11 Block Diagram of Variable Gamma Amplifier . . . . . . . . . . . . . 44 3-12 One Form of Nonlinear Amplifier . . . . . . . . . . . . . . . . . 44 3-13 Transfer Characteristic of Nonlinear Amplifier . . . . . . . . . . ... 45 3-14 Results of Step Voltage Signal Applied to Input of Gamma Amplifier . . . . . . 46 3-15 Video Signals . . . . . . . . . . . . . . . . . . . . . . . . 47 3-16 Schematic Diagram of Experimental Gamma Amplifier . . . . . . . . . . 49 3-17 Switching for Flicker Presentation . . . . . . . . . . . . . . . . . 51 3-18 Modulation Transfer Functions Referred to Image Dissector . . . . . . . . 53 3-19 Theoretical Modulation Transfer Function of Complete System . . . . . . . 54 e 1 r t VI I Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 1 t Multiple image integration is the technique of utilizing several independent images of the same object as an aid to photographic interpretation. The improvement obtained in reliability and accuracy of interpretation may be due to any one or a combination of the following effects: (1) improvement in the contrast of low contrast images, due to the coherent addition of image detail and the noncoherent addition of grain or other random disturbances, (2) revelation of image detail hidden in shadows or missing due to other causes, by the superimposition of two or more inputs taken at different times of day or from different viewpoints, and (3) detection of changes due to human activity or natural causes, e.g., seasonal variations. One of the major problems in image integration is that of superimposing the multiple images with sufficient accuracy to avoid loss of resolution, which would tend to offset any advantage gained by the increase in contrast or visibility of detail. Methods of image integration using optical superimposition have involved the use of multiple photographs taken at the same time from the same viewpoint. The improvement obtained is due solely to the integration of photographic grain, which theoretically improves image contrast by a factor of N112, where N is the number of photo- graphs integrated. The problem of superimposition is reduced in this case simply to that of physical alignment, since the inputs are all identical in scale and geometry. To take advantage of all the benefits of image integration, however, photographs of different scale taken from different viewpoints must be used. Superimposition then involves computation of the geometrical transformations necessary to make the images congruent, followed by simultane- ous implementation of these distortions on several images -a process similar to that required for stereo viewing of convergent oblique or panoramic photography. The required transformations can be computed either from a knowledge of the acquisition parameters of the photography, or by simultaneous scanning of two or more inputs with subsequent correlation of the imagery. The latter method is of far greater practical interest. At present, electronic scanning is the only feasible method of point by point image correlation. The images to be integrated are scanned by identical patterns, and the image density variations converted into electrical video frequency waveforms. These waveforms are then compared in an electronic correlator, and the image transformations necessary to render the images congruent are com- puted. The image transformations can be implemented either optically or electronically by dis-. torting the scanning patterns. Image transformations can be analyzed into orders, depending on whether the image displace- ment involved is independent of the coordinates x and y measured from the center of the viewed area, or varies as x, x2, x3, etc. Shifts in x and y which affect the entire image are zero-order transformations. There are four first-order transformations in which image displacement is proportional to x or y, and six second-order transformations in which image displacement is proportional to x2, y2, or xy. These prime transformations are shown in Fig. 1-1. Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Involving x parallaxes Involving y parallaxes y in x (x skew) xiny (y skew) Fig. 1-1 - Prime transformations y2 in x x2 in y The transformations to be applied to two images to obtain congruence depend not only on the viewpoint of the taking lens, but on the angular coverage of each image. Zero-order transforma- tions (uniform displacements) are, of course, necessary whatever the image size. Similarly, first-order transformations such as scale, rotation, and skew, in which image displacement is proportional to the distance from the center of the viewed area, are necessary in all cases and must be increasingly accurate as the number of resolution elements in the field of view is increased. Second-order distortions are present in every oblique photography. However, when only a small area is viewed, as is generally the case with an image integration viewer, the second-order distortion can be approximated with a straight line (first-order) correction. The superimposition errors involved in this process have been analyzed and are reported in Section 2.1.2. Third-order effects are present in panoramic photography in the form of S curve and cubic scale distortion, but the magnitude of these effects has been found to be negligibly small when measured over the area of photography normally viewed. x in x (x scale) y in y (y scale) LLIIJ x2 in x y2 in y 1 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 t 1 Another form of image distortion must be considered in an image integration viewer, namely, high order terrain relief displacements. First-order transformations already discussed will correct for a constant terrain slope, as shown in Fig. 1-2a, while second-order transformations will correct simple curvature, as shown in Fig. 1-2b. Terrain relief due to cultural objects shows discontinuities in profile, as shown in Fig. 1-2c, corresponding to transformations which may reach as high as 100th order. It is obviously impossible to correct these displacements by using a systematic analysis, since the number of corrections to be applied would be astronomical. This problem is discussed further in Section 2.1.3. (a) First order (b) Second order Fig. 1-2 - Types of terrain relief displacements (c) High order The next question to be considered is how the required transformations can be applied to the images. Of the ten possible first- and second-order transformations, only two (uniform scale and rotation) can be removed by conventional optical means. Correction of x and y scale varia- tions and skew distortion requires the use of anamorphic optics. Second-order distortion due to obliquity can be corrected in an optical system by tilting the image and object planes with respect to the lens axis. The use of these techniques results in a very elaborate and expensive optical system which must be duplicated for each input channel of the image integration. The problems associated with the use of optical systems for image superimposition lead to the consideration of electronic imaging systems. Image transformations can be produced rela- tively easily in an electronic system by changing the shape of the scanning pattern. Distortion of any order, including high order relief displacement, is capable of being corrected in this way. Because an electronic system must be used in any case to scan and correlate the images and to compute the relative distortion, the use of electronic distortion removal techniques requires a minimum of additional equipment. The main criticism leveled at electronic imaging systems is their bandwidth restriction. There are, however, techniques by which this restriction can be overcome to the point where the output imagery is suitable for photointerpretive use. Electronic imaging systems using scanning reduce the two-dimensional input imagery to a time varying video signal. Such a system is limited by three factors: (1) the size of the scanning spot or aperture relative to the area scanned, (2) the bandwidth of the electronic video channel, and (3) the size of the spot on the display tube relative to the area scanned. Factors 1 and 3 together determine the maximum number of resolution elements that can be reproduced, while factor 2 determines the maximum rate at which they can be reproduced. Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Image pickup and display tubes exist which can handle 9 x 106 image elements. This is equal to the maximum number of image elements that can be seen by the eye (at 5 line pairs per milli- meter in a 12- by 12-inch photograph at a distance of 10 inches. To present this information at the normal rate of 30 frames per second would require a video bandwidth of 135 megacycles per second, which is beyond the state of the art. However, the only reason for a frame rate of 30 frames per second is to produce the illusion of image motion without flicker. In an image integra- tion viewer, we are dealing only with static imagery. If a readout system using image storage is employed, the frame rate can be reduced to a few frames per second, and the full resolution capability of the pickup and display devices can be utilized with a video bandwidth as low as 20 megacycles per second, which is readily achieved. It should be noted that the capability of handling 9 x 106 picture elements for electronic scanning devices approaches the performance of a lens. While highly optimized lenses may exceed this performance, normally used lenses are capable of reproducing about 107 image elements. Certain lenses in which compromises have to be made may fall below this figure. So far as the pickup and display devices are concerned, therefore, available electronic imaging systems come very close to matching optical systems. The overall resolution of either type of system is of course reduced by virtue of the use of several compon- ents in cascade. Another aspect of image integration must be considered, namely, gamma control of the vari- ous inputs in general, and shadow suppression in particular. The use of input material taken under varying conditions of sunlight and in different seasons necessitates a correlation technique that ignores illumination conditions and the presence of heavy shadows, and operates only on physical objects. Since such objects are visible only by virtue of the illumination, this is not an easy task. The main problem is the presence of shadows; the ARES correlation circuit locks onto shadows very readily, which is quite acceptable when viewing stereo pairs obtained within a short time interval. In the image integration viewer, it is necessary to reduce the contrast between shadows and highlights for two reasons: (1) to enable images containing dissimilar shadow structure to be correlated, and (2) to reveal shadow detail present in the images. The contrast can be reduced by the use of nonlinear amplitude response (or gamma) in both the correlation and the viewing chan- nels. A square root characteristic (gamma of 0.5) has been found effective in suppressing shad- ows. It should be pointed out that the optimum video processing characteristics for correlation and for viewing may not be the same. Therefore, we propose to use two independent gamma con- trols in each channel, one to optimize correlation and the other to optimize viewing. As a result of the study program, design parameters for a three-input image integration viewer have been established. The instrument will accept three film chips of any size up to 9 i/2 by 9 i/2 inches. Correlation of the three inputs is achieved by electronic scanning using a 500-line, crossed diagonal scan. One input is designated as the master, and the geometry of the other two inputs is transformed in sequence into congruence with the master input. The necessary image transformations are stored in a memory. The scanned images are combined and displayed on a viewing monitor, which enables the video processing in each channel to be optimized in terms of tone reproduction and alignment. When a satisfactory image has been built up, the system is switched to slow scan operation, and the integrated image is recorded on film at high resolution. The scan time is about 1 second. I I 1 1 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 1 1 The first subject to be considered will be the required accuracy of registration. The distor- tion due to camera tilt will be analyzed next, to determine whether second-order corrections will be necessary in the image integration viewer. Finally, the effect of uncorrected relief parallax will be considered. 2.1.1 Registration Accuracy The effect of misregistration can be most easily evaluated by considering two sine-wave im- ages, whose amplitudes, a, at any point, x, are a1 = Ai sin (27rfix + (pi) a2 = A2 sin (27rF2x + 'P2) 1 where Ai and A2 are the peak amplitudes, and fi and f2 are the spatial frequencies. If the two im- ages contain the same spatial frequencies, and if they are added, the resultant, R = ai + a2, is given by R2 = (Ai cos q + A2 cos 02)2 + (Ai sin (p1 + A2 sin 02)2 R = [Ai + A2 + 2A1A2 cos ((P1 - 02)]112 The amplitude of the resulting image is therefore dependent on the phase angle, or displacement, between the two images. The phase difference can be expressed as 01 - 02 = 2vrfox 1 where Ox is the displacement between images. When Ox = 0, the two images are perfectly aligned and the resultant amplitude is Ai + A2. When Ox = 1/4f, the sine waves are 90 degrees out of phase, and the resultant amplitude is (Ai + A2)'2. When Ax = 1/2f, the sine waves are 180 degrees out of phase, and the resultant amplitude is (MI - Ai)1i2. The variation in amplitude of the combined sine wave is shown in Fig. 2-1 for Ai/A2 ratios of 1, 0.8, and 0.6. These curves can be used to de- termine the loss in modulation transfer function (MTF) due to the misalignment of images. Fig. 2-2 shows typical MTF's for an aerial camera lens (Itek 24-inch, f/3.5) and a high reso- lution film (type 4404). The combined MTF shows that the response is down to 50 percent at 50 cycles per millimeter, and down to 3 percent at 300 cycles per millimeter. Fig. 2-3 shows the Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 MTF resulting from two inputs, each having the combined MTF of Fig. 2-2, when the displace- ment, Ax, between them is equivalent to 1/4 wavelength and 1/2 wavelength, respectively, mea- sured at a 300-cycle-per-millimeter spatial frequency. At less than a 1/4-wavelength image dis- placement, the loss in MTF in most cases would be unimportant, whereas at image displacements of 1/2 wavelength and greater, the loss in MTF is quite noticeable. On this basis, we can establish the maximum tolerable displacement error at about 1/4f, where f is the spatial frequency at which the MTF of the system has dropped to 3 percent. The tolerable displacement error calculated on this basis is shown in Table 2-1. 1 1 t Of /001" ?~ ~_ Aj/A2 = 1 / __Aj/A2 = 0.8 ~._..A/A2 = 0.6 Displacement x Spatial Frequency, Ax x f Fig. 2-1 - Resultant amplitude of two displaced sine waves 1 1 1 1 I Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 N '~ ,,-" I 4404 film =24-inch, f/3.5 lens , Combined response 15n 200 2 50 31 Spatial Frequency, cycles per millimeter Fig. 2-2 - Typical modulation transfer functions for aerial photography Table 2-1 - Maximum Tolerable Displacement Errors at 3 Percent Response System Resolution at 3 Percent Response, lines per millimeter Maximum Tolerable Displacement Error, microns 25 10.0 50 5.0 100 2.5 150 1.7 200 1.25 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 0 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 MTF of two inputs displaced 1/4 w el th t 300 l av eng a cyc es per millimeter MTF of two inputs displaced 1/2 wavelength at 300 cycles per millimeter MTF of inputs (from Fig. 2-2) Spatial Frequency, cycles per millimeter Fig. 2-3 - Effect of image displacement on modulation transfer function 2.1.2 Second-Order Distortions Oblique and panoramic photography involve camera tilt angles that produce image distortion. The basic types of image distortion are shown in Fig. 1-1. Zero- and first-order distortions, i.e., scale, skew, and rotation, must always be corrected in order to superimpose images of any size. However, this is not the case with second-order distortions; the image displacements due to re- sidual second-order distortion depend on the tilt angle and vary with the square of the y dimension of the image area examined. It is important in the present case to determine whether or not sec- ond-order corrections will be required in order to superimpose images to the required degree of accuracy, since this will be a major factor in deciding the form of the final equipment. Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 t i I The required superimposition accuracies for materials of various resolutions were deter- mined in Section 2.1.1. If second-order corrections are necessary, there is a strong argument for using an electronic distortion removing system, where second-order corrections can be made by changing the shape of the scanning pattern. This is achieved far more easily than the correspond- ing correction in an optical system, where the use of tilted planes is required. The scale of any image on a tilted photograph can be expressed as S_F - ysint H -h where t = tilt angle y = distance of image from the isocenter measured in the direction of the tilt H = flying height of the camera h = ground elevation of the object F = focal length of the system used The rate of change of scale is therefore dS _ sin t dy H - h Dt (F/sin t) - y Tilt can also be expressed in terms of the displacement of the image (Fig. 2-4) by Since -y is normally small compared with F/sin t, Dt= 1 t t sinty2 F Fig. 2-4 - Image displacement due to tilt I Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 The image displacement is therefore of a parabolic form as shown in Fig. 2-5. An automatic registration system with only first-order capability will provide a linear approximation to this curve, as shown by the line AA. The residual peak to peak error is 2e. It can easily be shown that for the curve D = (sin t/F) y2, the residual second-order error is sin t e 8F (y2 - Yi)2 where yi and y2 define the edges of the viewed area in the y direction. d_sin t 2 f y sin t e 8f (Y2 - Yi)2 D2 t r t I Fig. 2-5 - Residual second-order displacement error due to tilt angle I Residual second-order errors have been computed for tilt angles of 7.5, 15, 30, and 45 degrees, with camera focal lengths of 6 inches (150 millimeters), 12 inches (300 millimeters), 24 inches (600 millimeters), 48 inches (1,200 millimiters), 100 inches (2,500 millimeters), and 200 inches (5,000 millimeters). The results are shown in Figs. 2-6 through 6-11. In each of these figures, the maximum permissible superimposition errors for images of resolutions of from 25 to 200 lines per millimeter have been indicated, enabling the effect of second-order distortion on the final im- age to be estimated. Figs. 2-6 through 2-11 show that, in general, second-order corrections are essential, especially at large tilt angles and with high resolution imagery. t Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 t 1 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Tilt 4 5? 30? 15? 7.5? 25 L/ mm 50 L/ mm Maximum displacement error for stated f 100 L/ mm resolution -a-200 L/mm y Dimension of Image, millimeters Fig. 2-6 - Residual second-order distortion for 6-inch focal length Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Tilt 45? 30? 15? ? 7.5 5 L/mm% 50 L/mm Maximum displacement error for stated .100 L/mm resolution -a-200 L/mm y Dimension of Image, millimeters Fig. 2-7 - Residual second order distortion for 12-inch focal length t t Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 t t t t Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Tilt 45? 30? 150 7.5? 25 L/m m 50 L/mm Maximu displace error f o stated f 100 L/mm resoluti 200 L/mm y Dimension of Image, millimeters Fig. 2-8 - Residual second-order distortion for 24-inch focal length m ment r Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Tilt 4 50 ? 30 15? 7 .5? X25 L/ mm --.0.50L/ Maxi mm displa error stated resol .,.100 L/ mm X200 L/ mm y Dimension of Image, millimeters Fig. 2-9 - Residual second order distortion for 48-inch focal length mum cement for ution 1 t I Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 t t t t Tilt 45? 300 150 7.5? 25 L/mm mw. Maximum 50 L/mm displace- ment error for stated resolution 100 L/mm 200 L/ mm 1 t y Dimension of Image, millimeters Fig. 2-10 - Residual second-order distortion for 100-inch focal length Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Tilt 45'- 300 15? 7.5? 25 L/mm -~ Maximu m 50 L/ m m-..P- displace- ment error for stated resolution 100 L/m m-.w.- 200 L/ mm ~- I I I I /~ / I I I I I I -Lj y Dimension of Image, millimeters Fig. 2-11 - Residual second-order distortion for 200-inch focal length t 1 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 IAT t t 1 2.1.3 High Order Corrections The high order image distortion produced by relief displacement presents a problem in image integration. Obviously, the differences in imagery due to viewpoint must be eliminated or com- pensated for, in order to obtain the full benefits of image integration. There are two approaches to the problem (1) eliminating relief displacements by making each element of imagery congruent with the corresponding element in other inputs, and (2) using stereo viewing to take advantage of the information present in relief displacements. If the images to be integrated have been taken from similar viewpoints, or if the vertical relief in the viewed object is small, the problem is considerably simplified; in these cases it will be pos- sible to directly integrate several photographs without being concerned with high order corrections. High order displacements can be eliminated on a point by point basis in an optical system, the process being similar to the production of an orthophotograph. This is, however, a slow process and not suitable for photointerpretive use. An electronic scanning system is potentially capable of removing high order image displacements almost instantaneously for direct viewing. Although this is not yet a practical reality, development of the ARES viewer to achieve this capability is being vigorously pursued atE= The best immediate solution for the integration of multiple images con- taining considerable vertical relief obtained from several different viewpoints appears to be to sep- arate the input material into groups, such that the variation in viewpoint in a single group is mini- mized. Each group can then be integrated directly. The integrated groups can then be taken in pairs and viewed stereoscopically; each pair may involve a different stereo base line and thus give a different view of the target. This approach seems to make the best possible use of the different capabilities of a multiple image integration device and a stereo viewer. Ultimately, the develop- ment of an image integrator with high order transformation capability will enable the viewpoints to be exactly compensated, so that a single integrated photograph, or a single stereo pair, will con- tain all the information present in the various inputs. The proposed electronic viewer will have this add-on capability for high order image transformation, and will not become obsolescent. 2.1.4 ARES Correlator Performance Having determined the registration accuracy requirements for image integration, we will now consider the performance of the current ARES correlator. The ARES correlator and distortion analyzer produce their outputs by averaging the errors over the whole viewed area. The accuracy with which distortion errors are computed is not there- fore limited by the number of lines in the scan, since there is a considerable integration effect present. Typical correlator transfer functions are shown in Fig. 2-12. In the process of image registration, the low frequency correlation channel comes into operation first, since this has the widest range of operation. As the image parallax is reduced, the displacement comes within the range of the higher fre- quency channels. The lower frequency channels are successively eliminated in order to reduce their noise contribution. The final accuracy of the system therefore depends on the transfer char- acteristic of the highest frequency correlator channel, the loop gain of the system, and the cor- relator noise. The correlator transfer curve has a slope of 2 volts per 1 percent of raster width. For an image 0.25 inch square, which is the smallest viewed area in the proposed design, the cor- relator gain is 800 volts per inch, or 0.03 volt per micron. If sufficient loop gain is provided, the limit on registration accuracy is set by the noise level at the correlator input. The noise level varies with the type of imagery being scanned, but is of the order of 0.1 volt. The minimum dis - placement error that can be sensed is therefore approximately 0.1/0.03 or about 3 microns. This error is consistent with the displacement error that will allow a resolution of about 100 lines per millimeter in the integrated image, referred to the input material, which was determined to be 2.5 microns in Section 2.1.1 (see Table 2-1). This 3-micron displacement error corresponds to a Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Parallax, percent of raster width (a) Channel A - 100 to 215 kc/sec, fc = 147 kc/sec Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 1.6 0.8 D 3 6 9 12 V (b) Channel B - 215 to 460 kc/sec, fc = 316 kc/sec Parallax, percent of raster width (c) Channel C - 460 to 1,000 kc/sec, fc = 680 kc/sec Fig. 2-12 - Correlator transfer functions (raster width is 18 millimeters) Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 t t t t 1 t 1 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 spatial frequency phase shift of 90 degrees at about 83 lines per millimeter. The amplitude of the resulting MTF of three combined images will be lower than this by a factor of approximately 1/31/'2 or 0.58. In computing the effect of image misalignment on the final image, it must be kept in mind that an image integration viewer cannot increase the detail seen in high contrast images. The purpose of integration is to improve the signal to noise ratio, and therefore the visibility, of low contrast detail. This increase in visibility is necessarily accompanied by a small decrease in the limiting resolution of the system due to small but finite image misregistration. Subjectively, the quality of reproduction produced by a television system is described by the term "photographic quality." The comparison between electronic display quality and photographic quality is rated in terms of the photographic system because of its higher performance. Those factors that are judged in the comparison are tonal quality, signal to noise ratio, and picture sharpness. These factors are interrelated in electronic systems, and tradeoffs are required to produce an image with satisfactory characteristics on the display system. The control of the relationship of the reproduced gray scale to the luminance of the original subject is of importance in achieving excellent tonal quality. According to the Weber-Fechner law, the eye perceives changes in luminance in a logarithmic relationship (i.e., an increase in stimulus, dB, is proportional to the existing stimulus, B, or, for equal changes, AB, SB/B is constant) there- fore, the transfer function of the system is generally plotted in terms of the logarithm of the input luminance to the logarithm of the output luminance of the system.* The gradient of the system describes the contrast of the reproduction compared to that of the original subject, and is the slope at any point of the gray scale dynamic transfer function (GTF) when plotted on log-log paper. The maximum slope, or gradient, is termed the "gamma." A maximum slope of 45 degrees is equivalent to a gamma of 1, and indicates a 1:1 correspondence between input and output at that point. The ratio of log input to log output is thus proportional to the value of gamma. The eye sees a uniform decrease in contrast between steps in a gray scale as the gamma is decreased below 1. However, in linear coordinates, the black end of the GTF is expanded while the highlight, or white end, is compressed. For gammas greater than 1, the opposite effect takes place, i.e., the white end of the gray scale is expanded and the black end compressed. In the latter case, the eye sees the contrast between steps increase uniformly. Gamma is measured at the point of maximum slope and reflects the gradient maximum. Be- cause of the nature of almost all gray scale reproducing systems, there is compression at both ends of the scale. The effect of this S distortion on reproducing systems is that for a constant GTF ratio, the gradient is increased for the central or middle grays and compressed for the high- light and shadow areas. The average gradient is therefore always less than the gamma of the sys- tem. It is the increase in overall average gradient that marks the reproduction as being inferior in quality to its original. In photography, and particularly in the field of color reproduction, this factor is well known. Techniques such as highlight masking are used to help overcome the degradation of successive generations of reproduction. Electronic systems are very flexible in handling this problem. Amplification of the video sig- nal with nonlinearities inverse to those nonlinearities present in the original material and in the * Since d[ln (B/Bmax)] = dB/B. Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 video channel can correct for gray scale distortions. In fact, it is possible in some cases to im- prove on the original by removing tonal distortions caused by improper processing or exposure. The basic limitation to the use of the above techniques is the noise component of the signal, whether it be derived from the original photography or generated in the video circuits used in re- producing the imagery. The overall dynamic transfer functions of both optical and electronic systems are degraded by noise. The signal to noise ratio for an image reproducing system is a measure of the maximum to minimum contrast, or contrast ratio, that can be handled. In optical systems, the noise is caused essentially by stray or flare light which reduces the dynamic range of the system. Electronic sys- tems suffer from this same problem of unwanted light, as well as from noise generated by the electronic components of the system. These factors limit the amount of correction that can be supplied by electronic gamma cor- rection. For rooting functions, as larger contrast ratios are handled, the gain ratio increases for the blacker parts of the video signal. This may involve high gains in the dark gray region, and may thereby enhance defects resulting from (1) noise generated in the transparency scanning sys- tem, (2) stray light (or flare) in lens systems, and (3) inaccurate black level adjustment. Therefore, in correcting for the nonlinearities, as greater contrast ratios are accommodated a point is reached where the disadvantages begin to equal the advantages. This point must be de- termined empirically, and will vary with different inputs. Therefore, the amount of gamma cor- rection must be controlled by the operator. Gamma Correction Circuitry In a video system, part of the characteristic is electrical, and this part of the overall GTF is expressed in terms of the ratio of the electrical input and output signals (voltage or current). A video signal which has been transferred through an ac coupling will be zero for some intermediate luminance value. When the peak to peak video signal is reduced to zero, there remains a dc com- ponent, either zero or some other value, which represents the average value of the signal. If the scene being transmitted is almost all white, the average is near the white peaks; if the scene is almost all black, the average is in the dark gray portion of the video signal. Before the signal can be applied to a nonlinear amplifier, it is necessary to set a certain value of the signal at a fixed dc point, so that the corresponding luminance value will always appear on the nonlinear characteristic at the correct point. Experimental work was conducted on the design of an amplifier for insertion in the ARES video channel for the correction of nonlinearities. This work was divided into three phases: 1. The establishment of a black level in the video signal by the addition of a blanking pulse to the flying spot scanner tubes 2. The development of an amplifier to drive the nonlinear circuitry and clamping system (keyed clamp), to establish an operating point at the black level during the clamping period 3. The development of a nonlinear amplifier with single knob control of the nonlinearity. Two breadboard gamma amplifiers were constructed and installed in the ARES for evaluation. In addition, a circuit was breadboarded for electronic switching between two video inputs at vari- ous rates without flicker. The arrangement was such that it was possible to switch each of the two ARES channels to a straightthrough condition, or to insert the gamma amplifier. When inserted, the gamma amplifier output fed both the correlation channel and the video driver for the display tube. 20 1 r r I t I I Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 The purpose of our tests was to demonstrate the application of manual control of gamma to enhancement of the visual display, and also to determine what effect a change in gamma would have on correlation. Blanking signals were fed to the cathodes of the two scanning cathode-ray tubes by means of a blanking generator. The blanking signal was "folded" around the edge of the raster and its ampli- tube adjusted to cut off the cathode-ray tube light for 2 microseconds. The blanking pulse then ap- peared on the video output of the photomultiplier as a pulse representing black (absence of light), which could be used as a reference in the do restoration circuits at the gamma amplifier and also at the grid of the viewing cathode-ray tube. The gamma amplifier used a keyed clamp circuit to establish a constant operating point for the nonlinear amplification of the video signal. At the cathode-ray tube, it was found that the black setting circuitry of the ARES clamped this point, since it was the blackest point in the picture. It was noted that the introduction of the blanking pulse to the ARES circuitry improved the appear- ance of the black portions of the viewed picture, permitting observation of detail in the blacker portions that otherwise was lost due to black compression. It was also noted that the time con- stants of the ARES circuitry, when photographs containing large, massive areas of black were used, caused the black setting operation to take place on these areas rather than on the blanking pulse. As a result of these observations, it is recommended that keyed clamps be used at all points requiring accurate black level setting. The circuit described above operates by detecting the blackest part of the picture and setting a constant cathode-ray beam current at this point representing black. The circuit works very well, but the results can be confusing. For example, when no photograph is in the viewing part of the ARES, the darkest part of the video signal is created by negative peaks of the phosphor grain pat- tern and the pattern caused by burning of the phosphor, which is a normal effect as the tube ages. The black level setter adjusted these negative peaks to represent subjective black as referred to the peak light output. The white excursions of the noise (grain and burn) signal were expanded by the automatic video gain to full peak output. Normally the grain pattern of a scanning tube phos- phor has an rms value of less than 10 percent near the average signal level. However, this circuit expanded the noise signal to approximately 95 percent. This form of image control presents the possibility of severe tonal distortion for certain types of photography, in particular, that which has no true subjective blacks. By using an established black reference point throughout the image integration viewer system, this form of tonal distortion will be avoided. 2.2.2 Shadow Suppression The automatic registration of several aerial photographs of the same area taken under dif- ferent conditions of illumination is sometimes difficult because of the presence of shadows or specular reflections. Shadows are a dominant feature of photographs taken with sunlight falling on the area from a low angle. Specular reflections, while less common, cause obliteration of significant detail due to saturation of the photographic material. If the shadows in the several photographs are in different positions due to a change in the position of the illumination source, or are present in only a few of the inputs, correlation is difficult to achieve. A great improve- ment in the operation of automatic registration circuitry can be realized if the effects of shadows can be eliminated. A better understanding of the problem may be had from the following considerations. Assume that we have two reflection density step wedges, each of the ten steps having a density greater by 0.15 than the preceding step, with step 1 being of zero density and assumed to reflect 100 percent of the light. We place the two step wedges in the field to be photographed. At the instant we take Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 the photograph, a cloud obscures the illumination on one of the two tablets, reducing the illumi- nation on it to be 8 percent of the illumination falling on the other. A second photograph is made at a later time, when the cloud has passed. Assume also that the photographic material used in making the pictures has no compression on the toe or shoulder of the density-log exposure char- acteristic curve. If we then plot the density of each step on the developed photograph, our plot shows that each step when plotted against its density (Fig. 2-13) has a constant height relative to the other steps. This is how the eye sees the photograph. The step value, in terms of density, is the same whether the step is in full sunlight or in shadow. However, when the photograph is placed in the flying spot system, the video signal will be as shown in Fig. 2-14. Since the photomultiplier of the flying spot system responds linearly, each step will be seen to decrease proportionally by a constant percentage of the previous step. The shadowed step wedge is seen to occupy only 8 percent of the available video channel amplitude, and the brightest step is step 1. We can, by increasing the gain of the amplifier, bring shadowed step 1 up to 100 percent, or sunlight, illumination, thereby eliminating the effect of the shadow. However, if we must see some of the area outside the shadow, we cannot do this. The other alternative is to take the logarithm of the signal shown in Fig. 2-14. On the output of the logarithmic amplifier, the steps will have equal increments and will appear as in Fig. 2-13. If, in the correlator, we differentiate the signal or pass it through abandpass filter, thereby re- moving the dc component and the lower frequencies, we should be able to improve the possibilities for automatic registration. The methods outlined above, namely (1) to look entirely within the shadow and raise the video gain, and (2) to take the logarithm of the signal and differentiate, are subject, of course, to the realities of the situation. We do not have photographic materials without compression in the toe and shoulder regions of the D-log E curve, so that even the logarithmic approach will not produce steps of equal amplitude for the shadow and highlight detail. Nevertheless, this will improve the situation and the number of photographs that can be automatically registered should be increased. It has been our experience in the experimental application of nonlinear amplification in the correlation channel of the ARES that there is a variable in the nature of the nonlinearity that is necessary for achieving optimum conditions for automatic correlation. On certain subjects, stretching of the blacker portions of the video signal seemed to improve correlation, while for other photographs, stretching of the white was found to be more beneficial. For this reason, it is our recommendation that the operator be provided with a means of selecting the characteristic to be inserted in the correlation channel. This will be accomplished by a switch which will select one of the following functions of the video signal to be inserted in the correlation channel: 1. Square law-to emphasize the whiter portions of the signal 2. Linear-the normal mode as now used 3. Logarithmic-to emphasize the blacker portion of the signal. The prediction of performance characteristics of both the optical and electronic systems is computed in the same manner. The response of optical and electronic systems combined can be calculated to arrive at a measure of total performance in resolution capability. In calculating the response of the system, MTF data for each component of the system are required. Modulation transfer, sometimes called sine-wave response or contrast transmission function, relates the output amplitude of a sine-wave signal to the input amplitude as a function of 22 t t Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved-For Release 2004107/29: ;TA- ERRATA On p. 22 and in Fig. 2-13 and 2-14 For:8 percent;Read:12.5 percent (Sunlight, 100 percent illumination 2.4 L 0 Shadow, 8 percent illumination Step Number Fig. 2-13 - Log plot of step wedges in sunlight and shadow Sunlight, 100 percent illumination Shadow, 8 percent illumination 0 2 4 6 8 10 Step Number Fig. 2-14 - Linear plot of step wedges in sunlight and shadow 23 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 frequency. Simply expressed, it is the frequency response of the component or system. When the MTF of each component of a system is known, the system MTF can be obtained by finding the product of all responses for each frequency. The term "frequency" as used in this context relates to the physical size of the picture ele- ment. The higher the frequency, the finer the size of the element. This is a crude means of ex- pressing the differences between the concept of "spatial" or "time" domain (the former applying to optical systems, the latter to electronic or scanning systems), and "frequency" domain. The resolution of optical systems is measured in line pairs or cycles per unit length. In electronic video systems, the number of scanning lines is fixed, and therefore, vertical resolution is also fixed. The size of the electronic display system may vary from one installation to the next. Therefore, the concept of frequency response of the video system must be related to a common factor, i.e., the height of the picture. Thus, the expression, "a 500-line picture," means that each picture element is 1/500 of the picture height, regardless of the actual dimensions of the display. Another important difference between optical and video resolution measurements is that the optical line pair is equal to two television (TV) lines. Therefore, in the display of a 3,000-TV-line picture in a raster 3 inches high, the ultimate resolution is 1,000 TV lines per inch, or 500 line pairs per inch. It should be noted that the resolution referred to here is along the television line. The reso- lution in the vertical direction, i.e., at right angles to the direction of the scan line, is modified by the Kell factor. Determination of vertical resolution is a sampling process. The Kell factor states the probability that given a sine-wave test target whose frequency in TV lines is equal to the number of TV lines in the scanning pattern, and which is oriented such that each half-cycle is scanned by one TV line, (1) the output will not be zero, as would be the case if the scanning line were to traverse the test target along the zero crossing, and (2) the output will not be a maximum, as would be the case if one line traversed the peak of the positive cycle and the next the peak of the negative cycle. The actual probability is the root mean square of the two extremes, and is there- fore generally considered to be equal to 0.7; hence, the average vertical resolution is 0.7 times the number of scanning lines. This means that to obtain vertical resolution equal to 3,000 horizontal TV lines, 4,200 active TV scanning lines are required. The empirical value of the Kell factor, as measured by a number of experimenters, has varied from 0.5 to 0.89, and depends on the type of display, the actual size of the video camera scanning spot, and other factors. 2.3.1 Flying Spot Scanning Systems . It has become the accepted procedure when generating a video signal from photographic trans- parencies to use a flying spot system. The system consists of a cathode-ray tube upon whose phosphor screen is generated a rapidly moving light spot, tracing out a raster by the action of an electronic beam. The light from the raster is imaged by a lens onto a photographic transparency. The light modulated by the transparency is collected by a field lens or condenser system and transmitted to a photomultiplier whose output represents the instantaneous value of transmittance of the photographic material as a function of the position of the spot in the cathode-ray tube raster. It is generally accepted that resolution and tonal qualities of the video signal generated by flying spot systems are superior to those produced by other forms of television systems, such as those which use the vidicon and the image orthicon. The limitations of the flying spot system are imposed by the spot size of the scanning beam and the persistence of the phosphor, the latter limitation being the greater. The fastest phosphors decay to the 10 percent point in about 0.1 microsecond. This limits the practical bandwidth obtain- able from flying spot systems to the order of 15 megacycles. The requirement for a flicker-free image requires a frame rate of 30 frames per second. If, in meeting the requirements for high resolution printout, this requirement of flickerless display 24 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 can be ignored, it is possible by reducing the frame rate to transmit a larger number of picture elements within the 15-megacycle limitation imposed by the decay time of the phosphor. With a slow scan system, the persistence factor is eliminated and the limitation on resolution and con- trast is imposed by the spot size and the noise generated in the photomultiplier tube. The best combination of phosphor efficiency and phototube sensitivity is found in the P-16 phosphor, which peaks in the ultraviolet region at 370 millimicrons, in conjunction with an ultra- violet sensitive photomultiplier. This allows the best possible beam current reduction in obtain- ing the best signal to noise ratio. The limiting resolution of such a system for commercial tele- vision application is 800 lines per frame, with signal to noise ratios close to 100:1 (40 db). Image Dissector The image dissector surpasses all known television pickup devices in resolution. All other camera tubes and flying spot scanner systems use a cathode-ray beam to perform the scanning operation or to illuminate the flying spot. The definition of a cathode-ray beam is never as sharp and exact as the direct imaging of an electronic image, as in the dissector or in an image con- verter tube. Measurements on an image converter with a transparent phosphor showed a resolu- tion of 140 line pairs per millimeter (equivalent to 280 TV lines per millimeter). Comparable resolution could be achieved with a image dissector if the mechanical aperture were fine enough.* Fig. 2-15 shows the MTF for an image dissector and a 1-mil cathode-ray tube. The limitation on the use of the image dissector is not on obtaining sufficiently fine mechani- cal apertures. An aperture of 0.0003 inch in a tube will give sufficient resolution to resolve 3,000 TV lines in a 1-inch-high raster. With conventional dissector techniques at high scanning rates, this is not achievable, due to signal to noise limitations connected with the amount of photo- cathode illumination permitted before deleterious effects set in. The signal to noise ratio of the dissector for a constant fixed scanning rate is proportional to the square of the linear dimension of the aperture. As a result, a dissector designed for com- mercial television requires an aperture of 1/500 of the picture height, or for a 1-inch raster, an aperture of 0.002 inch. Compared to a similar tube having a 1/3-mil aperture, the signal to noise ratio will be (2 x 10-3/3 x 10-4)2 = 4 x 10-s/9 x 10-$ = 44. The signal to noise ratio also varies as the square root of the sweep time. For a fixed photo- STAT cathode loading, doubling the sweep time will increase the signal to noise ratio by 40 percent. An image dissector tube, WL-23111, manufactured by the has a limiting resolution of 3,200 TV lines. Its photocathode can be loaded with illumination equal to a current density of 4 microamperes. For commercial TV line scans of 63 microseconds, the tube's peak to peak signal to rms noise ratio is 0.4. This, of course, is impractical and is the reason that the image dissector has not been universally adopted for stan- dard television systems. With conventional illumination, the WL-23111 image dissector must be used with slow rates in order to produce signals sufficiently greater than the noise component of the photocathode cur- rent. Since the signal to noise ratio varies as the square root of the scan time, a scan time of 0.6 second per horizontal line is necessary to obtain a ratio of 40:1. For a printout system utilizing the maximum resolution of the dissector, assuming a 0.7 Kell factor, 4,200 TV lines will be required to give equal horizontal and vertical resolution and to mask line structure in the output print. The product of 4,200 lines and 0.6 second is 2,520 seconds for one frame time, or approximately 43 minutes. * G. Papp, On a Novel Application of the Image Dissector, J. SMPTE, 74:782 (Sept 1965). 25 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 TV Lines Per Frame Height 4,000 5,000 6,000 23 11 image dissector, 0.3-mil aperture, 1-inch raster 1-mil spot, 3-inch raster on crt 1,000 3,000 2,000 1,000 3,000 1,500 2,000 Fig. 2-15 - Modulation transfer functions for cathode-ray tube and image dissector, linear plot "Follow Spot" Technique Our discussion of the image dissector has led to the conclusion that the tube is impractical for conventional scan techniques because of the signal to noise ratio imposed by the illumination limitation. However, by using a flying spot cathode-ray tube to illuminate only the small area being directly scanned on the dissector photocathode tube, in much the manner that a "follow spot" is used in the theater to follow an actor as he moves across the stage, the signal to noise ratio of the dissector can be improved enormously. We still meet the limitation of a 4-microampere total cathode current, but because of the short duty cycle of illumination per picture element, the major portion of this current now reaches the scanning aperture. The follow spot from the flying spot tube can be considerably larger than the picture element of the dissector tube, thereby minimizing tracking problems. The persistence of phosphor and the spot size of the cathode-ray tube do not affect the resolution of the image dissector. This technique is currently used for high resolution displays. Its use is recommended for the image integration viewer and printout system, although the complexity of the combined image dis- sector and flying spot system is much greater because of the requirements for geometric scan correction and electronic zoom. However, we believe that these complexities are a small price to pay for the increased sharpness and resolution that can be obtained from the image dissector. 26 I 1 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 1 2.3.2 High Resolution Printout System Photographic records of the superimposed imagery will be made in a module component of the image integration viewer-the hard copy printout system. The basic components of the printout station are a cathode-ray tube with high resolution display capabilities, and a P-11 phosphor im- aged through a lens onto the image plane. A Graflok back will be provided at the image plane to permit the use of Polaroid materials, as well as standard 4- by 5-inch cut film and roll film. The operation of the system will be initiated by a control on the viewer control panel, after the operator has made the necessary adjustments to the imagery as viewed on the system monitor. As discussed elsewhere, the monitor operates to provide a flicker-free display for direct viewing. When the printout operate button is depressed, the system shifts from a 30-frame operation to a slow scan mode. The linearities and geometrical transformations needed to achieve correct reg- istration of the several inputs are stored in the system memory, which controls the scanning at each of the input stations. Readout Cathode-Ray Tube It is our objective in the design of the printout system to maintain the inherent resolution of the video signal derived from the image dissectors. To this end, the selection of the cathode-ray tube for recording the video image photographically plays an important part. The cathode-ray tube parameters that determine its suitability for use in a photographic re- cording system are (1) the photoactinic light output, (2) the spot size, or ability to reproduce fine detail with good contrast, and (3) the noise or granularity of the phosphor. The actinic light output is the result of the spectral characteristics of the phosphor, and the photographic efficiency is rated on the basis of the density obtained for a given exposure. Nor- mally, the spectral sensitivity of the film must match the spectral sensitivity of the phosphor light output, to ensure maximum efficiency. Persistence of the phosphor is important in systems where change of information takes place in successive scans, in which case a carryover of the previous image would be detrimental. In the proposed system with a slow scan output, the persistence will im- prove the photoactinic efficiency. The phosphor that most closely meets the requirements for the printout system is P-11, a blue zinc sulfide. Its peak spectral output is at 460 millimicrons. Its average persistence is 60 microseconds at the 10 percent point; the actual decay time is a function of the beam current. A number of manufacturers are able to supply high resolution tubes with a fine grain version of this phosphor. The resolution on the P-11 cathode-ray tube is dependent on the spot size formed by the elec- tron gun on the phosphor screen. The spot dimensions are determined by the design of the elec- tron optics of the gun and also on the amount of spreading of light that occurs in the phosphor screen material. Tubes with a nominal 1-mil spot width, measured at 60 percent of the luminance peak, are available in tubes with a 41/ -inch optical quality screen. A raster 3 inches square will fit within this circle. If the spot shape istobe Gaussian, its transform to frequency response is also Gaussian, as expressed by F = exp (-27r2f2o2) where F is the percent modulation for a spatial frequency, f, and the spot width measured at 60 percent of peak output is 2Q. The results of a computation using this relationship are plotted in Fig. 2-16 for a raster of 3 -inch frame height, and a Gaussian spot width of 1 mil. The 3 -inch raster and 1-mil spot size are compatible with the 4,200 active line scan proposed for printout. The frequency response of the WL-23111 image dissector is plotted in terms of its frame height, and the combined result of 27 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 the dissector and the output cathode-ray tube is computed and plotted. It is seen that the 50 per- cent response point for the two is approximately 850 line pairs per frame height. The limiting response (3 percent) is approximately 1,400 line pairs. 2,000 4,000 101000 20,000 WL-23111 image dissector 1-mil Gaussian spot, 3-inch-high raster on cathode-ray tube Combined response 1 mil at 60 percent amplitude 100 percent amplitude 1,000 5,000 10,000 1,000 2,000 Fig. 2-16 - Modulation transfer functions for cathode-ray tube and image dissector, logarithmic plot The magnification required for printout is dictated by the film size, usually 4 by 5 inches, or if roll film is used, 21/2 by 3/ inches on 70-millimeter film. It is recommended that the output device operate at a 1:1 magnification for all film sizes. For 1:1 magnification, 850 line pairs in 3 inches corresponds to 12 lines per millimeter on the film plane. The MTF for the film and imaging lens show almost full response at this point; thus, the film image should have essentially the same response as appears on the face of the cathode-ray tube. 1 1 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Twelve lines per millimeter is somewhat finer detail than the eye can resolve at a 10-inch viewing distance. A magnification of 2x will bring the finest detail within the resolving capability of most observers. It should be recalled that we have not been discussing the limiting resolution of the system as is normally done in optical and photographic systems, but rather the 3 db down or 50 percent re- sponse point. This is compatible with measurements made on electronic equipment. 2.4 COMPARISON OF ELECTRONIC AND OPTICAL IMAGE INTEGRATION SYSTEMS A comparison of the features of electronic and optical image integration systems is given in Table 2-2. The features examined are those essential to an integration viewer, i.e., sensing of parallax, transformation capability for handling inputs of varying geometry, gray scale process- ing, resolution, and type of output. This is not intended as a general comparison between electronic and optical viewers. In a scanning viewer, for example, the resolution of an electronic system would be restricted by the necessity of presenting the information at a high frame rate. A high frame rate is not required in an integration viewer, since the imagery is essentially static. In summary, it can be stated that for the present purpose an electronic system has the advan- tage of a far greater flexibility in image transformation and gray scale processing. The limiting resolution of the hard copy image on film based on a crt spot size of 1.5 mils would correspond to about 100 lines per millimeter over an area of 6 by 6 millimeters at the input film. The total number of image elements is about 1.6 x 106. Maximum overall magnification will be 12x, giving an output image area of 3 by 3 inches, with a limiting resolution of about 8 lines per millimeter. An optical image integration system would be limited as to the types of materials that could be handled, as regards image geometry and film processing (e.g., negative material could not be mixed with positive). Our experience with the EROS stereo viewer indicates that the limiting resolution of the final image in an optical viewer using anamorphic and zoom lenses corresponds to about 150 lines per millimeter in the center and 50 lines per millimeter at the edge of a field about 8 millimeters in diameter, referred to the input material. This represents about 2 x 106 image elements, which does not differ greatly from the capacity of the electronic system. 1 29 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 W 0 Electronic System Optical System Feature Available Remarks Available Remarks Sensing of parallax Yes Electronic scanning No Possible future use of coherent light Transformation capability Zero order Yes Move scanning raster Yes Move input First order Yes Distort scanning raster Yes Anamorphic lenses Second order Yes Distort scanning raster Yes Tilted plane Higher orders Yes Distort scanning raster No - Gray scale processing Negative-positive polarity Yes Invert video signal No Reflection method inversion not suitable for transparencies Contrast Yes Change video gain Yes Limited, change coherence of illumination Nonlinear characteristic Yes Change video No - characteristic Edge enhancement Yes High pass filter Yes Spatial filter Shadow suppression Yes Logarithmic amplifier and No - high pass filter - Noise suppression Yes Low pass filter Yes Spatial filter High resolution Static imagery Yes 1.6 x 106 image Yes 2 x 106 image elements elements Changing imagery No Limited by bandwidth Yes 2 x 106 image elements of image transducers System output Direct viewing Yes Long persistence crt Yes Aerial image or screen Hard copy output Yes CRT film recorder, Yes Film high resolution Remote viewing-printing Yes Remote crt No - Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 M r Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 3. GENERAL DESCRIPTION OF MULTIPLE IMAGE INTEGRATION VIEWER-PRINTER This section describes the present design of the multiple image integration viewer-printer, with regard to producing this unit as deliverable hardware. Certain detailed design remains to be completed in certain areas, and will be finished during the development effort. The general configuration of the multiple image integration viewer-printer is shown in Fig. 3-1, and a block diagram of the unit is shown in Fig. 3-2. The unit is housed in a console 78.5 inches in length, 69 inches in height, and 47 inches in depth. A viewing table projects from the front of the console, and is 38 inches above the floor. Casters are attached to the console for ease of movement, and access panels are provided to facilitate equipment adjustment and main- tenance. The three separate input channels within the console each have a hinged control panel located on the front of the console. The input platens for each channel are located on the viewing table. Display units provided are the viewing monitor and the 5-inch cathode-ray printout tube. A 4- by 5-inch camera can be attached to the face of the printout tube to provide a hard copy record. The control panel of the multiple image integration viewer-printer is shown in Fig. 3-3. The function of each control is as follows: ? FILM DRIVE-drives the film forward, backward, left, or right ? ZOOM-selects magnifications of 0.925x, 1.66x, or 3x ? GAIN-varies the intensity of the video signal ? FLICKER-selects the flicker frequency, and switches the video on and off ? GAMMA-adjusts the shape of the video gain curve ? CORRELATION WEIGHTING-selects the square root, linear, or log function ? POSITIVE/NEGATIVE-selects the positive or negative video signal ? X in X-linear x-scale adjustment ? Y in X-y-skew adjustment ? XZ in X-oblique scale adjustment ? XY in X-keystone adjustment ? X in Y-x-skew adjustment ? Y in Y-linear y-scale adjustment ? XZ in Y-oblique scale adjustment ? XY in Y-keystone adjustment The configuration of the three input platens is shown in Fig. 3-4. The three input platens are located on the glass tabletop (1/4-inch-thick, " Parallel-O-plate" glass), which is illuminated Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 w N Viewing aperture r - I---------- I I i Magnetic ; 4== 1== shielding I ;~ I i I ~ 'L_ I _ I i 1 69 in. inch I camera, I ,+t 31/2 inches, ; r f/6.8 ~ h~\ ? } 5-inch printout tube .L_ --, Fig. 3-1 - General configuration of multiple image integration viewer-printer Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Ml Ml M Mr Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 High resolution oS~ Video Video printout processor combine ~Sp Video Film processor S1 Video processor Pre- Pre- Pre- amp amp am Flicker Viewing control monitor ~P--j Image dissector ( I~ILLLI , Image dissector 12 Video processor Master oscillator Video processor Pre amp Video processor Manual viewpoint control Slow scan generato Lissajous scan generator Correlator Distortio analyzer Correlation sequence switch Fig. 3-2 - Block diagram of multiple image integration viewer -printer Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 LINEAR SO. RT.0 0 LLOG Q ED 0 POSITIVE/NEGATIVE 0 Fig. 3-3 - Control panel CORRELATION WEIGHTING from below to allow viewing and positioning. Since the distance from the emulsion plane to the lens must be within 0.002 inch for an f/2 system, close tolerance control of the platen will be ac- complished by supporting the glass tabletop on an air inflated rubber sheet, which will sup- port the glass plate evenly over the entire area. The height of the rubber sheet will be controlled by three self-aligning exhaust valves which can be adjusted to provide a definite positioning of the sheet, and consequently, the glass plate. The platen can accommodate 9- by 9-inch and 70-millimeter film chips, which are placed between two pieces of glass. The platen is translated in both the x and y directions by the joystick control, through the use of ball screws and a motor-clutch arrangement. Disengagement of the clutches allows manual positioning of the platen. The section of film to be scanned is placed on the index registration mark, and when the platen is actuated, the desired area of film will move under the scanning tube. Manual positioning can be accomplished by handcranking or by positioning the platen by hand. The platen rests on three air bearings that are operative during platen positioning to provide smooth movement. The optical system (Fig. 3- 5) performs the following three functions: 1. Images the light from the flying spot scanner onto the film 2. Collects the light passing through the film and sends it to a photomultiplier tube 3. Images the film onto an image dissector tube. 34 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 1 ~ 1 I _ I I M + ~ II IT1 71, Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 v Fig. 3-5 - Diagram of optical system Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Functions 1 and 2 are used in driving the correlation circuitry, while function 3 is used to obtain the high resolution video information. Function 1 provides the light source for function 3 by scanning the image dissector synchronously with the flying spot scanner. Function 1 is accomplished with a lens designed for a P-11 phosphor spectral output, and corrected for the 2:1 conjugate ratio. The lens will be a 75-millimeter-focal-length, f/1.9, Wollensak Oscillo-Raptar. It will perform adequately at full aperture, although it may be stopped down to f/2.8 to improve the depth of focus. The phototube pickup lens for function 2 will be located below the film so as to be out of the high resolution portion of the optical path. It will be a simple planoconvex lens with a 1-inch diameter and 2-inch focal length. The pickup lens will image the 75-millimeter lens aperture onto the front face of the photomultiplier tube. A beam splitting pellicle mirror will be used to deviate this beam onto the phototube. This pellicle mirror is manufactured by the National Photocolor Company, and is used to avoid having a tilted, thick glass plate in the high resolution system. The pellicle mirror also avoids ghost images from the back surface. The high resolution system uses another 3-inch Oscillo-Raptar lens. This system would ideally move the lens through a range of distances to give a continuous zoom capability, but this is difficult to accomplish because of the need to dynamically maintain focus. For the purpose of this equipment, it will be adequate to provide three discrete magnifications and to zoom the raster size on the image dissector to fill in the gaps. The lens magnifications chosen are 0.925x, 1.66x, and 3x. The lens performance, referred to the film plane, will be better than 100 lines per millimeter at all points in the field, at all magnifications. At the highest (3x) magnification the resolution will be better than 150 lines per millimeter. The correlation subsystem consists of the following components: 1. Lissajous scan generator 2. Photomultiplier tubes and video amplifiers 3. Video correlator and distortion analyzer 4. Memory unit 5. Modulator. 3.4.1 Lissajous Scan Generator To detect image parallax, a scanning pattern must be used 'in which motion of the scanning spot has components in both the x and y directions. The crossed diagonal, or Lissajous, pattern formed by two triangular waveforms of slightly different frequencies has been found to be ideal for this purpose. Each point on the image is scanned successively in four orthogonal directions, enabling image parallax in any direction to be computed. A scanning pattern using 500 lines across the diagonal will be used for this equipment, with a line frequency of 15 kc/sec and a frame rate of 30 cps. A diagram of the Lissajous scan genera- tor is shown in Fig. 3-6. The x and y frequencies are derived through binary dividers from a common master oscillator, which ensures a fixed phase relationship between the frequencies. This is necessary in generating a stable pattern. In addition to the x and y deflection signals, this unit also provides the x and y reference signals that are required in the distortion analyzer. The 0-and 90-degree reference signals at 15 kc/sec are produced by further dividing the normal and inverted30-kc/sec signals at the output of the main divider by a factor of two. This ensures an accurate phase difference. 38 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 15 me/sec _ 90? Inverter _ 2 ~---Ox 15-kc/sec I Ooutput 2 x 30 kc/sec 0? 30 kc/sec Inverter Fig. 3-6 - Lissajous scan generator 90? -Oy 15-kc/sec output -Oy 0? 3.4.2 Photomultiplier Tubes and Video Amplifiers The photomultiplier tubes pick up the fluctuating light intensity produced by density variations in the film as it is scanned by the flying spot, and convert it into a varying electric current. This current is then amplified by the video preamplifier and applied to the video processor. The video processor has provisions for polarity change to accommodate both positive and negative input material, gain control to account for differences in image contrast, and gamma control, so that the shape of the video input and output characteristics can be changed to suit the input material. 3.4.3 Video Correlator and Distortion Analyzer The video signals are correlated by separating the video into three frequency bands, each channel covering about one octave. One channel of the video correlator and distortion analyzer is shown in Fig. 3-7. After band filtering, the left and right inputs are phase shifted by +45 degrees and -45 degrees, and hard limited so that only the zero crossings are preserved. The two signals are then applied to an exclusive OR circuit. The output of this unit, when the inputs are identical, consists of a symmetrical square wave. When either positive or negative phase shifts are present between the video inputs, indicating parallax between the images, the symmetry of the square wave is shifted to either positive or negative. The output of the video correlator is applied to the analyzer modules. Parallax in the x and y directions is detected by multiplying the video correlator output by the x and y reference sig- nals, delayed by suitable amounts to equalize the delay of the video processor and correlator. The x parallax and y parallax signals are further multiplied by the x and y 90-degree refer- ence signals to detect the first-order distortion errors, i.e., x scale, x skew, y scale, and y skew. The correlator and analyzer modules are mounted on printed circuit boards and extensive use is made of solid state integrated circuit components. 3.4.4 Memory Unit The memory unit (Fig. 3-8) stores the error signals from the distortion analyzer in the form of the voltage to which a potentiometer is set. Six potentiometers per channel are required to store thezero- and first-order error signals. The potentiometers are servo driven so that the voltage at the potentiometer wiper equalizes that of the error input. The correlation sequence switch initiates operation of each channel, in turn, by activating the servoamplifier. When the potentiometer has been driven to equalize the error voltage, the null at the output of the differen- tial amplifier is detected; when all channels have been nulled, the sequence control switches to the next channel. 39 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 a 0 x reference, 90 degrees x deflection reference Left video input Bandpass Zero level filter discriminator I Video correlator Right video input Bandpass Zero level filter discriminator y deflection reference 0 _y reference, 90 degrees Fig. 3-7 - One channel of video correlator and distortion analyzer Registration error signals Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Null detector f 1` From other differential amplifiers Servo- m nth- moo,.,.,-i;f;o.a Inputs from distortion analyzer To other servo u Fig. 3-8 - Block diagram of memory unit y shift x scale y scale x skew y skew To modulator circuits 3.4.5 Modulator The function of the modulator is to distort the scanning pattern applied to the cathode-ray tubes and image dissectors in accordance with the error signals stored in the memory unit. The modulator unit shown in Fig. 3-9 consists essentially of several linear balanced modulators and summing circuits. The x and y scanning waveform inputs are controlled by the positive or negative error input voltages, and are added to the main x and y scanning waveforms. For example, to com- pensate for a positive x scale error, a certain proportion of the x scan waveform is added to the basic x deflection, resulting in an increase in the x scanning amplitude. Similarly, an x skew error is compensated for by adding a certain proportion of the y scan waveform to the basic x deflection. The modulator units are mounted on printed circuit boards and make use of integrated solid state circuitry. 3.5.1 Video Processor The output of the image dissector is fed to a preamplifier and polarity selector that permits selection of either positive or negative display. The output of the polarity selector is fed to the video processor. Fig. 3-10 is a block diagram of one of the three image dissector channels of the multiple image integration viewer-printer. The camera preamplifier is essentially an impedance transforming stage whose output is at a level that enables it to drive a low impedance line terminated at the video processing unit. amplifier sc le x0 skew 0y skew Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 y2 ref in y scan in y scan 0 o y scan to crt o x scan to crt x scan a- in FU Y Y xy scale skew in Y x x x2 ref xY skew scale in in x First-order transformation error signals in 0 0 y2 y2 in in y x 111 x2 x x y in in y x shift Second-order transformation error signals in Fig. 3 -9 - Block diagram of modulator circuits Zero-order error signals Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 M Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Image dissector ? Focus coil ? Deflection coil Deflection driver Scan correction Clamp driver Sync generator To flying spot tube Camera video preamplifie Video amplifier Power supply Variable gamma correction Aperture correction Fig. 3-10 - Block diagram of a single image dissector channel (sync generator is common to all three channels) W Blanking F-Lnrti To switches Edriver and display Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 The first stage of the processor is a wideband video amplifier feedback pair which steps up the video voltage to the level required by the gamma correction amplifier stages. The block diagram of a variable gamma amplifier used in our breadboard tests is shown in Fig. 3-11. As shown in Fig. 3-11, the video amplifier drives two gamma (nonlinear) amplifiers in parallel. One amplifier produces a video signal which is the square of the input, the other delivers a video signal output which is the square root of the input. To establish a constant operating point, a keyed dc clamp is provided, which sets the operating point (base bias) for the two gamma ampli- fiers during the blanking period, which is itself established by turning off the illumination on the flying spot tube during the turnaround of the scan cycle. >_____II From video amplifier DC pulse clamp amplifier Gamma amplifier Gamma amplifier Fig. 3-11 - Block diagram of variable gamma amplifier ay, + by2 2 Gamma corrected video to line driver The nonlinear load for the gamma amplifiers is made up of three resistors in parallel, with diodes in series with two of the resistances, as shown in Fig. 3-12. The diodes are biased so that they close at different predetermined video signal levels, switching in the shunt resistance. Since the gain of the amplifier is proportional to the load resistance, this shunting effect lowers the load as the video signal increases, producing a close approximation to the desired nonlinear square root characteristic. Fig. 3-13 shows the transfer function characteristics of the non- linear amplifier; for square law amplification the diode polarities are reversed. 44 Fig. 3-12 - One form of nonlinear amplifier Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 1 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Fig. 3-13 - Transfer characteristic of nonlinear amplifier The outputs of the two gamma amplifiers are fed to two inputs of a mixer, essentially two differential amplifiers. The signals are introduced into the emitters of each pair. One collector of each pair is tied together to a common load. A variable dc control bias applied to the base of a transistor in each of the differential amplifier pairs controls the amount of signal from each source. The output of the mixer has an approximately constant amplitude aYa + = k 2 2 where a and b are the amplitudes of the two gamma corrected signals as set by the gamma con- trol bias, and k is a constant. It can be seen that at one end of the gamma control the output is yl, and at the other end it is 72, In the middle of the gamma control, the sum of the two signals closely approximates a linear signal. The signal from the gamma correcting stages is fed to an aperture corrector. As shown in the general discussion of the MTF of the system (Section 2.3), the limit on resolution is in part imposed by the finite size of the scanning aperture. The falloff in MTF caused by aperture losses is phaseless, and is similar in character to the falloff in optical systems. It is possible to partially compensate for this effect by generating a rising, phaseless response characteris- tic as the video frequency increases in the video amplifier. The amount of correction that can be introduced is limited by the increase in noise that can be tolerated. In general, it is safe to assume than an approximate 6 db boost can be used at the higher frequencies, resulting in an apparent increase in the sharpness of the reproduced picture. In our MTF analysis, the effect of the use of aperture correction was not included. After being fed through the aperture correction circuitry, the signal is fed to the blanking insertion amplifier. The purpose of this stage is to insert a negative (black) pulse to blank the printout cathode-ray tube during the retrace of the scanning beam. Control of the amplitude of the blanking pulse is used to set the operating point on the monitor tubes. Fig. 3-14 shows the results obtained with a step voltage signal applied to the input of the gamma amplifier, and the gamma adjusted for each of the three conditions described. Fig. 3-15a shows the waveform of a video signal with the positive peaks amplified more than the black, in essentially a square-law relationship. Fig. 3-15b results from taking the square root of the video signal with the black, negative peaks expanded. The effect, subjectively, of variable gamma control is that of illuminating the shadows for the rooting case, enhancing detail that previously was lost in more or less solid black. 45 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 CIA-RDP78BO477OA000200010048-8 (a) Signal A (b) Signals (A + B)/2 (c) Signal B Fig. 3-14 - Results of step voltage signal applied to input of gamma amplifier (0.5 ms/cm, 2 volts/cm) 46 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 1 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 (a) Square-law correction, white peaks expanded (b) Square root correction, black peaks expanded Fig. 3-15 - Video signals 1 3.5.2 Experimental Gamma Amplifier The schematic of the experimental breadboard gamma amplifier is shown in Fig. 3-16. Two of these breadboards were constructed and used with the ARES for evaluation. Tracing the cirucit from the video input, which requires approximately 0.1 volt peak to peak of video signal, we see that the first two stages, Qi and Q2, comprise a feedback pair, with the gain adjustable by means of a resistance in the feedback loop. The output of this stage is fed to Q3 and Q10 in parallel, which are used to invert the signal b fore it is fed to the gamma ampli- fier driver, Q5, in one channel, and Q11 in the other. The base of each of these stages is clamped, by a pulse derived from the blanking pulse on the flying spot tube, to the bias set by the poten- tiometer marked "black level adjust." The nonlinear load for the gamma drivers is made up of three resistors in parallel. Two of the three resistors have diodes in series, biased such that the resistance is switched in as the video signal amplitudes overcome the bias voltage. The outputs of the nonlinear amplifiers are coupled through emitter followers Q5 and Q11 to the adder stages, Q6 and Q12 in one channel, and Q7 and Q8 in the other. Each of these pairs is essentially a differential amplifier, with Q6 and Q8 sharing a common load. The two gamma corrected signals are applied to the common emitter load of each of the pairs. A do bias con- trolled by the potentiometer marked "gamma" is applied to one base in each differential pair, so that as it is increased the amplitude of the signal from one pair increases, while the ampli- tude from the other decreases across the common load resistance. At one end of the gamma control setting, the video signal is solely from one channel; at the opposite end, from the other channel; and in the middle of the potentiometer setting, the two video signals are added in equal proportions. The line driver consists of Q13, Q14, and Q15. Output gain is controlled by means of a con- trol in the emitter of Q13. Emitter Qi5, in series with Q16, is the driver with a low source imped- ance, and permits the driving of several low impedance lines, as shown. 3.5.3 Video Combiner The video signals from each of the three image dissector and video processor chains are fed to the video combiner. At this point, combinations of the three signals are made for pur- poses of registration in several modes: (1) superimposition, (2) flicker, and (3) individual image viewing. The mode is selected by means of a switch on the control panel, and the result is viewed on the viewing monitor for the purpose of checking the registration before initiating the printout cycle. 41 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Electronic Superimposition Several modes of combining the images from each of the three film input stations will be provided. The simplest method of combining images electronically is by amplitude addition. Thus, the signal from station A is added to the signal from station B, and, if desired, the sig- nal from station C is added to the first combination. One necessary technical consideration when planning the use of this method is the dynamic range of the video channel. When viewing one channel, the signal amplitude normally occupies the entire range (from black to white) that the video circuitry and the display cathode-ray tube can handle without saturation. It is there- fore necessary that when signals are added together, the sum of their amplitudes be no greater than the amplitude of each video signal viewed separately. This requires that as signal B is added to signal A, the peak amplitude of signal A be reduced so that A + B = 1. Or, if B = A, A and B must both be reduced to one-half the amplitude that would be used if either were to be viewed independently. One signal can be subtracted from the other by reversing its polarity. The overall effect of this type of addition is that each of the two images appears to have a lower brightness and contrast than when viewed independently. However, the capability of super- imposition for purposes of registering several input sources is sufficiently valuable to warrant this sacrifice. Several methods are available for automatically limiting the amplitude of the combined images to a value that prevents system overload. We will use a matrix that allows variable gain in each channel, while holding the output amplitude constant for all amplitudes of input. Flicker Another method of superimposition is the addition of the several signals in time. Each sig- nal is gated independently into the display system in sequence. If it were possible to do this at a cyclic rate exceeding the eye's flicker sensitivity, the results obtained would be similar to the effects obtained by the amplitude additive method described above. The time additive technique is based on a law formulated by Fox Talbot in 1834: "If a point of the retina is excited by a light which undergoes regular and periodic variations, and which has the duration of its period sufficiently short, it produces a continuous impression equal to that produced if the light emitted during each such period were distributed equally throughout the duration of the period."* In the design of television systems, flicker is avoided by presenting successive pictures to the eye at a rate well above that at which flicker is noticeable. However, if two images that are similar except for several small details are gated on in time sequence, and a balance is achieved for the larger tonal areas, the resulting image will appear to be continuous except for those small details that exist in only one image. These points will be presented at half the normal periodicity and will flicker at a rate that makes them very noticeable to the observer. By means of this method, successive photographs of the same area over a period of time can be quickly compared for the purpose of detecting new targets or other changes in an area of interest. To make fullest use of this technique, several conditions must be met in the design of the electronic display system. These conditions relate to the geometry of the superimposed pictures, the luminance values of similar areas in each image, and the repetition rate at which each image is presented to the observer. *J. W. T. Walsh, "Photometry" 2nd ed., Constable and Co. Ltd, London, 1953, p. 67. 1 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 CIA-RDP78B04770A000200010048-> Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 1 1 These conditions are interrelated. The repetition rate at which each image is flickered or gated into the display system is, for optimum detection, dependent on the luminance of the display. For low light levels, the critical frequency of flicker is much less than for displays of high lumi- nance. The color of the display and the angle of view are also factors. The simplest case com- prises periods of stimulation by a constant brightness alternating with equal periods of complete darkness. The lowest frequency at which no flicker is seen is defined as the critical frequency. Although this point varies from one observer to the next, at a luminance of approximately 1.0 foot- lambert, it is usually found to be between 12 and 15 flashes per second. A difference in luminance of 11/2 percent between the two images is detectable at these frequencies. From the above discussion it may be readily seen that the luminance of the two images to be analyzed must be adjusted such that the luminance of similar areas on the display screen differs by less than 11/2 percent. The requirement for precise geometrical registration is necessitated by the fact that misregistered points will flicker. Because of the characteristics of the electronic display system, it is necessary to select flicker rates that permit the display of an integral frame, or a multiple of integral frames, dur- ing the "on" period. Since the television frame rate is 30 cycles per second (60 fields interlaced 2 to 1) we can choose an "on" period of any integral multiple of 1/30 second. With one cycle rep- resenting the viewing of the two time- superimposed images, this limits us to flicker rates of 15, 7.5, 3.75, and 3 cycles, etc. It is not recommended that flicker rates be chosen to include an odd number of fields per cycle, since interline flicker between the interlaced fields will be annoying during observation of fine detail and may have somewhat the same effect as geometrical misregistration of the images. The flicker display mode is implemented by an electronic switch. Switching occurs during the period used for vertical retrace on the display screen, and is initiated by appropriate logic circuitry that is triggered by the vertical drive pulse. Selection of flicker rate will be on an individual channel basis that permits the operator to select the time during which each channel will be "on" in any integral number of frame periods. For example, it will be possible to switch channel A on for two frame periods and channel B on for one, by setting the channel A switch to 2 and the channel B flicker control switch to 1. The flicker rate is variable in submultiples of the frame rate and is controlled by an elec- tronic counter locked to the Lissajous scan converter. The output of the electronic counter operates an electronic switch in each channel. Fig. 3-17 shows the switching of two signals. For the purposes of illustration, one input signal is a 1-megacycle sine wave, the other a noise signal. Fig. 3-17 - Switching for flicker presentation (0.2 ms/cm, 1 volt/cm) The rate of the switching for flicker presentation is controlled by the counter which is locked to the frame time of the scan generator. The shortest duration of switching is one frame time. The duration can be selected in multiples of the frame time. This allows the duration selected Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 to be 1/30, 1/15, 1/8, 1/4, or 1/2 second. Thus, when two channels are being viewed, the flicker rate can be varied from 15 cps down to 1 cps. It is also possible to select different periods for each channel, so that, for example, one channel is viewed for two frames, and the other for one. In addition to the variable flicker rate, permanent on and off positions are provided on each con- trol. By this means, one channel at a time may be flickered on on top of a continuous display by the remaining channels. This method of control is very flexible and avoids the display of incom- plete frames. The expected performance of the complete multiple image integration viewer-printer system is summarized below. 3.6.1 Input Material The viewer will accept three film chips of any size up to 9 1/2 by 9 1/2 inches-positive, negative, or mixed. 3.6.2 Hard Copy Output The output will consist of a 3- by 3-inch image recorded on standard 4- by 5-inch cut film or Polaroid material. A regular 4- by 5-inch camera back will be used. 3.6.3 Viewing Outputs In addition to the film output, two viewing outputs will be provided for monitoring purposes: 1. A 10-inch-diagonal, short persistence crt scanned with the 500-line crossed diagonal raster, at 30 frames per second, to check operation of the automatic registration circuitry and to facilitate superimposition and gray scale adjustments 2. A 10-inch-diagonal, long persistence crt scanned with the 4,000-line, high resolution raster, at about 1 frame per second, to check operation of the slow scan readout and out- put image quality. 3.6.4 Magnification Ratios Three magnification ratios will be provided as detailed in Table 3- 1. In addition, the size of each input will be electronically adjustable over a range of 2:1, to accommodate variations in im- age scale and geometry. Table 3-1 - Input Magnification Ratios Magnification Magnification Image Area Onto Film Onto Viewing CRT's Viewed at Input, inches 12x 28x 0.25 by 0.25 6.7x 15.5x 0.45 by 0.45 3.7x 8.6x 0.80 by 0.80 Modulation transfer functions of the complete system have been calculated and are shown in Figs. 3-18 and 3-19. Fig. 3-18 shows the individual MTF's of the basic components of the system, 52 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 all referred to the face of the image dissector tube. Fig. 3-19 shows the overall theoretical MTF of the complete system at the three magnification ratios of Table 3-1, referred to the input. 3.6.6 Signal to Noise Ratio The signal to noise ratio of the system will be at least 100:1 (40 db). The signal to noise ratio of the output image will theoretically be increased by a factor of 1.73 over that of a single input when three inputs containing random additive noise with identical signal to noise ratios are integrated. Camera lens Image dissector, 1-i 1- b h t nc y ras er CRT, 1.5-mil spot, 3- by 3-inch raster Image dissector lens , maximum magnification Combined response, maximum magnification Spatial Frequency at Image Dissector Tube Face, cycles per millimeter Fig. 3-18 - Modulation transfer functions referred to image dissector 53 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 0.25- by 0.25-inch --, image area 0.45- by 0.45-inch image area 1,000 Spatial Frequency Referred to Input, cycles per millimeter Fig. 3-19 - Theoretical modulation transfer function of complete system Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 1 1 1 1. American Society of Photogrammetry, "Manual of Photogrammetry," George Banta Publishing Company, Menasha, Wisconsin, 1952, pp. 319-324, 336-345. 2. Perkin-Elmer Corporation, The Practical Application of Modulation Transfer Functions, Phot. Sci. Eng., 9(4):235-264 (July-Aug 1965). Scott, F., Scott, M., and hack, R. V., The Use of Edge Gradients in Determining Modulation- Transfer Functions, Phot. Sci. Eng., 7(6):345-349 (Nov-Dec 1963). 9. Swing, R. E. and Shin, M. C. H., The Determination of Modulation-Transfer Characteristics of Photographic Emulsions in a Coherent Optical System, Phot. Sci. Eng., 7(6):350-360 (Nov-Dec 1963). 10. Wentworth, J. W., Color Television Engineering, RCA Victor Division, Radio Corporation of America, Apr 1962, pp. 7-8-7-13. Kohler, R. J., and Howell, H. K., Photographic Image Enhancement by Superimposition of Multiple Images, Phot. Sci. Eng., 7(4):241-245 (July-Aug 1963). 13. Higgins, G. C., Lamberts, R. L., and Wolfe, R. N., Measurement and Analysis of the Dis- tribution of Energy in Optical Images, J. Opt. Soc. Am., 48(7):487-490 (July 1958). 14. Lambert, R. L., Relationship Between the Sine-Wave Response and the Distribution of Energy in the Optical Image of a Line, J. Opt. Soc. Am., 48(7):490-495 (July 1958). 15. Lamberts, R. L., Application of Sine-Wave Techniques to Image-Forming Systems, J. SMPTE, 71(9):635-640 (Sept 1962). 55 Approved For Release 2004/07/29 : CIA-RDP78B04770A000200010048-8 STAT STAT Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Appendix It is supposed that a number, N, of photographs containing the same signal, y, are to be superimposed so that the output, S, is N S = ai(aiy + ni) i=1 where ai represents the signal amplitude and ni represents the noise signal on the ith input. The problem is to determine the coefficients, ai, to maximize the fidelity of the representation, S. In optical signals, the dc noise level represents an overall gray scale and can result in a re- duction of contrast. The detail, however, is not affected by the dc levels; it is degraded only by variations in the noise signal. The method employed here is to determine the ai's so that the re- sultant noise variance is minimized for a given output signal strength. 1 1 1 N 2 2 Oi9i ~'2 a i=1 51 N S aly + ni ai where Qi = aiai The output signal strength is then fixed by constraining the /3i's so that N ai=k i=1 Let 92 be the variance of the ith noise signal. By noting that the variance of the noise signal, aini/ai, is (3jc4/ai, and using the fact that the variances of the different inputs add (because of the independence of the noise samples), we can write the variance of the output as Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Using the Lagrange multiplier, A, to take care of the constraint, we obtain N 22 2 = E aiai or a -~ ai-k i=1 i=1 Minimizing with respect to a particular coefficient, say /3j, we have 2 2 2a;oj bQ = a -X 600 y= i Since 6(3j is arbitrary, the function in the parentheses must vanish, and the result is ~ aX Rl 202 J The value of A can now be found from the constraint equation N N 2 [~1 ai 2 L ai k Q i i=1 i=1 2k M It should be noted that M can be determined from the inputs alone. The solution then is 2 k ai Pi =Mx 2 of k ai ai=Mx 2 of From this last expression it is seen that the variance of the output is minimized for a given output signal amplitude when the coefficients ai are proportional to the input signal strengths, ai, and in- versely proportional to the noise variances, Qi. The constant k/M determines the intensity of the output and need not be computed in practice. 1 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 In the particular case of equal input signal amplitudes, ai = a, and equal noise variances, 9i 9 , the result becomes ai = k x ; = constant Q The coefficients ai and ai then become superfluous and a single input can be represented by y+ni By simply averaging the N inputs, we obtain the output N S=y+N Ni f=1 Since the noise samples are independent, the variance of the sum is the sum of the variances. The output variance, therefore, is N 2 1 2 0,2 Qo= L Q =N i=1 and the standard deviation from average of the output noise signal is Qo = NNi2 1 1 Hence, in the case of equal input signal strengths and equal noise variances, the noise attenuation factor is the square root of the number of inputs. Having found the ai's, we can find the output signal to noise ratio in terms of the input signal amplitudes, ai, and the input noise variances, vi. The output is f2 Sk al Y 2 of a1 M of The signal power is the integral of the square of the signal part of the output S N z kz of Ps = f( -2 Y(, 71) d~ dry i N 2 2 k2 ai i=1 T 59 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 where T is a constant given by T = f5Y2(x, y) dx dy The noise power is the integral of the square of the noise part of the output N 2 k2 ~1ai Pn= %Q, 77) oi i=1 When the dc components of noise are neglected, the above expression that all cross product terms in samples and hence integrate to Pn = can be simplified by noting the square sum represent cross correlations of independent noise zero. Therefore, ai N! (x, y) dx dy (455 he power ratio of signal to noise then is T Ps 2 =T z Pn of E In the case of equal input signal amplitudes and equal noise variances, the above expression becomes PS = NT 2 2 n The amplitude signal to noise ratio is the square root of Ps/Pn N 1/2 2 A R _ As _ T1"2 \L\ ai N An 01 i=1 where the subscript N indicates that it is the ratio based on N inputs. If an additional input having signal amplitude aN + 1 and noise variance vN + 1 is added, the new signal to noise amplitude ratio is given by 2 aN+ 1 R N 1 =RN+ T U2 N+ 1 It is apparent that no input can degrade the output. The worst possible case is encountered for an input having zero signal amplitude, in which case it is added in with zero weight and N 2 t 1 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8 RN+1=RN 1 1 1 1 In the case of equal input signal amplitudes and equal noise variances (NT) 1/2 RN = Cr Approved For Release 2004/07/29 : CIA-RDP78BO477OA000200010048-8