Abstract:
The present invention provides extended depth of field or focus to conventional Amplitude Contrast imaging systems. This is accomplished by including a Wavefront Coding mask in the system to apply phase variations to the wavefront transmitted by the Phase Object being imaged. The phase variations induced by the Wavefront Coding mask code the wavefront and cause the optical transfer function to remain essentially constant within some range away from the in-focus position. This provides a coded image at the detector. Post processing decodes this coded image, resulting in an in-focus image over an increased depth of field.

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
   U.S. Pat. No. 5,748,371, issued May 5, 1998 and entitled “Extended Depth of Field Optical Systems,” is incorporated herein by reference. 

   BACKGROUND OF THE INVENTION 
   1. Field of the Invention 
   This invention relates to apparatus and methods for improving contrast imaging of objects which are transparent or reflective, and also vary in thickness or index of refraction, using wavefront coding. 
   2. Description of the Prior Art 
   Most imaging systems generate image contrast through variations in reflectance or absorption of the object being viewed. Objects that are transparent or reflective but have variations in thickness can be very difficult to image because the majority of the image contrast typically is derived from variations in the reflectance or absorption of the object. These types of objects can be considered “Phase Objects”. Various techniques have been developed over the years to produce high-contrast images from phase objects. These techniques allow high contrast images from essentially transparent objects that have only variations in thickness or index of refraction. These techniques generally modify both the illumination optics and the imaging optics and are different modes of what can be called “Contrast Imaging”. 
   There are a number of different Contrast Imaging techniques that have been developed over the years to image phase objects. These techniques can be grouped into three classes that are dependent on the type of modification made near the back focal plane of the imaging objective and the type of illumination method used. The simplest contrast imaging techniques modify the back focal plane of the imaging objective with an intensity or amplitude mask. Other techniques modify the back focal plane of the objective with phase masks. Still more techniques require the use of polarized illumination and polarization-sensitive beam splitters and shearing devices. In all of these contrast-imaging techniques modifications to the illumination system are matched to the modifications of the imaging optics. 
   Contrast Imaging techniques that require amplitude modification of the back focal plane of the imaging objectives we call “Amplitude Contrast” techniques. These techniques include Hoffman modulation contrast imaging (described in U.S. Pat. No. 4,062,619), edge enhancement of phase phenomena (described in U.S. Pat. No. 4,255,014), and the VAREL imaging techniques by Carl Zeiss. 
     FIG. 1  (Prior Art) is a block diagram  100 , which shows generally how Amplitude Contrast Imaging techniques are implemented. This block diagram shows imaging an object  108  through transmission, but those skilled in the art will appreciate that the elements could just as simply have been arranged to show imaging through reflection. 
   Illumination source  102  and illumination optics  104  act to produce focussed light upon Phase Object  108 . A Phase Object is defined here as an object that is transparent or reflective but has variations in thickness or index of refraction, and thus can be difficult to image because the majority of the image contrast typically is derived from variations in the reflectance or absorption of the object. Obviously almost any real life object is strictly speaking a Phase Object, but only objects having enough thickness or index of refraction variation to be difficult to image will require special imaging techniques. 
   Objective lens  110  and tube lens  114  act to produce an image  118  upon detector  120 . Detector  120  can be film, a CCD detector array, a CMOS detector, etc. The various amplitude contrast techniques differ in the form of illumination mask  106  and objective mask  112 . Traditional imaging, such as bright field imaging, would result if neither an illumination mask nor an objective mask were used. 
     FIG. 2  (Prior Art) shows a first embodiment of an illumination, mask  106   a  and an objective mask  112   a,  constructed and arranged for Hoffman modulation Contrast Imaging. Illumination mask  106   a  consists of two slits  202 ,  204  that are narrow in comparison to the diameter of the condenser aperture. Slit  204  has nearly 100% transmittance. Slit  202  contains a polarizer, and when an adjustable polarizer (not shown) is placed in the illumination path, the effect is to make this slit have a variable transmittance. When the adjustable and slit polarizers are adjusted to give extinction, the effective transmittance of this second slit is zero. In the opposite polarization configuration the effective transmittance is 100%. 
   Objective mask  112   a  is essentially the conjugate of illumination mask  106   a . Objective mask  112   a  consists of small regions  206 ,  208  of absorptive power with the remainder  210  of the mask having 100% transmittance. In operation, the light that travels through illumination slits  202 ,  204  that is not significantly diffracted from object  108  (as for example when a phase gradient is not present) is severely attenuated by objective mask blocks  206 ,  208 . The light that is diffracted by object  108  passes mainly through the transparent region  210  of the objective mask. In this way Hoffman modulation contrast imaging converts phase differences in the object into intensity differences in the formed images. 
     FIG. 3  (Prior Art) shows illumination mask  106   b  and objective mask  112   b  set for Carl Zeiss VAREL contrast imaging. Illumination mask  106   b  consists of an annulus  302  with 100% transmission on a fully absorptive field  304 . Objective mask  112   b  consists of a matching partially absorptive annulus  306  on a transparent field  308 . Light that passes through illumination mask  106   b  and is not diffracted by object  108  is severely attenuated by objective mask  112   b.  Light that is diffracted by object  108  passes mainly through the center of objective mask  308  unattenuated. In this way VAREL contrast imaging converts phase differences in the object into intensity differences in the formed images. 
   Although Amplitude Contrast Imaging techniques effectively produce high contrast images of Phase Objects, these techniques do not allow a large depth of field or control of general focus-related aberrations. A large depth of field is important when imaging objects that have a depth that is large in relation to the depth of field of the system or when making a very low cost imaging system. 
   There is a need to improve Contrast Imaging of Phase Objects by increasing depth of field and controlling focus-related aberrations. 
   SUMMARY OF THE INVENTION 
   An object of the present invention is to improve Contrast Imaging of phase objects by increasing depth of field and controlling focus-related aberrations. This is accomplished by combining Contrast Imaging apparatus and methods with Wavefront Coding and post processing to increase depth of field and reduce misfocus effects. 
   Wavefront Coding can be used in conjunction with amplitude contrast imaging techniques to produce systems that have both a large depth of field and high contrast imaging of phase objects. The general amplitude contrast imaging system is modified with a special purpose generalized aspheric optical element and image processing of the detected image to form the final image. Unlike the traditional imaging system, the final image using Wavefront Coding is not directly available at the image plane. Post processing of the detected image is required. The Wavefront Coding optical element can be fabricated as a separate component, can be combined with the objective mask, or can be constructed as an integral component of the imaging objective or tube lens. 
   A Wavefront Coding optical element can also be used on the illumination side of the system in order to extended the depth of field of the projected illumination due to the duality of projection and imaging. This projected illumination would be broader than without Wavefront Coding, but the optical density as a function of distance from the object would be less sensitive with Wavefront Coding than without. Without Wavefront Coding on the illumination side of the system at some point and object can technically be imaged clearly but is not illuminated sufficiently. See “Principal of Equivalence between Scanning and Conventional Optical Imaging Systems”, Dorian Kermisch, J. Opt. Soc. Am., Vol. 67, no. 10, pp.,1357-1360(1977). 
   The component of importance for the Wavefront Coding imaging optics and digital processing in amplitude contrast systems is the objective mask, as opposed to the illumination mask. Without the objective mask the imaging side of the system (as opposed to the illumination side) is a traditional imaging system. The illumination mask can be considered as only required to alter the transmitted (or reflected) light of the given object being imaged. Since many combinations of illumination configuration and object can produce the same transmitted (or reflected) wavefront, we can consider the use of specialized illumination as a means of altering the object&#39;s imaging characteristics when the object itself cannot be altered. The illuminated object that is being imaged is imaged through optics that have been modified to enhance the type of wavefront that the specialized illumination system is providing. Only changes in the objective mask necessitate changes in the optics or processing with Wavefront Coding. 
   Apparatus for increasing depth of field in a conventional Amplitude Contrast Imaging system having an illumination source, illumination optics, and an illumination mask placed before a Phase Object to be imaged, and an objective mask and objective optics after the Phase Object to form an image at a detector, comprises an optical Wavefront Coding mask placed between the Phase Object and the detector, the mask being constructed and arranged to alter the optical transfer function of the Amplitude Contrast Imaging system in such a way that the altered optical transfer function is substantially insensitive to the distance between the Phase Object and the objective optics over a greater range of object distances than was provided by the unaltered optical transfer function, wherein the mask affects the alteration to the optical transfer function substantially by affecting the phase of light transmitted by the mask, and a post processing element for processing the image captured by the detector by reversing the alteration of the optical transfer function accomplished by the mask. 
   For example, the illumination mask and the objective mask could be constructed and arranged for Hoffman modulation Contrast Imaging, or for Carl Zeiss VAREL Contrast Imaging. 

   
     BRIEF DESCRIPTION OF THE DRAWINGS 
       FIG. 1  (prior art) shows a standard prior art Amplitude Contrast imaging system. 
       FIG. 2  (prior art) shows an illumination mask and a transmission mask for use in the Amplitude Contrast imaging system of Figure, implementing Hoffman modulation contrast. 
       FIG. 3  (prior art) shows an illumination mask and a transmission mask for use in the Amplitude Contrast imaging system of Figure, implementing Carl Zeiss VAREL contrast imaging. 
       FIG. 4  shows an Extended Depth of Field (EDF) Amplitude Contrast imaging system including Wavefront Coding and post processing in accordance with the present invention. 
       FIG. 5  shows the amplitude transmittance function and the corresponding ambiguity function for the prior art system of  FIG. 1  without an objective mask. 
       FIG. 6  shows the amplitude transmittance function and the corresponding ambiguity function for the system of FIG.  4 . 
       FIG. 7  shows the amplitude transmittance function and the corresponding ambiguity function for the prior art system of  FIG. 1 , using Hoffman modulation contrast masks. 
       FIG. 8  shows the ambiguity function for the system of  FIG. 4 , using Hoffman modulation contrast masks. 
       FIG. 9  shows modulation transfer functions (MTFs) associated with the system of  FIGS. 1 and 7 , and with the system of  FIGS. 4 and 8 , both using Hoffman modulation contrast. 
       FIG. 10  is an image of a one cell mouse embryo with a conventional 40X Hoffman modulation contrast system similar to that of  FIG. 1 , and with a wavefront encoding 40X Hoffman modulation contrast system similar to that of FIG.  4 . 
   

   DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
   Wavefront Coding can be combined with traditional objectives and objective masks in Amplitude Contrast systems, as shown in  FIG. 4 , to achieve an increased depth of field in an optical and digital imaging system. This can be explained through inspection of the ambiguity functions and modulation transfer functions (MTFs) of the related traditional, amplitude contrast systems, and Wavefront Coded imaging systems, as shown in  FIGS. 5-9 .  FIG. 10  shows a real world image taken with a system having only Amplitude Contrast, compared to a system combining Amplitude Contrast and Wavefront Coding and post processing. 
     FIG. 4  shows a combined Extended Depth of Field (EDF) and Amplitude Contrast Imaging system  400  including Wavefront Coding and post processing in accordance with the present invention. The general Amplitude Contrast imaging system of  FIG. 1  is modified with a special purpose generalized aspheric optical element  422  and image processing  424  of the detected image to form the final image. Unlike the traditional imaging system, the final image in combined system  400  is not directly available at image plane  418 . Post processing  424  of the detected image is required, to remove the Wavefront Coding effects (other than the extended depth of field). Wavefront Coding optical element  422  can be fabricated as a separate component as shown in  FIG. 4 , can be combined with objective mask  412 , or can be constructed as an integral component of imaging objective  410  or tube lens  414 . 
   Wavefront Coding optical element  422  can also be used on the illumination side of system in order to extend the depth of field of the projected illumination due to the duality of projection and imaging. This projected illumination would be broader than without Wavefront Coding, but the optical density as a function of distance from the object would be less sensitive with Wavefront Coding than without. In other words, the illumination would not focus on a single plane as with conventional illumination, but the density of photons is less sensitive to position than without wavefront coding. 
   The component of importance in combined Wavefront Coding/Amplitude Contrast systems  400  is objective mask  412 , as opposed to illumination mask  406 . Illumination mask  406  can be considered as only required to alter the transmitted (or reflected) light off object  408 . Only changes in objective mask  412  necessitate changes in Wavefront Coding element  422  or Image Processing  424 . For example, consider illumination masks  106   a  of  FIG. 2 and 106   b  of FIG.  3 . Changing the effective slit area of illumination mask  106   a  with an adjustable polarizer, or rotating illumination mask  106   b , would require no changes in either Wavefront Coding element  422  or post processing  424  of a combined Wavefront Coding amplitude contrast system. 
   Similar reference numbers are used in  FIG. 4  as are used in  FIG. 1 , since the systems are very similar, except for the addition of Wavefront Coding element  422  and post processing  424 . 
     FIG. 5  shows the amplitude transmittance function and the corresponding ambiguity function for the prior art system of  FIG. 1 , without Amplitude Contrast modifications. Only the magnitude of the ambiguity functions in this and following figures are shown. Ambiguity functions are, in general, complex functions. One-dimensional systems are given for simplicity. Those skilled in the art of linear systems and ambiguity function analysis can quickly make extensions to two-dimensional systems. An ambiguity function representation of the optical system is a powerful tool that allows MTFs to be inspected for all values of misfocus at the same time. Essentially, the ambiguity function representation of a given optical system is similar to a polar plot of the MTF as a function of misfocus. The in-focus MTF is described by the trace along the horizontal axis of the ambiguity function. An MTF with normalized misfocus value of ψ=2πλW20, where W20 is the traditional misfocus aberration coefficient and λ is the illumination center wavelength, is described in the ambiguity function along the radial line with slope equal to (ψ/π). For more information on ambiguity function properties and their use in Wavefront Coding see “Extended Depth of Field Through Wavefront Coding”, E. R. Dowski and W. T. Cathey, Applied Optics, vol. 34, no 11, pp. 1859-1866, April, 1995, and references contained therein. 
   Returning to  FIG. 5 , the top plot shows the aperture transmittance function of a conventional system such as that shown in  FIG. 1 , without either an illumination mask  106  or an objective mask  112 . In other words,  FIG. 5  applies to a conventional imaging system without Amplitude Contrast modifications. The bottom plot shows the associated ambiguity function. 
   Over the normalized aperture (in normalized coordinates extending from −1 to +1) the ideal system has a transmittance of 1, i.e. 100%. The phase variation (not shown) is equal to zero over this range. The corresponding ambiguity function has concentrations of optical power (shown as dark shades) very close to the horizontal v=0 axis. From the relationship between the ambiguity function and misfocused MTFs we see that the diffraction limited imaging system has a small depth of field because slight changes in misfocus lead to MTFs that are represented by radial lines with non-zero slope in the ambiguity function. These lines intersect regions of small power. In other words, ambiguity functions that are concentrated about the horizontal axis indicate systems having small depths of field. 
     FIG. 6  shows the amplitude transmittance function and the corresponding ambiguity function for the improved system of  FIG. 4 , but without illumination mask  406  or objective mask  412 . Thus, this plot illustrates a system having Wavefront Coding, but not Amplitude Contrast Imaging. Modifying the ideal diffraction limited system associated with  FIG. 5  with Wavefront Coding element  422  results in the plots of FIG.  6 . As an example, the rectangularly separable complex phase function for this system is given in radians as: 
               phase   ⁡     (   x   )       =     exp   ⁡     (     j   *   15   *     (       x   ^   3     +     0.1   *     x   ^   9         )       )         ,     
     ⁢          x        &lt;=   1       ⁢     
     ⁢     j   =     sqrt   -   1         )         
   Increasing the peak-to-valley phase height (as can be done by increasing the constant 15 above) results in increasing depth of field. The transmittance of this system (not shown) is unity (i.e. 100%) over the entire aperture, as in the top plot of FIG.  5 . 
   Other more general rectangularly separable forms of the Wavefront Coding complex phase is given by:
 
phase( x,y )=exp( j*[Σa   i sign( x )| x|   b   i   +c   i  sign( y )| y|   d   i ])
 
where the sum is over the index i. Sign(x)=−1 for x&lt;0, +1 for x≧0.
 
   Rectangularly separable Wavefront Coding forms allow fast processing. Other forms of Wavefront Coding complex phases are non-separable, and the sum of rectangularly separable forms. One non-separable form is defined as:
 
phase( r ,θ)=exp( j*[Σr   a   i  cos( b   i θ+φ i )])
 
where the sum is again over the subscript i.
 
   The ambiguity function shown in  FIG. 6  for this Wavefront Coded system is seen to have optical power spread over a much larger region in the ambiguity domain than does the diffraction-limited system plotted in FIG.  5 . Broader regions of optical power in the ambiguity function translate to larger depth of field or depth of focus since the ambiguity function is essentially a radial plot of misfocused MTFs with the angular dimension pertaining to misfocus. 
     FIG. 7  shows the amplitude transmittance function and the corresponding ambiguity function for the prior art system of  FIG. 1 , using Hoffman modulation contrast masks as shown in FIG.  2 . Thus, these plots illustrate a system having Amplitude Contrast Imaging, but not Wavefront Coding. Again, a one-dimensional example is shown. The transmittance for this system, seen in the upper plot, is 1 for 80% of the aperture, 0.5 transmittance for 10% near the end of the aperture, and 0.1 transmittance for the final 10% of the aperture. The phase variation of the system (not shown) is again considered to be equal to zero over the entire aperture. 
   The corresponding ambiguity function for this amplitude contrast system in the lower plot is seen to differ from the diffraction-limited system plotted in FIG.  5 . The extent of the optical power in the present example along the v=0 axis is reduced compared to that of the diffraction limited system plotted in  FIG. 5 , and the optical power near the v=0 axis is slightly broader. Both differences are due to the severe reduction of transmittance or optical power near the edge of the aperture of the amplitude contrast systems. This reduction of the optical power at the aperture reduces the extent of the corresponding MTFs (thereby also reducing spatial resolution) and slightly increases the depth of field. These effects are well known by those in the field. Similar reductions of resolution and increases in depth of field are accomplished by the more common method of stopping down the aperture with an iris in a traditional imaging system. 
     FIG. 8  shows the ambiguity function for the improved system of  FIG. 4 , using Hoffman modulation contrast masks, as shown in FIG.  2 . Thus, the combination of Amplitude Contrast Imaging and Wavefront Coding systems is illustrated in FIG.  8 . The phase is as shown in  FIG. 6 , while the transmittance is as shown in FIG.  7 . 
   A misfocus bias equal to ψ=−10 was removed from the combined system (incorporating Wavefront Coding and Amplitude Contrast Imaging). The combined system ambiguity function is seen to have more optical power spread about the horizontal axis when compared to either the Amplitude Contrast system plotted in  FIG. 7  or the diffraction limited system plotted in FIG.  5 . 
   MTFs for combined Wavefront Coding and Amplitude Contrast Imaging systems will change much less as a function of misfocus than will the MTF&#39;s of Amplitude Contrast systems alone. Thus, the combined systems have extended depth of field. 
     FIG. 9  shows modulation transfer functions (MTF) associated with an Amplitude Contrast Imaging system (specifically the prior art system of  FIG. 1 , using Hoffman modulation contrast as in FIG.  2 ), and with a combined Wavefront Coding and Amplitude Contrast Imaging system (the system of  FIG. 4 , using Hoffman modulation contrast as in FIG.  2 . 
   The top plot shows the MTFs of the Amplitude Contrast Imaging system. The bottom plot shows the MTFs of the combined Wavefront Coding and Amplitude Contrast Imaging system. These plots are the particular MTFs given in the respective ambiguity functions for the normalized misfocus values ψ={0, 2.5, 5}. Notice that the MTFs for the Amplitude Contrast system (top plot) vary appreciably with even this slight amount of misfocus. The image will thus change drastically due to misfocus effects in the Amplitude Contrast system for only small, normalized misfocus values. This is expected from the ambiguity function associated with this system (shown in FIG.  7 ). 
   By comparison, the MTFs from the combined Wavefront Coded and Amplitude Contrast Imaging system (bottom plot) show very little change with misfocus as predicted by the ambiguity function associated with this system (shown in FIG.  8 ). If the MTFs of the system do not change, the resulting MTFs (and hence also point spread functions) can be corrected over a large range of misfocus with a single image post processing step  424 . This is not possible with systems that do not have a large depth of field since the MTFs and PSFs representing the images change with misfocus to values that are unknown and often impossible in practice to calculate. 
   Notice that the MTFs from the combined Wavefront Coding Amplitude Contrast system of  FIG. 8  (lower plot) essentially do not change with misfocus but also do not have the same shape as that of the in-focus MTF (ψ=0) of the Amplitude Contrast system alone in the top plot of FIG.  8 . In the spatial domain this is the same as forming images with a specialized blur where the blur is insensitive to the amount of misfocus. The Image Processing function  424  of  FIG. 4  is used to remove this blur. The Image Processing function is designed so that the MTFs and PSFs of the combined Wavefront Coding Amplitude Contrast system over a range of misfocus after processing closely match that of the in-focus Amplitude Contrast system(this can be done because all of the MTFs are essentially the same). If desired, the Image Processing function can also produce an effective MTF after processing that has more or less contrast than the in-focus Amplitude Contrast system depending on the needs of the particular application. 
   There are many linear and non-linear prior art techniques for removing specialized blur in images. Computationally effective techniques include rectangularly separable or multi-rank linear filtering. Rectangularly separable linear filtering involves a two step process where the set of one-dimensional columns are filtered with a one dimensional column filter and an intermediate image is formed. Filtering the set of one-dimensional rows of this intermediate image with a one-dimensional row filter produces the final image. Multi-rank filtering is essentially the parallel combination of more than one rectangularly separable filtering operation. A rank N, digital filter kernel can be implemented with rectangularly separable filtering by using N rectangularly separable filters in parallel. 
   The form of the processing (rectangularly separable, multi-rank, 2D kernel, etc.) is matched to that of the Wavefront Coding element. Rectangularly separable filtering requires a rectangularly separable Wavefront Coding element. The element described in  FIG. 6  is rectangularly separable. 
     FIG. 10  is an image of a one cell mouse embryo with a conventional 40X Hoffman modulation contrast system similar to that of  FIG. 1 , and with a Wavefront Coding 40X Hoffman modulation contrast system similar to that of FIG.  4 . 
     FIG. 10  shows comparison images of imaging a one-cell mouse embryo with a conventional 40X Hoffman Modulation Contrast system (refer to FIGS.  1  and  2 ), and a combined Wavefront Coding/40X Hoffman Modulation Contrast system (refer to FIGS.  4  and  2 ). The top set of images was produced by the conventional 40X Hoffman Modulation Contrast system. The bottom set of images was produced by the combined Wavefront Coding/40X Hoffman Modulation Contrast system. 
   Comparing the images from left to right, object distance was varied by six microns further from the objective for each image compared to the image on its left. The bottom row combined Wavefront Coding/40X Hoffman Modulation Contrast images are the final images produced after image processing of the detected image. Rectangularly separable digital filtering was used in the post processing step. 
   Notice the differential shading visible on the top row (40X Hoffman Modulation Contrast) images. This is a characteristic of Hoffman imaging. Notice also that many parts of the Hoffman images are blurred due to misfocus effects. The characteristic Hoffman shading and extended depth of field are both seen in the Wavefront Coding images.