Computerized adaptive imaging
Apparatus for computational adaptive imaging comprises the following: an image information acquirer, which provides information relating to the refractive characteristics in a three-dimensional imaged volume; a ray tracer, which uses the information relating to the refractive characteristics to trace a multiplicity of rays from a multiplicity of locations in the three-dimensional imaged volume through the three-dimensional imaged volume, thereby providing a location dependent point spread function, and a deconvolver, which uses the location dependent point spread function, to provide an output image corrected for distortions due to variations in the refractive characteristics in the three-dimensional imaged volume.
Latest Yeda Research and Development Co., Ltd. Patents:
The present invention relates to imaging generally and more particularly to post acquisition image processing generally.
BACKGROUND OF THE INVENTIONPost acquisition image processing is well known in the literature. Publications which describe the general state of the art in post acquisition image processing are: Lim, J. S. “Two dimensional signal and image processing”. Englewood Cliffs, N.J. Prentice Hall. (1990); Russ, J. C. “Image processing handbook”. CRC Press. (1992); Pratt, W. K. “Digital image processing”. NY John Wiley & Sons, Inc. (1991); Rosenfeld, A. and Kak, A. C. “Digital picture processing”. Academic Press. (1976); Castleman, K. R. “Digital Image Processing”. Prentice-Hall Inc. Englewood Cliffs, N.J. (1979).
Imaging which provides information relating to refractive characteristics in a imaged volume is known for extremely limited applications. In microscopy, Smith, Nomarski and Differential Interference Contrast (DIC) imaging is known and is described in the following publications: Nomarski, G. “Microinterferometer differential a ondes polarisees”. J. Phys. Radium 16:9S–11S (1955); Lang, W. “Differential-Interferenz-Miikroskopie”. Carl-Zeiss, Oberkochen (1975); Inoui, S. and Spring, K. S. “Video Microscopy: the fundamentals”. 2nd edition. Plenum Press, NY. (1997). Tanford, C. “Physical chemistry of macromolecules”. John Wiley NY. (1961). Appendix C describes classical Rayleigh interference methods, Philpot and Svenson methods based on schlieren image, Lamm method of line displacement, and Gouy interference method all developed for determination of one dimensional refractive index variations.
Computer analysis of DIC imaging is not readily achieved. Known instances are described in the following publications: Allen, R. D., Allen, N. S. and Travis, J. L. “Video-enhanced contrast, differential interference contrast (AVEC-DIC) microscopy: a new method capable of analyzing microtubule related motility in the reticulopodial network of Allogromia laticollaria.” Cell Motility 1: 291–302 (1981); Cogswell, C. J. and Sheppard, C. J. R. “Confocal differential interference contrast (DIC) microscopy: including a theoretical analysis of conventional and confocal DIC imaging”. J. Microsc. 165:81–101 (1992); Gelles, J., Schnapp, B. J. and Sheetz, M. P. “Tracking kinesin-driven movements with nanometer-scale precision”, Nature 331:450–453 (1988); Hdusler, G. and Kvrner, E. “Imaging with expanded depth of focus”. Zeiss Inform. 29: 9–13 (1987); Preza, C., Snyder, D. L. and Conchello, J-A. “Image reconstruction for three-dimensional transmitted light DIC microscopy”. SPIE 2984:220–231 (1997); Schormann, T. and Jovin, T. M. “Contrast enhancement and depth perception in three-dimensional representations of differential interference contrast and confocal scanning laser microscope images”. J. Microsc. 166:155–168 (1992).
Computerized ray tracing between discrete refractive and reflective surfaces is extremely well developed, but is not well known in the environment of non-homogeneous indices of refraction. This area is described in the following publications: Hecht E. and Zajac A. “Optics” 2nd ed. Addison-Wesley Reading Mass. (1997); Jenkins, F. A, and White, H. E. “Fundamentals of optics”. McGraw-Hill, NY (1950) ch. 8: Ray Tracing.
Calculation of point spread functions (PSF) is extremely well known as described in the following publication: Born M. and Wolf E. “Principles of Optics” Pergamon London (1959); Goodman J. W. “Statistical Optics” John Wiley & Sons NY (1985); Hecht E. and Zajac A. “Optics” 2nd ed. Addison-Wesley Reading Mass. (1997); Gibson S. F. and Lanni F. “Diffraction by circular aperture as a model for three-dimensional optical microscopy”. Opt. Soc. Am. A 6:1357–1367 (1989); Gibson S. F. and Lanni F. “Modeling aberrations due to mismatched layers for 3-D microscopy” SPIE optics in complex systems 1319:470–471 (1990); Gibson S. F. and Lanni F. “Experimental test of an analytical model of aberration in an oil-immersion objective lens used in three-dimensional light microscopy”. J. Opt. Soc. Am. A 8:1601–1613 (1991).
Deconvolution of three dimensional microscopic images having location independent PSF is well known and is described in the following publications, some of them authored by some of the present inventors: Jansson, P. A. ed. “Deconvolution of images and spectra”. Academic Press NY (1997); Agard, D. A. and Sedat, J. W. “Three-dimensional architecture of a polytene nucleus”. Nature 302:676–681 (1984); Agard, D. A., Hiraoka, Y., Shaw, P. and Sedat, J. W. “Fluorescence microscopy in three dimensions”. Methods in Cell Biology 30: 353–377 (1989); Castleman, KR. “Digital Image Processing”. Prentice-Hall Inc. Englewood Cliffs, N.J. (1979). Correction of telescopic images by the use of suitably distorted mirrors and deconvolution of two dimensional telescope images having location dependent PSF are described in the following publications: Boden, A. F., Reeding, D. C, Hanisch, R. J., Mo, J. and White, R. “Comparative results with massively parallel spatially-variant maximum likelihood image restoration”. Bul Am Astr. Soc 27:924–929 (1995); Boden, A. F., Reeding, D. C, Hanisch, R. J. and Mo, J. “Massively parallel spatially-variant maximum likelihood restoration of Hubble space telescope imagery”. J Opt Soc Am A 13: 1537–1545 (1996); Jansson, P. A. ed. “Deconvolution of images and spectra”. Academic Press NY (1997), Tyson R. K. “Principles of Adaptive Optics” Academic Press NY (1991). Reconstruction of blurred images from point objects is described in the following publications: Carrington, W. A., Lynch, R. M., Moore, D. W., Isenberg, G., Fogarty, K. E. and Fay, F. S. “Superresolution three-dimensional images of fluorescence in cells with minimal light exposure”. Science 268:1483–1487 (1995), Femino, A. M., Fay, F. S., Fogarty, K., and Singer, R. H. “Visualization of single RNA transcripts in situ”. Science 280:585–590 (1998).
SUMMARY OF THE INVENTIONThe present invention seeks to provide improved apparatus and techniques for post acquisition image processing.
There is thus provided in accordance with a preferred embodiment of the present invention apparatus for computational adaptive imaging including an image information acquirer providing information relating to the refractive characteristics in a three-dimensional imaged volume, a ray tracer, utilizing the information relating to the refractive characteristics to trace a multiplicity of rays from a multiplicity of locations in the three-dimensional imaged volume through the three-dimensional imaged volume, thereby providing a location dependent point spread function and a deconvolver, utilizing the location dependent point spread function, to provide an output image corrected for distortions due to variations in the refractive characteristics in the three-dimensional imaged volume.
Preferably, the image information acquirer acquires at least two three-dimensional images of a three-dimensional imaged volume, at least one of the two three-dimensional images containing the information relating to the refractive characteristics in a three-dimensional imaged volume.
When the refractive characteristics are extractable from the image to be corrected for distortions, or are known independently, only one three-dimensional image need be acquired.
The acquirer may obtain refractive index information from DIC, for example from phase microscopy or from fluorescence—for example in DNA associated stains wherein the stain intensity is proportional to the refractive index increment.
Refractive index mapping may be applied to samples whose refractive index is known. For example this may apply to microchip wafer structures, whose geometry is known.
In accordance with a preferred embodiment of the present invention, the image acquirer acquires at least three three-dimensional images of the three-dimensional imaged volume.
Preferably, the image acquirer acquires a plurality of three-dimensional images of the three-dimensional imaged volume, each the image having a discrete wavelength band.
Alternatively, the image acquirer acquires a multiplicity of three-dimensional images of the three-dimensional imaged volume, each the image having a wavelength band which is part of a continuum represented by the wavelength bands of the multiplicity of three-dimensional images.
In accordance with a preferred embodiment of the present invention, the ray tracer and the deconvolver utilize the information relating to the refractive characteristics in a three-dimensional imaged volume obtained from one of the three-dimensional images to correct at least another one of the three-dimensional image or itself.
The acquirer may obtain refractive index information from DIC, or from phase microscopy or from fluorescence—for example in DNA associated stains wherein the stain intensity is proportional to the refractive index increment.
Refractive index mapping may be applied to samples whose refractive index is known. For example this may apply to microchip wafer structures, whose geometry is known.
According to one embodiment of the present invention, the three-dimensional images are electromagnetic energy images. Preferably, the three-dimensional images are infrared images.
Alternatively, the three-dimensional images are non-electromagnetic images.
In accordance with a preferred embodiment of the present invention, the image acquirer receives digital image data from a digital image source and derives therefrom the information relating to the refractive characteristics in a three-dimensional imaged volume.
Preferably, the ray tracer and the deconvolver operate repeatedly over time to provide a multiplicity of output images, each corrected for distortions due to variations in the refractive characteristics in the three-dimensional imaged volume. Such a deconvolution process can be iteratively applied to the whole process to improve the estimation of the refractive index.
In accordance with one embodiment of the present invention, the output image is an acoustic image and the refractive characteristics are characteristics of a material which the passage of acoustic energy therethrough.
In accordance with an alternative embodiment of the present invention, the output image is an electromagnetic image and the refractive characteristics are characteristics of a material which the passage of electromagnetic energy therethrough.
There is also provided in accordance with a preferred embodiment of the present invention a method for computational adaptive imaging including the steps of:
providing information relating to the refractive characteristics in a three-dimensional imaged volume;
ray tracing, utilizing the information relating to the refractive characteristics, a multiplicity of rays from a multiplicity of locations in the three-dimensional imaged volume through the three-dimensional imaged volume, thereby providing a location dependent point spread function; and
deconvoluting, utilizing the location dependent point spread function, thereby providing an output image corrected for distortions due to variations in the refractive characteristics in the three-dimensional imaged volume. Such a deconvolution process can be iteratively applied to the whole process to improve the estimation of the refractive index.
Preferably, the step of providing information includes acquiring at least two three-dimensional images of a three-dimensional imaged volume, at least one of the two three-dimensional images containing the information relating to the refractive characteristics in a three-dimensional imaged volume.
When the refractive characteristics are extractable from the image to be corrected for distortions, or are known independently, only one three-dimensional image need be acquired.
In accordance with a preferred embodiment of the present invention, the step of providing information includes acquiring at least three three-dimensional images of a three-dimensional imaged volume.
Preferably, the step of providing information includes acquiring a plurality of three-dimensional images of the three-dimensional imaged volume, each image having a discrete wavelength band.
In accordance with a preferred embodiment of the present invention, the step of providing information includes acquiring a multiplicity of three-dimensional images of the three-dimensional imaged volume, each the image having a wavelength band which is part of a continuum represented by the wavelength bands of the multiplicity of three-dimensional images.
In accordance with one embodiment of the present invention, the three-dimensional images are electromagnetic energy images. Preferably, the three-dimensional images are infrared images.
In accordance with an alternative embodiment of the present invention, the three-dimensional images are non-electromagnetic images.
The refractive index may be in any medium and the imaging method may be for a generalised method for inhomogeneous media that may distort the image.
Preferably, the step of providing includes receiving digital image data from a digital image source and deriving therefrom the information relating to the refractive characteristics along a multiplicity of light paths in a three-dimensional imaged volume.
In accordance with a preferred embodiment of the present invention, the steps of providing information, ray tracing and deconvoluting operate repeatedly over time to provide a multiplicity of output images, each corrected for distortions due to variations in the refractive characteristics in the three-dimensional imaged volume. Such a deconvolution process may be iteratively applied to the whole process to improve the estimation for the refractive index map.
There is also provided in accordance with a preferred embodiment of the present invention apparatus for utilizing differential interference contrast images to provide three-dimensional refractive index information including a line integrator operating on differential interference contrast images displaying a directional derivative of refractive index of an object to invert the directional derivative thereof, thereby providing a plurality of two-dimensional representations of the refractive index of the object. Alternatively the three-dimensional refractive index map can be obtained from phase microscopy, or from fluorescence where the staining is proportional to the refractive index increment.
There is additionally provided in accordance with a preferred embodiment of the present invention apparatus for utilizing differential interference contrast images to provide three-dimensional refractive index information and also including a deconvolver performing deconvolution of the plurality of two-dimensional representations of the refractive index of the object, thereby reducing out-of-focus contributions to the two-dimensional representations of the refractive index of the object.
There is further provided in accordance with a preferred embodiment of the present invention a method for utilizing differential interference contrast images to provide three-dimensional refractive index information including performing line integration on differential interference contrast images displaying a directional derivative of refractive index of an object to invert the directional derivative thereof, thereby providing a plurality of two-dimensional representations of the refractive index of the object. Alternatively the three-dimensional refractive index map can be obtained from phase microscopy, or from fluorescence where the staining is proportional to the refractive index increment.
Additionally in accordance with a preferred embodiment of the present invention there is provided a method for utilizing differential interference contrast images to provide three-dimensional refractive index information and also including performing deconvolution of the plurality of two-dimensional representations of the refractive index of the object, thereby reducing out-of-focus contributions to the two-dimensional representations of the refractive index of the object. Again, the three-dimensional refractive index map can be obtained from phase microscopy, or from fluorescence where the staining is proportional to the refractive index increment.
Further in accordance with a preferred embodiment of the present invention there is provided apparatus for ray tracing through a medium having multiple variations in refractive index including:
a computer employing an analytically determined path of a ray through the multiplicity of locations in the medium, for a plurality of rays impinging thereon in different directions, by utilizing known local variation of the refractive index at a multiplicity of locations in the medium.
There is additionally provided in accordance with a preferred embodiment of the present invention a method of ray tracing through a medium having multiple variations in refractive index including:
determining local variation of the refractive index at a multiplicity of locations in the medium;
analytically determining the path of a ray through the multiplicity of locations in the medium, for a plurality of rays impinging thereon in different directions. The ray tracing may also include the computation of absorptions, reflections and scattering of rays and their contributions to the imaging process.
Still further in accordance with a preferred embodiment of the present invention there is provided apparatus for confocal microscopy including:
a ray tracer, employing known variations of the refractive index in a three-dimensional sample for determining the paths of a multiplicity of rays emerging from at least one point in the sample and passing through the sample, thereby determining an aberrated wavefront for each the point; and
an adaptive optics controller utilizing the aberrated wavefront to control an adaptive optical element in a confocal microscope, thereby to correct aberrations resulting from the variations in the refractive index.
There is additionally provided in accordance with a preferred embodiment of the present invention a method for confocal microscopy including:
determining variations of the refractive index in a three-dimensional sample;
determining the paths of a multiplicity of rays emerging from at least one point in the sample and passing through the sample, thereby determining an aberrated wavefront for each the point; and
utilizing the aberrated wavefront to control an adaptive optical element in a confocal microscope, thereby to correct aberration resulting from the variations in the refractive index.
There is additionally provided in accordance with a preferred embodiment of the present invention a method for adding (computationally or physically) in the imaging path a three-dimensional medium (anti-sample) with refractive properties that correct for the distortions of the three-dimensional sample.
The present invention will be understood and appreciated more fully from the following detailed description, taken in conjunction with the drawings in which:
Reference is now made to
It is known in the prior art to image a point source or a collection of point sources in an ideal sample displaying no substantial variation in refractive index. When an ideal optical system is focussed at slightly different depths in the sample, a three dimensional image appears, including a plurality of two-dimensional diffraction limited images designated by Roman numerals I, II, III, IV and V in
The prior art, however, does not know how to deal adequately with samples which display substantial variation in refractive index.
The present invention provides a solution to this problem, as illustrated in
The present invention, as will be described hereinbelow, is capable of deconvoluting the plurality of two-dimensional images I–V in
Reference is now made to
Trans-illumination is provided to a sample 22, typically mounted between two slides 24 and 26, by means of a halogen light source 28 via a computer-controlled shutter 30. Depending on which of shutters 18 and 30 is open, the sample receives trans-illumination or epi-illumination so as to provide either a DIC image or a fluorescent image respectively. It is noted that DIC images conventionally require additional optical elements in the imaging light path, which are omitted from
In accordance with a preferred embodiment of the present invention, the DIC or fluorescent image is received via computer-controlled filter wheel 14 by a digital CCD sensor 32, such as a Photometrics PXL. Preferably a polarizer is included in one of the windows of filter wheel 14 and is employed for DIC imaging.
In accordance with a preferred embodiment of the present invention, the output of the digital CCD sensor 32 is supplied to a computer 34, such as a Silicon Graphics 02 workstation which performs the following functionality:
ray tracing, utilizing information relating to the refractive characteristics in the sample, a multiplicity of rays from a multiplicity of locations in the sample through the sample, thereby providing a location dependent point spread function; and
deconvoluting, utilizing the location dependent point spread function, thereby providing an output image corrected for distortions due to variations in the refractive characteristics in the three-dimensional imaged volume.
Preferably wavefront integration is performed following the ray tracing and prior to the deconvoluting.
In accordance with a preferred embodiment of the present invention, the information relating to the refractive characteristics of the sample is provided by line integration of the DIC image.
Reference is made to
In accordance with a preferred embodiment of the present invention, line integration 44 is performed on the DIC. The line integration preferably provides a 3D refractive index map 46.
In accordance with a preferred embodiment of the present invention, ray tracing 48 is performed on the 3D refractive index map 46 and the resulting wavefront is subject to wavefront integration 50, thus providing a location dependent point spread function (PSF) 52.
In accordance with a preferred embodiment of the present invention, the location dependent PSF is utilized in a deconvolution step 54 which is applied to the observed fluorescent 3D image 40.
In accordance a preferred embodiment of the invention, the deconvolution produces a corrected image, such as the image illustrated at reference VI in
Reference is now made to
The output image of sample 60 of the CCD sensor 32 operating in a DIC mode is illustrated at reference numeral 70 and also by trace 72. Line integration of the output image produces an image 74 which accurately represents the original sample, seen at reference numerals 60 and 62.
It is appreciated that line integration of DIC images has two complex contributions in reality. One is the accumulation of noise in the integration and the second is the slow contribution of low-intensity out-of-focus contributions. The problem of noise is preferably alleviated by introducing a decay function in the line integration. The out-of-focus contribution can be reduced significantly by deconvoluting the integrated DIC images.
Reference is now made to
Reference is now made to
Reference is now made to
This iterative process typically proceeds by initially defining a guessed object 82, which typically is identical to the observed image. The guessed object is convoluted with a location dependent point spread function 84, such as that derived by ray tracing and wavefront integration (
Additional technical descriptions of a preferred embodiment of the invention appear in the following article by the inventor Z. Kam: “Microscopic Differential Interference Contrast Image Processing by Line Integration (LID) and Deconvolution”. Bioimaging 6 (4): 166–176 (1998).
It will be appreciated by persons skilled in the art that the present invention is not limited to what has been particularly shown and described hereinabove. Rather the scope of the present invention includes both combinations and subcombinations of the various features described hereinabove as well as modifications and additions thereto which would occur to a person of skill in the art upon reading the foregoing description and which are not in the prior art.
Claims
1. Apparatus for ray tracing through a medium having multiple variations in refractive index including:
- an image information acquirer providing information relating to local refractive index variations at any multiplicity of three dimensional locations in said medium, said local refractive index variations being determined by either one of differential interference contrast (DIC) imaging and phase microscopy; and
- a computer employing an analytically determined path of a ray through the multiplicity of three dimensional locations in the medium, for a plurality of rays impinging thereon in different directions, by utilizing said determined local variations of the refractive index at said multiplicity of three dimensional locations in the medium.
2. Apparatus according to claim 1, and wherein said ray tracer determines an aberrated wavefront for each of said plurality of rays originating from each point in said medium; and also comprising an adaptive optics controller utilizing said aberrated wavefront to control an adaptive optical element in said microscope, thereby to correct aberrations resulting from the variations in the refractive index.
3. A method of ray tracing through a medium having multiple variations in refractive index including:
- determining local variation of the refractive index at any multiplicity of three dimensional locations in the medium by either one of the methods of differential interference contrast (DIC) imaging and phase microscopy; and
- analytically determining the path of a ray through the multiplicity of three dimensional locations in the medium, for a plurality of rays impinging thereon in different directions, by utilizing said determined local variations of the refractive index at said multiplicity of three dimensional locations in the medium.
4. A method according to claim 3, and also comprising the steps of:
- determining an aberrated wavefront for each of said plurality of rays originating from each point in said medium; and
- utilizing said aberrated wavefront to control an adaptive optical element in said microscope, thereby to correct said aberrations resulting from said local variation of the refractive index.
5. A method for confocal microscopy comprising the steps of:
- providing a confocal microscope having an image information acquirer providing information relating to variations in the refractive index in a three-dimensional imaged volume, said microscope having an imaging path between a three-dimensional sample and said image information acquirer; and
- disposing in said imaging path a three-dimensional medium with refractive properties that correct aberrations resulting from said variations of the refractive index in the three-dimensional sample.
6. Apparatus for confocal microscopy comprising:
- an image information acquirer providing information relating to variations in the refractive index in a three-dimensional imaged volume, said apparatus having an imaging path between said three-dimensional imaged volume and said image information acquirer; and
- a three-dimensional medium disposed in said imaging path; wherein said three-dimensional medium has refractive properties that correct aberrations resulting from variations of said refractive index in said three-dimensional imaged volume.
4362943 | December 7, 1982 | Presby |
4720633 | January 19, 1988 | Nelson |
4827125 | May 2, 1989 | Goldstein |
4880976 | November 14, 1989 | Mancuso et al. |
4947323 | August 7, 1990 | Smith |
5412211 | May 2, 1995 | Knowles |
5671136 | September 23, 1997 | Willhoit, Jr. |
5783833 | July 21, 1998 | Sugaya et al. |
5787146 | July 28, 1998 | Giebeler |
5789748 | August 4, 1998 | Liu et al. |
5912257 | June 15, 1999 | Prasad et al. |
6084227 | July 4, 2000 | Rhoads |
6166853 | December 26, 2000 | Sapia et al. |
6275726 | August 14, 2001 | Chan et al. |
6384952 | May 7, 2002 | Clark et al. |
6459482 | October 1, 2002 | Singh et al. |
6658142 | December 2, 2003 | Kam et al. |
6771417 | August 3, 2004 | Wolleschensky et al. |
- Jos Stam et al., Ray Tracing in Non-Constant Media, Rendering Techniques 96, Proceedings of the 7th Eurographics Worksho on Rendering, 1996.
- Marc Berger et al., Ray Tracing, IEEE Computer Graphics & Applications, 1990, pp. 36-41.
- N.C. Schoen, Ray Tracing Analysis for Media with Nonhomogeneous Indices of Refraction, Optical Society of America, vol. 12, No. 18, Applied Optics, Sep. 15, 1982, pp. 3329-3331.
- Farhana Kagalwala et al., Computational model of DIC microscopy for reconstructing 3-D specimens: from observations to measurement, Conference on Three-dimensional and multidimensional, San Jose CA, Jan. 27-29, 1998,pp. 35-36.
- N. S. White et al., Aberration control in quantitative imaging of botanical specimens by multidimensional fluorescence microscopy, Journal of Microscopy, vol. 181, Pt. 2, Feb. 1996, pp. 99-116.
- Pratt, W.K. “Digital Image Processing”, NY John Wiley & Sons, Inc., (1991).
- Rosenfeld, A and Kak, A.C. “Digital Picture Processing”, Academic Press. (1976).
- Castleman, K.R. “Digital Image procssing”, Prentice-Hall inc., Englewood Cliffs, New Jersey. (1979).
- Inoui, S. and Spring, K.S. “Video Microscopy; The Fundamentals”, 2nd Edition, Plenum Press, NY (1997).
- Tanford, C. “Physical Chemistry of Macromolecules”, John Wiley NY. (1961).
- Allen R.D. et al., “Video-Enhanced Contrast, Differential Interference Contrast (Avec-Dic), Microscopy: A New Method Capable of Analyzing Microtuble Related Motility in the Reticulopodial Network of Allogromia Laticollaria”, Cell Motility 1:291-302 (1981).
- Cogswell, C.J. et al., “Confocal Differential Interference Contrast (DIC) Microscopy: Including a Theoretical Analysis of Conventional and Confocal DIC Imaging”, J. Microsc. 165:81-101 (1992).
- Gelles, J. et al., “Tracking Kinesin-Driven Movements with Nanometre-Scale Precision”, Nature 331:450-453 (1988).
- Ha-usler, G. et al., “Imaging with Expanded Depth of Focus”, Zeiss Inform. 29:9-13 (1987).
- Preza, C. et al., “Image Reconstruction for Three-Dimensional Transmitted Light DIC Microscopy”, SPIE 2984:220-231 (1997).
- Schormann, T. et al., “Contrast Enhancement and Depth Perception in Three-Dimensional Representations of Differential Interference Contrast and Confocal Scanning Laser Microscope Images”, J.Microsc. 166:155-168 (1992).
- Jenkins, F.A. et al., “Fundamentals of Optics”, McGraw-Hill, NY (1950) CH.8: Ray Tracing.
- Born M. et al., “Principles of Optics”, Pergamon London (1959).
- Goodman J.W. “Statistical Optics”, John Wiley & Sons NY (1985).
- Gibson S.F. et al., “Modeling Aberrations Due to Mismatched Layers for 3-D Microscopy” SPIE Optics in Complex Systems 1319:470-471 (1990).
- Gibson S.F. et al., “Experimental Test of an Analytical Model of Abberation in an Oilimmersion Objective Lens Used in Three-Dimensional Light Microscopy”, J. Opt. Soc. Am. A8:1601-1613 (1991).
- Jansson, P.A. ed. “Deconvolution of Images and Spectra”, Academic Press NY (1997).
- Agard, D.A. et al., “Three-Dimensional Architecture of a Polytene Nucles”, Nature 302:676-681 (1984).
- Agard, D.A. et al., “Fluorescence Microscopy in Three Dimensions”, Methods in Cell Biology 30:353-377 (1989).
- Boden, A.F. et al., “Comparative Results with Massively Prallel Spatially Variant Maximum Likelihood Image Restoration”, Bul Am Astr. Soc. 27:924-929 (1995).
- Boden, A.F. et al., “Massively Parallel Spatially-Variant Maximum Likelihood Restoration of Hubble Space Telescope Imagery”, J.Opt Soc Am A 13:1537-1545 (1996).
- Tyson R.K. “Principles of Adaptive Optics”, Academic Press NY (1991).
- Carrington, W.A. et al., “Superresolution Three Dimensional Images of Fluorescence in Cells with Minimal Light Exposure”, Science 268:1483-1487 (1995).
- Femino, A.M. et al., “Visualization of Single RNA Transcripts in Situ”, Science 280:585-590 (1998).
- Z, Kam, “Microscopic Differential Interference Contrast Image Processing by Line Integration (LID) and Deconvolution”, Bioimaging 6(4): 166-176 (1998).
- Nomarski's DIC Microscopy: A Review, Institute of Applied Optics, SPIE 1846:10-25 (1994).
- Scalettar, B.A. et al., “Dispersion, Aberration and Deconvolution in Multi-Wavelength Fluorescence Images”, Journal of Microscopy, vol. 182, No. 1, Apr. 1996, pp. 50-60.
- Patent Abstracts of Japan, vol. 1997, No. 8, Aug. 1997.
- Agard, D. et al., “Three-Dimensional Microscopy: Image Processing for High Resolution Subcellular Imaging”, New Methods in Microscopy and Low Light Imaging, USA, Aug. 1989, vol. 1161, pp. 24-30.
- Z. Kam, et al., “Computational Adaptive Optics for Live Three-Dimensional Biological Imaging”, PNAS, Mar. 27, 2001, vol. 98, No. 7, pp. 3790-3795.
Type: Grant
Filed: Nov 30, 1999
Date of Patent: May 29, 2007
Assignees: Yeda Research and Development Co., Ltd. (Rehovot), The Regents of the University of California (Oakland, CA)
Inventors: Zvi Kam (Tel Aviv), John W Sedat (San Francisco, CA), David A Agard (Burlingame, CA), Bridget M Hanser (San Francisco, CA)
Primary Examiner: Matthew C. Bella
Assistant Examiner: Tom Y. Lu
Attorney: Ladas and Parry LLP
Application Number: 09/856,422
International Classification: G06K 9/00 (20060101);