Abstract: Systems and methods for performing depth estimation may comprise: an illuminator capable of illuminating a scene from at least a first position and a second position, an image sensor to capture (i) a first image of the scene while the illuminator illuminates the scene from the first position and (ii) a second image of the scene while the illuminator illuminates the scene from the second position, and an image processor to receive the first and second images from the image sensor and estimate a depth of at least one feature that appears in the first and second images. The depth is estimated based on the relative intensity of the first image and the second image, a distance between the first illumination position and the second illumination position, and a position of the at least one feature within at least one of the first and second images.

Abstract: Systems and methods for performing depth estimation may comprise: an illuminator capable of illuminating a scene from at least a first position and a second position, an image sensor to capture (i) a first image of the scene while the illuminator illuminates the scene from the first position and (ii) a second image of the scene while the illuminator illuminates the scene from the second position, and an image processor to receive the first and second images from the image sensor and estimate a depth of at least one feature that appears in the first and second images. The depth is estimated based on the relative intensity of the first image and the second image, a distance between the first illumination position and the second illumination position, and a position of the at least one feature within at least one of the first and second images.

Abstract: The present invention provides methods to detect degenerative processes and abnormalities in soft tissues at high spatial resolution, high signal-to-noise ratio and short scanning times, based on quantitative tissue properties. These methods might provide a useful tool to detect and assess abnormalities in soft tissues and to monitor disease progression.

Abstract: Various aspects of the instant disclosure are directed to imaging tissue. As may be implemented in accordance with one or more embodiments, aspects of the present disclosure are directed to apparatuses and methods involving the following. A light source includes an array of light emitters that illuminate a tissue region of a heart wall with light at different wavelength ranges. A light collector collects multispectral images including respective images collected at each of the different wavelength ranges at which the tissue region is illuminated. A catheter positions the light source and light collector proximate the tissue region of the heart wall for respectively illuminating the tissue region and collecting the multispectral images. A display circuit collects and displays one or more images depicting a condition of the health of heart wall tissue, based on the respective images collected at the different ones of the wavelength ranges.

Abstract: Embodiments are directed to apparatuses and methods that jointly estimate reflectance and fluorescence spectra. An example embodiment includes providing captured intensity characteristics indicative of a target, the intensity characteristics acquired by illuminating the target with different illuminants and passing light in different spectral bands via a photodetector apparatus and providing reflectance properties and fluorescent properties of the target. The example embodiment further includes concurrently adjusting the reflectance properties and fluorescence properties to reduce a quantity indicative of a combination of: a difference between the captured intensity characteristics and intensities predicted using an image formation model incorporating the reflectance properties and fluorescence properties, functions of the reflectance properties, and functions of the fluorescence properties.

Abstract: Various aspects of the instant disclosure are directed to imaging tissue. As may be implemented in accordance with one or more embodiments, aspects of the present disclosure are directed to apparatuses and methods involving the following. A light source includes an array of light emitters that illuminate a tissue region of a heart wall with light at different wavelength ranges. A light collector collects multispectral images including respective images collected at each of the different wavelength ranges at which the tissue region is illuminated. A catheter positions the light source and light collector proximate the tissue region of the heart wall for respectively illuminating the tissue region and collecting the multispectral images. A display circuit collects and displays one or more images depicting a condition of the health of heart wall tissue, based on the respective images collected at the different ones of the wavelength ranges.

Abstract: The present invention provides methods to detect degenerative processes and abnormalities in soft tissues at high spatial resolution, high signal-to-noise ratio and short scanning times, based on quantitative tissue properties. These methods might provide a useful tool to detect and assess abnormalities in soft tissues and to monitor disease progression.

Abstract: The present invention provides methods to detect degenerative processes and abnormalities in soft tissues at high spatial resolution, high signal-to-noise ratio and short scanning times, based on quantitative tissue properties. These methods might provide a useful tool to detect and assess abnormalities in soft tissues and to monitor disease progression.

Abstract: A learning technique is provided that learns how to process images by exploiting the spatial and spectral correlations inherent in image data to process and enhance images. Using a training set of input and desired output images, regression coefficients are learned that are optimal for a predefined estimation function that estimates the values at a pixel of the desired output image using a collection of similarly located pixels in the input image. Application of the learned regression coefficients is fast, robust to noise, adapts to the particulars of a dataset, and generalizes to a large variety of applications. The invention enables the use of image sensors with novel color filter array designs that offer expanded capabilities beyond existing sensors and take advantage of typical high pixel counts.

Abstract: A learning technique is provided that learns how to process images by exploiting the spatial and spectral correlations inherent in image data to process and enhance images. Using a training set of input and desired output images, regression coefficients are learned that are optimal for a predefined estimation function that estimates the values at a pixel of the desired output image using a collection of similarly located pixels in the input image. Application of the learned regression coefficients is fast, robust to noise, adapts to the particulars of a dataset, and generalizes to a large variety of applications. The invention enables the use of image sensors with novel color filter array designs that offer expanded capabilities beyond existing sensors and take advantage of typical high pixel counts.

Abstract: The present invention provides methods to detect degenerative processes and abnormalities in soft tissues at high spatial resolution, high signal-to-noise ratio and short scanning times, based on quantitative tissue properties. These methods might provide a useful tool to detect and assess abnormalities in soft tissues and to monitor disease progression.

Abstract: An integrated color pixel (ICP) with at least one integrated metal filter is presented. Rather than utilizing a separate color filter, the wavelength responsivity of the ICP is specified and integrated at pixel level into the ICP itself using metal materials already available for standard integrated circuit design and fabrication process. The ICP of the present invention is thus distinguished from a conventional color pixel constructed in a two-stage process that combines an image sensor with a color filter array or other optical material.

Abstract: A method for improving SNR without reducing dynamic range in a CMOS video sensor system under low illumination is described, wherein the CMOS video sensor system employing self-reset DPS architecture includes pixel level A/D conversion and wherein each DPS pixels is capable of resetting itself whenever a corresponding diode reaches saturation during integration time, the method comprising the steps of eliminating global frame reset for the self-reset DPS pixels, capturing and storing a plurality of frames, extending integration time beyond frame readout time, and generating frame images using one or more previously stored frames.

Abstract: Color balancing algorithms for digital image processing require an accurate estimate of the physical properties of the ambient scene illuminant, particularly its spectral power distribution. An active imaging method and apparatus estimate these properties by emitting modulated light with a known spectral power distribution into a region of a scene. Backscattered light is detected and demodulated to separate output representing active emitter light from output representing ambient illuminant light. Using the emitter-related detector output and the known emitter spectral power distribution, the surface spectral reflectance function of the illuminated scene region can be computed. Subsequently, the spectral power distribution of the ambient scene illuminant can be computed from the surface reflectance function and the illuminant-related output of the detector. The estimated spectral power distribution can be used in standard color balancing algorithms for digital or film images.

Abstract: An integrated color pixel (ICP) with at least one integrated metal filter is presented. Rather than utilizing a separate color filter, the wavelength responsivity of the ICP is specified and integrated at pixel level into the ICP itself using metal materials already available for standard integrated circuit design and fabrication process. The ICP of the present invention is thus distinguished from a conventional color pixel constructed in a two-stage process that combines an image sensor with a color filter array or other optical material.

Abstract: A method for improving SNR without reducing dynamic range in a CMOS video sensor system under low illumination is described, wherein the CMOS video sensor system employing self-reset DPS architecture includes pixel level A/D conversion and wherein each DPS pixels is capable of resetting itself whenever a corresponding diode reaches saturation during integration time, the method comprising the steps of eliminating global frame reset for the self-reset DPS pixels, capturing and storing a plurality of frames, extending integration time beyond frame readout time, and generating frame images using one or more previously stored frames.

Abstract: Color balancing algorithms for digital image processing require an accurate estimate of the physical properties of the ambient scene illuminant, particularly its spectral power distribution. An active imaging method and apparatus estimate these properties by emitting modulated light with a known spectral power distribution into a region of a scene. Backscattered light is detected and demodulated to separate output representing active emitter light from output representing ambient illuminant light. Using the emitter-related detector output and the known emitter spectral power distribution, the surface spectral reflectance function of the illuminated scene region can be computed. Subsequently, the spectral power distribution of the ambient scene illuminant can be computed from the surface reflectance function and the illuminant-related output of the detector. The estimated spectral power distribution can be used in standard color balancing algorithms for digital or film images.

Abstract: A method and an apparatus to reduce the errors in linearly transforming the RGB values to the XYZ values of the colors of an image. The image is measured twice, once with and once without a filter between the image and the sensors measuring the image. The apparatus is capable of generating at least three output values substantially simultaneously to measure the color of each element of the image.

Abstract: A method is disclosed to separate the effect of the ambient lighting from the effects of surface reflectance to better analyze the surface properties of materials. The method uses the data sensed by N+1 sensor classes to define a finite dimensional approximation of a surface reflectance function at each image point, and a finite dimensional approximation of the ambient light.The ambient light reflected from a surface will cause a strength of response in the k.sup.th class of sensor, at position x, according to the formula.rho..sub.k.sup.x =.intg.E(.lambda.)S.sup.x (.lambda.)R.sub.k (.lambda.)d.lambda.We assume that there are P classes of sensor, and we represent the responses of all the sensors at location x by a vector,.rho..sup.x =(.rho..sub.1.sup.x . . . .rho..sup.x.sub.p)We use two approximating formulas, one to simplify the description of the ambient light and a second to simplify the description of the surface reflectance.