Abstract: A two-by-two pixel array within an image sensor includes a first pixel, a second pixel, a third pixel, and a fourth pixel. A red filter covers the first pixel, a first blue filter covers the second pixel, a second blue filter covers the third pixel, and a green filter covers the fourth pixel. The red filter is configured to allow the first pixel to collect a red component of visible light and prevent the first pixel from collecting blue and green components of the visible light. The first and second blue filters are configured to allow the second and third pixels to each collect the blue component and prevent the second and third pixels from collecting the red and green components. The green filter is configured to allow the fourth pixel to collect the green component and prevent the fourth pixel from collecting the red and blue components.

Abstract: A method for determining a position of a tool being received by a catheter, the method including capturing first images with the tool as the tool is being installed in the catheter. The method also includes generating training images for a deep convolutional neural network (DCNN) by replicating the first images and applying perturbations to the replicated first images. The method also includes training the DCNN by inputting the training images into the DCNN. The method also includes capturing second images with the tool as the tool is being installed in the catheter. The method also includes inputting the second images into the DCNN. The method also includes analyzing the second images with the trained DCNN. The method further includes determining a configuration of the tool based on the analyzed second images.

Abstract: A system comprises a tool and a catheter sized to receive the tool. The system also comprises a processor and a memory having computer readable instructions stored thereon. The computer readable instructions, when executed by the processor, cause the system to receive, via an image sensor of the tool, a plurality of images from within a lumen of the catheter. Each image comprises a plurality of pixels. For each image, a subset of the plurality of pixels associated with a viewable feature is identified. For each image, a likely orientation for the viewable feature is determined based on the identified subset of the plurality of pixels. A composite orientation for the viewable feature is determined based on a combination of the likely orientations of the viewable feature for each image. A rotational offset of the tool relative to the catheter is determined based on the determined composite orientation.

Abstract: An imaging system and method for generating a three-dimensional color image include an opening for allowing light from an object to enter the imaging system. Each sensor element in an array of sensor elements receives a portion of the light and generates a signal indicative of an intensity of the received portion of the light. Light from an optical element impinges on a filter comprising a plurality of filter regions, each filter region passes a predetermined band of wavelengths of the light and is associated with and disposed in alignment with one of the sensor elements such that light passing through each filter region impinges on the sensor associated and in alignment with the filter element. At least one of the filter regions is constructed to pass a visible color band, and at least one other of the filter regions is constructed to pass an infrared band.

Abstract: A brightness-sensitive automatic white balance method includes (a) determining the brightness of a scene captured in an electronic color image, (b) selecting a color-weighting map based upon the brightness of the scene, (c) extracting auto white balance parameters from the color-weighting map, and (d) white balancing the electronic color image according to the auto white balance parameters. An adaptive automatic white balance method includes (a) refining, based upon a first electronic color image of a scene illuminated by an illuminant of a first spectral type, a color-weighting probability distribution for the illuminant of the first spectral type, wherein the color-weighting probability distribution may be brightness-specific, (b) extracting auto white balance parameters from the refined color-weighting probability distribution, and (c) white balancing, according to the auto white balance parameters, an electronic color image of a scene illuminated by the illuminant of the first spectral type.

Abstract: A system for brightness-sensitive automatic white balancing of an electronic color image includes a processor and a memory with (a) brightness-specific color-weighting maps each specifying illuminant-specific auto white balance parameters, (b) brightness range definitions respectively indicating applicability range of the brightness-specific color-weighting maps, and (c) instructions for white balancing the electronic color image according to scene brightness and based upon the brightness-specific color-weighting maps.

Abstract: A method for calibrating auto white balancing in an electronic camera includes (a) obtaining a plurality of color values from a respective plurality of images of real-life scenes captured by the electronic camera under a first illuminant, (b) invoking an assumption about a true color value of at least portions of the real-life scenes, and (c) determining, based upon the difference between the true color value and the average of the color values, a plurality of final auto white balance parameters for a respective plurality of illuminants including the first illuminant. An electronic camera device includes an image sensor for capturing real-life images of real-life scenes, instructions including a partly calibrated auto white balance parameter set and auto white balance self-training instructions, and a processor for processing the real-life images according to the self-training instructions to produce a fully calibrated auto white balance parameter set specific to the electronic camera.

Abstract: A CMOS imaging system is capable of self-calibrating to correct for lens shading by use of images captured in the normal environment of use, apart from a production calibration facility.

Abstract: An imaging system and method for generating a three-dimensional color image include an opening for allowing light from an object to enter the imaging system. Each sensor element in an array of sensor elements receives a portion of the light and generates a signal indicative of an intensity of the received portion of the light. Light from an optical element impinges on a filter comprising a plurality of filter regions, each filter region passes a predetermined band of wavelengths of the light and is associated with and disposed in alignment with one of the sensor elements such that light passing through each filter region impinges on the sensor associated and in alignment with the filter element. At least one of the filter regions is constructed to pass a visible color band, and at least one other of the filter regions is constructed to pass an infrared band.

Abstract: A method of white balancing an image includes mapping pixels of the image to a color space diagram. Each of the pixels of the image include a red (“R”), a green (“G”), and a blue (“B”) subvalue. A first central tendency of each of the RGB subvalues of pixels mapped in a first pre-defined region of the color space diagram is determined and a second central tendency of each of the RGB subvalues of pixels mapped in a second pre-defined region of the color space diagram is determined. The first pre-defined region is associated with a first illuminating source and the second pre-defined region is associated with a second illuminating source. RGB values of a white pixel are generated based on the first and second central tendencies.

Abstract: A method for calibrating auto white balancing in an electronic camera includes (a) obtaining a plurality of color values from a respective plurality of images of real-life scenes captured by the electronic camera under a first illuminant, (b) invoking an assumption about a true color value of at least portions of the real-life scenes, and (c) determining, based upon the difference between the true color value and the average of the color values, a plurality of final auto white balance parameters for a respective plurality of illuminants including the first illuminant. An electronic camera device includes an image sensor for capturing real-life images of real-life scenes, instructions including a partly calibrated auto white balance parameter set and auto white balance self-training instructions, and a processor for processing the real-life images according to the self-training instructions to produce a fully calibrated auto white balance parameter set specific to the electronic camera.

Abstract: An imaging system may include a dual-band image sensor that captures visible and near-infrared light and image processing circuitry that performs color corrections on images captured by the dual-band image sensor. The image processing circuitry may analyze each captured image in two different color spaces to determine what type of light source lit each image. The image processing circuitry may determine whether an image was lit by a light source having a relatively high proportion of near-infrared emissions such as an incandescent light, a light source having a relatively low proportion of near-infrared emissions such as a fluorescent light, or a light source having an intermediate proportion of near-infrared emissions such as sunlight or other blackbody radiator. After determining what type of light source lit an image, the image processing circuitry may adjust color balances in that image using a color correction matrix associated with that type of light source.

Abstract: An imaging system may include a dual-band image sensor that captures visible and near-infrared light and image processing circuitry that performs color corrections on images captured by the dual-band image sensor. The image processing circuitry may analyze each captured image in two different color spaces to determine what type of light source lit each image. The image processing circuitry may determine whether an image was lit by a light source having a relatively high proportion of near-infrared emissions such as an incandescent light, a light source having a relatively low proportion of near-infrared emissions such as a fluorescent light, or a light source having an intermediate proportion of near-infrared emissions such as sunlight or other blackbody radiator. After determining what type of light source lit an image, the image processing circuitry may adjust color balances in that image using a color correction matrix associated with that type of light source.

Abstract: Methods, devices and systems for compressing images are provided. One method includes creating halftone mask structures and applying compression coding techniques to arrayed pixels sorted using the halftone mask structures in order to convert an image to a compressed bi-level, halftoned image.

Abstract: Methods, devices and systems for compressing images are provided. One method includes creating halftone mask structures and applying compression coding techniques to arrayed pixels sorted using the halftone mask structures in order to convert an image to a compressed bi-level, halftoned image.