Abstract: Image sensor with a successive approximation A/D converter that automatically compensates for black level and provides a signal indicative of the difference between the reset level and the signal level. Black level for each of a plurality of color pixels may be obtained. This may be obtained from, for example, an image sensor with intentionally darkened pixels. Levels from these pixels are sampled, and an average of these pixels is used to form a black level for similarly-colored pixels. That black level is stored, and used to drive a D/A converter. Another D/A converter forms the actual conversion, and is compared to a reference. The reference is selected such that the output signal is automatically compensated for black level, and also corresponds to the difference between signal and reset.

Abstract: An apparatus and method for measuring the breakpoint of a response curve representing the voltage output of an image array having an extended dynamic range. By flooding a light-opaque pixel with a charge and then applying an intermediate reset voltage to the pixel, the signal is read from the pixel and stored. The full reset voltage is applied to the pixel, and then the signal in the pixel is read and stored. The voltage output difference is the difference between the first and second stored signal. The voltage output difference is then used to determine the voltage of the knee point. Further, a conventional saturated pixel can be reset with an intermediate reset just prior to readout. The resulting signal can then be used to determine the voltage of the knee point.

Abstract: In an image processing system, the imager gain and the exposure time are adjusted based on a predefined stepping sequence using a stepping table designed to maximize the signal-to-noise ratio in the image. This is achieved by providing a stepping sequence with each step having the largest suitable integration time (exposure) and an appropriate amplifier and digital gain setting, while achieving an equal relative percentage change in image brightness between adjacent sequence steps. The size of the executed AE steps is proportional to the distance between a current image luminance and the target luminance. This is achieved by the capability to skip one or more steps in the stepping sequence, if appropriate, for each relevant executed step, with the number of skipped steps, if any, being proportional to the magnitude of the deviation from the target brightness.

Abstract: A CMOS imager in which a CMOS image sensor, a color image processing module and an image compression module are all provided on a single die. Both the color image processing module and the image compression module incorporate pipelined architectures to process the image data at a video rate in a massively parallel fashion.

Abstract: An image processing system and method compares each pixel of an image obtained from an image sensor array with at least eight surrounding pixels of the same color in the filter array. If the signal of a given pixel is larger than the respective signals of all eight surrounding pixels of the same color, then the value of that central pixel signal is substituted with the maximum signal value among the surrounding eight pixels of the same color. Similarly, if the signal of a given pixel is smaller than the respective signals of all eight surrounding pixels of the same color, then the value of that central pixel signal is substituted with the minimum signal value among the surrounding eight pixels of the same color.

Abstract: An image processing system and method compares each pixel of an image obtained from an image sensor array with at least eight surrounding pixels of the same color in the filter array. If the signal of a given pixel is larger than the respective signals of all eight surrounding pixels of the same color, then the value of that central pixel signal is substituted with the maximum signal value among the surrounding eight pixels of the same color. Similarly, if the signal of a given pixel is smaller than the respective signals of all eight surrounding pixels of the same color, then the value of that central pixel signal is substituted with the minimum signal value among the surrounding eight pixels of the same color.

Abstract: A process for performing white balancing of an image is performed by subdividing an image into a plurality of subframes, and then analyzing each subframe to determine if that subframe is predominantly monochromatic other than gray. If so, that subframe is excluded from the computation of the gain adjustments in the white balancing operation. As a result, the white balance process is performed using only the multicolored and/or gray subframes, thus allowing the overall white-balance of the image to be shifted only when a change in the color average is due to a change in the spectra of illumination, and not a presence of large monochromatic areas in the image.

Abstract: The integration time for an imager is adjusted to be an integer multiple of the light intensity received by the imager to reduce or eliminate flickering.

Abstract: A process for performing white balancing of an image is performed by subdividing an image into a plurality of subframes, and then analyzing each subframe to determine if that subframe is predominantly monochromatic other than gray. If so, that subframe is excluded from the computation of the gain adjustments in the white balancing operation. As a result, the white balance process is performed using only the multicolored and/or gray subframes, thus allowing the overall white-balance of the image to be shifted only when a change in the color average is due to a change in the spectra of illumination, and not a presence of large monochromatic areas in the image.

Abstract: In an image processing system, the imager gain and the exposure time are adjusted based on a predefined stepping sequence using a stepping table designed to maximize the signal-to-noise ratio in the image. This is achieved by providing a stepping sequence with each step having the largest suitable integration time (exposure) and an appropriate amplifier and digital gain setting, while achieving an equal relative percentage change in image brightness between adjacent sequence steps. The size of the executed AE steps is proportional to the distance between a current image luminance and the target luminance. This is achieved by the capability to skip one or more steps in the stepping sequence, if appropriate, for each relevant executed step, with the number of skipped steps, if any, being proportional to the magnitude of the deviation from the target brightness.

Abstract: A method for achieving flickerless operation of imagers using a rolling shutter, including the steps of detecting flicker in an image frame and adjusting an integration time such that the integration time is an integer multiple of a light intensity period, is described. The method reduces the task of detecting flicker to detecting a spatial sine wave in the image frame by subtracting two image frames from each other. The subtraction reduces or eliminates image content from the image frames and makes the detection process independent of image content. This method can be practiced based on a very short sequence of image frames (as few as two image frames) and is virtually insusceptible to motion of the image content. Adjustments to the integration time are made by changing the horizontal blanking time of the imager and, thereby extending the duration time of each row of said image frame.

Abstract: The subject of the present invention is the network video camera capable of delivering high-resolution digital images, comprising over a million of pixels per image, at full motion video frame rate.

Abstract: The subject of this invention is the network camera sensitive to both visual and near-infrared or infrared spectral bands and comprising two or more image sensors with different spectral responses, one or more image processors, and network interfaces. In the preferred embodiment the network camera disclosed in this invention comprises two image sensors with individual optics, where both sensors have similar fields of view. In the preferred embodiment of the present invention one of the sensors is color image sensor with infrared-cut filter positioned in front of pixel array, while the other sensor is monochrome image sensor with optics characterized by lower f-number than that used for color sensor and without infrared-cut filter in its field of view. In one of the embodiments of this invention, monochrome sensor has larger pixel sizes than color sensor to provide for higher low-light sensitivity.

Abstract: The subject of this invention is a multi-sensor network camera providing up to 360 degrees angle of view. The camera disclosed in the present invention comprises multiple image sensors with individual optics, one or more image processors, compression units and network interfaces mounted in the single housing. In the preferred embodiment image sensors are positioned in non-parallel planes, cumulatively providing panoramic field of view. In the preferred embodiment image streams originating from all sensors share the same image compression and network interface hardware, providing for low cost implementation. In the preferred embodiment the images from all sensors are transmitted over the network simultaneously via packet interleaving, with appropriate bandwidth reduction achieved by image decimation.

Abstract: An apparatus and method for measuring the breakpoint of a response curve representing the voltage output of an image array having an extended dynamic range. By flooding a light-opaque pixel with a charge and then applying an intermediate reset voltage to the pixel, the signal is read from the pixel and stored. The full reset voltage is applied to the pixel, and then the signal in the pixel is read and stored. The voltage output difference is the difference between the first and second stored signal. The voltage output difference is then used to determine the voltage of the knee point. Further, a conventional saturated pixel can be reset with an intermediate reset just prior to readout. The resulting signal can then be used to determine the voltage of the knee point.

Abstract: A method for achieving flickerless operation of imagers using a rolling shutter, including the steps of detecting flicker in an image frame and adjusting an integration time such that the integration time is an integer multiple of a light intensity period, is described. The method reduces the task of detecting flicker to detecting a spatial sine wave in the image frame by subtracting two image frames from each other. The subtraction reduces or eliminates image content from the image frames and makes the detection process independent of image content. This method can be practiced based on a very short sequence of image frames (as few as two image frames) and is virtually insusceptible to motion of the image content. Adjustments to the integration time are made by changing the horizontal blanking time of the imager and, thereby extending the duration time of each row of said image frame.

Abstract: A CMOS imager in which a CMOS image sensor, a color image processing module and an image compression module are all provided on a single die. Both the color image processing module and the image compression module incorporate pipelined architectures to process the image data at a video rate in a massively parallel fashion.

Abstract: The invention provides a new method and apparatus for NTSC and PAL image sensors which employs fusion of adjacent row pixel charge samples to generate image data for a row. A variety of fusion schemes are possible for fusing the pixel signals from the adjacent rows. The rows of pixels are scanned so that each scan takes an odd row signal sample and, in some cases, an adjacent even row signal sample when specified conditions are met. One sampled row of the two adjacent rows integrate an image with a first integration period while the other adjacent row integrates an image with a second integration period.

Abstract: Generation of a single look-up table for performing DNL correction on an array of analog-to-digital converters (ADCs) is disclosed. Initially, the analog input voltages to the array of ADCs are generated. The input voltages ramp up in steps of some predetermined value. Then, the digital output data are collected and stored in a frame-grabber buffer. A frame of output data are examined for missed codes. The missed codes are identified and recorded. Next, an ADC with a highest number of missed codes is selected for use in generating the look-up table. Finally, the look-up table entries are filled in with consecutive integer values using the corresponding actual output of the selected ADC as an address in the look-up table. During this process, there will be some entries that are missing. These empty entries are filled in with values identical to the value following the empty entries.

Abstract: An image processing system and method compares each pixel of an image obtained from an image sensor array with at least eight surrounding pixels of the same color in the filter array. If the signal of a given pixel is larger than the respective signals of all eight surrounding pixels of the same color, then the value of that central pixel signal is substituted with the maximum signal value among the surrounding eight pixels of the same color. Similarly, if the signal of a given pixel is smaller than the respective signals of all eight surrounding pixels of the same color, then the value of that central pixel signal is substituted with the minimum signal value among the surrounding eight pixels of the same color.