Abstract: There is provided an image processing apparatus including a representative pixel calculation unit configured to select some pixels in an input image as representative pixels, a representative pixel update unit configured to update pixel values of the representative pixels, and a corrected image generation unit configured to set pixel values for pixels other than the representative pixels by applying the updated pixel values of the representative pixels. The representative pixel update unit is configured to, based on pixels around a position of the representative pixels in a smoothed image generated based on the input image as reference pixels, execute pixel value correction of the representative pixels by applying the pixel values of the reference pixels.

Abstract: Methods and systems for coded rolling shutter are provided. In accordance with some embodiments, methods and system are provided that control the readout timing and exposure length for each row of a pixel array in an image sensor, thereby flexibly sampling the three-dimensional space-time value of a scene and capturing sub-images that effectively encode motion and dynamic range information within a single captured image.

Abstract: An apparatus and a method are provided which have a simple configuration to perform highly accurate demosaic processing. A local region of interest being a region to be processed is selected from a raw image format, and a standard color image is generated based on an input image. Further, a similar local region is selected which has a phase different from that of the local region of interest, and is determined to have high similarity to the local region of interest based on the standard color image. Further, the local region of interest and the similar local region are combined to generate a local region image set with RGB, having each RGB pixel value set to each pixel position of component pixels of the local region of interest. Further, the local region images set with RGB corresponding to different local regions of interest are combined to generate an RGB image having each RGB pixel value set to each pixel position of component pixels of the input raw image format.

Abstract: There are provided an imaging apparatus and method which perform different exposure control in pixel group units. Brightness in the pixel group units obtained by dividing a plurality of pixels of an imaging area of the image sensor is evaluated, and pixel group unit exposure control values are calculated according to an evaluation result. The image sensor outputs a control signal matching the calculated pixel group unit exposure control value to each pixel group constituent pixel, and controls exposure in the pixel group units. For example, the exposure control signal including an identical pattern is sequentially output to a plurality of pixels in a pixel group in a time sequence, and exposure control which sets an identical exposure time for a plurality of pixels belonging to one pixel group is realized.

Abstract: An image processing apparatus includes: a target position selecting unit to select a pixel position on an input image, as a target position; a candidate line setting unit to set two or more sets of candidate lines including a pixel with a value, in the vicinity of the target position; a weighted-value calculating unit to calculate a weighted value that corresponds to a degree of expectation that the target position and the pixel position on the candidate line are on the same pattern; a direction classifying unit to selectively determine a set of candidate lines that are close to a direction of a pattern of the target position in accordance with the weighted value of each pixel on the candidate lines; and a first interpolated-value calculating unit to calculate a pixel value of the target position in accordance with the weighted value of each pixel on the candidate lines.

Abstract: A moving subject detection map is generated by performing moving subject region determination based on input image information from an image capture portion, and is used to set an exposure pattern for a moving subject detected pixel region. The exposure pattern is cyclically arranged with multiple different exposure times. The exposure time for a stationary subject region is set according to the brightness of the subject. Regarding an image captured based on the exposure time control, an output image is generated by computing pixel values for a moving subject region, using pixel value combination processing that utilizes the pixel values of pixels with a plurality of different exposure times being set, and by computing pixel values for the stationary subject region by multiplying a gain according to the exposure time. This achieves the acquisition of a dynamic range image while keeping deterioration of the resolution to a minimum.

Abstract: Provided is an imaging device including an image sensor for outputting a high-sensitivity pixel signal from a long-time exposure pixel and a low-sensitivity pixel signal from a short-time exposure pixel; and a blooming correction processing unit for receiving the output pixel signal from the image sensor and executing blooming correction for the pixel signal. The blooming correction processing unit executes pixel value correction of the input pixel from the image sensor according to a difference between or a ratio of an input pixel value from the image sensor and an ideal pixel value not affected by blooming.

Abstract: Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.

Abstract: An image processing apparatus includes: a shaking estimating unit configured to estimate the shaking information of an image generated within a predetermined period of time; a short-time-exposure shaking correcting unit configured to correct the shaking of a plurality of short-time-exposure images generated due to intermittent exposure within the predetermined period of time based on the estimated shaking information; a long-time-exposure shaking correcting unit configured to correct the shaking of a long-time-exposure image generated due to consecutive exposure within the predetermined period of time based on the estimated shaking information; and an image synthesizing unit configured to synthesize the corrected short-time-exposure images and the corrected long-time-exposure image.

Abstract: Generalized assorted pixel camera systems and methods are provided. In accordance with some embodiments, the generalized assorted pixel camera systems include a color filter array, where the color filter array includes a plurality of primary filters and a plurality of secondary filters. Each filter has a particular spectral response and each filter is formed on a corresponding pixel of a plurality of pixels. Each of the plurality of primary filters and the plurality of secondary filters enhances an attribute of image quality and the information obtained using the plurality of primary filters and the plurality of secondary filters is used to balance spectral resolution, dynamic range, and spatial resolution for generating an image of a plurality of image types.

Abstract: Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.

Abstract: Generalized assorted pixel camera systems and methods are provided. In accordance with some embodiments, the generalized assorted pixel camera systems include a color filter array, where the color filter array includes a plurality of primary filters and a plurality of secondary filters. Each filter has a particular spectral response and each filter is formed on a corresponding pixel of a plurality of pixels. Each of the plurality of primary filters and the plurality of secondary filters enhances an attribute of image quality and the information obtained using the plurality of primary filters and the plurality of secondary filters is used to balance spectral resolution, dynamic range, and spatial resolution for generating an image of a plurality of image types.

Abstract: Long and short exposure time pixel information are input to pixel information. A long exposure time image set with the pixel values assuming all of the pixels have been exposed for a long time and a short exposure time image set with the pixel values assuming all of the pixels have been exposed for a short time are generated. A point spread function corresponding to the long exposure time image is computed as a long exposure time image PSF. A corrected image is generated using the short exposure time image, the long exposure time image, and the long exposure time image PSF. The corrected image is generated as a wide dynamic range image utilizing the pixel information for the long and short exposure time image. Utilizing the pixel information for the short exposure time image with little blurring, makes the corrected image a high quality corrected image with little blurring.

Abstract: An imaging apparatus includes: a first imaging device configured to perform photoelectric conversion on subject light input through a first filter to output a first image signal, the first filter preventing light in a predetermined wavelength band of wavelengths longer than that of visible light from being transmitted; a second imaging device arranged at a different position from the first imaging device and configured to perform photoelectric conversion on subject light containing a wavelength component of the light in the predetermined wavelength band to output a second image signal; a correlation detection unit configured to detect a correlation between the first and second image signals; a luminance signal generation unit configured to generate a luminance signal; a color signal generation unit configured to generate a color signal; and a three-dimensional image generation unit configured to generate a three-dimensional image by the correlation, the luminance signal, and the color signal.

Abstract: An image processing apparatus includes an intermediate image generating unit configured to input an image which has been shot with differing exposure times set by region, generates a plurality of exposure pattern images corresponding to differing exposure times based on the input image, and generates a plurality of timing images which are difference images of the plurality of exposure pattern images; and a distortion correction processing unit configured to generate a corrected image equivalent to an exposure processing image at a predetermined exposure time by synthesizing processing of the plurality of timing images.

Abstract: There is provided an image processing apparatus including an HDR (High Dynamic Range) processing unit inputting images picked up while exposure control that changes an exposure time is being carried out with a predetermined spatial period and a predetermined temporal period on pixels that compose an image sensor, and carrying out image processing. The HDR processing unit generates a first combined image by combining pixel values of a plurality of images with different sensitivities generated by an interpolation process using a plurality of consecutively picked-up images, generates a second combined image by combining pixel values of a plurality of images with different sensitivities generated by an interpolation process that uses a single picked-up image, and generates an HDR image by executing a pixel value blending process on the first combined image and the second combined image in accordance with a blending ratio calculated in accordance with movement detection information.

Abstract: Long and short exposure time pixel information are input to pixel information. A long exposure time image set with the pixel values assuming all of the pixels have been exposed for a long time and a short exposure time image set with the pixel values assuming all of the pixels have been exposed for a short time are generated. A point spread function corresponding to the long exposure time image is computed as a long exposure time image PSF. A corrected image is generated using the short exposure time image, the long exposure time image, and the long exposure time image PSF. The corrected image is generated as a wide dynamic range image utilizing the pixel information for the long and short exposure time image. Utilizing the pixel information for the short exposure time image with little blurring, makes the corrected image a high quality corrected image with little blurring.

Abstract: An image processing apparatus, which calculates weight values based on difference values between the pixel values of pixel positions in an image data and the pixel values of pixels of a peripheral region, calculates expectation values of the pixel values of the peripheral region on the basis of weight values calculated for the pixels in the peripheral region, and makes the expectation values the calculation results of the pixel position, includes: a plurality of normalized weighting functions for calculating the weight values; a unit that calculates the total sum of weight of all of pixels in the peripheral region, for the plurality of normalized weighting functions; a unit that selects the normalized weighting functions on the basis of the total sum of the weight values; and a unit that calculates expectation values of the pixel values in the peripheral region based on the selected normalized weighting function.

Abstract: There is provided an image processing apparatus including an HDR (High Dynamic Range) processing unit inputting images picked up while exposure control that changes an exposure time is being carried out with a predetermined spatial period and a predetermined temporal period on pixels that compose an image sensor, and carrying out image processing. The HDR processing unit generates a first combined image by combining pixel values of a plurality of images with different sensitivities generated by an interpolation process using a plurality of consecutively picked-up images, generates a second combined image by combining pixel values of a plurality of images with different sensitivities generated by an interpolation process that uses a single picked-up image, and generates an HDR image by executing a pixel value blending process on the first combined image and the second combined image in accordance with a blending ratio calculated in accordance with movement detection information.

Abstract: An image processing apparatus includes an intermediate image generating unit configured to input an image which has been shot with differing exposure times set by region, generates a plurality of exposure pattern images corresponding to differing exposure times based on the input image, and generates a plurality of timing images which are difference images of the plurality of exposure pattern images; and a distortion correction processing unit configured to generate a corrected image equivalent to an exposure processing image at a predetermined exposure time by synthesizing processing of the plurality of timing images.