Abstract: An image processing device includes a processor, and the processor acquires a captured image that has been captured using an image sensor, the image sensor including a multi-band color filter array in which color filters that respectively correspond to four or more bands are arranged in an array, generates a low-noise reference image subjected to a noise reduction process as a reference image that is used for an interpolation process that is performed on pixel values of the captured image, and performs the interpolation process on a band basis based on the generated low-noise reference image to generate an interpolated image in which pixel values of missing pixels are interpolated.

Abstract: An image processing device includes: an acquisition unit configured to acquire image data generated by an imaging element where each of narrow band filters constituting a predetermined array pattern is disposed at a position corresponding to any one of a plurality of pixels; a determination unit configured to determine whether or not a light amount of the invisible light range under an environment at the time when the imaging element generates the image data is larger than a threshold value; and a generation unit configured to generate vital information of a subject based on the determination result of the determination unit.

Abstract: The imaging apparatus includes: a multiband image sensor with a light receiving surface which includes two-dimensional arrays of at least three visible light pixels and an infrared pixels, the visible light pixels having sensitivity in different visible light wavelength ranges, the infrared pixels having sensitivity in the infrared wavelength range; a coded aperture which is disposed on the light receiving surface side of the multiband image sensor and serves as an aperture in a predetermined shape with respect to light in the wavelength range in which the infrared pixel has sensitivity while directly transmitting light in other wavelengths; and a processor for processing an image obtained by the multiband image sensor. The processor generates a depth map based on an image obtained by the multiband image sensor to thereby perform processing of a blurred image.

Abstract: An imaging device includes: an image sensor that includes a color filter array in which normal image generation color filters corresponding to three or more bands and correction information generation color filters differing in spectral sensitivity characteristics from the normal image generation color filters are placed in an array; a normal image generation section that generates a normal image in which pixel values of missing pixels are interpolated; a spectral estimation section that performs a spectral estimation process based on pixel values obtained using at least the correction information generation color filters; a correction information generation section that generates correction information that corrects the normal image based on a spectral estimate value; and a corrected image generation section that performs a correction process on the normal image based on the correction information to generate a corrected image.

Abstract: An imaging apparatus has a color filter array, an image sensor, and a differential information acquisition unit. In the color filter array, including five or more types of color filters are arranged in a two dimensional form. The image sensor has a plurality of pixels covered by the color filters, and the plurality of pixels generate pixel signals. The acquisition unit designates one of the pixels covered by the color filters of interest as a pixel of interest one pixel at a time in order. The acquisition unit calculates first differential information based on pixel signals generated by two of the pixels arranged on both sides of the pixel of interest along the first direction. The acquisition unit calculates second differential information based on pixel signals generated by two of the pixels arranged on both sides of the pixel of interest along the second direction.

Abstract: An image processing device includes: an image acquisition section that acquires captured image data captured using an image sensor including color filters corresponding to bands, and corresponding to a plurality of frames; an alignment processing section that performs an alignment process on the captured image data to generate integrated captured image data; a reference band selection section that selects a reference band from the bands using an output image in a preceding frame; a reference image generation section that performs an interpolation process on image data included in the integrated captured image data and corresponding to the color filter corresponding to the reference band; and an interpolated image generation section that performs an interpolation process on image data included in the integrated captured image data and corresponding to the color filter corresponding to a band differing from the reference band based on a reference image to generate an interpolated image.

Abstract: The color filter array 21a comprises seven or more types of color filters including a first color filter. The seven or more types color filters have different spectral sensitivity characteristics. The seven or more types of color filters are arranged in a two-dimensional form. Among the seven or more types of color filters, at least two types of color filters are designated as a color filter of interest. Two color filters arranged at a first interval on both sides of the color filter of interest along a first direction are of the same type. Two color filters arranged at a second interval on both sides of the color filter of interest along a second direction that is different from the first direction are of the same type. Among the color filters, at least one type of color filter have a density higher than that of the other types of color filters, thereby realizing acquisition of highly accurate gradient information from a multiband color filter array.

Abstract: An image processing device includes: an image acquisition section that acquires captured image data captured using an image sensor including color filters corresponding to bands, and corresponding to a plurality of frames; an alignment processing section that performs an alignment process on the captured image data to generate integrated captured image data; a reference band selection section that selects a reference band from the bands using an output image in a preceding frame; a reference image generation section that performs an interpolation process on image data included in the integrated captured image data and corresponding to the color filter corresponding to the reference band; and an interpolated image generation section that performs an interpolation process on image data included in the integrated captured image data and corresponding to the color filter corresponding to a band differing from the reference band based on a reference image to generate an interpolated image.

Abstract: An imaging device includes: an image sensor that includes a color filter array in which normal image generation color filters corresponding to three or more bands and correction information generation color filters differing in spectral sensitivity characteristics from the normal image generation color filters are placed in an array; a normal image generation section that generates a normal image in which pixel values of missing pixels are interpolated; a spectral estimation section that performs a spectral estimation process based on pixel values obtained using at least the correction information generation color filters; a correction information generation section that generates correction information that corrects the normal image based on a spectral estimate value; and a corrected image generation section that performs a correction process on the normal image based on the correction information to generate a corrected image.

Abstract: An imaging apparatus has a color filter array, an image sensor, and a differential information acquisition unit. In the color filter array, including five or more types of color filters are arranged in a two dimensional form. The image sensor has a plurality of pixels covered by the color filters, and the plurality of pixels generate pixel signals. The acquisition unit designates one of the pixels covered by the color filters of interest as a pixel of interest one pixel at a time in order. The acquisition unit calculates first differential information based on pixel signals generated by two of the pixels arranged on both sides of the pixel of interest along the first direction. The acquisition unit calculates second differential information based on pixel signals generated by two of the pixels arranged on both sides of the pixel of interest along the second direction.

Abstract: The color filter array 21a comprises seven or more types of color filters including a first color filter. The seven or more types color filters have different spectral sensitivity characteristics. The seven or more types of color filters are arranged in a two-dimensional form. Among the seven or more types of color filters, at least two types of color filters are designated as a color filter of interest. Two color filters arranged at a first interval on both sides of the color filter of interest along a first direction are of the same type. Two color filters arranged at a second interval on both sides of the color filter of interest along a second direction that is different from the first direction are of the same type. Among the color filters, at least one type of color filter have a density higher than that of the other types of color filters, thereby realizing acquisition of highly accurate gradient information from a multiband color filter array.

Abstract: The imaging apparatus includes: a multiband image sensor with a light receiving surface which includes two-dimensional arrays of at least three visible light pixels and an infrared pixels, the visible light pixels having sensitivity in different visible light wavelength ranges, the infrared pixels having sensitivity in the infrared wavelength range; a coded aperture which is disposed on the light receiving surface side of the multiband image sensor and serves as an aperture in a predetermined shape with respect to light in the wavelength range in which the infrared pixel has sensitivity while directly transmitting light in other wavelengths; and a processor for processing an image obtained by the multiband image sensor. The processor generates a depth map based on an image obtained by the multiband image sensor to thereby perform processing of a blurred image.

Abstract: An image pickup apparatus is configured to include an image pickup possibility determination unit to permit a pickup of an image at an exposure when a shutter speed corresponding to that exposure is determined to be equal to or higher than a threshold value, an image pickup setting unit to set the number of images to be picked up at the exposure at which image pickup has been permitted in such a manner that the total number of images that have to be picked up to generate an image signal having a wide dynamic range using image signals obtained at the exposure at which image pickup has been permitted is minimum, a serial image pickup control unit to obtain the number of images set, and an image signal synthesis unit to synthesize the plurality of image signals obtained so as to generate an image signal having a wide dynamic range.

Abstract: An image pickup apparatus is configured to include an image pickup possibility determination unit to permit a pickup of an image at an exposure when a shutter speed corresponding to that exposure is determined to be equal to or higher than a threshold value, an image pickup setting unit to set the number of images to be picked up at the exposure at which image pickup has been permitted in such a manner that the total number of images that have to be picked up to generate an image signal having a wide dynamic range using image signals obtained at the exposure at which image pickup has been permitted is minimum, a serial image pickup control unit to obtain the number of images set, and an image signal synthesis unit to synthesize the plurality of image signals obtained so as to generate an image signal having a wide dynamic range.