Abstract: An image sensor (IS) includes a plurality of pixel blocks (PB) to which colors different from each other are assigned. Each of the plurality of pixel blocks (PB) includes a plurality of pixels (PX). The plurality of pixels PX provided in at least one pixel block (PB) among the plurality of pixel blocks (PB) includes one or more anomalous pixels (UPX). The anomalous pixel (UPX) detects light of one or more colors assigned to the other one or more pixel blocks (PB).

Abstract: An electronic device (10) includes a display unit (11), an imaging unit (12), and a control unit (132). The display unit (11) has a first display area and a second display area having a smaller pixel area than the first display area. The imaging unit (12) captures an image by receiving light through the second display area. When displaying an image based on an image signal acquired by the imaging unit (12) on the display unit, the control unit (132) processes at least one of an image signal corresponding to the second display area and an image signal corresponding to a surrounding area adjacent to the second display area.

Abstract: Provided imaging control apparatus effectively avoid image capturing competition in a scene in which a large number of infrared cameras capture images. The imaging control apparatus includes an image acquisition unit that acquires an infrared image generated by an infrared camera imaging reflected light of emitted infrared rays; and a control unit that controls a setting for the generation of the infrared image on the basis of a control parameter transmitted to another apparatus or received from another apparatus via a communication interface.

Abstract: A pixel addition processing unit 35 adds pupil division pixel signals with a plurality of different addition patterns in pupil units to generate a pixel addition image for each addition pattern. Further, the pixel addition processing unit 35 may use a pupil division pixel signal in which a sensitivity difference between pupil division pixels has been corrected, and the addition pattern may be set on the basis of image characteristic information calculated by using the pupil division pixel signal. A super-resolution processing unit 36 performs super-resolution processing using a pixel addition image signal generated for each addition pattern by the pixel addition processing unit 35 to generate an image signal with a higher resolution than that of the pixel addition image signal. A high-resolution image can be generated using pupil division.

Abstract: An imaging element of an imaging unit 24 divides the exit pupil of an imaging optical system 21 into a plurality of regions and generates a pixel signal for each region. An optical axis position adjustment unit 23 adjusts the optical axis position of the imaging optical system with respect to the imaging element. A control unit 26 calculates a parallax on the basis of the pixel signal for each region after the pupil division and performs focus control of the imaging optical system 21. The control unit 26 also moves the optical axis position using the optical axis position adjustment unit 23, and generates, using the imaging element, pixel signals indicating the same subject region in the plurality of regions after the pupil division. An image processing unit 25 performs binning of a plurality of pixel signals indicating the same subject region generated by moving the optical axis position to generate a high-resolution captured image.

Abstract: An image sensor (IS) includes a plurality of pixel blocks (PB) to which colors different from each other are assigned. Each of the plurality of pixel blocks (PB) includes a plurality of pixels (PX). The plurality of pixels PX provided in at least one pixel block (PB) among the plurality of pixel blocks (PB) includes one or more anomalous pixels (UPX). The anomalous pixel (UPX) detects light of one or more colors assigned to the other one or more pixel blocks (PB).

Abstract: An information processing apparatus (IP1) includes a depth information extraction unit (DIE1) and a processing unit (IMP). The depth information extraction unit (DIE1) can extract depth information from a plurality of pieces of infrared image information included in a plurality of pieces of image data. The plurality of pieces of image data is image data captured from a plurality of viewpoints. Each of the plurality of pieces of image data includes visible light image information and infrared image information. Based on the depth information, the processing unit (IMP) processes the visible light image generated using the visible light image information included in at least one piece of image data among the plurality of pieces of image data.

Abstract: There is provided an imaging device (10) including: an imaging module (100) including an image sensor (130) in which a plurality of pixels for converting light into an electric signal is arranged; a drive unit (140) that moves a part of the imaging module in a manner that the image sensor can sequentially acquire a reference image under a predetermined pixel phase, a plurality of generation images, and a detection image under the predetermined pixel phase in this order; and a detection unit (220) that detects a moving subject based on a difference between the reference image and the detection image.

Abstract: An imaging element of an imaging unit 24 divides the exit pupil of an imaging optical system 21 into a plurality of regions and generates a pixel signal for each region. An optical axis position adjustment unit 23 adjusts the optical axis position of the imaging optical system with respect to the imaging element. A control unit 26 calculates a parallax on the basis of the pixel signal for each region after the pupil division and performs focus control of the imaging optical system 21. The control unit 26 also moves the optical axis position using the optical axis position adjustment unit 23, and generates, using the imaging element, pixel signals indicating the same subject region in the plurality of regions after the pupil division. An image processing unit 25 performs binning of a plurality of pixel signals indicating the same subject region generated by moving the optical axis position to generate a high-resolution captured image.

Abstract: A pixel addition processing unit 35 adds pupil division pixel signals with a plurality of different addition patterns in pupil units to generate a pixel addition image for each addition pattern. Further, the pixel addition processing unit 35 may use a pupil division pixel signal in which a sensitivity difference between pupil division pixels has been corrected, and the addition pattern may be set on the basis of image characteristic information calculated by using the pupil division pixel signal. A super-resolution processing unit 36 performs super-resolution processing using a pixel addition image signal generated for each addition pattern by the pixel addition processing unit 35 to generate an image signal with a higher resolution than that of the pixel addition image signal. A high-resolution image can be generated using pupil division.

Abstract: Provided is an image processing device that includes a wide image capturing unit which captures an image of a wide viewing angle, a tele image capturing unit which captures an image of a narrow viewing angle, and an image processing unit which receives an input of the captured images of the respective imaging units and executes signal processing. In a case where a wide conversion lens is attached to the tele image capturing unit, the image processing unit executes any one of a high-sensitivity image generation processing, a HDR image generation processing, or a high-resolution image generation processing based on the captured images of the wide image capturing unit and the tele image capturing unit according to a situation at the time of imaging with a wide conversion lens attachment detection unit which detects whether the wide conversion lens is attached.

Abstract: Provided are a signal processing apparatus, a signal processing method, and an imaging apparatus for estimating depth with a high degree of accuracy from video signals of a plurality of cameras. The signal processing apparatus includes a detection unit that detects depth from video captured by a plurality of cameras, an estimation unit that estimates camera motion by detecting a camera position, a prediction unit that predicts present depth from camera motion and depth obtained previously, and a synthesis unit that synthesizes depth detected by the detection unit and depth predicted by the prediction unit on the basis of a result of estimating the amount of blur that occurs in each image captured by cameras. The amount of blur can be estimated using camera motion, previous depth information, and shutter time.

Abstract: An apparatus and a method that perform a false color correction according to image characteristics of a color image in units of image regions are provided. Included therein is an image processor that receives inputs of a color image and a white (W) image photographed by a W array imaging element whose all pixels are placed in a white (W) pixel array and executes an image process that reduces false colors included in the color image. Together with a frequency-corresponding parameter calculation unit that receives an input of the white (W) image and calculates a frequency-corresponding parameter in units of image regions, and a positional deviation-corresponding parameter calculation unit that receives inputs of the white (W) image and the color image and calculates a positional deviation-corresponding parameter of the two input images in units of image regions, the image processor executes a blending process and calculates a corrected pixel value.

Abstract: To realize a device and a method capable of generating a high-quality image similar to that of a same viewing angle compound eye camera by using captured images of a tele/wide compound eye camera. A wide image capturing unit which captures an image of a wide viewing angle, a tele image capturing unit which captures an image of a narrow viewing angle, and an image processing unit which receives an input of the captured images of the respective imaging units and executes signal processing are included.

Abstract: Provided are an apparatus and a method for generating accurate distance information of a subject. The apparatus has an image processing unit which inputs a first image constituted by a visible light component and a second image including a visible light component and an infrared light component to calculate a subject distance, in which an image processing unit calculates two distance information of a TOF distance, which is the subject distance calculated according to a TOF system by utilizing the second image, and a stereo distance calculated according to a stereo system by utilizing the first image and the second image, determines TOF distance reliability indicating reliability of the TOF distance, and generates, as final distance information, the stereo distance, which is the subject distance according to the stereo system, or distance information calculated by synthesis processing of the TOF distance and the stereo distance, for a pixel region in which the reliability of the TOF distance is low.

Abstract: Provided are a signal processing apparatus, a signal processing method, and an imaging apparatus for estimating depth with a high degree of accuracy from video signals of a plurality of cameras. The signal processing apparatus includes a detection unit that detects depth from video captured by a plurality of cameras, an estimation unit that estimates camera motion by detecting a camera position, a prediction unit that predicts present depth from camera motion and depth obtained previously, and a synthesis unit that synthesizes depth detected by the detection unit and depth predicted by the prediction unit on the basis of a result of estimating the amount of blur that occurs in each image captured by cameras. The amount of blur can be estimated using camera motion, previous depth information, and shutter time.

Abstract: There is provided an imaging apparatus and an imaging method, and an image processing apparatus and an image processing method each capable of capturing a high resolution image by effectively using respective pixel signals of a plurality of pixels defined by pupil division immediately below a microlens. A disparity is detected in units of pupil on the basis of respective pixel values of a plurality of divided pixels defined by pupil division. The pixel values of the plurality of divided pixels are added in units of pupil to obtain an added pixel value. The pixel value of the divided pixel and the added pixel value are blended in units of divided pixel in accordance with the disparity. The present disclosure is applicable to an imaging apparatus.

Abstract: On the basis of a first imaging signal corresponding to a first viewpoint and including white pixels and color component pixels and a second imaging signal corresponding to a second viewpoint different from the first viewpoint and including fewer white pixels than the first imaging signal to increase a rate of the color component pixels in the second imaging signal, a parallax detecting section detects a parallax of the second viewpoint with respect to the first viewpoint. A parallax compensating section performs parallax compensation for the imaging signal for the second viewpoint on the basis of the detected parallax to generate a parallax-compensated color difference signal for the first viewpoint. A fallback determining section and a signal selecting section selects a parallax-compensated second color difference signal or a color difference signal for the first viewpoint to obtain a high-sensitivity captured image while suppressing degradation of the image quality performance.

Abstract: An apparatus and a method that perform a false color correction according to image characteristics of a color image in units of image regions are provided. Included therein is an image processor that receives inputs of a color image and a white (W) image photographed by a W array imaging element whose all pixels are placed in a white (W) pixel array and executes an image process that reduces false colors included in the color image. Together with a frequency-corresponding parameter calculation unit that receives an input of the white (W) image and calculates a frequency-corresponding parameter in units of image regions, and a positional deviation-corresponding parameter calculation unit that receives inputs of the white (W) image and the color image and calculates a positional deviation-corresponding parameter of the two input images in units of image regions, the image processor executes a blending process and calculates a corrected pixel value.

Abstract: With a wide angle-of-view image acquired by an image pickup unit 21-1 as a reference, a signal processing unit 30 performs super-resolution processing by using a plurality of narrow angle-of-view images acquired by an image pickup unit 21-2 that uses a lens having a higher MTF (Modulation Transfer Function) than the image pickup unit 21-1. A control unit 60 controls the signal processing unit 30 so as to select an image having a range of angle of view according to a zoom magnification indicated by user's operation from the image subjected to the super-resolution processing. In the super-resolution processing, according to a detection result of parallax from a narrow angle-of-view image and the wide angle-of-view image acquired at the same time and a motion detection result for each of the plurality of narrow angle-of-view images, parallax compensation and motion compensation are performed on the plurality of narrow angle-of-view images.