Abstract: An image processing apparatus generates an image pertaining to a subject. The apparatus obtains a captured image and asperity information of the subject; generates 3D data of the subject based on the captured image and the asperity information obtained; makes a change instruction to change a form of the 3D data generated; and generates, as the image pertaining to the subject, an image corresponding to the 3D data changed based on the change instruction.

Abstract: A shape information acquisition apparatus, comprises a memory and at least one processor and/or at least one circuit to perform operations of the following units. The acquiring unit is configured to acquire photometric images for which a subject is illuminated from different directions by an illuminance portion and a pattern projection image for which a predetermined light pattern is projected onto the subject by a projection portion. The detection unit configured to detect a position of the illuminance portion based on the pattern projection image. The shape calculation unit configured to calculate shape information for the subject based on the photometric images and the position of the illuminance portion.

Abstract: An apparatus includes an imaging element for obtaining a plurality of parallax images by receiving a plurality of light flux that passes through different areas of a pupil of an optical system by different pixels, and a processor for performing image processing on an image that is obtained by using the imaging element. The processor includes a first obtaining unit that obtains first shape information based on a plurality of photometric stereo images that are shot by using the imaging element in light source conditions that include at least three different light source conditions, a second obtaining unit that obtains second shape information by using the plurality of parallax images, and a third obtaining unit that obtains third shape information by using the first shape information and the second shape information.

Abstract: An image shift amount calculation apparatus comprises: an obtaining unit that obtains a pair of images having parallax; a generation unit that generates, from the pair of images, an image pair for each of a plurality of hierarchal levels having different resolutions; and a calculation unit calculates an image shift amount for an image pair in a predetermined first hierarchal level among the plurality of hierarchal levels, determines, on the basis of the image shift amount in the first hierarchal level, a second hierarchal level, among the plurality of hierarchal levels, where the calculation of the image shift amount is to end, and calculates an image shift amount of the image pair in the second hierarchal level using the image shift amount in the first hierarchal level.

Abstract: A shape information acquisition apparatus, comprises a memory and at least one processor and/or at least one circuit to perform operations of the following units. The acquiring unit is configured to acquire photometric images for which a subject is illuminated from different directions by an illuminance portion and a pattern projection image for which a predetermined light pattern is projected onto the subject by a projection portion. The detection unit configured to detect a position of the illuminance portion based on the pattern projection image. The shape calculation unit configured to calculate shape information for the subject based on the photometric images and the position of the illuminance portion.

Abstract: Provided is a depth detection apparatus for detecting depth information from a first and a second image based on a light flux passing through different pupil regions, the apparatus including an image generator that generates a third and a fourth image by subjecting the first and the second image to a filter, a depth detector that detects depth information from a relative positional shift amount between the third and the fourth image, a representative value acquirer that acquires a representative value of spatial frequencies of the third or the fourth image from a frequency characteristic of the filter, and a confidence determiner that determines confidence for the depth information from the representative value. The confidence is determined as a value representing higher confidence as the representative value is greater.

Abstract: An apparatus includes an imaging element for obtaining a plurality of parallax images by receiving a plurality of light flux that passes through different areas of a pupil of an optical system by different pixels, and a processor for performing image processing on an image that is obtained by using the imaging element. The processor includes a first obtaining unit that obtains first shape information based on a plurality of photometric stereo images that are shot by using the imaging element in light source conditions that include at least three different light source conditions, a second obtaining unit that obtains second shape information by using the plurality of parallax images, and a third obtaining unit that obtains third shape information by using the first shape information and the second shape information.

Abstract: A distance detecting apparatus includes an imaging unit that generates a first image signal and a second image signal and an arithmetic processing unit. The distance detecting apparatus detects the distance to a subject on the basis of an amount of defocus indicating the distance between an imaging plane of the imaging unit and an image forming plane of light fluxes. The arithmetic processing unit executes a first step of calculating an amount of temporary defocus on the basis of the first image signal and the second image signal, a second step of calculating a conversion factor used to convert an amount of image displacement between a first image and a second image into the amount of defocus on the basis of the amount of temporary defocus, and a third step of calculating the amount of defocus by using the conversion factor.

Abstract: A parallax detection device is provided. The device obtains an image pair having parallax; sets a base image in one of images in the image pair; calculates the first and second correlation values of the image pair; and calculates a parallax amount of the image pair using the correlation values. The device calculates the first and second correlation values respectively based on the first and second based images set in one of the images in the image pair, wherein the second base image is set at a position different from the position of the first base image with respect to a prescribed direction.

Abstract: An image shift amount calculation apparatus comprises: an obtaining unit that obtains a pair of images having parallax; a generation unit that generates, from the pair of images, an image pair for each of a plurality of hierarchal levels having different resolutions; and a calculation unit calculates an image shift amount for an image pair in a predetermined first hierarchal level among the plurality of hierarchal levels, determines, on the basis of the image shift amount in the first hierarchal level, a second hierarchal level, among the plurality of hierarchal levels, where the calculation of the image shift amount is to end, and calculates an image shift amount of the image pair in the second hierarchal level using the image shift amount in the first hierarchal level.

Abstract: A depth detection apparatus that detects depth information on a depth to an object on the basis of first and second signals corresponding to first and second pupil regions of an exit pupil, including: a first calculation unit that calculates a first shift amount between the first and second signals; a signal processing unit that generates a corrected signal by performing filter processing on at least one of the first and second signals, the filter processing being performed to relatively displace the first and second signals by a displacement amount corresponding to the first shift amount; and a second calculation unit that calculates a second shift amount between the filtered first and second signals or between signals, one of which is filtered in the filter processing and the other one of which is unfiltered.

Abstract: Provided is a depth detection apparatus for detecting depth information from a first and a second image based on a light flux passing through different pupil regions, the apparatus including an image generator that generates a third and a fourth image by subjecting the first and the second image to a filter, a depth detector that detects depth information from a relative positional shift amount between the third and the fourth image, a representative value acquirer that acquires a representative value of spatial frequencies of the third or the fourth image from a frequency characteristic of the filter, and a confidence determiner that determines confidence for the depth information from the representative value. The confidence is determined as a value representing higher confidence as the representative value is greater.

Abstract: The present invention relates to a distance measuring apparatus including an imaging device and a calculation unit calculating a distance to a subject on the basis of an electrical signal. The imaging device includes a signal acquisition unit that acquires a first electrical signal based on a beam that has passed through a first region off the center of the exit pupil in a predetermined direction; a second electrical signal based on a beam that has passed through a second region off the center of the exit pupil in a direction opposite to the predetermined direction; and a third electrical signal based on a beam that has passed through a region eccentric from the first region in the direction opposite to the predetermined direction. The calculation unit performs a signal correction process for generating a first corrected signal and a distance calculation process for calculating the distance.

Abstract: A depth detection apparatus that detects depth information on a depth to an object on the basis of first and second signals corresponding to first and second pupil regions of an exit pupil, including: a first calculation unit that calculates a first shift amount between the first and second signals; a signal processing unit that generates a corrected signal by perfoiining filter processing on at least one of the first and second signals, the filter processing being performed to relatively displace the first and second signals by a displacement amount corresponding to the first shift amount; and a second calculation unit that calculates a second shift amount between the filtered first and second signals or between signals, one of which is filtered in the filter processing and the other one of which is unfiltered.

Abstract: Provided is a depth detection apparatus having: a shift amount acquisition unit to acquire a provisional image shift amount; a filter processing unit to perform filter processing on one or both of the first and second signal; and a depth deriving unit to derive the depth information on an object, based on a positional shift amount between the filtered first signal and the filtered second signal. A phase term of the filter is a function generated by a second function by a coefficient, wherein the second function is generated based on a phase transfer function corresponding to the first or second pupil region and on the provisional image shift amount, and the coefficient is a real number greater than 0 and smaller than 1.

Abstract: Provided is a depth detection apparatus having: a shift amount acquisition unit to acquire a provisional image shift amount; a filter processing unit to perform filter processing on one or both of the first and second signal; and a depth deriving unit to derive the depth information on an object, based on a positional shift amount between the filtered first signal and the filtered second signal. A phase term of the filter is a function generated by a second function by a coefficient, wherein the second function is generated based on a phase transfer function corresponding to the first or second pupil region and on the provisional image shift amount, and the coefficient is a real number greater than 0 and smaller than 1.

Abstract: A distance detecting device includes a distance calculation unit configured to calculate a distance to a target of imaging based on a first signal corresponding to a luminous flux having passed through a first pupil region of an exit pupil in an imaging optical system, and a second signal corresponding to a luminous flux having passed through a second pupil region different from the first pupil region, and a signal processing unit configured to perform a filtering process on at least one of the first signal and the second signal by using a band pass filter having a lower number of cells in a first direction than a number of cells in a second direction perpendicular to the first direction, and a filter for phase correction having a higher number of cells in the first direction than the number of cells in the second direction.

Abstract: An imaging apparatus includes an imaging optical system having an exit pupil and an image sensor having pixels including first and second pixels. Each pixel has high and low sensitivity light receiving sections and a pupil divider. Each of the first pixels is arranged near one of the second pixels. The pupil divider guides light from a part of the exit pupil of the imaging optical system to the high or low sensitivity light receiving section in a first pixel and guides light from another part of the exit pupil to the high or low sensitivity light receiving section in the neighboring second pixel. The positional relation between the high and low sensitivity light receiving sections relative to the center in a pixel is mutually inverted in the pupil dividing direction between a first pixel and the neighboring second pixel.

Abstract: An imaging device for photoelectric conversion includes a plurality of pixels receiving light fluxes from an exit pupil of an optical system. At least part of the pixels are ranging pixels, each including a plurality of photoelectric conversion sections configured to receive light fluxes from a plurality of pupil areas in the exit pupil and a waveguide formed by a core and a clad that guides the light fluxes to the photoelectric conversion section. At least some of the ranging pixels include respective attenuating members arranged in the clad at a position opposite to the photoelectric conversion sections corresponding to pupil areas containing a large number of light fluxes representing a large angle relative to the normal at the pixel center of the ranging pixel having the attenuating member with regard to the pupil division direction on the ranging pixel corresponding to the displacement direction of the pupil areas.

Abstract: Provided is a ranging apparatus or the like capable of high-accuracy ranging. The image sensor, comprising multiple pixels, wherein the pixels comprises a ranging pixel including a light collecting member, a waveguide, and first and second photoelectric conversion units, wherein: the first and second units are arranged along a first direction; when a region decentered from a center of pupil in a second direction opposite to the first direction is a first pupil region, a region decentered in the first direction is a second pupil region, a region located in the second direction is a first region, and a region located in the first direction is a second region, the collecting member collects lights passed through the first and second pupil regions to the second and first regions; and the waveguide guides lights collected in the second and first regions toward the first and second units.