Abstract: An information processing apparatus is configured to provide imaging assisting information for an object to a user of an image pickup apparatus to collect images for generating a three-dimensional model of the object. The information processing apparatus includes a memory storing instructions, and a processor configured to execute the instructions to acquire object information including an image of the object, acquire a provisional three-dimensional model including an uncaptured part of the object upon inputting of the object information, calculate imaging range information including position-posture of the image pickup apparatus with respect to the object for the acquired image of the object and including a view angle range with respect to the object for the image of the object, and generate the imaging assisting information for the object based on the imaging range information.

Abstract: An image processing apparatus comprises: an acquisition unit that acquires a plurality of different viewpoint images obtained by shooting a same scene from different viewpoints, and acquires at least one parallax image pair having parallax by pupil division; a first generator that generates a first distance image from the parallax image pair; a second generator that generates a second distance image from the plurality of different viewpoint images; and an integrator that integrates the first distance image and the second distance image and generates an integrated distance image.

Abstract: There is provided an image capturing apparatus comprising an image sensor that outputs a plurality of parallax images in a single instance of shooting, the parallax images having different viewpoints. A shooting control unit carries out, using the image sensor, first shooting and a plurality of instances of second shooting. The plurality of instances of second shooting is carried out under a shooting condition in which a depth of field is shallower than in the first shooting. A generating unit generates a plurality of range images corresponding to the plurality of instances of second shooting. A detection unit detects an amount of positional skew, relative to a first image generated through the first shooting, of each of a plurality of second images generated through the plurality of instances of second shooting.

Abstract: There is provided an image capturing apparatus comprising an image sensor that outputs a plurality of parallax images in a single instance of shooting, the parallax images having different viewpoints. A shooting control unit carries out, using the image sensor, first shooting and a plurality of instances of second shooting. The plurality of instances of second shooting is carried out under a shooting condition in which a depth of field is shallower than in the first shooting. A generating unit generates a plurality of range images corresponding to the plurality of instances of second shooting. A detection unit detects an amount of positional skew, relative to a first image generated through the first shooting, of each of a plurality of second images generated through the plurality of instances of second shooting.

Abstract: To provide a distance measuring apparatus, a distance measuring method, and an imaging apparatus that can satisfactorily measure a distance. A distance measuring apparatus includes an imaging unit capable of acquiring a plurality of images having view points different from one another and a controlling unit configured to perform control to acquire the plurality of images with the imaging unit in a state in which a patterned light is projected on any region using a projecting unit disposed in a position optically conjugate to the imaging unit and measure a distance on the basis of the plurality of images acquired by the imaging unit.

Abstract: In an image pickup apparatus, a parallax image acquisition unit acquires data of a plurality of viewpoint images having different viewpoints from an imaging unit. A detection unit detects the amount of change in a position or an attitude of the imaging unit which has generated the data of the plurality of viewpoint images. A calculation unit calculates a correction quantity of a shake correction unit and a mixture ratio of images when an image compositing unit generates a composite image from the plurality of viewpoint images on the basis of the amount of change in a position or an attitude of the image pickup apparatus. The image compositing unit generates a composite image from the plurality of viewpoint images using the calculated mixture ratio. The shake correction unit corrects image shake of the viewpoint images or the composite image according to the calculated correction quantity.

Abstract: In an image pickup apparatus, a parallax image acquisition unit acquires data of a plurality of viewpoint images having different viewpoints from an imaging unit. A detection unit detects the amount of change in a position or an attitude of the imaging unit which has generated the data of the plurality of viewpoint images. A calculation unit calculates a correction quantity of a shake correction unit and a mixture ratio of images when an image compositing unit generates a composite image from the plurality of viewpoint images on the basis of the amount of change in a position or an attitude of the image pickup apparatus. The image compositing unit generates a composite image from the plurality of viewpoint images using the calculated mixture ratio. The shake correction unit corrects image shake of the viewpoint images or the composite image according to the calculated correction quantity.

Abstract: To provide a distance measuring apparatus, a distance measuring method, and an imaging apparatus that can satisfactorily measure a distance. A distance measuring apparatus includes an imaging unit capable of acquiring a plurality of images having view points different from one another and a controlling unit configured to perform control to acquire the plurality of images with the imaging unit in a state in which a patterned light is projected on any region using a projecting unit disposed in a position optically conjugate to the imaging unit and measure a distance on the basis of the plurality of images acquired by the imaging unit.

Abstract: An image processing apparatus includes at least one processor operatively coupled to a memory. A first anti-shake unit executes an anti-shake process on image data relating to a captured image, and to record image data after the anti-shake process on a recording unit. A second anti-shake unit executes a re-anti-shake process while performing a control process of removing influence of the anti-shake process, which adversely affects the re-anti-shake process executed by the second anti-shake unit, executed by the first anti-shake unit on the image data, after the anti-shake process recorded on the recording unit, based on auxiliary information regarding the anti-shake process output by the first anti-shake unit.

Abstract: A control apparatus includes a depth information acquirer (3) which acquires depth information of an object image, a position attitude acquirer (8) which acquires position information or attitude information of an apparatus, and an image processor (7, 9) which generates three-dimensional information based on information relating to an optical vibration-proof state of the apparatus, the depth information, and the position information or the attitude information.

Abstract: An image processing apparatus comprises: an input unit configured to input an image signal obtained by photoelectrically converting, by an image sensor, an optical image incident via an optical system including optical image stabilization unit; an acquisition unit configured to acquire optical image stabilization control information obtained by the optical image stabilization unit; and a motion of camera prediction unit configured to predict a motion of camera based on information obtained by eliminating influence of optical image stabilization by the optical image stabilization unit from the image signal input from the input unit based on the optical image stabilization control information.

Abstract: An image processing apparatus comprises a detection unit configured to detect a main subject from an image captured by an image sensor that captures a subject image, a position detection unit configured to detect a position, on a screen, of the main subject, and a correction unit configured to correct, based on the position of the main subject detected by the detection unit, at least one of a blur and a distortion of an image of a subject other than the main subject, the blur and the distortion occurring due to correction of a blur of an image of the main subject performed by an optical image stabilization unit configured to optically correct a blur, on the screen, of the image of the main subject.

Abstract: An image processing apparatus that is capable of improving image stabilization performance by improving motion vector search performance by restricting a search range even for an image with a large motion due to a camera shake of an image pickup apparatus at a tele-end side of a zoom lens or a shoot while walking at a wide-end side. A motion vector search unit searches for a motion vector of a reference image later input from an image pickup device with respect to a standard image input previously. A control unit sets at least one of a search range and a search position of a motion vector searched by the motion vector search unit based on position-posture change information about the image pickup apparatus detected by a detection unit and image stabilization control information obtained from an image stabilizing unit.

Abstract: A control apparatus includes a depth information acquirer (3) which acquires depth information of an object image, a position attitude acquirer (8) which acquires position information or attitude information of an apparatus, and an image processor (7, 9) which generates three-dimensional information based on information relating to an optical vibration-proof state of the apparatus, the depth information, and the position information or the attitude information.

Abstract: An amount of change between images is calculated based on a motion vector between images obtained by an image sensor and on shake information related to a shake in a rotational direction around at least an axis perpendicular to an optical axis of an imaging optical system. Then, based on a shake correction amount determined based on the shake information and the amount of change, an image obtained by the image sensor is geometrically deformed. The amount of change is a shake component of the image capture apparatus in a direction perpendicular to the optical axis, and is calculated after cancelling at least one of a change between images caused by the shake in the rotational direction included in the shake information and a change between images caused by an influence of a difference between exposure periods of the image sensor.

Abstract: An image capture apparatus has an image sensor and an optical anti-shake mechanism that reduces a shake of a captured image by driving an optical correction element in a different direction from an optical axis of an imaging optical system in accordance with a detected shake. Reference coordinates for geometric deformation processing applied to the captured image are determined based on an amount and direction of a movement of the optical correction element. The geometric deformation processing is applied to the captured image using these reference coordinates and an amount of geometric deformation based on the detected shake. Coordinates of the captured image corresponding to an intersection of the optical axis and the image sensor after the optical correction element is moved through the driving are determined as the reference coordinates.

Abstract: The image processing apparatus includes an area dividing part that divides an input image produced by an image pickup system into plural image areas whose evaluation values are mutually different. The evaluation value is obtained by using a response function of the image pickup system. The apparatus further includes a processing part that performs image processing to produce an output image whose definition is higher than that of the input image by using the response functions different for the respective image areas.

Abstract: An image pickup apparatus capable of detecting a motion vector and selecting a vector search method which enables effects to be always obtained in various usages of a camera, taking into account load balancing with the performance. One input image is set as a reference image, and the other input image is set as a search target image. Using a template having a predetermined size on the reference image, a motion vector is detected from the search target image. A determination index associated with frequency of occurrence of parallax conflict is calculated. When the determination index is not larger than a threshold value, a first detection method using a single layer is selected, whereas when the determination index is larger than the threshold value, a second detection method using a plurality of layers is selected.

Abstract: An image processing apparatus that is capable of improving image stabilization performance by improving motion vector search performance by restricting a search range even for an image with a large motion due to a camera shake of an image pickup apparatus at a tele-end side of a zoom lens or a shoot while walking at a wide-end side. A motion vector search unit searches for a motion vector of a reference image later input from an image pickup device with respect to a standard image input previously. A control unit sets at least one of a search range and a search position of a motion vector searched by the motion vector search unit based on position-posture change information about the image pickup apparatus detected by a detection unit and image stabilization control information obtained from an image stabilizing unit.

Abstract: An image processing apparatus which can increase processing speed, reduce memory access load, and enhance ease of control in image processing. Coordinate computations through different geometric deformations are performed on respective pixels of an input image, thus calculating post-geometric deformation coordinates and coordinate moving vectors. Geometric deformation parameters for geometric deformations are output to a plurality of coordinate computation units connected in series. The coordinate moving vectors are collectively combined together to generate combined coordinate moving vectors, based on which coordinates of pixels in an image to be output are converted into coordinates of the pixels of the input image. The coordinate computations are performed based on the coordinates of the pixels of the input image and the geometric deformation parameters.