Abstract: An imaging apparatus comprising: an imaging device having a first imaging unit configured to generate an image having a first spectral characteristic and a second imaging unit configured to generate an image having a second spectral characteristic, a calculation unit configured to calculate a first exposure time appropriate for an image having the first spectral characteristic and a second exposure time appropriate for an image having the second spectral characteristic, a control unit configured to, in a case where the first exposure time is longer than the second exposure time, perform first image capture with the second exposure time to generate a first image having the first spectral characteristic and a second image having the second spectral characteristic, and perform second imaging with an exposure time corresponding to a difference between the first exposure time and the second exposure time to generate a third image having the first spectral characteristic, and a combining unit configured to combine

Abstract: An image pickup apparatus includes an image sensor, a memory device, and a processor. The image sensor includes first pixels and second pixels that are arranged two-dimensionally and that respectively receive visible light and invisible light entering through an image pickup optical system. Each of the first pixels and the second pixels has photoelectric conversion elements that receive light beams passing through different pupil areas of the image pickup optical system. The memory device stores instructions. The processor executes the instructions to detect focus detection results from signals output from the first pixels and signals output from the second pixels, determine a lens position of the image pickup optical system based on the focus detection results, and determine an exposure condition of a time of image pickup with the image sensor according to the focus detection results.

Abstract: An image processing apparatus includes one or more processors, and a memory storing instructions which, when the instructions are executed by the one or more processors, cause the image processing apparatus to function as an acquisition unit configured to acquire image signals from an image capturing element in which a plurality of pixels that receive rays of light having passed through different pupil areas of an image forming optical system is arrayed, a combining unit configured to, based on the image signals acquired by the acquisition unit, combine virtual objects with the respective image signals corresponding to the different pupil areas to generate a pair of mixed reality images, and a focus adjustment unit configured to adjust a lens position of the image forming optical system based on an image defocus amount between the pair of mixed reality images.

Abstract: An image processing apparatus includes one or more processors, and a memory storing instructions which, when the instructions are executed by the one or more processors, cause the image processing apparatus to function as an acquisition unit configured to acquire image signals from an image capturing element in which a plurality of pixels that receive rays of light having passed through different pupil areas of an image forming optical system is arrayed, a combining unit configured to, based on the image signals acquired by the acquisition unit, combine virtual objects with the respective image signals corresponding to the different pupil areas to generate a pair of mixed reality images, and a focus adjustment unit configured to adjust a lens position of the image forming optical system based on an image defocus amount between the pair of mixed reality images.

Abstract: An image processing apparatus obtains image data and transmits the image data to an external apparatus. The image processing apparatus applies first image processing to the image data and receives a result of second image processing applied in the external apparatus to a part of the image data corresponding to a partial area of an entire image represented by the image data, prior to receiving a result of the second image processing applied in the external apparatus to the entirety of the image data corresponding to the entire image. The image processing apparatus, when causing a display apparatus to display the image data that has been transmitted to the external apparatus, causes the display apparatus to display the image data along with an indicator indicating a status of the second image processing being applied to the image data in the external apparatus.

Abstract: A CPU of an image capturing apparatus acquires a motion amount of a target including a virtual object and performs exposure control based on the acquired motion amount. The CPU captures an image of a real space using the exposure control. The CPU combines the captured image of the real space with an image of the virtual object to generate a mixed reality image.

Abstract: An imaging apparatus comprises an imaging element configured to have a plurality of photoelectric conversion units for each of a plurality of pixels arranged in a row direction and a column direction; at least one processor and memory holding a program which makes the processor function as: an acquisition unit configured to acquire an imaging signal based on a light beam that has passed through the entire pupil region of an imaging optical system and a first image signal based on a light beam that has passed through a part of the pupil region of the imaging optical system from the pixels; and a calculation unit configured to calculate a phase difference by using the imaging signal and the first image signal, wherein the calculation unit calculates the phase difference based on the first image signal and the imaging signal in the row that is the same as the first image signal or a neighboring row of the first image signal.

Abstract: An image processing apparatus obtains image data and transmits the image data to an external apparatus. The image processing apparatus applies first image processing to the image data and receives a result of second image processing applied in the external apparatus to a part of the image data corresponding to a partial area of an entire image represented by the image data, prior to receiving a result of the second image processing applied in the external apparatus to the entirety of the image data corresponding to the entire image. The image processing apparatus, when causing a display apparatus to display the image data that has been transmitted to the external apparatus, causes the display apparatus to display the image data along with an indicator indicating a status of the second image processing being applied to the image data in the external apparatus.

Abstract: An imaging apparatus comprises an imaging element configured to have a plurality of photoelectric conversion units for each of a plurality of pixels arranged in a row direction and a column direction: at least one processor and memory holding a program which makes the processor function as: an acquisition unit configured to acquire an imaging signal based on a light beam that has passed through the entire pupil region of an imaging optical system and a first image signal based on a light beam that has passed through a part of the pupil region of the imaging optical system from the pixels; and a calculation unit configured to calculate a phase difference by using the imaging signal and the first image signal, wherein the calculation unit calculates the phase difference based on the first image signal and the imaging signal in the row that is the same as the first image signal or a neighboring row of the first image signal.

Abstract: An image processing apparatus includes a system controlling unit including a processor and a memory, the system controlling unit being configured to load and to execute an operation control program stored in the memory. The system controlling unit and the memory are configured to acquire light field data, including a plurality of divided image data, to perform an image processing including color correction processing to each of the plurality of divided image data, and to form image data by combining pixel signals of the plurality of the divided image data. Depths of field of the plurality of divided image data are deeper than those of the formed image data. The system controlling unit controls operation to perform the image processing and to form the image using the processed plurality of divided image data.

Abstract: An image pickup apparatus, including: a compression unit configured to perform compression processing on image data; an expansion unit configured to perform expansion processing on the image data that has been subjected to the compression processing based on a coding parameter used for the compression processing on the image data; and a processing unit configured to perform autofocus processing based on the image data that has been subjected to the expansion processing, the autofocus processing being adaptively performed based on the coding parameter.

Abstract: An image processing apparatus for processing imaging data, which is capable of generating a plurality of recomposed images respectively in focus at different subject distances, the image processing apparatus including an acquisition unit configured to acquire time-series imaging data capable of generating the recomposed image; a focal plane determination unit configured to determine a position of a focal plane in processing for generating the recomposed image; and a generation unit configured to generate recomposed-image data at the position of the focal plane determined by the focal plane determination unit, wherein the focal plane determination unit determines the position of the focal plane in the processing for generating the recomposed image based on the positions of the focal plane respectively corresponding to the time-series imaging data on which the processing for generating the recomposed image is to be performed.

Abstract: A focus detection apparatus performs focus detection of a phase difference method by using signals from an image pickup element including a first pixel and a second pixel sharing one micro lens, and the focus detection apparatus includes a first saturation detector configured to detect saturation of a first signal obtained from the first pixel, a second saturation detector configured to detect saturation of a second signal obtained from the second pixel, a luminance generating portion configured to generate luminance signals of the first signal and the second signal after detecting the saturations of the first signal and the second signal are detected, and a processor configured to perform a correlation calculation based on the luminance signals.

Abstract: An image pickup apparatus, including: a compression unit configured to perform compression processing on image data; an expansion unit configured to perform expansion processing on the image data that has been subjected to the compression processing based on a coding parameter used for the compression processing on the image data; and a processing unit configured to perform autofocus processing based on the image data that has been subjected to the expansion processing, the autofocus processing being adaptively performed based on the coding parameter.

Abstract: The present invention provides an image processing apparatus that can prevent incorrect correction of an image, which originates in blurring, in image processing of a re-focus image. The image processing apparatus includes: a data acquiring unit which acquires light field data formed by an imaging unit having a pupil dividing function of an exit pupil of an imaging optical system for forming an optical image of an object; an image processing unit which performs a set image processing of image data; an image forming unit which forms the image data to be subjected to the set image processing, using the light field data; and a control unit which controls the image processing unit, to perform the set processing of the image data formed, to form the light field data corrected according to the predetermined image processing.

Abstract: An image processing apparatus for processing imaging data, which is capable of generating a plurality of recomposed images respectively in focus at different subject distances, the image processing apparatus including an acquisition unit configured to acquire time-series imaging data capable of generating the recomposed image; a focal plane determination unit configured to determine a position of a focal plane in processing for generating the recomposed image; and a generation unit configured to generate recomposed-image data at the position of the focal plane determined by the focal plane determination unit, wherein the focal plane determination unit determines the position of the focal plane in the processing for generating the recomposed image based on the positions of the focal plane respectively corresponding to the time-series imaging data on which the processing for generating the recomposed image is to be performed.

Abstract: A focus detection apparatus which is capable of estimating each of signals from a plurality of split PDs, which are included in a sum signal from split PDs, by performing a computation to thus detect saturation with respect to each split PD. With respect to each unit pixel cell having a plurality of PDs sharing one micro lens, saturation of a pixel signal read out in a non-destructive manner from one of the PDs is detected. Based on a first luminance signal and a sum pixel signal obtained by summing signals output from the PDs, another pixel signal output from another one of the PDs is estimated. Saturation of the estimated pixel signal is detected, and a second luminance signal is generated. Based on the first and second luminance signals, the amount of defocus for an optical unit is calculated.

Abstract: A focus detection apparatus performs focus detection of a phase difference method by using signals from an image pickup element including a first pixel and a second pixel sharing one micro lens, and the focus detection apparatus includes a first saturation detector configured to detect saturation of a first signal obtained from the first pixel, a second saturation detector configured to detect saturation of a second signal obtained from the second pixel, a luminance generating portion configured to generate luminance signals of the first signal and the second signal after detecting the saturations of the first signal and the second signal are detected, and a processor configured to perform a correlation calculation based on the luminance signals.

Abstract: A focus detection apparatus which is capable of estimating each of signals from a plurality of split PDs, which are included in a sum signal from split PDs, by performing a computation to thus detect saturation with respect to each split PD. With respect to each unit pixel cell having a plurality of PDs sharing one micro lens, saturation of a pixel signal read out in a non-destructive manner from one of the PDs is detected. Based on a first luminance signal and a sum pixel signal obtained by summing signals output from the PDs, another pixel signal output from another one of the PDs is estimated. Saturation of the estimated pixel signal is detected, and a second luminance signal is generated. Based on the first and second luminance signals, the amount of defocus for an optical unit is calculated.