Abstract: When a first noise and second noise to be generated after the first noise are generated within a predetermined period, a noise reduction unit is controlled so as to execute a first noise reduction process for an audio signal in a period including the first noise and not to execute the first noise reduction process for an audio signal in a period including the second noise.

Abstract: An image generation method is provided for generating an output image from an input image acquired by an image sensor that has an array of multiple pixels, each of which has arranged therein multiple sub-pixels that each receive a light beam that passes through a different pupil sub-area of an imaging optical system. The method includes a step of generating multiple parallax images that respectively correspond to the different pupil sub-areas; a step of generating multiple pixel shifted images by performing different shifting for each of the parallax images according to a virtual image forming plane of the imaging optical system; and a step of generating an output image that has a higher resolution than the resolution of the parallax images from the pixel shifted images through composition processing.

Abstract: A processor combines a first predicted signal generated based on an audio signal in an interval preceding a noise detection interval, and a second predicted signal generated based on an audio signal in an interval succeeding the noise detection interval, based on the ratio between the periodicity of the audio signal in the interval preceding the noise detection interval, and the periodicity of the audio signal in the interval succeeding the noise detection interval. The processor replaces the audio signal in the noise detection interval with the combined signal.

Abstract: An image pickup apparatus which can perform an AF of a high speed and a high focusing precision by simultaneously realizing a phase difference AF and a contrast AF, decides arrange where a contrast evaluation can be performed on the basis of a correspondence relation between each pixel of an image pickup element which is restricted by pupil division means provided for restricting light of an optical image of an object which enters each pixel of the image pickup element to light from a specific exit pupil area of a photographing lens and the specific exit pupil area of the photographing lens, and decides a focus evaluation value of the object in accordance with the decided range from a contrast focus position or a correlation focus position.

Abstract: An audio processing apparatus including: an obtaining unit configured to obtain audio signals; and a processor configured to process the audio signals, wherein if it is not determined that the audio signals contain an abnormal value, the processor calculates a next sample value based on a predetermined number of sample values of the audio signals obtained by the obtaining unit, and wherein if it is determined that the audio signals contain an abnormal value, the processor uses the calculated next sample value so as to calculate a further next sample value.

Abstract: An audio processing apparatus includes an acquisition unit configured to acquire an audio signal, and an audio processing unit configured to reduce noise contained in the audio signal, wherein the audio processing unit complements an audio signal in a section containing noise of the audio signal with a signal generated based on an audio signal in a predetermined section before the section containing noise and an audio signal in a predetermined section after the section containing noise, and wherein, in a case where noise is contained in one of the audio signal in the predetermined section before the section containing noise and the audio signal in the predetermined section after the section containing noise, the audio processing unit complements the audio signal in the section containing noise with a signal generated based on the audio signal in a noise-free section.

Abstract: An image processing apparatus obtains an image signal of an image pickup element having a pupil division unit that restricts light of an optical image of an object arriving at each pixel of the element to light from a specific pupil area of a photographing lens. A memory unit stores information of a pixel defect of the element. An image shift unit determines a shift amount of the image signal of the photographed object corresponding to an image re-formation plane for every pupil area, to shift the image signal on the basis of the plane. A defect correction unit corrects an image signal of a defective pixel using the shifted image signal of a pixel other than the defective pixel, in accordance with the information of the pixel defect. An image re-formation unit re-forms an image corresponding to the image re-formation plane from the corrected image signal.

Abstract: An information processing apparatus obtains information of a plurality of viewpoints corresponding to images in which a same subject is captured. Then the apparatus detects a region of interest within a captured range including the subject, and displays, on a display medium, an image corresponding to a display viewpoint selected as a viewpoint corresponding to the region of interest from among the plurality of viewpoints.

Abstract: An image pickup element of an image pickup apparatus photoelectrically converts an optical image of an object to be photographed, and outputs an image signal of the photographed object. A memory unit stores information of a pixel defect of the image pickup element and information for determining an angle of incidence of the optical image arriving at each pixel of the image pickup element. A setting unit sets an image re-formation plane on which an image is re-formed from the image signal of the photographed object. A pupil division unit restricts light of the optical image of the object arriving at each pixel of the image pickup element to a light from a specific pupil area of the photographing lens. An image shift unit determines a shift amount of the image signal corresponding to the image re-formation plane for every pupil area, to shift the image signal.

Abstract: An image pickup apparatus which is capable of obtaining a high-quality image at high speed even when frame rate is high. A frame rate control unit controls frame rate for the shooting. An image decimation unit samples a plurality of images at predetermined time intervals and selects at least two images among the plurality of images as decimation images. A moving vector detection unit detects a moving vector indicative of a moving direction and a moving amount of a subject between the decimation images. A decimation control unit changes decimation conditions according to an absolute value of the moving vector output from the moving vector detection unit. A synthesizing unit aligns the plurality of images based on the output from the moving vector detection unit and then synthesizes the aligned plurality of images to obtain the composite image.

Abstract: An audio processing apparatus includes a first microphone, a second microphone, and a masking unit configured to mask movement of air from outside of the apparatus to the second microphone. A filter coefficient is estimated and learned so as to minimize the difference between the output signal of the first microphone and the output signal of the second microphone, thereby suppressing a reverberation component generated in the closed space between the masking unit and the second microphone out of the output signal of the second microphone.

Abstract: An image pickup apparatus which can perform an AF of a high speed and a high focusing precision by simultaneously realizing a phase difference AF and a contrast AF, decides arrange where a contrast evaluation can be performed on the basis of a correspondence relation between each pixel of an image pickup element which is restricted by pupil division means provided for restricting light of an optical image of an object which enters each pixel of the image pickup element to light from a specific exit pupil area of a photographing lens and the specific exit pupil area of the photographing lens, and decides a focus evaluation value of the object in accordance with the decided range from a contrast focus position or a correlation focus position.

Abstract: An imaging apparatus includes an image sensor including a microlens array between an imaging optical system and a plurality of pixels and configured to receive a light flux from each of microlenses in the microlens array at the plurality of pixels to output an image signal, and a generation unit configured to select, among a plurality of pixel signals obtained at different viewpoints corresponding to a subject in the image signal from the image sensor, the pixel signal based on the brightness of the pixel signal serving as a reference and positions of the pixels at which the plurality of pixel signals are output relative to each of the microlenses, to generate an output image.

Abstract: An image pickup apparatus which can perform an AF of a high speed and a high focusing precision by simultaneously realizing a phase difference AF and a contrast AF, decides a range where a contrast evaluation can be performed on the basis of a correspondence relation between each pixel of an image pickup element which is restricted by pupil division means provided for restricting light of an optical image of an object which enters each pixel of the image pickup element to light from a specific exit pupil area of a photographing lens and the specific exit pupil area of the photographing lens, and decides a focus evaluation value of the object in accordance with the decided range from a contrast focus position or a correlation focus position.

Abstract: The imaging apparatus has: a first exposure mode in which an exposure condition is determined based on pixel data generated by photoelectrically converting, by a plurality of pixels, light rays entering through a pupil division unit, a state of vignetting of the photographing optical system is determined based on information about a construction of a photographing optical system, and an exposure condition is determined based on the pixel data selected from the pixel data generated in accordance with the vignetting state; and a second exposure mode in which an exposure condition is determined based on data obtained by adding the generated pixel data with respect to the exit pupil area of the photographing lens.

Abstract: A controller controls a first changing unit to intermittently drive an optical unit of an image pick-up unit, and while the image pick-up parameter is being changed, reduces the noise based on an audio signal obtained by a microphone unit in a period before or after a period the optical unit is being driven.

Abstract: An audio processing apparatus includes first and second audio pickup units. The second audio pickup unit includes an audio resistor provided to cover a sound receiving portion to suppress external wind introduction while passing an external audio. A first filter attenuates a signal having a frequency lower than a first cutoff frequency of the output signal of a first A/D converter. A second filter attenuates a signal having a frequency higher than a second cutoff frequency of the output signal of a second A/D converter. A third filter is provided between the first audio pickup unit and the first A/D converter to attenuate a signal having a frequency lower than a third cutoff frequency for suppressing the wind noise.

Abstract: An image generation method is provided for generating an output image from an input image acquired by an image sensor that has an array of multiple pixels, each of which has arranged therein multiple sub-pixels that each receive a light beam that passes through a different pupil sub-area of an imaging optical system. The method includes a step of generating multiple parallax images that respectively correspond to the different pupil sub-areas; a step of generating multiple pixel shifted images by performing different shifting for each of the parallax images according to a virtual image forming plane of the imaging optical system; and a step of generating an output image that has a higher resolution than the resolution of the parallax images from the pixel shifted images through composition processing.

Abstract: An audio processing device including a first audio collecting unit configured to convert an audio vibration into an electric signal and acquire an audio signal includes a shielding unit having a predetermined resonant frequency that shields the first audio collecting unit from an influence of airflow outside the device; and an acquiring unit configured to acquire, as a first audio signal, an audio signal in a predetermined frequency band lower than the resonant frequency of the shielding unit from among the audio signal acquired by the first audio collecting unit that is shielded from the influence of the air flow outside the device by the shielding unit.

Abstract: A control unit controls a driving unit to drive an optical system in a first driving mode and controls a sound processing unit to process a sound signal in a first noise reduction processing mode in the case where a level of the sound signal obtained by a sound obtaining unit is lower than a predetermined level. The control unit controls the driving unit to drive the optical system in a second driving mode with a longer driving time than the first driving mode and controls the sound processing unit not to process the sound signal in the first noise reduction processing mode in the case where the level of the sound signal obtained by the sound obtaining unit is equal to or higher than the predetermined level.