Abstract: Various systems and methods for an all-in-focus implementation are described herein. A system to for operating a camera, comprising an image sensor in the camera to capture a sequence of images in different focal planes, at least a portion of the sequence of images occurring before receiving a signal to store an all-in-focus image, a user interface module to receive, from a user, the signal to store an all-in-focus image, and an image processor to fuse at least two images to result in the all-in-focus image, wherein the at least two images have different focal planes.

Abstract: The imaging apparatus has a plurality of pixels each of which has a plurality of photoelectric conversion units; generates a plurality of first combined signals obtained by combining signals based on electric charges of photoelectric conversion units in one side with each other, and a plurality of second signals obtained by combining signals based on electric charges of the plurality of photoelectric conversion units with each other; and outputs a part of the first combined signals out of the plurality of first combined signals.

Abstract: There is provided an image sensor including a normal pixel group composed of a plurality of normal pixels, each of the normal pixels having a photoelectric conversion device for photoelectrically converting an incident light, and a detection pixel configured to detect a light incident from a neighboring pixel by the photoelectric conversion device within an effective pixel area of the normal pixel group.

Abstract: A block-based digital refocusing method includes a capturing step, a dividing step, a selecting step, a refocusing step and a combining step. The capturing step is for capturing at least one picture datum. The dividing step is for dividing the picture datum into a plurality of block data. The selecting step is for defining a regional datum according to each of the block data. The refocusing step is for conducting a refocusing computation to obtain a refocused block datum according to each of the regional data. The combining step is for combining each of the refocused block data based on each of the regional data to form a refocused picture datum.

Abstract: A light field imaging system captures different images provide views that are shifted by sub-pixel amounts relative to one another. These views can be combined to produce a higher resolution digital image of the object.

Abstract: An autofocus device comprising includes a lens drive system for translating a lens, a first in-focus position detector for detecting a first in-focus position while translating the lens in a first direction by the lens drive system and a second in-focus position detector for detecting a second in-focus position while translating the lens in a direction opposite with respect to the first direction by the lens drive system, the second in-focus position detector operating after the first in-focus position is detected. A backlash detector detects a backlash in the lens drive system according to the first and the second in-focus positions.

Abstract: An image pickup apparatus includes an image pickup unit configured to receive an incident light beam from regions of a pupil of an optical system different from each other to output a first image signal and a second image signal, and a calculation unit configured to calculate an evaluation value while relatively shifting the first and second image signals from pixels included in a predetermined range to calculate a defocus amount, and the calculation unit is configured to change a size of the predetermined range so that a center of a visual field range relative to a position of a target pixel does not vary depending on a shift amount between the first and second image signals.

Abstract: The invention relates to a method for determining a static element in images captured by an imaging means mounted on a movable device. The method comprises steps of acquiring a first image and a second image captured by the imaging means. The first image and the second image are captured at capture times separated by a time difference and the method is characterized by the time difference being selected depending on motion parameters of the movable device. A determination measure for corresponding regions of the first and the second image for representing a similarity of the corresponding regions is calculated and a static element of the first and the second image is determined based on the calculated determination measure. An output signal comprising information on the determined static element is generated.

Abstract: A solid-state image pickup device including a lens, a first light receiving element, a second light receiving element, and an element separation area. The first light receiving element is configured to receive light from the lens. The second light receiving element is configured to receive light from the lens. The element separation area is between the first light receiving element and the second light receiving element. The lens has an optical axis, which is offset from a center of the element separation area.

Abstract: Multiframe reconstruction combines a set of acquired images into a reconstructed image. Here, which images to acquire are selected based at least in part on the content of previously acquired images. In one approach, a set of at least three images of an object are acquired at different acquisition settings. For at least one of the images in the set, the acquisition setting for the image is determined based at least in part on the content of previously acquired images. Multiframe image reconstruction is applied to the set of acquired images to synthesize a reconstructed image of the object.

Abstract: An electronic device and a focus adjustment method thereof are provided. The electronic device and the focus adjustment method thereof pre-process the image frames captured to provide focus information of the image frames and adjust the focus according to the focus information. Therefore, as the subject followed or the current scene is out of focus in response to movement of the electronic device, the present invention can immediately obtain the change of focus via the focus information and effectively adjust the focus according to the focus information.

Abstract: A method and an apparatus for detecting and removing a false contour, a method and an apparatus for verifying whether a pixel is included in a contour, and a method and an apparatus for calculating simplicity are provided. The method for detecting and removing the false contour includes: verifying whether a pixel of an input video is included in a contour; calculating simplicity of the pixel; determining whether the pixel is included in a false contour based on the simplicity and based on whether the pixel is included in the contour; and removing the false contour from the input video via smoothing with respect to the false contour.

Abstract: An imaging apparatus with a focus assist (FA) function includes an imager configured to obtain an image signal from a subject formed by a lens, a high-frequency signal extractor configured to extract a high-frequency signal from the image signal, a modulation level calculator configured to determine a magnitude of a modulation level signal in each of regions, into which a screen of the image signal is divided, in accordance with an amplitude level of the high-frequency signal, a level modulator configured to modulate an amplitude level of the high-frequency signal using the modulation level signal to obtain an FA signal, and an FA signal synthesizer configured to synthesize the FA signal with the image signal to output a resultant signal.

Abstract: An imaging apparatus includes an image-capturing element, an optical axis position estimation processor, and a pixel correction unit. The optical axis position estimation processor includes a relationship calculator and an optical axis position calculator. The relationship calculator calculates a relationship between a pixel output of a phase difference detection pixel and an image height. The optical axis position calculator calculates an optical axis position of an optical system. The pixel correction unit corrects pixel outputs of the respective phase difference detection pixels in accordance with the relationship.

Abstract: A focus detection sensor and an image pickup system are provided. The focus detection sensor includes photoelectric conversion units converting light into charges, memory units storing the charges generated by the photoelectric conversion units as pixel signals, transfer units transferring the charges generated by the photoelectric conversion units to the memory units, reset units resetting the photoelectric conversion units and the memory units, a detection unit outputting a first detection signal in accordance with the pixel signals stored in the memory units, and a mode switching determination unit performing switching from a first operation mode in which the transfer units are set to a transfer state in a charge accumulation period after the photoelectric conversion units are reset to a second operation mode in which the transfer units are set to a non-transfer state.

Abstract: The image pickup apparatus includes an imaging optical system to cause light rays from an object plane to image on an image side conjugate plane with respect to the object plane, an image sensor including pixels and to photoelectrically convert the optical image, and an optical element array including optical element cells each of which conjugates the image side conjugate plane with the image sensor and which are arranged so as to cause light rays from a same point on the object plane to enter mutually different pixels depending on positions on a pupil plane of the imaging optical system through which the light rays pass. An arrangement pitch of the optical element cells in the optical element array is 25 times or less of an arrangement pitch of the pixels in the image sensor.

Abstract: Optical systems utilize waveplates to simultaneously encode information for increasing image depth of field and for providing a depth map of the imaged object or sample. These waveplates are configured to result in a focus-invariant point spread function in one focal region, and to result in point spread functions that vary as a function of range within the imaged object in a different focal region. For example, a basic compound microscope might have a specially shaped waveplate inserted at the back aperture plane of the microscope objective to manipulate the phase of the wavefront. An image formed on one side of the plane of best focus is focus invariant, and is brought into focus by a restoring algorithm. An image formed on the other side of the plane of best focus captures point spread functions comprising rings that vary with depth within the imaged object.

Abstract: The image pickup apparatus includes an image sensor operable to generate an image signal, and controller that controls communication with a mounted lens unit including an image taking optical system and generates a drive instruction to drive a focus lens of the mounted lens unit on a basis of a focus signal generated by using the image signal, the focus signal indicating a focus state of the image taking optical system. The controller sends information relating to a predetermined timing and the drive instruction to the lens unit, and receives, from the lens unit, a first signal indicating whether the focus lens is able to be moved by a movement based on the drive instruction to satisfy the predetermined timing.

Abstract: There is provided a control device including a focus control unit configured to perform control so as to sequentially bring multiple subjects within a captured image into focus, and a recording control unit configured to perform control in response to a trigger from a user so as to record, onto a storage medium, captured images of the multiple subjects sequentially brought into focus by the focus control unit.

Abstract: A depth calculation device for calculating depth information on an object from captured first image and second image with different blur, the depth calculation device comprising: an extraction unit configured to extract a first frequency component and a second frequency component from each of the first image and the second image, the first frequency component being a component of a first frequency band, the second frequency component being a component of a second frequency band, the second frequency band being lower than the first frequency band; and a depth calculation unit configured to calculate the depth information from the frequency components extracted by the extraction unit.

Abstract: Before receiving an instruction, an apparatus identifies an object region to be focused by detecting a focus signal while moving a focusing lens. When the instruction is received, the apparatus moves the focusing lens based on the focus signal of the identified object region to be focused to detect a focus signal and perform a focus adjustment for the focusing lens.

Abstract: According to one embodiment, an image processing device includes a shift estimator, and a de-mosaic module. The shift estimator is configured to estimate a shift amount between a first pixel in a first image and a corresponding second pixel in a second image. The first image is taken by a first image pickup apparatus, and the second image is taken by a second image pickup apparatus. A focus position of the first image pickup apparatus is different from a focus position of the second image pickup apparatus. The de-mosaic module is configured to generate a first de-mosaic image by performing de-mosaic processing on each pixel in the first pixel using a pixel value of the corresponding second pixel, when the first pixel is determined to be in a state of in-focus based on the shift amount.

Abstract: An apparatus and a method for performing an Auto Focus (AF) function in an electronic device which does not perform the AF function while performing a camcorder function are provided. The apparatus includes a camera for receiving a photographing data, a camera processing unit for performing any one of a still picture acquisition function and an AF function, a recording processing unit for performing a function for recording the photographing data, a camera driver for operating the camera under control of the camera processing unit and the recording processing unit, and a processor for controlling the camera processing unit and the recording processing unit when detecting an AF request while photographing a moving picture to focus on the photographing data automatically and to record the focused photographing data.

Abstract: An image processing apparatus which processes a captured image including angle information of a light beam traveling from the object, comprises a generation unit configured to generate a reconstructed image by reconstructing the captured image, an extraction unit configured to extract an address of a defective photoelectric conversion element which is included in photoelectric conversion elements which captured the captured image based on a plurality of reconstructed images corresponding to different imaging distances.

Abstract: In image processing of multi-viewpoint image data including image data captured with different focal lengths, an image of high quality, distance information with high precision, etc., are obtained by utilizing image data with different angles of view (focal lengths). An image processing device for generating combined image data using multi-viewpoint image data including image data acquired with different focal lengths, includes a resolution converting unit configured to perform resolution conversion for at least part of image data in multi-viewpoint image data in accordance with a focal length to be output and an image combining unit configured to generate combined image data with the focal length to be output using the resolution-converted image data.

Abstract: An imaging method uses an imaging device including a taking lens having a plurality of regions each with an independent characteristic and an image pickup element having a plurality of light-receiving sensors provided so as to correspond to the plurality of regions, the plurality of light-receiving sensors performing pupil division of a light beam passing through any of the plurality of regions for selective light-receiving, from an imaging signal from a light-receiving sensor corresponding to one region of the plurality of regions, an image corresponding to the one region is generated. When the generated image is corrected, an influence of a light beam passing through a region other than the one region is removed from the image generated so as to correspond to the one region.

Abstract: An image pickup apparatus, an image pickup method and a non-transitory computer readable recording medium are provided. The image pickup apparatus includes an image sensor including a first pixel group and a second pixel group, a controller which controls the image sensor to capture an image of an object by using the first pixel group and to capture a live view of the object by using the second pixel group, a storage which stores the image captured by the first pixel group, and an auto focusing (AF) processor which generates AF information by using the live view captured by the second pixel group.

Abstract: A backside illumination image sensor that includes a semiconductor substrate with a plurality of photoelectric conversion elements and a read circuit formed on a front surface side of the semiconductor substrate, and captures an image by outputting, via the read circuit, electrical signals generated as incident light having reached a back surface side of the semiconductor substrate is received at the photoelectric conversion elements includes: a light shielding film formed on a side where incident light enters the photoelectric conversion elements, with an opening formed therein in correspondence to each photoelectric conversion element; and an on-chip lens formed at a position set apart from the light shielding film by a predetermined distance in correspondence to each photoelectric conversion element. The light shielding film and an exit pupil plane of the image forming optical system achieve a conjugate relation to each other with regard to the on-chip lens.

Abstract: According to the present invention, since a color image for a moving image including that for live view display includes image data on pixel lines including first and second phase difference pixels, phase difference AF can be accurately performed during the moving image taking. A color image for the moving image includes not only the image data on the pixel lines including the first and second phase difference pixels, but also image data on pixel lines that do not include the first and second phase difference pixels and only include normal pixels. Accordingly, the image quality of the color image for the moving image is improved, an image interpolation process can be accurately performed, and reduction in image quality of a taken image (still image and moving image) through the phase difference pixels can be prevented or alleviated.

Abstract: A solid-state image pickup device includes a lens, a first light receiving element, a second light receiving element, and an element separation area. The first light receiving element is configured to receive light from the lens. The second light receiving element is configured to receive light from the lens. The element separation area is between the first light receiving element and the second light receiving element. The lens has an optical axis, which is offset from a center of the element separation area.

Abstract: Image pickup information output apparatus which outputs information about image pickup condition derived from combination of positions/states of condition decision members serving as optical members that affect fulfillment of the condition, comprising: setting unit for setting a condition setting value as the condition to be fulfilled; controller for driving one of the condition decision members to control its position/state based on the condition setting value, condition calculator for calculating information about the condition as calculated condition based on the combination of positions/states of the condition decision members; determination unit for determining whether or not the condition setting value changed; decision unit for determining the information about condition to be output, based on the calculated condition and the determination made by the determination unit as to whether or not the condition setting value changed; and output unit for outputting information about the condition to be output

Abstract: A solid-state image capture element includes a pixel, which receives light of one of a pair of light beams which pass through iris regions of different locations on a photographic lens, and a pixel which receives light of the other, in a pair of said pixels. The pair of pixels are positioned shifted from one another in a direction which intersects the x-axis which is the phase difference direction. The pair includes a plurality of first pairs and second pairs which respectively have mutually inverse location relations with respect to the pixels and the pixels therein. The first pair and the second pair are alternately positioned in either the phase difference detection direction or the direction which is orthogonal thereto.

Abstract: An autofocus apparatus includes a light source; an optical coupler having a first port, second port and a third port; wherein the optic coupler couples to the light source at the first port; an optical collimator for directing a light output from the second port of the optical coupler onto a sample through a Dichroic mirror and a microscope objective, wherein the sample is placed on a substrate supported by an adjustable microscopy stage; a scanning device for focusing the light at a plurality of focal points along an axis; a photodiode detector for converting a reflected light signal into an intensity signal; a memory device for storing a signal template; and a microprocessor for detecting a peak in the intensity signal by cross-correlating the intensity signal with the signal template; wherein the microprocessor generates a command for moving the position of the adjustable microscopy stage along the axis.

Abstract: A focusing device including: an optical system that includes a focusing lens; an image sensor that captures a subject image formed via the optical system and outputs an image signal containing a plurality of color components; an edge detection unit that detects an edge in correspondence to each color component among the plurality of color components contained in the image signal; a differential value calculation unit that calculates a differential value of an edge strength of the edge detected by the edge detection unit, in correspondence to the each color component; and a decision-making unit that determines a moving direction along which the focusing lens is to move for purposes of focus adjustment of the optical system based upon the differential value calculated by the differential value calculation unit.

Abstract: A method of providing an all-in-focus video from a single captured video is disclosed. The method uses a processor to perform the steps of acquiring a single captured video of a scene such that during capture there are at least two differing focus settings by using the single captured video to provide a plurality of videos having at least a first video at the first focus setting and a second video at the second focus setting and providing an all-in-focus video from the plurality of videos.

Abstract: An imaging apparatus includes a histogram shape determination unit that acquires a histogram of luminance values from video captured by an image capturing unit and determines whether or not the captured video is a night scene from the shape of the histogram. The imaging apparatus also includes a point light source determination unit that acquires the maximum value of contrast for each horizontal line in the video as a line evaluation value and determines whether the captured video is a night scene based on whether or not the line evaluation value has a characteristic of an object as a point light source. If the histogram shape determination unit and the point light source determination unit determine that the captured video is a night scene, the imaging apparatus determines that the scene captured by the image capturing unit is a night scene.

Abstract: An imaging apparatus with a solid-state imaging device having phase difference detection pixels arranged on a light receiving surface acquires the size of a main subject image by identifying the main subject image picked on the light receiving surface of the solid-state imaging device, sets an AF region subjected to autofocus processing in accordance with an image size, and selects a phase difference AF mode (step S32) or a contrast AF mode (step S31) depending on whether the image size is larger than a required size (step S23) as a mode used for the autofocus processing.

Abstract: Manufacturing errors are suppressed, a variable magnification function is provided, and good observation with aberrations appropriately corrected is performed. Provided is an endoscope objective lens including, in order from an object side, a positive first lens group, a negative second lens group, and a positive third lens group, in which the first lens group has a meniscus lens; and a normal observation state (wide angle end) and a magnifying observation state (telephoto end) can be switched between by moving the second lens group on the optical axis, and the following conditions are satisfied; ?9<f2/fW<?3.5 4.5<|fM/fW|<8.3 where fM represents the focal distance of the meniscus lens, fW represents the entire focal distance for the normal observation, and f2 represents the focal distance of the second lens group.

Abstract: A motion estimation apparatus according to an aspect of the present invention is a motion estimation apparatus for estimating, using a set of multi-focus images which correspond to a single scene and have different focuses, motion for each of the first regions included in the scene, including: a cost value computing unit configured to compute, using the set of multi-focus images, for each of the first regions, a cost value indicating a difference between a blur amount of the first region and a standard blur amount determined for each of distances in a depth direction; and a motion estimation unit configured to estimate, using the cost value, the motion of the first region corresponding to the cost value.

Abstract: An imaging apparatus includes an optical system including a focus lens, an imaging unit operable to capture a subject image formed by the optical system to generate image data, a driver operable to drive the focus lens along an optical axis of the optical system, and an autofocus adjusting unit operable to adjust a subject image formed on the imaging unit to be in focus by evaluating the image data generated by the imaging unit and by controlling the driver to drive the focus lens. When adjusting the subject image to be in focus anew after previously adjusting the subject image to be in focus, the autofocus adjusting unit estimates a focus position and controls the driver to drive the focus lens according to a driving method used for evaluating the image data generated by the imaging unit, and different driving methods are used for different results of the estimation.

Abstract: An image pickup apparatus 100 includes an image pickup element 101 including a plurality of image pickup pixels that perform a photoelectric conversion for an image formed by a light beam from an image pickup optical system and a plurality of focus detection pixels that perform a photoelectric conversion for an image formed by a divided light beam of the light beam from the image pickup optical system, and a DSP 103 configured to perform a shading correction for a pixel signal from the image pickup element 101, the image pickup element 101 generates a first pixel signal by adding signals from the plurality of image pickup pixels, and generates a second pixel signal without adding a signal from the focus detection pixel, and the DSP 103 performs the shading correction for the first pixel signal and the second pixel signal using correction data different from each other.

Abstract: Image sensors include an array of image sensor pixels therein. This array of image sensor pixels includes a first focus detection pixel and at least a first color pixel. A switching network is provided, which is electrically coupled to the array. This switching network may be configured to generate a first mixed image signal by electronically mixing a focus detection signal generated by the first focus detection pixel with at least one color pixel signal generated by the at least a first color pixel. The first focus detection pixel can be a color-blind pixel, which may include a light-blocking shield mask therein.

Abstract: A light field data acquisition device includes optics and a light field sensor to acquire light field image data of a scene. In at least one embodiment, the light field sensor is located at a substantially fixed, predetermined distance relative to the focal point of the optics. In response to user input, the light field acquires the light field image data of the scene, and a storage device stores the acquired data. Such acquired data can subsequently be used to generate a plurality of images of the scene using different virtual focus depths.

Abstract: The present disclosure provides an image-capturing apparatus for determining an object distance with higher accuracy. An image-capturing apparatus includes an optical system that forms an object image of an object, the optical system including a focus lens, an image sensor that captures the object image formed via the optical system and generates image data, and a controller that determines an object distance according to information representing a state of the optical system based on (i) first image data generated when the focus lens is at a first focus lens position and (ii) second image data generated when the focus lens is at a second focus lens position.

Abstract: An image-capturing apparatus of the present disclosure includes a focus lens, an image sensor that captures an object image formed via the focus lens and generates image data, and a controller that calculates a value relating to an in-focus position based on (i) first image data generated by the image sensor when the focus lens is at a first position and (ii) second image data generated by the image sensor when the focus lens is moved from the first position by a first moving amount and located at a second position, and the controller changing a next moving amount of the focus lens from the first moving amount based on the calculated value relating to the in-focus position.

Abstract: An optical imager includes: an image sensor for capturing images of targets and outputting image signals; a lens for focusing the target on the image sensor as a function of lens position; a memory for storing predetermined lens positions determined from predetermined target sizes; and a controller for determining current target size based on captured images and positioning the lens at a predetermined lens position by correlating current target size with predetermined target sizes.

Abstract: An imaging apparatus includes a shooting lens having a focus lens for adjusting a degree of focus on an imaging plane; an image sensor converting an optical image of a photographic subject to an electric image signal and outputting it; a confirmation image creator creating a focus state confirmation image in which a part, or a whole of an image expressed by the image signal is enlarged; a display displaying the focus state confirmation image; and a focus evaluation value calculator calculating a focus evaluation value based on the image signal; wherein when a state of an inclination of change in a focus evaluation value calculated at a plurality of positions of the focus lens while moving the focus lens is different from a state of an inclination of change in a focus evaluation value calculated immediately before, the focus state confirmation image is displayed on the display.

Abstract: An image sensor includes a first pixel that outputs a focus detection signal, and a second pixel that includes a semiconductor layer and a wiring layer. The semiconductor layer includes a first surface on which light enters, a second surface opposite from the first surface, and a photoelectric conversion unit that converts light to an electric charge and is disposed between the first surface and the second surface. The wiring layer is formed on a side of the second surface of the semiconductor layer and includes a signal output line through which the focus detection signal read out from the first pixel and an image-capturing signal generated according to the electric charge converted at the photoelectric conversion unit are output.

Abstract: An imaging apparatus enables the user to separately set an AF area and an enlargement area and, when the position of the AF area is changed, eliminates time and effort to change the position of the enlargement area. To achieve this, the imaging apparatus includes an AF area setting unit configured to set an AF area used for AF indicating an area out of the live view image of a subject imaged by an imaging unit, and a control unit configured to change a position of an enlargement area indicating an area to be enlarged in conjunction with a position of the AF area set by the AF area setting unit and configured, in response to an instruction to change the position of the enlargement area, to change the position of the enlargement area without changing the position of the AF area set by the AF area setting unit.

Abstract: A solid-state image pickup device includes a plurality of pixels arranged in a two-dimensional matrix, and outputs signals corresponding to the light quantity incident on each pixel. Each pixel includes: a first pixel that is equipped with a first photoelectric conversion means that converts incident light into an electrical signal to store it; and a second pixel that is equipped with a second photoelectric conversion means that converts incident light into an electrical signal to store it, and a light beam selecting means that selects a light beam that is incident on the second photoelectric conversion means. The solid-state image pickup device includes: a first scanning circuit; and a second scanning circuit. The solid-state image pickup device outputs the electrical signals stored in the first photoelectric conversion means as image signals, and outputs the electrical signals stored in the second photoelectric conversion means as focus signals.