Abstract: Methods and apparatus for capturing or generating images using multiple optical chains operating in parallel are described. Pixel values captured by individual optical chains corresponding to the same scene area are combined to provide an image with at least some of the benefits which would have been provided by capturing an image of the scene using a larger lens than that of the individual lenses of the optical chain modules. By using multiple optical chains in parallel at least some benefits normally obtained from using a large lens can be obtained without the need for a large lens. Furthermore in at least some embodiments, a wide dynamic range can be supported through the use of multiple sensors with the overall supported dynamic range being potentially larger than that of the individual sensors. Some lens and/or optical chain configurations are designed for use in small handheld devices, e.g., cell phones.

Abstract: An image pickup apparatus arranged to perform a focus adjustment by moving a focus lens based on an image pickup signal, parallelly reading out the image pickup signal obtained in a period set by a timing signal for setting a first exposure period and the image pickup signal obtained in a period set by a timing signal for setting a second exposure period from an image pickup unit by shifting the timing signals from each other in phase, obtain a focus evaluation value from the image pickup signal obtained in the set exposure period, and determine a position of the focus lens corresponding to the focus evaluation value based on a focus lens position when the image pickup signal is read out for the first exposure period and a focus lens position when the image pickup signal is read out for the second exposure period.

Abstract: Imaging systems may be provided with stacked-chip image sensors. A stacked-chip image sensor may include a vertical chip stack that includes an array of image pixels and processing circuitry. The image pixel array may be coupled to the processing circuitry through an array of vertical metal interconnects. The image pixel array may be partitioned into image pixel sub-arrays configured to capture image data using one or more integration times. The processing circuitry may determine motion information for the image data captured by each pixel sub-array and may determine integration times for each pixel sub-array. The pixel sub-arrays may capture additional image data using the determined integration times. The additional image data may be combined to generate final image frames having short integration pixel values and long integration pixel values. The processing circuitry may output the final image frames to off-chip image processing circuitry.

Abstract: The disclosed subject matter includes an apparatus configured to remove a shading effect from an image. The apparatus can include one or more interfaces configured to provide communication with an imaging module that is configured to capture the image, and a processor, in communication with the one or more interfaces, configured to run a module stored in memory. The module is configured to receive the image captured by the imaging module under a first lighting spectrum, receive a per-unit correction mesh for adjusting images captured by the imaging module under a second lighting spectrum, determine a correction mesh for the image captured under the first lighting spectrum based on the per-unit correction mesh for the second lighting spectrum, and operate the correction mesh on the image to remove the shading effect from the image.

Abstract: Certain embodiments relate to systems and methods for dynamic color shading correction, which can estimate the color shading in a captured image on the fly. The color shading may be estimated from the scene statistics of the captured image, and the estimated shading may be used for color shading correction. The color shading estimation method may separate out the color shading component from the actual image content by its unique characteristic in the gradient domain.

Abstract: A case attachable to a mobile communications device such as a smart phone operatively equipped with a camera can accommodate an optical refractor. The optical refractor can be adapted to change the direction of light rays passing through it. The case can align a first optical surface of the optical refractor with the camera lens and can maintain a second optical surface in a non-parallel arrangement with the first optical surface. The optical refractor can redirect light rays from an unaligned object to the camera lens. In an aspect, the object may be a bar code label.

Abstract: Array cameras, and array camera modules incorporating independently aligned lens stacks are disclosed. Processes for manufacturing array camera modules including independently aligned lens stacks can include: forming at least one hole in at least one carrier; mounting the at least one carrier relative to at least one sensor so that light passing through the at least one hole in the at least one carrier is incident on a plurality of focal planes formed by arrays of pixels on the at least one sensor; and independently mounting a plurality of lens barrels to the at least one carrier, so that a lens stack in each lens barrel directs light through the at least one hole in the at least one carrier and focuses the light onto one of the plurality of focal planes.

Abstract: A live view image generation unit sequentially displays on a display screen a captured image that is sequentially outputted from an image capture unit as a live view image. In a case of photographing and recording being directed, a review image generation unit displays a captured image for recording outputted from the image capture unit as a first review image on a portion of a display screen in a state of displaying the live view image. A photographing result evaluation unit evaluates a photographing result based on a captured image for recording outputted from the image capture unit according to an direction for photographing and recording. The review image generation unit performs display control to make a display form of the first review image different according to the evaluation result by the photographing result evaluation unit.

Abstract: According to one embodiment, a solid state image sensor has a photoelectric conversion element array, a light collecting optical element array, wavelength-selective elements and a reflecting unit. Wavelength-selective elements pass light of the color which is to be detected, and reflect other colors. The reflecting unit further reflects the light that has been reflected by the wavelength-selective elements. The cell includes photoelectric conversion elements for three different light colors. A microlens serving as a light collecting optical element is arranged corresponding to the cell. The reflecting unit includes at least a first reflecting surface and a second reflecting surface. The first reflecting surface faces the wavelength-selective elements. In every cell, the second reflecting surface is enclosed between wavelength-selective elements and the first reflecting surface.

Abstract: An image pickup device includes pixels arranged in a matrix shape, vertical signal lines to which the pixels are respectively connected via normal connection lines for each column, focus detection pixels discretely arranged among the pixels, focus connection lines that set, in a range in which a total number of the focus detection pixels included in a row group including a plurality of rows is not more than a number of the vertical signal lines, the row group and respectively connect all the focus detection pixels included in the row group to the different vertical signal lines, focus readout switches respectively provided on the focus connection lines, and a vertical scanning circuit that causes the focus readout switches to simultaneously operate by a unit of the row group.

Abstract: A method processes a video acquired of a scene by first aligning a group of video images using compressed domain motion information and then solving for a low rank component and a sparse component of the video. A homography map is computed from the motion information to determine image alignment parameters. The video images are then warped using the homography map to share a similar camera perspective. A Newton root step is followed to traverse separately Pareto curves of each low rank component and sparse component. The solving for the low rank component and the sparse component is repeated alternately until a termination condition is reached. Then, the low ranks component and the sparse component are outputted. The low rank component represents a background in the video, and the sparse component represents moving objects in the video.

Abstract: An image processing device includes an acquisition section, first conversion section, determination section, filtering section, and second conversion section. The acquisition section acquires first image data defined by a plurality of color components. The first conversion section converts, for each pixel data, the plurality of color components into converted pixel data defined by a luminance and a color difference. The determination section determines whether or not each converted pixel data is target pixel data having a black character attribute. The filtering section performs a filtering process on a luminance of each target pixel data using a filter coefficient to obtain processed pixel data defined by the luminance and the color difference. The filter coefficient enhances a difference in the luminance between the each target pixel data and neighboring pixel data. The second conversion section converts each processed pixel data into updated pixel data defined by the plurality of color components.

Abstract: An optical device that is capable of reducing eccentric aberration while reducing image blur. A first shake correction unit corrects image blur optically based on a shake amount that is detected by a shake detection unit. A second shake correction unit corrects image blur optically based on a shake amount that is detected by the shake detection unit. The second shake correction unit has a different image blur correction effect from the first shake correction unit. The optical device has a mode in which shake correction is performed using the first shake correction unit without using the second shake correction unit.

Abstract: The present disclosure provides a stream processor, an associated stream controller and compiler, and associated methods for data processing, such as image processing. In some embodiments, a method includes defining a kernel pattern associated with an image frame, and processing the image frame using the defined kernel pattern. The method can further include generating a kernel switch lookup table based on the defined kernel pattern. In various implementations, the stream controller is operable to direct execution of kernels on the image frame according to the defined kernel pattern and the kernel switch lookup table.

Abstract: A method and apparatus are provided, for improving contrast detected in a fringe projection autofocus system that projects light from a substrate to a digital camera. The method and apparatus reduce the fill factor of the digital camera in a direction that improves the contrast at spatial frequencies near or above the Nyquist limit in that direction.

Abstract: A ring structure for reducing flash glare and a manufacturing method thereof are provided. The ring structure for reducing flash glare is assembled on a camera module with a lens and a flashlight and includes a transparent substrate and a shading plate. The flashlight and the lens are fully separated by the shading plate to prevent light rays of the flashlight from interfering with the lens through the transparent substrate. The manufacturing method includes: providing a transparent substrate; forming a C-shaped hole on the transparent substrate; and injecting a plastic to fill the C-shaped hole and thereby form a shading plate on the transparent substrate. The manufacturing method entails performing a processing process on the transparent substrate directly and forming the shading plate by injection molding to not only simplify the manufacturing process but also makes the ring structure waterproof.

Abstract: Light field image processing includes generating a projected image using a light source, wherein the projected image includes a sharp feature, capturing a first light field image of a scene including the projected image, and determining, using a circuit block, a distance for the sharp feature from the first light field image.

Abstract: Optical isolation is provided for optically black pixels in image sensors. Image sensors, such as backside illumination (BSI) image sensors, may have an active pixel array and an array having optically black pixels. Isolation structures such as a metal wall may be formed in a dielectric stack between an active pixel array and optically black pixels. Patterned shallow trench isolation regions or polysilicon regions may be formed in a substrate between an active pixel array and optically black pixels. An absorption region such as a germanium-doped absorption region may be formed in a substrate between an active pixel array and optically black pixels. Optical isolation and absorption regions may be formed in a ring surrounding an active pixel array.

Abstract: A method of reducing shutter-lag in a camera image sensor may include maintaining a sensor output image to have a low resolution in a preview mode of a camera image sensor; changing a resolution of the sensor output image from a low resolution to a high resolution in response to a capture preparation signal to change an operation mode of the camera image sensor from a preview mode to a capture preparation mode, the low resolution being a resolution equal to or below a reference resolution, the high resolution being a resolution above the reference resolution; and capturing the sensor output image in response to a capture signal in the capture preparation mode of the camera image sensor.

Abstract: A method, non-transitory computer readable medium, and apparatus for compressive imaging of a scene in a single pixel camera are disclosed. For example, the method moves a pseudo-random pattern media behind an aperture until a pseudo-random sampling function of a plurality of pseudo-random sampling functions is viewable through the aperture, records a value of an intensity of a modulated light from the scene with a detector, wherein the intensity of the modulated light is representative of an inner product between the pseudo-random sampling function and an image of the scene and repeats the moving and the recording until a necessary number of a plurality of inner products are processed.