Abstract: A substantially rectangular spectral representation is synthesized, which is adapted to produce image capture device sensor outputs if applied to an image capture device. The synthesized substantially rectangular spectral representation can be utilized in generating output color values of an output color space from image capture device sensor outputs, where the image capture device sensor outputs correspond to an image captured by an image capture device. The generated output color values correspond to colors perceived by the human visual system for the same image as that captured by the image capture device. Image capture device gamut is also determined.

Abstract: A sub-image extractor extracts a target sub-image from a light field image. A partial area definer defines a predetermined area in the target sub-image as a partial area. A pixel extractor extracts pixels from the partial area, the number of pixels meeting correspondence areas of a generation image. The pixel arranger arranges the extracted pixels to the correspondence areas of the generation image in an arrangement according to the optical path of the optical system which photographs the light field image. Pixels are extracted for all sub-images in the light field image, and are arranged to the generation image to generate a reconstruction image.

Abstract: A plurality of first image data having a first resolution, which are obtained by capturing images from a plurality of viewpoints, and capturing information in the capturing operation are input. Based on the capturing information, a plurality of candidate values are set as a synthesis parameter required to synthesize second image data having a second resolution higher than the first resolution from the first image data. Using a candidate value selected from the plurality of candidate values as a synthesis parameter, the second image data is synthesized from the plurality of first image data.

Abstract: To provide an image including no blur from a plurality of images acquired by a camera array image capturing device. An image processing device of the present invention is characterized by including an image acquisition unit configured to acquire a plurality of images captured by a camera array image capturing device having a plurality of image capturing units the exposure conditions of which are different from one another, an overlap region calculation unit configured to calculate an overlap region in which field angles overlap in the plurality of image capturing units from the acquired plurality of images, and a blurred image detection unit configured to detect an image including a blur using a region image of the plurality of images corresponding to the overlap region calculated by the overlap region calculation unit.

Abstract: One embodiment relates to a method of outputting multiple views from a networked camera. Each imager of an array of imagers in the camera captures image frames and transmits the captured image frames to an associated image flow processor. Each image flow processor processes the captured image frames and transmits the processed image frames to a multi-imager video processor. An updating of parameters for said processing by each image flow processor is performed on a frame-by-frame basis. Another embodiment relates to a video camera including a plurality of imagers, a plurality of image flow processors, a multi-imager video processor, and a plurality of update queues. Other embodiments and features are also disclosed.

Abstract: A stable combined image is generated from a plurality of image signals having parallax and obtained at different focal positions. An image acquisition apparatus includes an image-acquisition optical system that collects light from a subject; an image acquisition element that acquires an image of the light collected by the image-acquisition optical system; a micro-lens array having an array of multiple micro-lenses arranged such that each micro-lens covers multiple pixels of the image acquisition element; and a focal-length changing section that is disposed at a pupil position of the image-acquisition optical system and that spatially changes a focal length so as to focus light passing therethrough at a plurality of different focal positions.

Abstract: A dual-shot image preview method and apparatus is disclosed. An electronic device with dual image sensors provides a preview screen combining in real-time a partial image captured from a first image sensor and a rear image captured from a second image sensor. The partial image is a portion of a front image that includes a desired portion of the user, such as the user's face based on algorithmic detection. The electronic device displays a dual-shot preview screen by overlaying the partial image on the rear image.

Abstract: A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

Abstract: An imaging apparatus for improving the detection accuracy of in-focus positions of an imaging optical system when a composite image is acquired and a method for controlling the same are provided. The imaging apparatus detects in-focus positions of the imaging optical system respectively corresponding to a plurality of images with different exposures used to generate the composite image, and selects the in-focus position used to control an operation of the imaging apparatus out of the detected plurality of in-focus positions based on a predetermined condition.

Abstract: A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

Abstract: A method of operating a camera with a microfluidic lens to identify a depth of an object in image data generated by the camera has been developed. The camera generates an image with the object in focus, and a second image with the object out of focus. An image processor generates a plurality of blurred images from image data of the focused image, and identifies blur parameters that correspond to the object in the second image. The depth of the object from the camera is identified with reference to the blur parameters.

Abstract: A display apparatus and a control method thereof are provided The display apparatus includes: an image processor configured to process an image of content; a display configured to display the processed image of the content; a camera configured to capture an image of a remote controller; a storage configured to store information regarding a plurality of appearance states of the remote controller corresponding to user commands; and a controller configured to determine an appearance state from among the plurality of appearance states of the remote controller based on the image of remote controller captured by the camera, and control the display section to display the image of the content according to a user command corresponding to the determined appearance state of the remote controller.

Abstract: A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

Abstract: A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

Abstract: A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

Abstract: Devices and methods for reducing parallax in graphic content captured by a camera array include identifying color fringes that correspond to the parallax in the captured graphic content, determining an amount of displacement of the color fringes and adjusting the parallax in the captured graphic content based on the amount of displacement. The camera array may comprise a two-dimensional array of cameras.

Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. Lens stack arrays in accordance with many embodiments of the invention include lens elements formed on substrates separated by spacers, where the lens elements, substrates and spacers are configured to form a plurality of optical channels, at least one aperture located within each optical channel, at least one spectral filter located within each optical channel, where each spectral filter is configured to pass a specific spectral band of light, and light blocking materials located within the lens stack array to optically isolate the optical channels.

Abstract: Disclosed herein are a method and a device of real-time image processing. The method comprises capturing three images, enhancing a resolution of the images to obtain for each image a high-resolution image (HRI), obtaining two displacement vectors using the HRIs, obtaining a superimposed HRI based on the HRIs and the displacement vectors, obtaining a compensatory vector based on the displacement vectors, and generating a super-resolution image based on the superimposed HRI and the compensatory vector.

Abstract: A dual sensor camera that uses two aligned sensors each having a separate lens of different focal length but the same f-number. The wider FOV image from one sensor is combined with the narrower FOV image from the other sensor to form a combined image. Up-sampling of the wide FOV image and down-sampling of the narrow FOV image is performed. The longer focal length lens may have certain aberrations introduced so that Extended Depth of Field (EDoF) processing can be used to give the narrow FOV image approximately the same depth of field as the wide FOV image so that a noticeable difference in depth of field is not see in the combined image.

Abstract: The present invention is directed to an electronic vision system. The system implements at least 3 apertures. A first aperture is set at near focus, while second and third apertures (positioned to the left and right of the first aperture respectively) are set at far focus. The fields of view of the left and right apertures may be spaced apart relative to each other, thereby forming a blind spot in the overall field of view of the system. However, the field of vision of the center aperture overlaps the blind spot, thereby reducing the blind spot for the system. The system includes a computer configured for receiving electronic image data from the apertures and rendering display data derived from the received image data. The system includes a display mounted to a mounting structure (ex.—helmet) for receiving the display data and displaying visual images of the display data.

Abstract: A low dynamic range (LDR) image data storage stores LDR image sets each of which includes a plurality of LDR segmented images captured with a camera panned. Here each LDR image set is of a different exposure level, respectively. A high-dynamic-range (HDR) synthesizing unit combines and merges a plurality of LDR segmented images of different exposure levels so as to generate an HDR segmented image set including a plurality of HDR segmented images of different pan angles or tilt angles. A panoramic image synthesizing unit generates an HDR panoramic image by stitching together adjacent HDR segmented images.

Abstract: Systems, methods, and computer readable media to improve image stabilization operations and other image processing operations are described. A novel combination of interleaved image capture and image processing operations, e.g., image registration operations, may be employed on a bracketed capture of still images. Such techniques may result in improved camera performance and processing efficiency, as well as decreased shot-to-shot time intervals. In another embodiment, an image fusion portion of an image post-processing pipeline may also be performed in an interleaved fashion, such that each image in the sequence of obtained bracketed images may be incrementally added to an output composite image after it has been aligned with the preceding image or images from the sequence.

Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.

Abstract: A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

Abstract: In certain aspects, designating an attribute of at least one shared image at least partially with a designating shared image device that can be utilized to capture an image with at least one capturing shared image device. In other aspects, synchronizing a capturing shared image device to a sharing session in a manner that at least partially allows conveying between the capturing shared image device with at least another shared image device at least some shared images captured during the sharing session.

Abstract: Procedures are described for blending images in real-time that avoid ghosting artifacts (attributable to moving objects), maintain the proper appearance of contiguous edges in the final image, and permits the use of fast (real-time) blending operations. A “guard-band” may be defined around an initially identified seam that perturbs the path of the initial seam so that both the seam and the guard-band's edges avoid moving objects by at least a specified amount. Rapid blend operations may then be performed in the region demarcated by the guard-band. The seam may be further adjusted to bias its position toward a specified trajectory within the overlap region when there is no moving object present. If visual registration techniques are not able to provide a properly aligned overlap region, motion sensor data for the image capture device, may be used instead to facilitate blending operations.

Abstract: An imaging system comprises four image sensors each pointing outwardly from the vertices of a notional tetrahedron with the optical axes of the image sensors substantially collinear with respective medians of the notional tetrahedron, with the focal plane array of each image sensor positioned between the lens system of its respective image sensor and the centroid of the notional tetrahedron. The imaging system and can be used to obtain image data for generating a spherical image of the space surrounding the imaging system. A method for generating a spherical image from this image data assigns spherical coordinates to the pixels in the images according to a cylindrical projection that is individually aligned with the image plane of each image, and blends overlapping pixels and fills blank pixel spaces. The method can be applied to image data representing outward views from the vertices or centroids of faces of any Platonic solid.

Abstract: A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.

Abstract: A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

Abstract: A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

Abstract: A method, apparatus and computer program are disclosed for: receiving from an image sensor image data; obtaining from the image data a source image and a user image so that the user image corresponds to a user set portion of the source image; wherein the source image and the user image are obtained on receiving the image data from the image sensor.

Abstract: A digital photographing apparatus and a method of controlling the same. The digital photographing apparatus that generates a 3D image includes a digital signal processing unit that generates the 3D image based on a first image obtained by photographing a predetermined object and a second image sent from another digital photographing apparatus photographing the object.

Abstract: A method of encoding multi-view video using camera parameters and a method of decoding multi-view video using the camera parameters are provided. The method of encoding multi-view video using the camera parameters includes detecting the camera parameters from each of a plurality of video data input from a multi-view camera in predetermined video units, and adaptively encoding each of the plurality of the video data according to whether each video data has the camera parameters. Accordingly, it is possible to increase the efficiency of compressing video without degrading video quality.

Abstract: A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

Abstract: A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

Abstract: An imaging device and method of providing an increased depth-of-field of an electronic image. The image sensor and the optical lens assembly are selectively repositionable along the optical axis of the lens using electronic actuator elements such as piezo-electric actuator elements, A plurality of images of a scene are captured while the image sensor, the optical lens assembly, or both are positioned at predetermined locations along the optical axis. Selected elements of each of the images captured using different focal planes are electronically combined to define a final image having an increased depth-of-field.

Abstract: Systems and methods in accordance with embodiments of the invention are disclosed that use super-resolution (SR) processes to use information from a plurality of low resolution (LR) images captured by an array camera to produce a synthesized higher resolution image. One embodiment includes obtaining input images using the plurality of imagers, using a microprocessor to determine an initial estimate of at least a portion of a high resolution image using a plurality of pixels from the input images, and using a microprocessor to determine a high resolution image that when mapped through the forward imaging transformation matches the input images to within at least one predetermined criterion using the initial estimate of at least a portion of the high resolution image.

Abstract: In the present invention, images at a front side or a rear side of a vehicle are obtained from a plurality of image capturing devices and a disparity and a distance to the captured object are calculated from the images, if the disparity is not sufficiently obtained, pattern light is irradiated onto a capturing object and an image of the object onto which the pattern light is irradiated is obtained again from the plurality of image capturing devices and the disparity and the distance to the captured object are calculated. Therefore, it is possible to provide an in-vehicle camera and system that recognizes an obstacle even in a situation where it is difficult to obtain the disparity of the obstacle around the vehicle.

Abstract: An imaging apparatus, comprising a sensor array in which a plurality of sensors are arrayed, a first readout unit configured to read out, from each of the plurality of sensors, a first signal corresponding to an amount of one of an electron and a hole of each of electron-hole pairs generated in the sensor array in response to irradiation with radiation or light, and a second readout unit configured to read out, from each of the plurality of sensors, a second signal corresponding to an amount of the other of the electron and the hole of the electron-hole pairs.

Abstract: The present invention relates to a method (300) for reducing stray light in an output image of a scene, said method comprising; providing (301) a camera (100) comprising a lens assembly (102, 202), providing (302) an aperture unit (103, 203) having an aperture gate (204a, 204b) in an aperture plane being orthogonal to an optical axis (OA) of said lens assembly (102, 202), said aperture gate (204a, 204b) being adjustable in said aperture plane, acquiring (303), by means of said camera (100), a plurality of images of said scene, wherein each image of said plurality of images is acquired using an unique aperture gate setting, wherein each of said unique aperture gate settings correspond to a unique combination of a position and a shape of said aperture gate (204a, 204b) in said aperture plane, analyzing (305) said plurality of images for generating data pertaining to a difference in stray light content with respect to said plurality of images, and producing (306) said output image based on said data pertaining t

Abstract: An image capture apparatus includes: an image capturing unit; a first image capture controller configured to control the image capturing unit to capture a set of a plurality of images while changing exposure time for each of the images; a second image capture controller configured to obtain a plurality of sets of the images; an addition combination section configured to perform image alignment on the images contained in each of the sets and to perform addition combination on the aligned images to generate a combined image; a combination controller configured to control the addition combination section to perform the image alignment and the addition combination for each of the sets to obtain a plurality of combined images; a selector configured to evaluate the combined images and to select one of the combined images most highly evaluated as a selected image; and a storage configured to store the selected image.

Abstract: Disclosed is a camera assembly having a wide viewing angle using a variable mirror. The camera assembly includes a variable mirror located in front of an image sensor, a variable mirror controller to switch a mode of the variable mirror to one of a reflection mode to reflect light incident upon the variable mirror and a transmission mode to transmit light incident upon the variable mirror, an image sensor to sense the light reflected by the variable mirror to acquire first image data and to sense the light transmitted through the variable mirror to acquire second image data, and an image processing unit to register the first image data and the second image data acquired by the image sensor to generate a third image.

Abstract: A method for processing image captured by an image sensor is provided. The operation method of an electronic device according to the present disclosure includes receiving a sensing image having a sensor pattern of an image sensor and meta-information including sensing image information related to the sensing image and storing the sensing image and the sensing image information including the meta-information.

Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.

Abstract: Devices and methods involving enhanced resolution image capture are provided. A representative electronic device includes: an image capture sensor having a plurality of pixels, the image capture sensor being operative to acquire a frame of image information by converting light incident upon the pixels during an exposure duration into electrical signals; and an image capture system selectively operative in a first image capture mode and a second image capture mode; in the first image capture mode, the image capture system outputs an image corresponding to a single frame of image information acquired during a single exposure duration; and in the second image capture mode, the image capture system outputs an enhanced image corresponding to frames of image information acquired during multiple exposure durations such that the enhanced image exhibits a higher resolution than a resolution exhibited by the acquired image associated with the first mode.

Abstract: Systems and methods for calibrating a 360 degree camera system include imaging reference strips, analyzing the imaged data to correct for pitch, roll, and yaw of cameras of the 360 degree camera system, and analyzing the image data to correct for zoom and shifting of the cameras. Each of the reference strips may include a bullseye component and a dots component to aid in the analyzing and correcting.

Abstract: Exemplary methods, apparatuses, and systems for image processing are described. One or more reference images are selected based on image quality scores. At least a portion of each reference image is merged to create an output image. An output image with motion artifacts is compared to a target to correct the motion artifacts of the output image.

Abstract: An exposure control method and an image processing system are provided. The image processing system comprises: an image sensor module, configured to provide at least two types of source images in parallel, each type of the source images has different exposure setting; a pre-processing unit, configured to determine luminance distribution of the source images on block basis, perform a first exposure control according to the luminance distribution of the two types of source images, and generate output images according to the source images in RAW image domain, and a post-processing unit, configured to determine luminance distribution of the output images, and perform a second exposure control according to the luminance distribution of the output images in normal image domain; wherein exposure settings of the image sensor module is adjusted according to the first exposure control and the second exposure control.

Abstract: A boresight alignment system facilitates aligning a plurality of cameras and/or images of the cameras with respect to one another. The system may have a mount configured to facilitate attachment of a bezel containing a plurality of cameras to the mount. The system may have a plurality of targets and each target may be configured to provide light of at least two different wavelengths and/or ranges of wavelengths. One or more baffles may be disposed optically between the mount and the target assembly to inhibit stray light from being incident upon the cameras.