Abstract: The present disclosure overcomes the limitations of the prior art by providing 3D compression (i.e., compression that also accounts for changes in depth), including 3D compression of video sequences. In one aspect, depth information is obtained by processing captured images from a multi-aperture imaging device. The availability of IR images and depth information facilitates additional processing compared to when only color images are available.

Abstract: A computer-implemented method for a gesture-based user interface and a gesture-based user interface system are described. The method comprises receiving image data from a multi-aperture image sensor in said electronic device, said image sensor being configured to simultaneously expose an image sensor to at least a first part of the electromagnetic (EM) spectrum using a first aperture and at least a second part of the EM spectrum using one or more second apertures; determining sharpness information in at least one area of said image data associated with at least part of an object imaged by said first aperture and said one or more second apertures onto the image plane of said image sensor; generating depth information on the basis of at least part of said sharpness information; and, recognizing on the basis of said depth information, at least part of a gesture associated with a movement of said object.

Abstract: A method for determining a distance between an image sensor and an object includes acquiring a first image for an object and a second image distinguished from the first image, using a cut-off filter for cutting off one of R G and B signals, and determining a distance between the image sensor and the object.

Abstract: The present disclosure overcomes the limitations of the prior art by using partial blur kernels, rather than using full blur kernels. For example, single-sided blur kernels may be used in order to accommodate different edge orientations. In one aspect, the single-sided blur kernels may be used in order to accommodate edges caused by occlusions, where the two sides of the edge are at different depths.

Abstract: The present disclosure overcomes the limitations of the prior art by using blurring of edges. For example, a first image may contain an edge and a second image may contain the same edge as the first image. The two images may be captured by imaging systems with blur characteristics that vary differently as a function of object depth. For example, a dual-aperture system may simultaneously capture a faster f-number visible image and a slower f-number infrared image. Depth information may be generated by comparing blurring of the same edge in the two images.

Abstract: A method to correct an image in a dual-aperture camera. Infrared noise may be subtracted from a pixel of an RGB image by the amount proportional to the distance from the corresponding edge to minimize imaging defects in a dual aperture camera. Such defect minimization may prevent edge information from being lost. A method reduces the effect of false color along the edges by converting inconsistent color edges to more consistent monochrome edges using the YCbCr color space.

Abstract: A method and a system for forming an image of a scene are provided. The method includes capturing an image of the scene by exposing an image sensor to radiation from one part of the EM spectrum using one aperture and to radiation from another part of the EM spectrum using another aperture having a different size than the first aperture. Simultaneously with capturing the image, the scene is illuminated with radiation from the second part of the EM spectrum. The image is then formed on the basis of image data generated by the radiation from the first part of the EM spectrum and image data generated by radiation from the second part of the EM spectrum.

Abstract: Disclosed is a dual aperture camera which includes a dual band filter and a CMOS image sensor (CIS). The dual band filter is adapted to filter light signals to receive a light signal of a first wavelength range and receive a light signal of a second wavelength range through a pin hole included therein. The CIS is adapted to process the light signal of the first wavelength range and the light signal of the second wavelength range received through the dual band filter.

Abstract: A method and a system for processing multi-aperture image data are described, wherein the method comprises: capturing image data associated with one or more objects by simultaneously exposing an image sensor in an imaging system to spectral energy associated with at least a first part of the electromagnetic spectrum using at least a first aperture and to spectral energy associated with at least a second part of the electromagnetic spectrum using at least a second and third aperture; generating first image data associated with said first part of the electromagnetic spectrum and second image data associated with said second part of the electromagnetic spectrum; and, generating depth information associated with said captured image on the basis displacement information in said second image data, preferably on the basis of displacement information in an auto-correlation function of the high-frequency image data associated with said second image data.

Abstract: An application programming interface (API) provides access to a multi-aperture imaging system. By using the API, higher level applications can access and/or specify the image capture by the multi-aperture imaging device. For example, the API can support the specification of various image capture parameters: resolution, frame rate, exposure, flash, filtering, and additional processing to be applied. These could be specified for all frames and all channels (Red, Green, Blue and Infrared), or could be specified for specific subframes within a frame and/or for specific channels. The API can also specify output data from the multi-aperture imaging device. This can include raw pixel data, image data (color and Infrared), depth maps, and other processed image data. It can also include metadata and data about the status of the multi-aperture imaging device.

Abstract: a sensor system for a dual-aperture camera. The sensitivity of infrared (IR) light may be increased in order to reduce the noise of an image. For example, the size of an infrared pixel may be increased with respect to visible light pixels. For example, an infrared pixel may be stacked below a visible light pixel or pixels. For example, a separate infrared pixel may be provided as a second source of infrared light.

Abstract: A method to correct an image in a dual-aperture camera. Infrared noise may be subtracted from a pixel of an RGB image by the amount proportional to the distance from the corresponding edge to minimize imaging defects in a dual aperture camera. Such defect minimization may prevent edge information from being lost. A method reduces the effect of false color along the edges by converting inconsistent color edges to more consistent monochrome edges using the YCbCr color space.

Abstract: A method for controlling a display screen of a mobile terminal includes acquiring a first image and a second image distinguished from the first image, using a cut-off filter provided in the camera attached to a front of the mobile terminal to cut off one of R (Red), G (Green) and B (Blue) signals, recognizing an object comprising a user's face or gesture based on the first image and second image, and controlling on/off of the display screen provided in the mobile terminal based on the result of the recognition.

Abstract: A method is described of capturing an image. The method comprising the steps of: exposing an image sensor to radiation from a first part of the electromagnetic spectrum using a first aperture and to radiation from a second part of the spectrum using a second aperture having a different size than the first aperture; and, forming an image on the basis of first image data generated by the radiation from the first part of the spectrum and second image data generated by radiation from the second part of the spectrum.