Abstract: A method is applied to an electronic device including a color camera and a monochrome camera, and the color camera and the monochrome camera are disposed in parallel on the electronic device, includes: obtaining a to-be-processed color image obtained after the color camera photographs a target scenario, and extracting a first luminance component of the to-be-processed color image; obtaining a monochrome image obtained after the monochrome camera collects the target scenario at the same moment, and extracting a second luminance component of the monochrome image; performing registration on the first luminance component and the second luminance component by using a preset algorithm, to generate a third luminance component; extracting a chrominance component of the to-be-processed color image based on the third luminance component; and compositing a color output image based on the extracted chrominance component of the to-be-processed color image and the third luminance component.

Abstract: An imaging apparatus includes a filter, a first image sensor and a second image sensor. The filter transmits a first light in a range of wavelengths and reflects a reflected light out of the range of wavelengths. An incident light is split to the first light and the reflected light. The first image sensor receives the first light to generate a first image signal. The second image sensor receives the reflected light to generate a second image signal.

Abstract: A method of generating a high resolution color image includes focusing a first image onto a monochrome image sensor having a P resolution and focusing a second image onto a color image sensor having a Q resolution, where Q<P, and where the first image is a same image as the second image. P resolution pixel data representative of the first image from the monochrome image sensor is generated. Q resolution pixel data representative of the second image from the color image sensor is generated. The P resolution pixel data representative of the first image from the monochrome image sensor and the Q resolution pixel data representative of the second image from the color image sensor are combined to generate an R resolution color image, where P<R?(P+Q).

Abstract: A natural user interface system and method of operation thereof including: a display device having a display screen and a display device camera; a mobile device having a mobile device camera, an optical axis of the mobile device camera positioned at an angle to an optical axis of the display device camera; wherein: the mobile device includes a first device pairing module for pairing the mobile device with the display device; the mobile device camera and the display device camera are for: detecting a user's hand, and determining posture and movement of the user's hand; and the display device includes a motion translation module for translating the posture and movement of the user's hand into a gesture for controlling an element of a user interface on the display screen.

Abstract: An image processing device configured to be installed in a vehicle includes an image acquirer, an image selector, a first luminance adjuster, a synthetic image generator, and an image provider. The image acquirer acquires camera images captured by cameras provided on the vehicle. The image selector selects one of the camera images as a representative image based on luminances of the camera images. The first luminance adjuster adjusts a luminance of at least one of the other camera images based on a luminance of the representative image. The synthetic image generator generates a synthetic image showing a periphery of the vehicle, based on the representative image and the other camera images the luminance of at least one of which has been adjusted by the first adjuster. The image provider outputs, to a display device installed in the vehicle, information corresponding to the synthetic image.

Abstract: An object is to provide an imaging system for taking an image of a subject with high reproducibility. It includes an imaging device for taking a picture in accordance with imaging conditions which are set values concerning imaging, a display device for displaying the image taken with the imaging device in accordance with display conditions which are set values concerning display, and an imaging condition decision unit for determining imaging conditions corresponding to the display conditions. When the display device alters the display conditions, the imaging condition decision unit determines the imaging conditions corresponding to the display conditions after the alteration, and the imaging device alters the imaging conditions stored in an imaging condition altering unit to the imaging conditions the imaging condition decision unit determines.

Abstract: A method, system and reference target for estimating spectral data on a selected one of three spectral information types is disclosed. Spectral information types comprise illumination of a scene, spectral sensitivity of an imager imaging the scene and reflectance of a surface in the scene. The method comprises obtaining a ranking order for plural sensor responses produced by the imager, each sensor responses being produced from a reference target in the scene, obtaining, from an alternate source, data on the other two spectral information types, determining a set of constraints, the set including, for each sequential pair combination of sensor responses when taken in said ranking order, a constraint determined in dependence on the ranking and on the other two spectral information types for the respective sensor responses and, in dependence on the ranking order and on the set of constraints, determining said spectral data that optimally satisfies said constraints.

Abstract: An image processing device includes a dynamic range compressor that changes a characteristic of a tone curve depending on a position on input image data so as to compress a dynamic range of the image data, and a coordinate converter that converts coordinates of the image data of which the dynamic range has been compressed.

Abstract: The amount of resources needed to provide automatic exposure control (AEC) for a camera of a computing device, as well as the amount of latency required to determine an appropriate exposure setting for current conditions, can be improved utilizing an ambient light sensor (ALS) that is integrated with a camera module corresponding to the camera. The ALS can capture data regarding the amount of ambient light around the device, and a microprocessor or other component of the camera module can analyze the data using an AEC algorithm or other such process to determine one or more initial exposure settings for the camera. This process can be completed without sending image data to a host processor or other such component. Providing relatively accurate initial exposure settings can, in at least many situations, enable the AEC algorithm to more quickly converge to proper settings than is possible using conventional approaches.

Abstract: This invention discloses an image pickup device and an image synthesis method thereof The image pickup device comprises an image-pickup module, an image-synthesis module, a database and a processing module. The image-pickup module captures a plurality of temporary images of a scene. The image-synthesis module extracts a part of each temporary image and combines the parts to form a panorama temporary image, and splits the panorama temporary image into a plurality of zone-areas according to at least one threshold value and a panorama luminosity histogram. The database stores a lookup table for recording a plurality of exposure values. The plurality of the exposure values correspond to luminance values of the zone-areas respectively. The processing module obtains the plurality of exposure values corresponding to the luminance values and obtains a weighting-exposure value by an equation, and controls the image-pickup module to capture the panorama image according to the weighting-exposure value.

Abstract: A method of operating a camera with a microfluidic lens to identify a depth of an object in image data generated by the camera has been developed. The camera generates an image with the object in focus, and a second image with the object out of focus. An image processor generates a plurality of blurred images from image data of the focused image, and identifies blur parameters that correspond to the object in the second image. The depth of the object from the camera is identified with reference to the blur parameters.

Abstract: A measuring device for measuring a response speed of a display panel is provided. The measuring device includes a microcontroller and at least one photo sensor. The microcontroller provides a control command, according to which a display controller of the display panel provides test pattern to the display panel. The photo sensor senses a test frame displayed corresponding to the test pattern by the display panel, and provides a corresponding sensing signal associated with brightness and a response signal. According to the response signal, the response speed of the display panel is calculated.

Abstract: A system is disclosed for controlling operation of an electronic device, such as a TV. The system includes a first sensor located at or near the electronic device and a second sensor spaced apart from the first sensor, wherein the first and second sensors are configured to detect motion of a user within an operating zone associated with the electronic device. A processor is coupled to the electronic device and the first and second sensors, the processor being configured to input a signal from the first and second sensors. Memory is coupled to the processor, the memory comprising a sensing algorithm configured to process the input signal from the first and second sensors and determine the location of the user with respect to the operating zone. The processor is configured to send a control command to the electronic device based on an output of the sensing algorithm.

Abstract: A measurement method and a measurement device are disclosed. The measurement method is adapted to a 3D display capable of producing a plurality of viewing zones, which includes following steps. At least a part of a display area of the 3D display displays an image of one of the viewing zones. Light radiation amounts of a first position of the 3D display are detected with a light detector from different viewing angles. A viewing angle with a local maximum light radiation amount is taken as a reference viewing angle, a distance between the light detector and the 3D display along the reference viewing angle is changed, and light radiation amounts of a plurality of different second positions of the 3D display are detected in different distances. A distance at which light radiation amounts of the second positions are most uniform is taken as the optimal viewing distance.

Abstract: An imaging apparatus includes: a half-silvered mirror that divides incident light from a subject into light fluxes traveling along two optical paths; a first imaging device that receives one of the incident light fluxes divided by the half-silvered mirror; a second imaging device that receives the other one of the incident light fluxes divided by the half-silvered mirror; a first subject luminance information calculator that calculates first subject luminance information based on an output from the first imaging device; a second subject luminance information calculator that calculates second subject luminance information based on an output from the second imaging device; and a subject luminance information comparator that compares the first subject luminance information with the second subject luminance information.

Abstract: In one embodiment, a method comprises generating three-dimensional (3D) imaging data for an environment using an imaging sensor, extracting an extracted plane from the 3D imaging data, and estimating an uncertainty of an attribute associated with the extracted plan. The method further comprises generating a navigation solution using the attribute associated with the extracted plane and the estimate of the uncertainty of the attribute associated with the extracted plane.

Abstract: An image capturing device is equipped with an external parameter estimating unit for estimating external parameters using a distance image obtained by a TOF camera and a luminance image obtained by a CCD camera, a corresponding pixel determining unit for determining a correspondence relationship between pixel positions in the distance image and pixel positions in the luminance image, using previously stored internal parameters of the TOF camera and the CCD camera or the CCD camera, and the external parameters, and an occlusion searching unit for searching for an occlusion region in the distance image, using the correspondence relationship between pixel positions in the distance image and pixel positions in the luminance image.

Abstract: An image processing device includes: a blurring correction processing unit configured to perform blurring correction processing on output signals of an imaging device having an RGBW array which includes RGB pixels and white (W) pixels, and generate blurring-corrected signals corresponding to each pixels; and a data conversion unit configured to convert the RGBW array into an RGB array; wherein the data conversion unit executes processing of generating blurring-corrected RGB signals (Rd, Gd, Bd) which are blurring-corrected signals corresponding to RGB that have been estimated from blurring-corrected signals generated by the blurring correction processing unit, and applying the blurring-corrected RGB signals (Rd, Gd, Bd) to determine RGB signals values configuring an RGB array.

Abstract: An apparatus including an event detection filter and a spatial event accumulator. The event detection filter receives at least one camera video output and generating a plurality of difference images from a time sequence. Each difference image is based on a time-subtraction of the current image from the previous image, the time sequence above an ambient pixel intensity level including at least one of at least one true flash event and at least one false positive. The spatial event accumulator receives the plurality of difference images from the event detection filter, merges a plurality of spatially proximate smaller flash events of the possible flash event to determine a shape of a single larger flash event, and measures pixel intensities of the plurality of spatially proximate smaller flash events to determine a varying brightness over the shape of the single larger flash event.

Abstract: An image processing apparatus includes a low-frequency-component storage unit that stores therein a low-frequency component generated from a frame in an input moving image composed of a plurality of frames, a low-frequency-component generating unit that generates a low-frequency component from an N-th frame of the input moving image, and stores the low-frequency component in the low-frequency-component storage unit, and a dynamic-range correcting unit that corrects a dynamic range by using an (N+1)-th or later frame of the input moving image and the low-frequency component of the N-th frame stored in the low-frequency-component storage unit.

Abstract: A driving method of a solid-state imaging device including a plurality of photoelectric conversion elements as defined herein, includes performing first driving which mixes a first electric charge generated in the first photoelectric conversion element with a second electric charge generated in the photoelectric conversion element for luminance detection, converts the electric charges obtained by the mixing into a signal, and outputs the signal.

Abstract: An electronic device for producing an image of an object is disclosed. The electronic device may include a black-and-white camera having a first sensor area configured to receive luma data pertaining to the object. The first sensor area may correspond to a first pixel array, the luma data associated with the first pixel array. The electronic device may also include a color camera having a second sensor area configured to receive chroma data pertaining to the object. The second sensor area may correspond to a second pixel array. The chroma data may be associated with the second pixel array. The electronic device may also include first logic configured to correlate pixels in the first pixel array with locations on the second sensor area.

Abstract: An imaging apparatus includes a solid-state imaging device, a derive section and a signal processing section. The imaging device includes plural pixels arranged on a surface of a semiconductor substrate. The pixels include plural chromatic color pixels for plural colors and plural high-sensitivity pixels having a higher sensitivity to incident light than the chromatic color pixels. The drive section controls the imaging device to simultaneously start exposing the chromatic color pixels and exposing the high-sensitivity pixels, to read first signals from the high-sensitivity pixels during an exposure period, respectively and hold the read first signals, thereafter, to read second signals from the high-sensitivity pixels, respectively, and to read third signals from the chromatic color pixels, respectively. The signal processing section produces color image data based on the first signals, the second signals and the third signals.

Abstract: An imaging apparatus includes an imaging device, a first luminance signal generating unit and a correcting unit. The imaging device includes at least three types of color detecting photoelectric converting elements and a luminance detecting photoelectric converting element. The first luminance signal generating unit generates a first luminance signal corresponding to the color detecting photoelectric converting element from a color signal obtained from each of the at least three types of color detecting photoelectric converting elements. The correcting unit corrects, based on the color signal, at least a second luminance signal corresponding to the luminance detecting photoelectric converting element which is obtained from the luminance detecting photoelectric converting element so as to generate a luminance signal which constitutes image data corresponding to each of the photoelectric converting elements.

Abstract: An image processing system for interpolating image data is comprised of a shift invariant point determining device, an illumination averager, a second order differentiator, and color data calculator. The shift invariant point determining device ascertains shift invariant points within the mosaic color element array pattern. The illumination averager determines average illumination values of clusters of a plurality of pixels. The second order differentiator determines a second order derivative of the average illumination values of the clusters of the plurality of pixels. The color data calculator determines color data for each of the plurality of pixels from the image data and second order derivative. A second order derivative scaler multiplies the second order derivative by a scaling factor for selectively smoothing and sharpening the second order derivative. A color data averager averages color data values of adjacent pixels to a resolution of the image data.

Abstract: A digital still camera includes a lens system. A cold mirror separates object light incident on the lens system into a visible light component and an infrared component. A visible light image sensor outputs a first image signal of a visible light image by receiving the visible light component. An infrared light image sensor outputs a second image signal of an infrared image by receiving the infrared component. A contour signal generator extracts a high frequency component from a luminance signal determined according to the second image signal, to produce an edge enhancement signal. An adder adds the edge enhancement signal to a luminance signal determined according to the first image signal. Addition of the edge enhancement signal is adapted to the object light from an object at a far distance. Specifically, the cold mirror reflects the visible light component and transmits the infrared component.

Abstract: An image pickup apparatus includes an image pickup device that has high-sensitivity pixel devices receiving a relatively large amount of light and low-sensitivity pixel devices receiving a relatively small amount of light, an exposure control unit independently controlling exposure periods of the high-sensitivity pixel devices and the low-sensitivity pixel devices, and an image generation unit performing image generation on the basis of an output signal of the image pickup device.

Abstract: An image pickup apparatus is disclosed which can remove noise with certainty from an image pickup signal while a high resolution of the image pickup signal is assured regardless of a reading out method of the image pickup signal and achieve reduction of the cost. A light receiving face of a solid-state image pickup device has an image pickup region from which a detection signal corresponding to an image of an image pickup subject formed from light incoming to the light receiving face is outputted as an image pickup signal and a light amount detection region from which a detection signal corresponding to the amount of the light incoming to the light receiving face is outputted as a light amount detection signal. A signal processing circuit of a signal processing section processes the image pickup signal to produce a video signal. A detection circuit detects cyclic variation of the luminosity of a light source from the light amount detection signal.

Abstract: Disclosed is a method of removing image noise of a camera having an illumination sensor. The method includes: grasping the noise response characteristics of the camera and storing mean signal-to-noise ratio values for respective illumination values in a low frequency region and a high frequency region; acquiring the present illumination value using the illumination sensor when photographing an image; reading mean signal-to-noise ratio values of the low frequency region and the high frequency region corresponding to the present illumination value from the stored mean signal-to-noise ratio values; and applying the read mean signal-to-noise values to filters for respective frequency regions, thereby filtering the signals of the photographed image.

Abstract: An image of a scene is captured with a digital camera. An item related to the scene is selected on a document stored on an electronic user device. The image is linked to the item and reversibly both on the electronic user device and on the digital camera to allow access to the full information.

Abstract: In a color separation circuit, a camera comprising such a color separation circuit and a color separation method, an adapted luminance signal is recovered from an image sensor signal using an adaptive wide band filter, wherein the adaptive wide band filter is controlled by the amount of a diagonal energy in the image sensor signal.

Abstract: An image processing apparatus comprises a light source presumption unit adapted to presume a light source on the basis of a plurality of feature information including illuminance information of first image signals obtained by image capturing, information of signals belonging to a hue region of a predetermined color among the first image signals, and information of a color temperature associated with second image signals obtained by image capturing before the first image signals; and a white balance control unit adapted to perform white balance control in accordance with light source information presumed by the light source presumption unit.

Abstract: In a method and apparatus for processing an image signal, luminance signals are generated for an object pixel and local pixels. A luminance dispersion value is then generated for the object pixel from the luminance signals of the object and local pixels. A control factor is determined from the luminance dispersion value, and at least one image signal of the object pixel is low-pass filtered according to the control factor.

Abstract: Adaptive brightness enhancement of digital camera images constructs tone mapping from increment high and decrement low occupancy levels' differentials.

Abstract: Wireless communications devices, such as cellular telephones (100), include an integrated camera (202) and process image data captured by that camera (202) to determine desired device illumination levels. A controller (410) within the wireless communications device (100) causes an image to be captured by the integrated camera (202). The captured image data is processed to determine approximate ambient light levels. A level of device illumination, such as provided by a display backlight (416) and a keypad backlight (418) is controlled based upon the approximate ambient light levels.

Abstract: A technique for producing electronic video signals representative of color images of a scene includes use of a regular CCD for the color channel and a back-thinned CCD for a luminance channel; a technique for deriving blue and reconstructing full resolution R, G, B from full resolution white and a red and green checkerboard pattern; and a technique for deriving an automatic gain control signal using an unshielded white area on the CCD to obtain a white reference.

Abstract: A technique for producing electronic video signals representative of color images of a scene, includes the following steps: providing a luminance sensor and a color sensor having a color filter thereover; providing a pellicle beamsplitter, and providing a motion picture film camera type of lens system that focuses light from the image, via the beamsplitter, onto the luminance sensor and the color sensor; and producing electronic video signals from outputs of the luminance sensor and the color sensor. The pellicle can be ultrasonically excited to effect optical prefiltering.

Abstract: The method of gradation correction of input image data to be displayed on an image display apparatus converts to logarithmic data first characteristic values which represent the display characteristics inherent in the image display apparatus and second characteristic values which represent the desired gradation to be eventually realized with the image display apparatus, respectively, and optionally interpolating both the logarithmic data, constructs a gradation correction table based on both the logarithmic data of the first characteristic values and the logarithmic data of the second characteristic values and performs gradation correction on the input image data to the image display apparatus using the gradation correction table. The image display system displays on the image display apparatus the thus corrected image data on which the gradation correction is performed by implementing the method.

Abstract: A technique for producing electronic video signals representative of color images of a scene, includes the following steps: providing a luminance sensor and a color sensor having a color filter thereover; providing a beamsplitter, and providing a motion picture film camera type of lens system that focuses light from the image, via the beamsplitter, onto the luminance sensor and the color sensor; and producing electronic video signals from outputs of the luminance sensor and the color sensor.

Abstract: An image processor includes unit pixel circuits, each circuit outputting a pixel value, according to incident light, to an output line; and read circuits in each row and each column, each of which can read out a pixel value of each unit pixel circuit and a result of computing for projection for each row and each column. The unit pixel circuits of each row and column and the corresponding read circuits are connected to each other by discrete output lines. The result of computing for projection readout by the compression processing is an average of pixel values in the unit pixel circuits of each row and of each column.

Abstract: A signal processing method for estimating luminance is provided, for use with matrix patterned image sensors where elected sensor pixels (G), preferably green pixels, from which luminance-representative signals are taken, only occupy alternate horizontal and vertical positions in the matrix pattern. The method is designed for detecting luminance contour edges and/or stripes in an image so as to enable images obtained form the sensor to be enhanced. Each pixel site (Hc) which is at the centre of both a row and a column of five pixels, and which is not the site of an elected (green) pixel, is identified and, for each such identified site (Hc), the signals output from the immediately adjacent four pixels (Gn,Ge,Gs,Gw) in said row and column are processed to establish both signal amplitude and pixel position.

Abstract: First and second optical images of an object are respectively taken using two optical filters, having different optical transfer properties, which are placed one at a time in the optical path of the taken images. The first and second optical images are converted to first and second memories, respectively. The first digital signal indicative of the first optical image is provided to a luminance-signal generator which produces a luminance signal. The second digital signal indicative of the second optical image is provided to a color-signal generator which produces a color signal. A combining unit combines the luminance signal and the color signal to produce a single image signal of the object having a suppressed color moire. An image reproduction device receives the single image signal to reproduce the image of the object.

Abstract: A fill-in light emitting apparatus having an illuminating mechanism for emitting illumination light whose color temperature can be varied; a color temperature metering mechanism for measuring the color temperature of the external light; and a color temperature controlling mechanism for varying the color temperature of the illumination light in accordance with color temperature data measured by the color temperature metering mechanism.

Abstract: A device and method of doubling a vertical line speed for a camera for domestic use, the method including the steps of a) writing G1 channel data output from a G1 CCD of a 4CCD for a period of 0.5H, where H is a horizontal sync period, and then reading the written G1 channel data at a speed twice a first writing speed, b) writing G2 channel data output from a G2 CCD of the 4CCD for a period of 0.5H, and then reading the written G2 channel data at a speed twice a second writing speed, and c) alternately selecting data read out by the steps a) and b), thereby outputting G signals of a broad-band. As a result, the line memory of 4H used in a device of doubling a line speed of a G channel signal can be reduced to 1H.

Abstract: An image sensor comprises an array of photodiodes and corresponding transfer cells for receiving charge packets from the photodiodes. Each of the transfer cells includes first, second and third electrodes arranged in sequence along a semiconductor channel, wherein the first and third electrodes have substantially equal time constants, and the second electrode has a lower electrical resistance than the first and third electrodes. With the charge packets being transferred to the transfer cells, first and second pulse sequences are respectively applied to the first and third electrode, of each transfer cell, and a constant potential is applied to the second electrode, wherein the first and second pulse sequences have a 90-degree phase difference with respect to each other.

Abstract: A fill-in light emitting apparatus having an illuminating mechanism for emitting illumination light whose color temperature can be varied; a color temperature metering mechanism for measuring the color temperature of the external light; and a color temperature controlling mechanism for varying the color temperature of the illumination light in accordance with color temperature data measured by the color temperature metering mechanism.

Abstract: The outputs of N kinds of spectral response characteristics from an image sensor are passed through low-pass filters to obtain N kinds of outputs from the 1st through Nth, and the output signal of a pixel of interest having the Kth (1.ltoreq.K.ltoreq.N) spectral response characteristic is multiplied by the ratio of the low-pass filter output of the image sensor output at the coordinates of the pixel of interest to the Kth low-pass filter output at the coordinates of the pixel of interest, thereby the luminance signal with alleviated attenuation of the harmonics components is obtained.

Abstract: A luminance signal generating apparatus including a first CCD device, and a second CCD device disposed at a position obliquely displaced relative to a spatial position of the first CCD device, an interpolating circuit for interpolating an output from the second CCD device. A low band luminance signal generating circuit generates a low band luminance signal on the basis of an output from the interpolating circuit. A high band luminance signal generating circuit generates a high band luminance signal on the basis of output signals from the first and second CCD devices and the interpolation signal from the interpolating circuit. A luminance signal generating circuit generates a luminance signal on the basis of the low band luminance signal and the high band luminance signal from the low band luminance signal generating circuit and the high band luminance generating circuit.