Using Distinct Luminance Image Sensor Patents (Class 348/238)
  • Patent number: 10645268
    Abstract: In an image processing method and apparatus of a terminal, the terminal includes a monochrome camera and a color camera. The monochrome camera and the color camera are disposed side by side. The method includes receiving a photographing instruction, and controlling, according to the photographing instruction, the monochrome camera and the color camera to simultaneously photograph a current scene, to obtain a monochrome image and a color image of the current scene. The method also includes obtaining a luminance component and a chrominance component of the color image. The method further includes fusing the luminance component with the monochrome image to obtain a luminance-fused component, and obtaining a target color image according to the luminance-fused component and the chrominance component. The monochrome image is fused with the color image.
    Type: Grant
    Filed: March 9, 2016
    Date of Patent: May 5, 2020
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Congchao Zhu, Wei Luo
  • Patent number: 10531067
    Abstract: Techniques are disclosed for capturing stereoscopic images using one or more high color density or “full color” image sensors and one or more low color density or “sparse color” image sensors. Low color density image sensors, may include substantially fewer color pixels than the sensor's total number of pixels, as well as fewer color pixels than the total number of color pixels on the full color image sensor. More particularly, the mostly-monochrome image captured by the low color density image sensor may be used to reduce noise and increase the spatial resolution of an imaging system's output image. In addition, the color pixels present in the low color density image sensor may be used to identify and fill in color pixel values, e.g., for regions occluded in the image captured using the full color image sensor. Optical Image Stabilization and/or split photodiodes may be employed on one or more sensors.
    Type: Grant
    Filed: March 26, 2018
    Date of Patent: January 7, 2020
    Assignee: Apple Inc.
    Inventors: Ziv Attar, Paul M. Hubel, Ilana Volfin, Sebastien Marineau-Mes
  • Patent number: 10187566
    Abstract: Disclosed are devices and methods for generating an image. A device according to an aspect of an example embodiment includes: a first camera configured to acquire a first black-and-white image; a second camera configured to acquire a first color image; a first electronic circuit configured to generate a second black-and-white image using the first color image; a second electronic circuit configured to determine information representing positional relationships between pixels in the first black-and-white image and pixels in the second black-and-white image; and a third electronic circuit configured to generate a third black-and-white image based on the first black-and-white image, the second black-and-white image, and the determined information.
    Type: Grant
    Filed: March 7, 2018
    Date of Patent: January 22, 2019
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Sung-hyun Cho, Hee-chul Han
  • Patent number: 9998716
    Abstract: An image sensing device includes a single-color image sensor and a multi-color image sensor having resolutions different from each other; image data receiving circuitry configured to receive first image data from the single-color image sensor and second image data from the multi-color image sensor; first preprocessor circuitry configured to generate first aligned image data and second aligned image data based on the first image data and the second image data, respectively, by correcting an optical path difference between a pixel stream of the first image data and a pixel stream of the second image; and second preprocessor circuitry configured to generate third image data by merging the first aligned image data and the second aligned image data.
    Type: Grant
    Filed: July 27, 2016
    Date of Patent: June 12, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jong-Hwa Lee, Jin-Aeon Lee, Woong-Hee Lee
  • Patent number: 9948857
    Abstract: Disclosed are devices and methods for generating an image. A device according to an aspect of an example embodiment includes: a first camera configured to acquire a first black-and-white image; a second camera configured to acquire a first color image; a first electronic circuit configured to generate a second black-and-white image using the first color image; a second electronic circuit configured to determine information representing positional relationships between pixels in the first black-and-white image and pixels in the second black-and-white image; and a third electronic circuit configured to generate a third black-and-white image based on the first black-and-white image, the second black-and-white image, and the determined information.
    Type: Grant
    Filed: August 23, 2016
    Date of Patent: April 17, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Sung-hyun Cho, Hee-chul Han
  • Patent number: 9912846
    Abstract: According to an aspect, there is provided an apparatus comprising at least one processor and at least one memory connected to the at least one processor. The at least one memory stores program instructions that, when executed by the at least one processor, cause the apparatus to determine based on at least one indicator that a camera connected to the apparatus is in a dark environment, initiate a calibration sequence of the camera in response to determining based on the at least one indicator that the camera connected to the apparatus is in a dark environment, capture, during the calibration sequence, multiple images with the camera with different sets of shooting parameters, cause analysis of the captured images to obtain camera calibration data, and store the camera calibration data in a memory of the apparatus.
    Type: Grant
    Filed: May 11, 2016
    Date of Patent: March 6, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Mikko Vaahteranoksa, Jean-Luc Olives, Petteri Valve, Euan Barron
  • Patent number: 9465221
    Abstract: A digital camera component is described that has a light splitter cube having an entrance face to receive incident light from a camera scene. The cube splits the incident light into first, second, and third color components that emerge from the cube through a first face, a second face, and a third face of the cube, respectively. First, second, and third image sensors are provided, each being positioned to receive a respective one of the color components that emerge from the first, second, and third faces of the cube. Other embodiments are also described and claimed.
    Type: Grant
    Filed: March 5, 2015
    Date of Patent: October 11, 2016
    Assignee: Apple Inc.
    Inventors: Steven Webster, Ning Y. Chan
  • Patent number: 9313466
    Abstract: A single-plate color imaging element including color filters in a predetermined color filter array arranged on a plurality of pixels formed by photoelectric conversion elements arranged in horizontal and vertical directions, wherein in the color filter array, the first filters are vertically and horizontally arranged across a filter at a center of a 3×3 pixel group, and the 3×3 pixel group is repeatedly arranged in the horizontal and vertical directions.
    Type: Grant
    Filed: October 26, 2012
    Date of Patent: April 12, 2016
    Assignee: FUJIFILM Corporation
    Inventors: Kenkichi Hayashi, Seiji Tanaka
  • Patent number: 9300885
    Abstract: A solid state imaging device according to an embodiment includes: an imaging element formed on a semiconductor substrate, and including pixel blocks each having pixels; a main lens forming an image of a subject on an imaging plane; a microlens array including microlenses corresponding to the pixel blocks, the microlens array reducing an image to be formed on the imaging plane by Nf times or less and forming reduced images on the pixel blocks corresponding to the respective microlenses; and an image processing unit enlarging and synthesizing the reduced images formed by the microlenses, the solid state imaging device meeting conditions of an expression MTFMain(u)?MTFML(u)?MTFMain(u×Nf) where u denotes an image spatial frequency, MTFML(u) denotes an MTF function of the microlenses, and MTFMain(u) denotes an MTF function of the main lens.
    Type: Grant
    Filed: January 23, 2014
    Date of Patent: March 29, 2016
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Risako Ueno, Hiroto Honda, Mitsuyoshi Kobayashi, Kazuhiro Suzuki, Honam Kwon, Hideyuki Funaki
  • Patent number: 9257478
    Abstract: A spatially resolved spectral device comprising a dispersive array to receive an incident light comprising a principal ray. The dispersive array comprising a plurality of dichroic layers, each of the plurality of dichroic layers disposed in a path of a direction of the principal ray. Each of the plurality of dichroic layers configured to at least one of reflect or transmit a different wavelength range of the incident light. The device further comprising a detection array operatively coupled with the dispersive array. The detection array comprising a photosensitive component including a plurality of detection pixels, each of the plurality of detection pixels having a light-receiving surface disposed parallel to the direction of the principal ray to detect a respective one of the different wavelength ranges of incident light reflected from a corresponding one of the plurality of dichroic layers.
    Type: Grant
    Filed: May 22, 2013
    Date of Patent: February 9, 2016
    Assignee: The Regents of the University of California
    Inventors: Joshua Simon Bloom, John Anthony Tyson
  • Patent number: 9055181
    Abstract: According to one embodiment, a solid-state imaging device includes a first image sensor, a second image sensor, and an image pickup processing circuit. The first image sensor is configured to output a first image signal according to an intensity distribution of each of color lights from an object. The second image sensor is configured to output a second image signal according to a luminance distribution of the light from the object. The image pickup processing circuit includes an image synthesizer. The image synthesizer is configured to synthesize color information included in the first image signal and luminance information included in the second image signal.
    Type: Grant
    Filed: March 14, 2012
    Date of Patent: June 9, 2015
    Assignee: Kabushiki Kaisha Toshiba
    Inventor: Takayuki Ogasahara
  • Patent number: 9041807
    Abstract: An image processing device configured to be installed in a vehicle includes an image acquirer, an image selector, a first luminance adjuster, a synthetic image generator, and an image provider. The image acquirer acquires camera images captured by cameras provided on the vehicle. The image selector selects one of the camera images as a representative image based on luminances of the camera images. The first luminance adjuster adjusts a luminance of at least one of the other camera images based on a luminance of the representative image. The synthetic image generator generates a synthetic image showing a periphery of the vehicle, based on the representative image and the other camera images the luminance of at least one of which has been adjusted by the first adjuster. The image provider outputs, to a display device installed in the vehicle, information corresponding to the synthetic image.
    Type: Grant
    Filed: January 27, 2011
    Date of Patent: May 26, 2015
    Assignees: FUJITSU TEN LIMITED, FUJITSU LIMITED
    Inventors: Masahiko Murakami, Nobunori Asayama
  • Patent number: 9001214
    Abstract: A method, system and reference target for estimating spectral data on a selected one of three spectral information types is disclosed. Spectral information types comprise illumination of a scene, spectral sensitivity of an imager imaging the scene and reflectance of a surface in the scene. The method comprises obtaining a ranking order for plural sensor responses produced by the imager, each sensor responses being produced from a reference target in the scene, obtaining, from an alternate source, data on the other two spectral information types, determining a set of constraints, the set including, for each sequential pair combination of sensor responses when taken in said ranking order, a constraint determined in dependence on the ranking and on the other two spectral information types for the respective sensor responses and, in dependence on the ranking order and on the set of constraints, determining said spectral data that optimally satisfies said constraints.
    Type: Grant
    Filed: November 9, 2012
    Date of Patent: April 7, 2015
    Assignee: University of East Anglia
    Inventor: Graham Finlayson
  • Patent number: 8994848
    Abstract: A method including: obtaining, with an image processing apparatus, a white point that corresponds to an image captured by a camera with only the natural light as a light source; obtaining, with the image processing apparatus, a white point that corresponds to an image captured by the camera with only the artificial light as a light source; determining, with the image processing apparatus, a ratio of an intensity of natural light for a pixel to an intensity of an artificial light for the pixel within an image captured by a camera under mixed illumination of the natural light and the artificial light; and determining, with the image processing apparatus, a white point for the pixel in the image under mixed illumination based on the ratio of the intensity of natural light to the intensity of artificial light for the pixel in the image, the white point for only the natural light, and the white point for only the artificial light.
    Type: Grant
    Filed: March 14, 2013
    Date of Patent: March 31, 2015
    Assignee: Cisco Technology, Inc.
    Inventor: Per Ove Husoy
  • Patent number: 8953013
    Abstract: This invention discloses an image pickup device and an image synthesis method thereof The image pickup device comprises an image-pickup module, an image-synthesis module, a database and a processing module. The image-pickup module captures a plurality of temporary images of a scene. The image-synthesis module extracts a part of each temporary image and combines the parts to form a panorama temporary image, and splits the panorama temporary image into a plurality of zone-areas according to at least one threshold value and a panorama luminosity histogram. The database stores a lookup table for recording a plurality of exposure values. The plurality of the exposure values correspond to luminance values of the zone-areas respectively. The processing module obtains the plurality of exposure values corresponding to the luminance values and obtains a weighting-exposure value by an equation, and controls the image-pickup module to capture the panorama image according to the weighting-exposure value.
    Type: Grant
    Filed: July 30, 2012
    Date of Patent: February 10, 2015
    Assignee: Altek Corporation
    Inventors: Hong-Long Chou, Chia-Chun Tseng, Chia-Yu Wu
  • Patent number: 8928737
    Abstract: A method of operating a camera with a microfluidic lens to identify a depth of an object in image data generated by the camera has been developed. The camera generates an image with the object in focus, and a second image with the object out of focus. An image processor generates a plurality of blurred images from image data of the focused image, and identifies blur parameters that correspond to the object in the second image. The depth of the object from the camera is identified with reference to the blur parameters.
    Type: Grant
    Filed: July 26, 2012
    Date of Patent: January 6, 2015
    Assignee: Indiana University Research and Technology Corp.
    Inventors: Lauren Ann Christopher, Mangilal Agarwal, Weixu Li
  • Patent number: 8854544
    Abstract: A system is disclosed for controlling operation of an electronic device, such as a TV. The system includes a first sensor located at or near the electronic device and a second sensor spaced apart from the first sensor, wherein the first and second sensors are configured to detect motion of a user within an operating zone associated with the electronic device. A processor is coupled to the electronic device and the first and second sensors, the processor being configured to input a signal from the first and second sensors. Memory is coupled to the processor, the memory comprising a sensing algorithm configured to process the input signal from the first and second sensors and determine the location of the user with respect to the operating zone. The processor is configured to send a control command to the electronic device based on an output of the sensing algorithm.
    Type: Grant
    Filed: December 13, 2013
    Date of Patent: October 7, 2014
    Assignees: Sony Corporation, Sony Electronics Inc.
    Inventor: Ling Jun Wong
  • Patent number: 8787625
    Abstract: Embodiments include methods, devices, software, and systems for identifying a person based on relatively permanent pigmented or vascular skin mark (RPPVSM) patterns in images. Locations of RPPVSMs in different images of people are point matched, and a correspondence probability that the point matched RPPVSMs are from different people is calculated. Other embodiments are also described. Other embodiments are also described and claimed.
    Type: Grant
    Filed: April 26, 2012
    Date of Patent: July 22, 2014
    Assignee: Los Angeles Biomedical Research Institute at Harbor-UCLA Medical Center
    Inventors: Noah Ames Craft, Wai Kin Adams Kong, Arfika Nurhudatiana
  • Publication number: 20140168456
    Abstract: A light source sensing device and a light source sensing method thereof are provided. The light source sensing device includes an optical sensor, a rod, a motor and a controller. The optical sensor is used for sensing lighting brightness emitted by the light source. The rod is disposed on a circular track which surrounds the optical sensor. When the light source irradiates the rod, a shadow is formed on a sensing surface of the optical sensor. The motor drives the rod to move along the circular track in a moving speed. The controller is coupled to the motor and the optical sensor, and controls the optical sensor to sample in a sampling frequency during a sampling period for obtaining a plurality of brightness values. The controller calculates and processes the brightness values for obtaining an irradiating angle of the light source.
    Type: Application
    Filed: March 15, 2013
    Publication date: June 19, 2014
    Applicant: WISTRON CORPORATION
    Inventor: Kuang-Lan Chang
  • Patent number: 8723993
    Abstract: An imaging apparatus and image capture program are provided that enable an image processing section compatible with a Bayer array to be employed without modification even in cases in which an image pickup device is employed that is provided with a color filter of an array other than a Bayer array. An imaging apparatus (10) is equipped with a color filter (30) having repeatedly disposed 6×6 pixel basic array patterns C containing a portion of a Bayer array pattern; and a drive section (22) that drives the image pickup device (14) so as to read pixel data only of pixels at a predetermined position so as to give the same pattern as the Bayer array pattern.
    Type: Grant
    Filed: September 9, 2013
    Date of Patent: May 13, 2014
    Assignee: FUJIFILM Corporation
    Inventor: Kenkichi Hayashi
  • Publication number: 20130155287
    Abstract: An imaging apparatus includes a first imaging unit, a second imaging unit, a light measurement calculator, a holding unit, a detection unit, a recognition unit, a selection unit, and a focus adjustment controller. The second imaging unit is configured to acquire first image information, second image information, and third image information. The selection unit is configured to select the at least one of focus detection areas using a recognition result of the recognition unit. The focus adjustment controller is connected to the selection unit and is configured to perform a focus adjustment control using a focus adjustment state in a focus detection area selected by the selection unit. The changing unit is connected to the recognition unit and is configured to change the predetermined range based on the first determination and the second determination.
    Type: Application
    Filed: February 13, 2013
    Publication date: June 20, 2013
    Applicant: Nikon Corporation
    Inventor: Nikon Corporation
  • Patent number: 8462101
    Abstract: An apparatus controls a backlight of a display panel of a camera system. The apparatus includes a sub-pixel extracting unit, an ambient light luminance calculating unit, and a backlight controller. The sub-pixel extracting unit extracts sub-pixel luminance values from image data, where the image data is indicative of a current image frame defined by a plurality of pixels, and where each of the pixels includes a plurality of sub-pixels. The ambient light luminance calculating unit calculates an ambient light luminance value of the current image frame from the sub-pixel luminance values extracted by the sub-pixel extracting unit. The backlight controller which generates a backlight control signal based on a comparison between the calculated ambient light luminance value of the current image frame and an ambient light luminance value of a previous image frame.
    Type: Grant
    Filed: July 13, 2010
    Date of Patent: June 11, 2013
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Bing Han, Paul Gallagher, Yun-tae Lee, Joon-seo Yim
  • Publication number: 20130141614
    Abstract: An image shading correction method for an image capturing apparatus, comprising an obtaining step of obtaining a first image signal of an image captured of an area having a uniform luminance distribution using another image capturing apparatus that is different from the image capturing apparatus under a first condition, a second image signal of an image captured of the area having a uniform luminance distribution using the other image capturing apparatus under a second condition, and a third image signal of an image captured of the area having a uniform luminance distribution using the image capturing apparatus under the first condition, and a correction step of performing, based on the first to third image signals, correction processing on an image of an object captured using the image capturing apparatus under the second condition.
    Type: Application
    Filed: October 31, 2012
    Publication date: June 6, 2013
    Applicant: CANON KABUSHIKI KAISHA
    Inventor: CANON KABUSHIKI KAISHA
  • Publication number: 20130021499
    Abstract: A solid-state image pickup device includes a lens, a first light receiving element, a second light receiving element, and an element separation area. The first light receiving element is configured to receive light from the lens. The second light receiving element is configured to receive light from the lens. The element separation area is between the first light receiving element and the second light receiving element. The lens has an optical axis, which is offset from a center of the element separation area.
    Type: Application
    Filed: April 1, 2011
    Publication date: January 24, 2013
    Applicant: SONY CORPORATION
    Inventors: Hiroki Ui, Yutaka Nishimura, Shinichi Fujii
  • Publication number: 20130016251
    Abstract: According to one embodiment, a solid-state imaging device includes a first image sensor, a second image sensor, and an image pickup processing circuit. The first image sensor is configured to output a first image signal according to an intensity distribution of each of color lights from an object. The second image sensor is configured to output a second image signal according to a luminance distribution of the light from the object. The image pickup processing circuit includes an image synthesizer. The image synthesizer is configured to synthesize color information included in the first image signal and luminance information included in the second image signal.
    Type: Application
    Filed: March 14, 2012
    Publication date: January 17, 2013
    Applicant: Kabushiki Kaisha Toshiba
    Inventor: Takayuki OGASAHARA
  • Patent number: 8310724
    Abstract: An image processing system for interpolating image data is comprised of a shift invariant point determining device, an illumination averager, a second order differentiator, and color data calculator. The shift invariant point determining device ascertains shift invariant points within the mosaic color element array pattern. The illumination averager determines average illumination values of clusters of a plurality of pixels. The second order differentiator determines a second order derivative of the average illumination values of the clusters of the plurality of pixels. The color data calculator determines color data for each of the plurality of pixels from the image data and second order derivative. A second order derivative scaler multiplies the second order derivative by a scaling factor for selectively smoothing and sharpening the second order derivative. A color data averager averages color data values of adjacent pixels to a resolution of the image data.
    Type: Grant
    Filed: September 13, 2011
    Date of Patent: November 13, 2012
    Assignee: Youliza, Gehts B.V. Limited Liability Company
    Inventor: Taner Dosluoglu
  • Publication number: 20120194705
    Abstract: An imaging apparatus includes: a half-silvered mirror that divides incident light from a subject into light fluxes traveling along two optical paths; a first imaging device that receives one of the incident light fluxes divided by the half-silvered mirror; a second imaging device that receives the other one of the incident light fluxes divided by the half-silvered mirror; a first subject luminance information calculator that calculates first subject luminance information based on an output from the first imaging device; a second subject luminance information calculator that calculates second subject luminance information based on an output from the second imaging device; and a subject luminance information comparator that compares the first subject luminance information with the second subject luminance information.
    Type: Application
    Filed: December 13, 2011
    Publication date: August 2, 2012
    Applicant: Sony Corporation
    Inventor: Takuji YOSHIDA
  • Patent number: 8229216
    Abstract: A method for adjusting a skin color of a digital image adjusts the skin color of an input image. The method includes performing a skin color detection process on the input image to generate a skin-color probability plot Sp in a size corresponding to the input image; providing a hue-saturation lookup table named LUT_Color; performing a skin-color reproduction process on the input image to look up the LUT_Color for a chrominance pixel value for each pixel value of the input image to generate a first image, and adjust each pixel value of the first image by using the skin-color probability plot Sp to generate a second image; performing a skin color smoothing process on the second image to generate a third image; and mixing pixel values of the input image and the third image to generate a target image.
    Type: Grant
    Filed: April 23, 2009
    Date of Patent: July 24, 2012
    Assignee: Altek Corporation
    Inventors: Chen-Hung Chan, Hong-Long Chou
  • Publication number: 20120169901
    Abstract: An electronic apparatus, an image capturing device and a method for automatically capturing an image thereof are disclosed. The image capturing device comprises an image capturing module, a sensing module and a processing module. The image capturing module is used to capture an image corresponding to a scene through a capturing window. The sensing module senses a brightness value of the scene. The processing module is used to divide the capturing window into a plurality of blocks, and control the sensing module to decide whether the brightness value of each block has been changed. When the brightness value of any block has been changed, the processing module controls the image capturing module to capture the image.
    Type: Application
    Filed: March 9, 2011
    Publication date: July 5, 2012
    Applicant: Altek Corporation
    Inventor: Szu-Yi Chang
  • Patent number: 8212894
    Abstract: An electronic camera includes an image pickup device that takes a subject image, a face detecting section, an inferential section, and an image processing section. The face detecting section not only detects a face area in a shooting image plane based on the output of the image pickup device but also extracts a feature amount of the face of the subject from the face area. The inferential section performs inferential processing relating to either of the age and gender of the subject based on the feature amount. The image processing section makes at least one of an exposure correction, a soft focus correction, a skin smoothing correction to adjust color saturation of the color of the skin, and a correction to make a person look slim, on a recording-purpose image taken by the image pickup device based on the inference result of the inferential section.
    Type: Grant
    Filed: April 3, 2007
    Date of Patent: July 3, 2012
    Assignee: Nikon Corporation
    Inventors: Hirotake Nozaki, Akira Ohmura
  • Publication number: 20120081581
    Abstract: The present invention provides an image capturing apparatus, which is configured to capture an image using a light-emitting device, including a photometry unit configured to perform photometry on a plurality of regions, a calculation unit configured to calculate an emission amount of the light-emitting device based on photometry results of the photometry unit, and a display unit configured to display information associated with differences between proper emission amounts respectively for the plurality of regions and the emission amount calculated by the calculation unit.
    Type: Application
    Filed: September 12, 2011
    Publication date: April 5, 2012
    Applicant: CANON KABUSHIKI KAISHA
    Inventor: Yoshiro Ichihara
  • Publication number: 20120069221
    Abstract: An image capture device includes an image sensor for capturing image data of a scene, and a display screen for displaying a preview of the captured image of the scene. Additionally, the image capture device includes a photovoltaic solar cell for outputting electrical energy responsive to environmental lighting conditions. A control section determines whether the image capture device is or is not currently being used in a bright environment. Responsive to a determination that the image capture device is currently being used in a bright environment, the control section increases brightness of the display screen, and switches electrical energy outputted from the photovoltaic cell for use by the display screen.
    Type: Application
    Filed: September 20, 2010
    Publication date: March 22, 2012
    Applicant: CANON KABUSHIKI KAISHA
    Inventor: Francisco Imai
  • Patent number: 8045022
    Abstract: An imaging apparatus includes an imaging device, a first luminance signal generating unit and a correcting unit. The imaging device includes at least three types of color detecting photoelectric converting elements and a luminance detecting photoelectric converting element. The first luminance signal generating unit generates a first luminance signal corresponding to the color detecting photoelectric converting element from a color signal obtained from each of the at least three types of color detecting photoelectric converting elements. The correcting unit corrects, based on the color signal, at least a second luminance signal corresponding to the luminance detecting photoelectric converting element which is obtained from the luminance detecting photoelectric converting element so as to generate a luminance signal which constitutes image data corresponding to each of the photoelectric converting elements.
    Type: Grant
    Filed: June 12, 2008
    Date of Patent: October 25, 2011
    Assignee: Fujifilm Corporation
    Inventor: Tetsu Wada
  • Patent number: 8040397
    Abstract: The image processing device performs image processing using image data generated by an image generating device, and image generation record information associated with the image data where the image generation record information includes at least operating information about the image generating device at the time of generation of the image data. A picture quality adjuster is able, when the image generation record information includes subject brightness information relating to the brightness of a subject at the time of generation of the image data, to adjust the picture quality of the image data using the subject brightness level derived from the subject brightness information.
    Type: Grant
    Filed: December 20, 2007
    Date of Patent: October 18, 2011
    Assignee: Seiko Epson Corporation
    Inventor: Makoto Fujino
  • Patent number: 8040558
    Abstract: An image processing system for interpolating image data is comprised of a shift invariant point determining device, an illumination averager, a second order differentiator, and color data calculator. The shift invariant point determining device ascertains shift invariant points within the mosaic color element array pattern. The illumination averager determines average illumination values of clusters of a plurality of pixels. The second order differentiator determines a second order derivative of the average illumination values of the clusters of the plurality of pixels. The color data calculator determines color data for each of the plurality of pixels from the image data and second order derivative. A second order derivative scaler multiplies the second order derivative by a scaling factor for selectively smoothing and sharpening the second order derivative. A color data averager averages color data values of adjacent pixels to a resolution of the image data.
    Type: Grant
    Filed: November 28, 2007
    Date of Patent: October 18, 2011
    Assignee: Youliza, Gehts B.V. Limited Liability Company
    Inventor: Taner Dosluoglu
  • Patent number: 7911507
    Abstract: In a pixel unit, cells are arranged in rows and columns two-dimensionally. Each of the cells accumulates signal charge obtained by photoelectrically converting light incident on photoelectric conversion section and outputs a voltage corresponding to the accumulated signal charge. On the cells, W, R, G, and B color filters are provided. Analog signals output from the W pixel, R pixel, G pixel, and B pixel are converted into digital signals by an analog/digital converter circuit, which outputs a W signal, an R signal, a G signal, and a B signal separately. A W signal saturated signal quantity is controlled by a saturated signal quantity control circuit. Then, a signal generator circuit corrects the R signal, the G signal, and the B signal using the W signal, the R signal, the G signal, and B signal output from the analog/digital converter circuit and outputs the corrected R, G, and B signals.
    Type: Grant
    Filed: December 31, 2007
    Date of Patent: March 22, 2011
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Yoshitaka Egawa, Hiroto Honda, Yoshinori Iida, Goh Itoh
  • Publication number: 20110019032
    Abstract: A multi-spectral video camera and corresponding method have an optical arrangement for collecting light, a light splitting prism for splitting the light into a number of spatially separated channels of distinct spectral ranges, and a corresponding number of image sensor arrays. An electronic control and processing system receives sensed pixel data from each of image sensor arrays, analyzes the pixel data separately for each of the image sensor arrays to determine an exposure parameter for each of the sensor arrays, and actuates each of the sensor arrays to capture a subsequent image frame with an effective exposure individually set for each sensor array in accordance with the corresponding exposure parameter. The camera also preferably performs independent contrast enhancement corrections for each spectral channel of the camera.
    Type: Application
    Filed: December 31, 2008
    Publication date: January 27, 2011
    Applicant: RAFAEL ADVANCED DEFENSE SYSTEMS LTD.
    Inventors: Ephraim Pinsky, Ramy Leber
  • Patent number: 7839437
    Abstract: An image pickup apparatus includes an image pickup device that has high-sensitivity pixel devices receiving a relatively large amount of light and low-sensitivity pixel devices receiving a relatively small amount of light, an exposure control unit independently controlling exposure periods of the high-sensitivity pixel devices and the low-sensitivity pixel devices, and an image generation unit performing image generation on the basis of an output signal of the image pickup device.
    Type: Grant
    Filed: May 10, 2007
    Date of Patent: November 23, 2010
    Assignee: Sony Corporation
    Inventors: Masanori Kasai, Yusuke Oike
  • Patent number: 7812870
    Abstract: Systems and related methods have been achieved to convert in an analog domain the output of color image sensors into another color space. A chosen implementation converts the output of red, green, blue and white image sensors to the YcrCb color space, wherein the white image sensors are either extended dynamic range (XDR) image sensors or are of the same type as the other image sensors but have a larger size. The output of the white pixels can be used without conversion directly for the luminance Y value, thus achieving a very simple method for a conversion to YCbCr color space. Analog amplifiers, assigned to each of the red, green, and blue image sensors, have a gain according to the matrix describing the conversion from RGB to CbCr. Analog adders, assigned to Cb and Cr are adding the coefficients required for the computation of Cb and Cr. Finally the values of Y, Cb and Cr are converted to digital values. White pixels are advantageous but not required using the present invention.
    Type: Grant
    Filed: June 22, 2004
    Date of Patent: October 12, 2010
    Assignee: Digital Imaging Systems GmbH
    Inventors: Hubert Utz, Detlef Schweng
  • Patent number: 7791652
    Abstract: An image processing apparatus includes: a contrast area detector detecting a partial area from among partial areas in an input image signal as a contrast area, the input image signal being formed by a plurality of pixels, the contrast area being a partial area in which contrast of an input luminance indicative of a luminance of the input image signal is greater than a predetermined value; a luminance distributor distributing the input luminance in the contrast area into a bright-side luminance corresponding to a bright side of the input luminance and a dark-side luminance corresponding to a dark side of the input luminance; and a boundary luminance value generator generating a boundary luminance value between the bright-side luminance and the dark-side luminance on the basis of the distributions of the bright-side luminance and the dark-side luminance.
    Type: Grant
    Filed: June 11, 2007
    Date of Patent: September 7, 2010
    Assignee: Sony Corporation
    Inventor: Tomoo Mitsunaga
  • Patent number: 7777806
    Abstract: A digital still camera according to the present invention can obtain an image with appropriate brightness easily without an increase in memory capacity. The digital still camera of the present invention includes: an image-capturing unit which captures a field of object to generate an image; a photometry unit which measures a luminance of a predetermined area of the field of object; a calculating unit which calculates a ratio between a luminance value of a portion of the image captured according to the luminance measured by the photometry unit, and a target luminance value of the predetermined area, the portion corresponding to the predetermined area; and a correcting unit which corrects the image generated by the image-capturing unit according to the ratio.
    Type: Grant
    Filed: February 2, 2005
    Date of Patent: August 17, 2010
    Assignee: Nikon Corporation
    Inventors: Hidehiko Aoyagi, Masaru Muramatsu, Yuko Hattori
  • Publication number: 20100201849
    Abstract: A method for determining a luminance threshold value of a video region includes: performing a plurality of luminance threshold value generation operations on the video region included in a plurality of video frames, respectively. Each luminance threshold value generation operation includes: generating a total luminance value according to a plurality of luminance values of a plurality of pixels in the video region; subtracting a current luminance threshold value temporarily stored in a register from the total luminance value to generate a luminance error value; performing a specific filtering operation on the luminance error value to generate a filtered luminous error value; accumulating the filtered luminance error value to generate an accumulation result; and updating the current luminance value in the register according to the accumulation result and a luminance approximative value.
    Type: Application
    Filed: April 15, 2009
    Publication date: August 12, 2010
    Inventor: Ting-Yuan Cheng
  • Publication number: 20100134616
    Abstract: A color mask for an image sensor of a vehicle camera has a matrix arrangement made up of first filter pixels and second filter pixels. In every horizontal row and/or every vertical column, first filter pixels and second filter pixels are situated, the first filter pixels and the second filter pixels having different transmission behaviors. The second filter pixels have a more comprehensive transmission behavior, e.g., completely transparent to optical light. The first filter pixels are preferably red.
    Type: Application
    Filed: July 7, 2008
    Publication date: June 3, 2010
    Inventors: Ulrich Seger, Lothar Bergen, Steffen Fritz
  • Patent number: 7667880
    Abstract: One embodiment of the present invention provides a system that generates a look-up table which can be used to preview digital motion picture content. During operation, the system receives an analytical model for a digital motion picture workflow. Next, the system selects a set of input pixel values. The system then determines a set of output pixel values using the set of input pixel values and the analytical model. Finally, the system generates the look-up table by associating the set of input pixel values with the set of output pixel values. The analytical model comprises a number of models that capture the various stages in the digital motion picture workflow. These models can include a recorder model, a negative film model, a printer model, a positive film model, and a projector model.
    Type: Grant
    Filed: February 10, 2006
    Date of Patent: February 23, 2010
    Assignee: Adobe Systems, Incorporated
    Inventor: Lars U. Borg
  • Publication number: 20100026851
    Abstract: An image processing apparatus includes first and second standard-deviation calculating circuits for calculating deviations ?1 and ?2 indicating a luminance bias of each pixel forming an input image. The deviation ?1 is calculated by referring to an average luminance of first block images forming the input image, and the deviation a2 is calculated by referring to an average luminance of second block images forming the input image. A first correction-coefficient calculating circuit adjusts a correction coefficient K1 based on the deviation ?1, and a second correction-coefficient calculating circuit adjusts a correction coefficient K2 based on the deviation ?2. A Y correcting circuit corrects the luminance of each pixel forming the input image by referring to the correction coefficients K1 and K2. A CPU determines an input-image-attribute including presence/absence of a face image of a person so as to change adjustment characteristics of the correction coefficients K1 and K2.
    Type: Application
    Filed: July 16, 2009
    Publication date: February 4, 2010
    Applicant: SANYO ELECTRIC CO., LTD.
    Inventor: Yoshitaka Yoneyama
  • Patent number: 7643680
    Abstract: A method of calibrating image luminance values is provided. At first, a calibration chart is scanned, and a dark actual luminance value and a white actual luminance value are obtained accordingly. Next, a document is scanned, and a scan luminance value is obtained accordingly. Then, a white ideal luminance value, a dark ideal luminance value, an ideal luminance value and a predetermined calibrated luminance value are provided. Next, a calibrated luminance value is determined according to the dark actual luminance value, the white actual luminance value, the white ideal luminance value, the dark ideal luminance value, the ideal luminance value, the predetermined calibrated luminance value and the scan luminance value.
    Type: Grant
    Filed: November 16, 2005
    Date of Patent: January 5, 2010
    Assignee: Avision Inc.
    Inventor: Chih-Fang Huang
  • Publication number: 20080259186
    Abstract: A method is provided for correcting a captured image. The method comprises determining an illuminant for the captured image. When the determined illuminant matches a reference illuminant the image is corrected with a reference inversion mask. When the determined illuminant matches a first extreme illuminant, the reference inversion mask is modified using a first set of reference point ratios that corresponds to the first extreme illuminant and the image is corrected with the modified inversion mask. When the determined illuminant does not match the first extreme illuminant, a set of reference point ratios are calculated for the determined illuminant. The reference inversion mask is modified using the calculated set of reference point ratios and the image is corrected with the modified inversion mask.
    Type: Application
    Filed: April 23, 2007
    Publication date: October 23, 2008
    Inventors: Yu-wei Wang, Robert Sobol, Kevin Matherson
  • Patent number: 7400332
    Abstract: A digital color imager provides an extended luminance range, enabling a method for an easy transformation into all other color spaces having luminance as a component. White pixels are added to hexagonal red, green and blue pixels. These white pixels can alternatively have an extended dynamic range as described by U.S. Pat. No. (6,441,852 to Levine et al.). Especially the white pixels may have a larger size than the red, green, or blue pixels used. This larger size can be implemented by concatenation of “normal” size hexagonal white pixels. The output of said white pixels can be directly used for the luminance values Y of the destination color space. Therefore only the color values have to be calculated from the RGB values, leading to an easier and faster calculation. As an example chosen by the inventor the conversion to YCbCr color space has been shown in detail.
    Type: Grant
    Filed: January 10, 2005
    Date of Patent: July 15, 2008
    Assignee: Oigital Imaging Systems GmbH
    Inventors: Detlef Schweng, Stefan Spaeth
  • Publication number: 20080049122
    Abstract: An electronic camera includes: a luminance detection device that detects a luminance of a photographic field; an image sensor that captures an image of a photographic subject; a light reduction device that changes over between reducing an amount of light from the photographic subject that is conducted to the image sensor, and not performing such light amount reduction; and a calculation device that, when moving image photography is started with the image sensor, decides whether or not to perform the light amount reduction with the light reduction device according to the luminance detected by the luminance detection device, and then calculates a control exposure for this moving image photography.
    Type: Application
    Filed: August 16, 2007
    Publication date: February 28, 2008
    Applicant: NIKON CORPORATION
    Inventors: Akihiko Meguro, Kazuya Umeyama
  • Patent number: 7304683
    Abstract: In accordance with the present invention a shutterless single lens digital still camera includes an internal processor and auto exposure algorithm that automatically adjusts the exposure of the camera in high and low ambient lighting conditions. The auto exposure algorithm causes the camera to generate a signature of a current ambient luminance level and then in response to the signature to generate automatically an exposure setting.
    Type: Grant
    Filed: February 20, 2004
    Date of Patent: December 4, 2007
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventor: Ricardo Motta