For Single Sensor Type Camera Supplying Plural Color Signals Patents (Class 348/237)
  • Patent number: 11367166
    Abstract: In one implementation, a method includes obtaining an image. The method includes correcting color aberration of the image comprising, for a particular pixel of the image by determining one or more chromatic characteristic values for the particular pixel, determining a likelihood that the particular pixel exhibits color aberration based on the one or more chromatic characteristic values for the particular pixel, generating a filtered version of the particular pixel by filtering the particular pixel using pixels in a neighborhood surrounding the particular pixel, and generating a color-corrected version of the particular pixel based on the likelihood that the particular pixel exhibits color aberration and the filtered version of the particular pixel.
    Type: Grant
    Filed: June 19, 2020
    Date of Patent: June 21, 2022
    Assignee: APPLE INC.
    Inventors: Zahra Sadeghipoor Kermani, Sheng Lin, Emmanuel Piuze Phaneuf, Ryan Joseph Dunn, Joachim Michael Deguara, Farhan A. Baqai
  • Patent number: 11088209
    Abstract: A pixel structure of an organic light emitting diode display comprises a substrate and a plurality of pixels arranged on the substrate. The plurality of pixels is closely arranged. Each of the pixels is a light-emitting region. Each of the pixels comprises a plurality of sub-regions arranged in at least one column. Each sub-region of each of the column of the pixels comprises a color sub-pixel, a transparent sub-pixel or a sensing component. At least one of the pluralities of sub-regions of each pixel is the sensing component and the sensing component is arranged in the light-emitting region. The pixel structure of the organic light emitting diode display of the disclosure has a sensing function in addition to the display function, and at the same time the such arrangement enables the display to have a resolution of more than 500 ppi.
    Type: Grant
    Filed: July 31, 2018
    Date of Patent: August 10, 2021
    Assignee: SHANGHAI TUO KUANG OPTOECLECTRONIC TECHNOLOGY CO., LTD.
    Inventors: Kuo-Hsing Shih, Chia-Chen Li, Chin-Rung Yan
  • Patent number: 9853073
    Abstract: An image sensor and a method of manufacturing the same are provided. The image sensor includes a photoelectric conversion layer; a color filter disposed on the photoelectric conversion layer; a low refractive index layer disposed on the color filter; a beam splitter disposed within the low refractive index layer; and a lens layer disposed on the low refractive index layer and covering the beam splitter. The beam splitter extends in a diagonal direction of a pixel area of the color filter, in a plan view.
    Type: Grant
    Filed: April 2, 2015
    Date of Patent: December 26, 2017
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Sookyoung Roh, Sunghyun Nam, Seokho Yun, Hongkyu Park
  • Patent number: 9660409
    Abstract: A laser for generating deep ultra-violet (DUV) continuous wave (CW) light includes a second-harmonic generator and a fourth-harmonic generator. The fourth-harmonic generator includes a plurality of mirrors as well as a first non-linear optical (NLO) crystal and a pair of tilted plates. The first NLO crystal generates the light having the fourth harmonic wavelength and a first astigmatism, and is placed in operative relation to the plurality of mirrors. The pair of tilted plates is placed in operative relation to the first NLO crystal such that the light having the second harmonic wavelength passes through both of the tilted plates. Notably, the pair of tilted plates are disposed at substantially equal and opposite angles about respective parallel axes such that they introduce a second astigmatism that corrects for the first astigmatism while minimizing displacement of the circulated light.
    Type: Grant
    Filed: February 8, 2016
    Date of Patent: May 23, 2017
    Assignee: KLA-Tencor Corporation
    Inventor: Yung-Ho Chuang
  • Patent number: 9542875
    Abstract: A method of signal-processing input image data of a display device including a plurality of pixels, each pixel including a green subpixel and one of a red subpixel and a blue subpixel, the method includes: performing a gamma-conversion on input image data corresponding to the one of the red subpixel and the blue subpixel in each pixel; distributing the gamma-converted input image data corresponding to a center pixel to image data of a pixel in a vertical direction based on the center pixel by a first ratio; and distributing the gamma-converted input image data corresponding to the center pixel to image data of a pixel in a horizontal direction based on the center pixel by a second ratio, where the green subpixel and the one of the red subpixel and the blue subpixel are diagonally disposed in each pixel.
    Type: Grant
    Filed: April 18, 2014
    Date of Patent: January 10, 2017
    Assignee: SAMSUNG DISPLAY CO., LTD.
    Inventors: Ji-Yeon Yang, Geun-Young Jeong, Myung-Ho Lee, Jeong-Eun Kim
  • Patent number: 9514525
    Abstract: A temporal filter in an image processing pipeline may perform filtering using spatial filtering and noise history. A given pixel of a current image frame may be received for filtering at a temporal filter. A filtering weight may be determined for blending the given pixel with a corresponding pixel of a reference image frame that was previously filtered at the temporal filter. The filtering weight may be determined based on neighboring pixels of the given pixel in the current image frame and corresponding pixels in the reference image frame. The filtering weight may be adjusted according to a quality score indicating noise history for the corresponding pixel in the reference image frame. Based on the filtering weight, a filtered version of the given pixel may be generated, blending the given pixel and the corresponding pixel to store as part of a filtered version of the current image frame.
    Type: Grant
    Filed: July 31, 2014
    Date of Patent: December 6, 2016
    Assignee: Apple Inc.
    Inventors: Suk Hwan Lim, D. Amnon Silverstein
  • Patent number: 9462198
    Abstract: A method of acquiring an image of a scene illuminated by a first beam, by means of a sensor including at least two pixels, including the steps of: a) for each pixel, reading a first output value of the pixel representative of the intensity of the radiation received by the pixel during a first integration period during which the sensor is illuminated by a second beam coherent with the first beam; and b) for each pixel, reading a second output value of the pixel representative of the intensity of the radiation received by the pixel during a second integration period during which the sensor is not illuminated by the second beam, wherein steps a) and b) are repeated a plurality of times by changing, between two successive iterations, the angle of incidence or a phase parameter of the second beam.
    Type: Grant
    Filed: March 4, 2014
    Date of Patent: October 4, 2016
    Assignee: Commissariat a l'energie atomique et aux energies alternatives
    Inventors: Assim Boukhayma, Antoine Dupret
  • Patent number: 9131174
    Abstract: An image processing device includes a texture direction determining unit that determines a texture direction of an image, a defective pixel detecting unit that calculates a pixel value average for each of pixel groups including a plurality of pixels, and detects a defective pixel position on the basis of difference information of the pixel value average according to an arrangement direction of the pixel groups, and a correction unit that corrects, as a correction target, a pixel value at the defective pixel position detected on the basis of the difference information in the same pixel group arrangement direction as the texture direction determined by the texture direction determining unit.
    Type: Grant
    Filed: March 6, 2014
    Date of Patent: September 8, 2015
    Assignee: Sony Corporation
    Inventor: Fumihito Yasuma
  • Patent number: 9041812
    Abstract: Real-time access by a requestor to surveillance video is conditionally pre-authorized dependent on the existence of at least one pre-specified automatically detectable condition, and recorded in a data processing system. A requestor subsequently requests real-time access to the surveillance video (e.g., as a result of an alarm), and if the pre-specified automatically detectable condition is met, access is automatically granted, i.e., without the need for manual intervention. An automatically detectable condition could, e.g., be an alarm condition detected by a sensor at the site of the video surveillance. Alternatively, it could be a locational proximity of the requestor to the site of the video surveillance. Alternatively, it could be a previously defined time interval.
    Type: Grant
    Filed: November 13, 2012
    Date of Patent: May 26, 2015
    Assignee: International Business Machines Corporation
    Inventors: Ronald L. Billau, Vincenzo V. Di Luoffo, Dan P. Dumarot, Matthew J. Paschal, Brandon W. Schulz, James E. Woodbury
  • Patent number: 9019399
    Abstract: The device for encoding a Bayer pattern image includes a two-dimensional high-pass filtering means for calculating a GH coefficient which is a high-pass component corresponding to a space coordinate of a G1 pixel, from the value of the G1 pixel and the values of four G0 pixels in the neighborhood of the G1 pixel; a two-dimensional low-pass filtering means for calculating a GL coefficient which is a low-pass component corresponding to a space coordinate of a G0 pixel, from the value of the G0 pixel and the values of four GH coefficients in the neighborhood of the G0 pixel; a first encoding means for encoding a two-dimensional signal including the GH coefficient; and a second encoding means for encoding a two-dimensional signal including the GL coefficient.
    Type: Grant
    Filed: November 30, 2011
    Date of Patent: April 28, 2015
    Assignee: NEC Corporation
    Inventor: Jun Takada
  • Patent number: 9001214
    Abstract: A method, system and reference target for estimating spectral data on a selected one of three spectral information types is disclosed. Spectral information types comprise illumination of a scene, spectral sensitivity of an imager imaging the scene and reflectance of a surface in the scene. The method comprises obtaining a ranking order for plural sensor responses produced by the imager, each sensor responses being produced from a reference target in the scene, obtaining, from an alternate source, data on the other two spectral information types, determining a set of constraints, the set including, for each sequential pair combination of sensor responses when taken in said ranking order, a constraint determined in dependence on the ranking and on the other two spectral information types for the respective sensor responses and, in dependence on the ranking order and on the set of constraints, determining said spectral data that optimally satisfies said constraints.
    Type: Grant
    Filed: November 9, 2012
    Date of Patent: April 7, 2015
    Assignee: University of East Anglia
    Inventor: Graham Finlayson
  • Patent number: 8994870
    Abstract: An imaging apparatus disclosed in the present application includes a lens optical system including a lens and a stop; an imaging; and an array-form optical element located between the lens optical system and the imaging device and including optical components extending in a row direction in a plane vertical to an optical axis of the lens optical system, the optical components being arrayed in a column direction in the plane. The imaging device includes pixel groups, each of which includes first pixels arrayed in the row direction and second pixels arrayed in the row direction at positions adjacent, in the column direction, to the first pixels. The pixel groups are arrayed in the column direction. Border positions between the optical components are respectively offset in the column direction with respect to corresponding border positions between the pixel groups.
    Type: Grant
    Filed: July 1, 2013
    Date of Patent: March 31, 2015
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventor: Norihiro Imamura
  • Patent number: 8947584
    Abstract: A camera module is provided for an electronic device, such as a wireless mobile station or standalone device. The camera module includes a low F-stop lens assembly that is translatable into a desired position. An image of a subject is provided to an EDOF assembly, including a sensor assembly, and an extended-depth-of-field processor. The extended-depth-of-field processor provides for formation of a resultant, recorded image that exhibits improved depth of field characteristics.
    Type: Grant
    Filed: July 7, 2011
    Date of Patent: February 3, 2015
    Assignee: BlackBerry Limited
    Inventors: Yun Seok Choi, Qian Wang, Graham Charles Townsend
  • Patent number: 8928737
    Abstract: A method of operating a camera with a microfluidic lens to identify a depth of an object in image data generated by the camera has been developed. The camera generates an image with the object in focus, and a second image with the object out of focus. An image processor generates a plurality of blurred images from image data of the focused image, and identifies blur parameters that correspond to the object in the second image. The depth of the object from the camera is identified with reference to the blur parameters.
    Type: Grant
    Filed: July 26, 2012
    Date of Patent: January 6, 2015
    Assignee: Indiana University Research and Technology Corp.
    Inventors: Lauren Ann Christopher, Mangilal Agarwal, Weixu Li
  • Patent number: 8917324
    Abstract: In an image capturing and processing system, a device and method is provided. The lens is made of simple lens with high diffractive materials and known strong color aberrations. The method includes the steps of: calibrating or measuring a Point Spread Function (PSF) for each color components at a set of distances, capturing image data, and calculating the image obtained using a de-convolution method based on the PSF found.
    Type: Grant
    Filed: September 13, 2012
    Date of Patent: December 23, 2014
    Inventor: Jennifer Jinghan Yu
  • Patent number: 8896731
    Abstract: According to one embodiment, an image processing apparatus includes a pixel interpolation unit. The pixel interpolation unit includes a calculating unit that adds, to a first frequency band component, a second frequency band component in a direction in which the amount of change in the sensitivity level value of an acquired color component is determined to be small. The second frequency band component is in a frequency band higher than the first frequency band component.
    Type: Grant
    Filed: November 14, 2011
    Date of Patent: November 25, 2014
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Shiroshi Kanemitsu, Kazuhiro Tabuchi, Takaaki Kawakami
  • Patent number: 8896705
    Abstract: A measuring device for measuring a response speed of a display panel is provided. The measuring device includes a microcontroller and at least one photo sensor. The microcontroller provides a control command, according to which a display controller of the display panel provides test pattern to the display panel. The photo sensor senses a test frame displayed corresponding to the test pattern by the display panel, and provides a corresponding sensing signal associated with brightness and a response signal. According to the response signal, the response speed of the display panel is calculated.
    Type: Grant
    Filed: August 21, 2012
    Date of Patent: November 25, 2014
    Assignee: MStar Semiconductor, Inc.
    Inventors: Chih-Chiang Chiu, Tien-Hua Yu, Wen-Cheng Wu
  • Patent number: 8860845
    Abstract: An imaging apparatus includes an optical wavefront coding element that performs a dispersion of a light flux emitted from a subject into three or more directions, an imaging element that receives the light flux dispersed by the optical wavefront coding element to acquire a subject preimage, and a generation unit that generates an image of the subject by applying a process corresponding to the dispersion to the subject preimage.
    Type: Grant
    Filed: September 13, 2012
    Date of Patent: October 14, 2014
    Assignee: Fujitsu Limited
    Inventor: Yukio Hirai
  • Patent number: 8854544
    Abstract: A system is disclosed for controlling operation of an electronic device, such as a TV. The system includes a first sensor located at or near the electronic device and a second sensor spaced apart from the first sensor, wherein the first and second sensors are configured to detect motion of a user within an operating zone associated with the electronic device. A processor is coupled to the electronic device and the first and second sensors, the processor being configured to input a signal from the first and second sensors. Memory is coupled to the processor, the memory comprising a sensing algorithm configured to process the input signal from the first and second sensors and determine the location of the user with respect to the operating zone. The processor is configured to send a control command to the electronic device based on an output of the sensing algorithm.
    Type: Grant
    Filed: December 13, 2013
    Date of Patent: October 7, 2014
    Assignees: Sony Corporation, Sony Electronics Inc.
    Inventor: Ling Jun Wong
  • Patent number: 8842203
    Abstract: A solid-state imaging device includes a plurality of pairs of a first photoelectric conversion element and a second photoelectric conversion element which have different spectral sensitivity characteristics. A wavelength range where the first photoelectric conversion element of each pair mainly has a spectral sensitivity and a wavelength range where the second photoelectric conversion element of each pair mainly has a spectral sensitivity respectively fall within a wavelength ranges of specific colors of visible light. The plurality of pairs include a plurality of types of pairs having different specific colors of visible light. The half width in the spectral sensitivity characteristic of the first photoelectric conversion element of the each pair is wider than a half width in the spectral sensitivity characteristic of the second photoelectric conversion element of the each corresponding pair.
    Type: Grant
    Filed: October 19, 2012
    Date of Patent: September 23, 2014
    Assignee: FUJIFILM Corporation
    Inventors: Tomoyuki Kawai, Seiji Tanaka, Tetsuro Ashida, Takehiro Kouguchi, Hisashi Endo, Tomoki Inoue
  • Patent number: 8830398
    Abstract: It is determined whether or not an input image is an image converted from an image with a relatively low resolution based on one frame of an image. A resolution determination device includes: an edge strength calculator configured to obtain an edge strength of a pixel included in an input image based on luminance of the pixel and luminance of a pixel adjacent to the pixel, for each of a plurality of pixels included in the input image; and a resolution determiner configured to determine whether or not the input image is an image upconverted from an image with a predetermined resolution or less, based on distribution of the edge strengths.
    Type: Grant
    Filed: December 18, 2012
    Date of Patent: September 9, 2014
    Assignee: Panasonic Corporation
    Inventors: Koichi Inoue, Shinichi Tomioka, Atsuhisa Kageyama
  • Patent number: 8749673
    Abstract: The image generation device generates a new moving picture of a subject based on first and second moving pictures shot with a single-chip color image sensor, which detects two light rays including first and second color components, respectively, to represent the first and second color components of the subject. As the first moving picture has been shot in a longer exposure time than the second moving picture, the first picture has a lower frame rate than the second picture. The image generation device includes: a getting section which gets video signals representing the first and second moving pictures, respectively; a processing section which generates a new moving picture with as high a frame rate as the second moving picture based on the respective video signals representing the first and second moving pictures gotten; and an output section which outputs the new moving picture.
    Type: Grant
    Filed: December 4, 2012
    Date of Patent: June 10, 2014
    Assignee: Panasonic Corporation
    Inventors: Taro Imagawa, Takeo Azuma, Sanzo Ugawa, Yusuke Okada
  • Patent number: 8723987
    Abstract: In one embodiment, a method comprises generating three-dimensional (3D) imaging data for an environment using an imaging sensor, extracting an extracted plane from the 3D imaging data, and estimating an uncertainty of an attribute associated with the extracted plan. The method further comprises generating a navigation solution using the attribute associated with the extracted plane and the estimate of the uncertainty of the attribute associated with the extracted plane.
    Type: Grant
    Filed: October 30, 2009
    Date of Patent: May 13, 2014
    Assignee: Honeywell International Inc.
    Inventors: Kailash Krishnaswamy, Sara Susca
  • Patent number: 8723978
    Abstract: Provided are an image fusion apparatus and method for combining multi-exposure images. The image fusion apparatus and method may generate a sharp high-resolution high dynamic image while fully representing detail in an over-exposed region and an under-exposed region of the image without contrast degradation.
    Type: Grant
    Filed: January 14, 2011
    Date of Patent: May 13, 2014
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Jae-Hyun Kwon, Hyun-Hwa Oh, Won-Hee Choe, Sung-Chan Park, Seong-Deok Lee
  • Patent number: 8520097
    Abstract: An image processing device of the present invention includes a color-gamut determining part, a color-space determining part, and a color-space conversion part. The color-gamut determining part determines a color gamut as a range of color distribution from input image data. The color-space determining part determines a color space substantially covering the color gamut determined by the color-gamut determining part. The color-space conversion part converts the input image data into such image data that is rendered in the determined color space. The colors of the subject can thus be reproduced accurately from the converted image data.
    Type: Grant
    Filed: February 22, 2011
    Date of Patent: August 27, 2013
    Assignee: Nikon Corporation
    Inventor: Hideo Hoshuyama
  • Patent number: 8493468
    Abstract: An imaging apparatus includes an image pickup element to acquire a short-exposure-image data and a long-exposure-image data; a white balance evaluation value acquiring device to acquire white balance evaluation value for each of short-exposure-image data and long-exposure-image data; a white extraction range setting device to set a white extraction range for each of short-exposure-image data and long-exposure-image data; a white extraction device to extract white extraction result on the basis of the white balance evaluation value and the white extraction range for each of short-exposure-image data and long-exposure-image data; a correction factor calculating device to calculate corrected white extraction results from the white extraction result on the basis of the white extraction range and calculate correction factor for each of short-exposure-image data and long-exposure-image data; a white balance correcting device to correct the short-exposure-image data and the long-exposure-image data to form white bal
    Type: Grant
    Filed: September 2, 2010
    Date of Patent: July 23, 2013
    Assignee: Ricoh Company, Ltd.
    Inventor: Kenichiroh Nomura
  • Patent number: 8494260
    Abstract: An image processing device includes: a coordinate conversion unit (142) which calculates a corresponding sampling coordinate on a color mosaic image corresponding to a pixel position of a color image when a deformation process is performed, according to the pixel position of the color image; a sampling unit (143); a sampling unit (143) which interpolates-generates a pixel value in a sampling coordinate for each of color planes obtained by decomposing the color mosaic image; and a color generation unit (144) which generates a color image by synthesizing interpolation values of the respective color planes. Each pixel value of a color image subjected to a deformation process is obtained as a pixel value of the sampling coordinate from the color mosaic image by interpolation calculation, thereby realizing the color interpolation process for generating a color image from the color mosaic image and a deformation process of the color image by one interpolation calculation.
    Type: Grant
    Filed: June 24, 2008
    Date of Patent: July 23, 2013
    Assignee: Silicon Hive B.V.
    Inventors: Yasuhiro Sawada, XianJi Zhang, Takashi Masuda
  • Patent number: 8446493
    Abstract: In order to effectively and efficiently perform noise reduction by smoothing, an image processing apparatus of the present invention includes an image inputting part inputting an image in which a first pixels and a second pixels indicating mutually different color components are included and at least the second pixels are arranged at discrete positions, a color estimating part estimating first color component data at the second pixels based on first color component data of the first pixels, a calculating part calculating color-difference data at the second pixels based on the first color component data at the second pixels and second color component data of the second pixels, a smoothing part performing smoothing processing on a discrete color-difference image formed of the color-difference data being calculated at the second pixels, and a color-difference estimating part estimating color-difference data at pixels other than the second pixels on the input image.
    Type: Grant
    Filed: February 3, 2012
    Date of Patent: May 21, 2013
    Assignee: Nikon Corporation
    Inventor: Akihiko Utsugi
  • Patent number: 8436856
    Abstract: A shader can include a series of instructions, among which are horizontal instructions and vertical instructions. Executing such shader for rendering animation information may mean many redundant computations on millions of graphic data points. Thus, vertical instructions are separated out from horizontal instructions and executed in a vertical manner, thereby reducing rendering time and cache space used during the process. That is, a block of instructions is recursively subdivided until a number of instructions that are to be executed in a horizontal manner are approximately minimized in each sub-block. All of the identified vertical sub-blocks can process each data point individually and independently from other data points, thereby achieving various advantages, including, but not limited to, temporary processing, index processing, efficient caching and the like.
    Type: Grant
    Filed: November 6, 2009
    Date of Patent: May 7, 2013
    Assignee: Pixar
    Inventors: Thomas Douglas Selkirk Duff, Robert L. Cook
  • Patent number: 8314863
    Abstract: An image processing device includes: a blurring correction processing unit configured to perform blurring correction processing on output signals of an imaging device having an RGBW array which includes RGB pixels and white (W) pixels, and generate blurring-corrected signals corresponding to each pixels; and a data conversion unit configured to convert the RGBW array into an RGB array; wherein the data conversion unit executes processing of generating blurring-corrected RGB signals (Rd, Gd, Bd) which are blurring-corrected signals corresponding to RGB that have been estimated from blurring-corrected signals generated by the blurring correction processing unit, and applying the blurring-corrected RGB signals (Rd, Gd, Bd) to determine RGB signals values configuring an RGB array.
    Type: Grant
    Filed: August 23, 2010
    Date of Patent: November 20, 2012
    Assignee: Sony Corporation
    Inventor: Masayuki Tachi
  • Patent number: 8294781
    Abstract: Various techniques relating to image sharpening are provided. In one embodiment, a luminance image is obtained based upon image data acquired by an image sensor. A multi-scale unsharp mask, which may include at least two Gaussian filters of difference radii, is applied to the luminance image to determine a plurality of unsharp values. Each of the unsharp values may be compared to a corresponding threshold and, for the unsharp values that exceed their respective thresholds, the unsharp value is multiplied by a corresponding gain and added to a base image, which may be selected as the luminance image or the output of one of the Gaussian filters. Each gained unsharp value may be summed with the base image to produce a final sharpened output. In some embodiments, an attenuated gain may be applied to unsharp values that do not exceed their respective thresholds.
    Type: Grant
    Filed: October 20, 2009
    Date of Patent: October 23, 2012
    Assignee: Apple Inc.
    Inventors: Guy Cote, Jeffrey E. Frederiksen
  • Patent number: 8259198
    Abstract: Various techniques are provided for the detection and correction of defective pixels in an image sensor. In accordance with one embodiment, a static defect table storing the locations of known static defects is provided, and the location of a current pixel is compared to the static defect table. If the location of the current pixel is found in the static defect table, the current pixel is identified as a static defect and is corrected using the value of the previous pixel of the same color. If the current pixel is not identified as a static defect, a dynamic defect detection process includes comparing pixel-to-pixel gradients between the current pixel a set of neighboring pixels against a dynamic defect threshold. If a dynamic defect is detected, a replacement value for correcting the dynamic defect may be determined by interpolating the value of two neighboring pixels on opposite sides of the current pixel in a direction exhibiting the smallest gradient.
    Type: Grant
    Filed: October 20, 2009
    Date of Patent: September 4, 2012
    Assignee: Apple Inc.
    Inventors: Guy Cote, Jeffrey E. Frederiksen
  • Patent number: 8218021
    Abstract: An apparatus includes an image capture unit which includes an image sensor in which pixels for photoelectrically converting an object image are two-dimensionally arrayed in correspondence with color filters of a plurality of colors, and generates an image signal, a reducing unit which reduces the image signal output from the image capture unit to generate a reduced image, an image processing unit which performs development processing for the reduced image to obtain a first developed image containing luminance components and color difference components and performs development for the image signal output from the image capture unit to obtain a second developed image containing luminance and color difference components, an enlargement unit which enlarges the first developed image to the same size as that of the second developed image, and a composition unit which performs composition of the second developed image and an enlarged image.
    Type: Grant
    Filed: January 8, 2010
    Date of Patent: July 10, 2012
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kota Terayama
  • Patent number: 8149296
    Abstract: This invention is a solid-state image pickup device that solves the problem of limited dynamic range in the high luminance region in an image sensor having white pixels. White pixels or yellow pixels and at least red pixels, green pixels or blue pixels are arranged in array form on the light receiving surface of a semiconductor substrate. White pixels or yellow pixels have an additional capacitance CS connected to the photodiode via the floating diffusion, a capacitance coupling transistor S that can couple or separate the floating diffusion and the additional capacitance. The proportion of white or yellow pixels to the total number of pixels is higher in a central portion of the light receiving surface than a peripheral portion. The white or yellow pixel may share a floating diffusion with a red, green or blue pixel.
    Type: Grant
    Filed: May 20, 2009
    Date of Patent: April 3, 2012
    Assignee: Texas Instruments Incorporated
    Inventors: Hiromichi Oshikubo, Satoru Adachi, Koichi Mizobuchi
  • Publication number: 20110317038
    Abstract: An imaging apparatus includes an optical system, plural types of color filters, an imaging device including a plurality of pixels each receiving a light incident to the imaging apparatus through a predetermined type of color filter and being operable to generate image data with the plurality of pixels from the image formed by the optical system, a light information acquiring section operable to acquire information on the incident light, and a correction processing section operable to convert a position of a pixel of the image data formed by the pixels, according to at least type of the color filter provided for the pixel and the information on the incident light acquired by the light information acquiring section.
    Type: Application
    Filed: September 9, 2011
    Publication date: December 29, 2011
    Inventor: Norikazu YAMAMOTO
  • Patent number: 8045022
    Abstract: An imaging apparatus includes an imaging device, a first luminance signal generating unit and a correcting unit. The imaging device includes at least three types of color detecting photoelectric converting elements and a luminance detecting photoelectric converting element. The first luminance signal generating unit generates a first luminance signal corresponding to the color detecting photoelectric converting element from a color signal obtained from each of the at least three types of color detecting photoelectric converting elements. The correcting unit corrects, based on the color signal, at least a second luminance signal corresponding to the luminance detecting photoelectric converting element which is obtained from the luminance detecting photoelectric converting element so as to generate a luminance signal which constitutes image data corresponding to each of the photoelectric converting elements.
    Type: Grant
    Filed: June 12, 2008
    Date of Patent: October 25, 2011
    Assignee: Fujifilm Corporation
    Inventor: Tetsu Wada
  • Publication number: 20110090371
    Abstract: Various techniques are provided for the detection and correction of defective pixels in an image sensor. In accordance with one embodiment, a static defect table storing the locations of known static defects is provided, and the location of a current pixel is compared to the static defect table. If the location of the current pixel is found in the static defect table, the current pixel is identified as a static defect and is corrected using the value of the previous pixel of the same color. If the current pixel is not identified as a static defect, a dynamic defect detection process includes comparing pixel-to-pixel gradients between the current pixel a set of neighboring pixels against a dynamic defect threshold. If a dynamic defect is detected, a replacement value for correcting the dynamic defect may be determined by interpolating the value of two neighboring pixels on opposite sides of the current pixel in a direction exhibiting the smallest gradient.
    Type: Application
    Filed: October 20, 2009
    Publication date: April 21, 2011
    Applicant: APPLE INC.
    Inventors: Guy Cote, Jeffrey E. Frederiksen
  • Publication number: 20110090370
    Abstract: Various techniques relating to image sharpening are provided. In one embodiment, a luminance image is obtained based upon image data acquired by an image sensor. A multi-scale unsharp mask, which may include at least two Gaussian filters of difference radii, is applied to the luminance image to determine a plurality of unsharp values. Each of the unsharp values may be compared to a corresponding threshold and, for the unsharp values that exceed their respective thresholds, the unsharp value is multiplied by a corresponding gain and added to a base image, which may be selected as the luminance image or the output of one of the Gaussian filters. Each gained unsharp value may be summed with the base image to produce a final sharpened output. In some embodiments, an attenuated gain may be applied to unsharp values that do not exceed their respective thresholds.
    Type: Application
    Filed: October 20, 2009
    Publication date: April 21, 2011
    Applicant: APPLE INC.
    Inventors: Guy Cote, Jeffrey E. Frederiksen
  • Patent number: 7801355
    Abstract: An image processing method comprising a step of performing a color interpolation process on image data output from a single-chip color image capturing sensor to calculate color data for each pixel and a step of converting the color data using a predetermined transformation formula and of filtering the converted data, and the transformation formula is replaced based on the magnitude of a color value of the color data. When a color value of a specific color is large, the transformation formula can be appropriately changed. Therefore, it is possible to prevent the lowering of the overall resolution without being affected by the resolution of the color. Further, it is possible to reliably reproduce a smooth and natural edge of an image without adding other processes to the color interpolation process.
    Type: Grant
    Filed: February 11, 2005
    Date of Patent: September 21, 2010
    Assignee: Seiko Epson Corporation
    Inventor: Shinichi Arazaki
  • Publication number: 20100208106
    Abstract: An image processing device includes: a coordinate conversion unit (142) which calculates a corresponding sampling coordinate on a color mosaic image corresponding to a pixel position of a color image when a deformation process is performed, according to the pixel position of the color image; a sampling unit (143); a sampling unit (143) which interpolates-generates a pixel value in a sampling coordinate for each of color planes obtained by decomposing the color mosaic image; and a color generation unit (144) which generates a color image by synthesizing interpolation values of the respective color planes. Each pixel value of a color image subjected to a deformation process is obtained as a pixel value of the sampling coordinate from the color mosaic image by interpolation calculation, thereby realizing the color interpolation process for generating a color image from the color mosaic image and a deformation process of the color image by one interpolation calculation.
    Type: Application
    Filed: June 24, 2008
    Publication date: August 19, 2010
    Applicant: SILICON HIVE B.V.
    Inventors: Yasuhiro Sawada, XianJi Zhang, Takashi Masuda
  • Patent number: 7688362
    Abstract: A method for generating color video signals representative of color images of a scene includes the following steps: focusing light from the scene on an electronic image sensor via a filter having a tri-color filter pattern; producing, from outputs of the sensor, first and second relatively low resolution luminance signals; producing, from outputs of the sensor, a relatively high resolution luminance signal; producing, from a ratio of the relatively high resolution luminance signal to the first relatively low resolution luminance signal, a high band luminance component signal; producing, from outputs of the sensor, relatively low resolution color component signals; and combining each of the relatively low resolution color component signals with the high band luminance component signal to obtain relatively high resolution color component signals.
    Type: Grant
    Filed: March 7, 2005
    Date of Patent: March 30, 2010
    Assignee: Florida Atlantic University
    Inventor: William E. Glenn
  • Patent number: 7663668
    Abstract: An imaging device has color signal generating means (20) for outputting first color signals (R5, G5, B5) corresponding to incident light, and matrix operation means (67) for performing a matrix calculation including multiplication of the first color signals, color signals obtained by raising the first color signals to a power with a first constant (i) as an exponent, color signals obtained by raising the first color signals to a power with a second constant (j) as an exponent, and corresponding matrix coefficients to obtain second color signals (R6, G6, B6). The first and second constants and the matrix coefficients are determined so that the total characteristics of the color signal generating means and the spectral sensitivity characteristic correction means (6) approximate human chromatic curves or spectral sensitivity curves obtained by a linear transformation thereof.
    Type: Grant
    Filed: January 14, 2005
    Date of Patent: February 16, 2010
    Assignee: Mitsubishi Electric Corporation
    Inventors: Tetsuya Kuno, Hiroaki Sugiura, Takashi Itow, Koichi Yamashita, Katsutoshi Sugiyama
  • Patent number: 7595826
    Abstract: An intensity value is independently estimated based upon interpolated values as well as measured sensor values according to the location of an individual sensor within a sensor unit. The interpolated values are in either CrCb or RGB values while an estimated intensity value is in Y value. The independent intensity value substantially improves color resolution.
    Type: Grant
    Filed: July 30, 2003
    Date of Patent: September 29, 2009
    Assignee: Ricoh Company, Ltd.
    Inventors: Shin Aoki, Haike Guan
  • Patent number: 7492412
    Abstract: A solid-state image pickup apparatus includes a low-sensitivity decision section made up of an arithmetic circuit and a data decision circuit. During RAW mode recording operation, the arithmetic circuit executes sensitivity correction on low-sensitivity pixel data. The data decision circuit compares the low-sensitivity pixel data thus corrected with high-sensitivity pixel data to thereby produce map data pixel by pixel. Subsequently, pixel data are omitted on the basis of an embedding condition assigned to basic data set beforehand and the map data, whereby recording data a regenerated. The recording data are then recorded in a recording medium together with the map data and high-sensitivity pixel data.
    Type: Grant
    Filed: February 2, 2005
    Date of Patent: February 17, 2009
    Assignee: Fujifilm Corporation
    Inventor: Takeshi Misawa
  • Patent number: 7336302
    Abstract: A frame memory device is employed in a digital camera, for example, to output raster-scanned digital color image signals at lower resolution than that of original image signals. The order of sequentially received original raster-scanned digital color image signals is rearranged, and the rearranged signals are sequentially stored in a memory having a two-dimensional address structure such that vertical addresses represent the order of entry of respective scan lines that constitute the image signals and horizontal addresses represent the order of entry of respective signals that belong to each of the scan lines. The stored rearranged signals are subsampled and read out while skipping horizontal and vertical addresses of the memory at regular intervals. The image signals may comprise YCBCR color signals having a sampling ratio of 4:2:2. Sequentially received C signals in the order of CB?CR?CB?CR, for example, are rearranged in the order of CB?CB?CR?CR.
    Type: Grant
    Filed: January 23, 2004
    Date of Patent: February 26, 2008
    Assignee: Nikon Corporation
    Inventor: Toshihisa Kuroiwa
  • Patent number: 7307657
    Abstract: In a video signal processing method of processing a luminance signal of a video signal generated by causing a CCD to receive light transmitted through color filters, a control signal yf1 is generated by calculating Cy/Y using a complementary color signal Cy and a luminance signal Y, and coring correction is performed to the luminance signal by using the control signal yf1. The characteristic difference between the color filters is suppressed, and, as a result, flickers are suppressed from being generated.
    Type: Grant
    Filed: March 13, 2003
    Date of Patent: December 11, 2007
    Assignee: Victor Company of Japan, Limited
    Inventor: Hiroyuki Miyahara
  • Patent number: 7256828
    Abstract: The apparatus and method invented are operating upon a digital image signal obtained from an image sensor. The sensor is covered with different colored filters and is only able to record the color transmitted through each specific filter into the photosite or pixel. This type of sensor is known as a color filter array or CFA sensor. The different colored filters are arranged in a predefined pattern across the sensor. To obtain a full color image the missing color information is estimated by a set of weighed values obtained by an inverted gradient function. The set of weighted values is found from the neighboring pixels in the four compass directions, north, east, west and south or is found horizontally and vertically. The surrounding pixels are corrected by the chrominance channel to better fit the center pixel in the luminance channel, prior to using the gradient functions.
    Type: Grant
    Filed: January 21, 2003
    Date of Patent: August 14, 2007
    Assignee: Dialog Imaging Systems GmbH
    Inventors: Andreas Nilsson, Pierre Nordblom
  • Patent number: 7236627
    Abstract: The object of this invention is to decrease a memory capacity required for a lookup table. To achieve this object, in an image sensing apparatus which causes an image processing section to execute image processing to convert digital image data, which is obtained by A/D-converting the output from an image sensing element, into output image data, the image processing section includes a matrix arithmetic processing section and an N-dimensional (N is a positive integer) lookup table arithmetic processing section. The image processing section causes the matrix arithmetic processing section to process the digital image data before the N-dimensional lookup table arithmetic processing section.
    Type: Grant
    Filed: July 2, 2003
    Date of Patent: June 26, 2007
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kenji Takahashi
  • Patent number: 7098945
    Abstract: An electronic camera apparatus reads out, from an image sensing device, an image signal which represents a color image constructed by a number of pixels to which predetermined colors are assigned and has pieces of luminance information with analog values representing luminances of the pixels, the luminance information being discrete on a time axis, and generates a desired image from the image signal. The apparatus has a luminance correction section.
    Type: Grant
    Filed: February 23, 2000
    Date of Patent: August 29, 2006
    Assignee: NuCORE Technology, Inc.
    Inventors: Toshihiro Sasai, Shuji Kitagawa
  • Patent number: RE43085
    Abstract: An adaptive color enhancer applies different scale factors to different pixels in a digital image. More color enhancement occurs for bright pixels and for dim pixels than for average-intensity pixels. Also, more color enhancement is applied to the more colorful pixels while less color enhancement is applied to dull, less-colorful pixels. Rather than enhance all pixels to the same extent, the bright, colorful pixels are enhanced further than the average. Likewise, dim areas are color enhanced more than average. A calculation unit receives a YUV pixel. The Y value is compared to range limits and a piece-wise-linear (PWL) function generates an intermediate scale factor. The absolute values of the U and V color values are combined to create a colorfulness factor. The colorfulness factor is also used with a PWL function and the intermediate scale factor to generate a final scale factor for that pixel. The final scale factor is then multiplied by the U and V values of the pixel to generate a color-corrected pixel.
    Type: Grant
    Filed: April 13, 2006
    Date of Patent: January 10, 2012
    Assignee: Faust Communications, LLC
    Inventors: Tao Lin, Tianhua Tang