Details Of Luminance Signal Formation In Color Camera Patents (Class 348/234)
  • Patent number: 10341601
    Abstract: An image processing apparatus receives an input of an image signal obtained by imaging an object, and performs signal conversion on the image signal to output the image signal to a display apparatus. The image processing apparatus includes a calculation unit configured to calculate an absolute luminance value of the object from a luminance value of the object acquired from the image signal and an exposure parameter in the imaging, a determination unit configured to determine a predetermined absolute luminance code for the luminance value of the object according to input-output characteristics of the display apparatus so that the object is displayed at the absolute luminance value on the display apparatus, and a conversion unit configured to perform signal conversion for converting the image signal based on a relationship between the luminance value of the object and the absolute luminance code.
    Type: Grant
    Filed: September 19, 2017
    Date of Patent: July 2, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Akihito Shin
  • Patent number: 10242435
    Abstract: An apparatus for HDR image processing is provided. The apparatus determines an imaging sensitivity value. The apparatus then compares subsets of imaging information with the determined imaging sensitivity value and applies a gamma correction to each subset of imaging information using a gamma low contrast curve or a gamma high contrast curve based on the comparison to obtain the gamma corrected subset of imaging information.
    Type: Grant
    Filed: September 6, 2017
    Date of Patent: March 26, 2019
    Assignee: GVBB HOLDINGS S.A.R.L.
    Inventors: Jeroen Rotte, Dirk Snoeck-Henkemans, Petrus Gijsbertus Centen
  • Patent number: 10223983
    Abstract: The present invention provides a brightness compensation method, a system and a display panel in a Demura system. The method comprises obtaining an included angle ? between a connection line of a pixel dot and a center point of a camera lens and a horizontal line as a camera is fixed; obtaining a brightness value f(?) corresponding to the ? according to a pre-stored angle-brightness relationship; obtaining a correction brightness value of the pixel dot according to a calculation of the f(?) and a default formula, and performing brightness compensation to the display panel according to the brightness value of the pixel dot after correction. The technical solution provided by the present invention can reduce the influence of the view angle to the brightness and the influence of cos4 ? to the brightness, and thus, it possesses the benefit of the brightness decay offset reduction.
    Type: Grant
    Filed: January 14, 2016
    Date of Patent: March 5, 2019
    Assignee: Shenzhen China Star Optoelectronics Technology Co., Ltd
    Inventors: Ping-sheng Kuo, Liwei Zhu
  • Patent number: 10205877
    Abstract: The disclosure extends to methods, systems, and computer program products for producing an image in light deficient environments and associated structures, methods and features. The features of the systems and methods described herein may include providing improved resolution and color reproduction.
    Type: Grant
    Filed: May 1, 2017
    Date of Patent: February 12, 2019
    Assignee: DePuy Synthes Products, Inc.
    Inventors: John Richardson, Laurent Blanquart
  • Patent number: 10186544
    Abstract: An image sensor includes a semiconductor substrate and a photoelectric conversion device on the semiconductor substrate and including a plurality of pixel electrodes, a light absorption layer, and a common electrode. The plurality of pixel electrodes may include a first pixel electrode and a second pixel electrode. The photoelectric conversion device may include a first photoelectric conversion region defined in an overlapping region with the first pixel electrode, the light absorption layer, and the common electrode, and a second photoelectric conversion region defined in an overlapping region with the second pixel electrode, the light absorption layer, and the common electrode. Sensitivity of the first photoelectric conversion region may be higher than sensitivity of the second photoelectric conversion region. An electronic device may include the image sensor.
    Type: Grant
    Filed: October 3, 2016
    Date of Patent: January 22, 2019
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Gae Hwang Lee, Kwang Hee Lee, Kyu Sik Kim, Sung Young Yun, Dong-Seok Leem, Yong Wan Jin
  • Patent number: 10171787
    Abstract: The present technology relates to a reproduction device, reproduction method, and recording medium that enable graphics with an appropriate brightness to be displayed on a video having a wide dynamic range of brightness. A recording medium, on which the reproduction device of one aspect of the present technology performs reproduction, records coded data of an extended video that is a video having a first brightness range that is wider than a second brightness range, brightness characteristic information that represents a brightness characteristic of the extended video, and graphics data that is superimposed on the extended video and that has the second brightness range. The reproduction device converts a first pixel value of the graphics to a second pixel value in the brightness characteristic of the extended video represented by the brightness characteristic information, and synthesizes the extended video. The present technology can be applied to players that reproduce contents.
    Type: Grant
    Filed: July 2, 2014
    Date of Patent: January 1, 2019
    Assignee: SONY CORPORATION
    Inventors: Kazuo Yamamoto, Toshiya Hamada, Shinobu Hattori, Kuniaki Takahashi
  • Patent number: 10157583
    Abstract: A display apparatus includes a plurality of first pixel units and a plurality of second pixel units. Each of the first pixel units includes at least one first color sub-pixel, at least one second color sub-pixel, at least one third color sub-pixel and at least one fourth color sub-pixel arranged in a first configuration. Each of the second pixel units includes the at least one first color sub-pixel, the at least one second color sub-pixel, the at least one third color sub-pixel and the at least one fourth color sub-pixel arranged in a second configuration different from the first configuration. The first pixel units and the second pixel units are alternately disposed to make all of the pixel units adjacent to each of the first pixel units be the second pixel units, and all of the pixel units adjacent to each of the second pixel units be the first pixel units.
    Type: Grant
    Filed: January 25, 2017
    Date of Patent: December 18, 2018
    Assignee: AU OPTRONICS CORPORATION
    Inventors: Shih-Ting Huang, Yu-Chin Chu, Sheng-Wen Cheng
  • Patent number: 10115371
    Abstract: The embodiment of the present invention discloses a look up table management method of a liquid crystal display and a device. The method can include: obtaining an input data and an output data from a first look up table; performing preset operation to the output data to obtain a middle data, of which a sum of absolute values is smaller than a sum of the output data, and associatively storing the input data and the middle data to be a second look up table; as the liquid crystal display performs display, performing an inverse operation of the preset operation to the middle data in the second look up table which is corresponded with a display data inputted in real time to obtain and output an output data corresponded with the display data.
    Type: Grant
    Filed: January 6, 2016
    Date of Patent: October 30, 2018
    Assignee: Shenzhen China Star Optoelectronics Technology Co., Ltd
    Inventors: Yuhong Fu, Liwei Zhu, Wenqin Zhao
  • Patent number: 10104312
    Abstract: A mobile terminal including a wireless communication processor configured to provide wireless communication; a display; a first camera configured to capture a still image and a second camera configured to capture a video image at overlapping capturing times in a preset simultaneous shooting mode; and a controller configured to in response to a preset user input, generate a composite image including the still image captured by the first camera and the video image captured by the second camera, and display the composite image on the display.
    Type: Grant
    Filed: October 3, 2016
    Date of Patent: October 16, 2018
    Assignee: LG ELECTRONICS INC.
    Inventors: Hyomin Eum, Younghoon Song, Seongeun Kim, Jinseong Lee
  • Patent number: 10062020
    Abstract: According to one example, there is provided a method of processing content data representing content to be printed. The method comprises obtaining content data representing content to be printed, and generating raised print data from the content data, the raised print data representing areas of the content to be formed as raised print.
    Type: Grant
    Filed: September 26, 2013
    Date of Patent: August 28, 2018
    Assignee: HP Indigo B.V.
    Inventor: Gadi Oron
  • Patent number: 10057503
    Abstract: An image processing apparatus comprises: an obtainment unit configured to obtain an image; a setting unit configured to set, based on a shading status of a region of a first subject out of a plurality of subjects included in the image, a virtual light source for virtually emitting light on a region of a second subject in the image that is different to the first subject; and a generation unit configured to generate an image having a shading status such that light based on the set virtual light source is emitted onto the region of the second subject.
    Type: Grant
    Filed: January 6, 2017
    Date of Patent: August 21, 2018
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hiroshi Suzuki
  • Patent number: 10043443
    Abstract: A luminance compensating method and apparatus for a display device is provided.
    Type: Grant
    Filed: September 26, 2014
    Date of Patent: August 7, 2018
    Assignee: BOE Technology Group Co., Ltd.
    Inventor: Xiangfei Zhang
  • Patent number: 10021331
    Abstract: The present disclosure relates to a comparator, an AD converter, a solid-state imaging device, an electronic apparatus, and a comparator control method that can reduce power consumption while increasing the determination speed of the comparator. The comparator includes a comparison unit, a positive feedback circuit, and a current limiting unit. The comparison unit compares the voltage of an input signal and the voltage of a reference signal, and outputs a comparison result signal. The positive feedback circuit increases the transition speed at the time when the comparison result signal is inverted. The current limiting unit limits the current flowing in the comparison unit after the inversion of the comparison result signal. The present disclosure can be applied to comparators, for example.
    Type: Grant
    Filed: July 1, 2015
    Date of Patent: July 10, 2018
    Assignee: Sony Corporation
    Inventors: Masaki Sakakibara, Kenichi Aoyagi, Seiji Yamada
  • Patent number: 10021358
    Abstract: A plurality of adjacent pixels is provided adjacently in a plurality of directions to a first pixel. A direction with a highest correlation is derived from signals of the plurality of pixels, and the direction with the highest correlation is reflected to interpolation processing to be performed on the signal of first pixel.
    Type: Grant
    Filed: December 19, 2017
    Date of Patent: July 10, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Tomoya Onishi, Noriyuki Kaifu, Fujio Kawano, Hisashi Takado
  • Patent number: 10007337
    Abstract: A device for acquiring a combined eye gaze image of an object under dark-eye effect conditions, with a first camera, a second camera, a first light source and a second light source being located on opposite sides of, and on essentially equal distance to a central optical axis. A control unit is arranged to acquire the combined eye gaze image by capturing, in a first point in time, a first frame of the object with the first camera with the second light source activated, and, at a second point in time, capturing a second frame of the object with the second camera with the first light source activated. The device comprises no additional light sources further away from the central optical axis than the first location and the second location. The device is thereby designed as compact as possible while a sufficient eye gaze tracking accuracy and robustness is maintained.
    Type: Grant
    Filed: July 1, 2014
    Date of Patent: June 26, 2018
    Assignee: Smart Eye AB
    Inventors: Martin Rydberg, Martin Krantz
  • Patent number: 9979906
    Abstract: An optical system and method may relate to capturing extended dynamic range images. In an example embodiment, the optical system may include a lens element configured to receive incident light and a beam splitter optically coupled to the lens element. The beam splitter is configured to separate the incident light into at least a first portion having a first photon flux and a second portion having a second photon flux. The first photon flux is at least an order of magnitude greater than the second photon flux. A controller may be configured to cause a first image sensor to capture a first image of the first portion of the incident light according to first exposure parameters and cause a second image sensor to capture a second image of the second portion of the incident light according to second exposure parameters.
    Type: Grant
    Filed: August 3, 2016
    Date of Patent: May 22, 2018
    Assignee: Waymo LLC
    Inventors: Roman Lewkow, Mark Shand
  • Patent number: 9955209
    Abstract: An apparatus, a method of providing scenes on a display and an immersive viewing system is disclosed. In one embodiment, the apparatus includes: (1) a movement detector configured to monitor movement of a user with respect to a display, wherein the movement detector is disengaged from the user and includes a distance sensor configured to detect a distance of the user from the display and (2) an active screen displayer configured to navigate an active scene on the display based on changes in the distance and dynamically provide an updated view of the active scene on the display based thereon.
    Type: Grant
    Filed: April 14, 2010
    Date of Patent: April 24, 2018
    Assignee: Alcatel-Lucent USA Inc.
    Inventor: Hock M. Ng
  • Patent number: 9918007
    Abstract: The present invention discloses a photographing method. The method includes: determining a photographed object in a viewing frame; obtaining characteristic information of the photographed object, where the characteristic information is used to indicate a type of the photographed object; analyzing a behavioral parameter of the photographed object and an environmental parameter in the viewing frame, where the behavioral parameter is used to indicate a behavior type and a behavior speed of the photographed object, and the environmental parameter is used to indicate a color condition and/or a light condition in the viewing frame; determining a photographing parameter that corresponds to the characteristic information, the behavioral parameter, and the environmental parameter; and photographing the photographed object according to the photographing parameter.
    Type: Grant
    Filed: January 26, 2017
    Date of Patent: March 13, 2018
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Zhen He, Jilin Liu, Tengyue Li
  • Patent number: 9900519
    Abstract: A method, a device and a computer readable for automatically identifying a Christmas tree scene and setting a camera's focus and/or exposure parameters in a way that yields images with high image quality. The Christmas tree scene identification can be performed by segmenting the image into bright and dark regions, identifying the light objects, collecting the statistics of the light objects, and classifying the scene based on the statistics of the light objects, or by collecting the pixel value statistics for the image, and classifying the scene based on the statistics of the pixel values, or by collecting the pixel value statistics for the image, filtering the image, collecting the pixel value statistics for the filtered image, and classifying the scene by comparing the statistics of the pixel values before and after filtering. The focus and exposure settings can be adjusted based on the Christmas tree scene identification results.
    Type: Grant
    Filed: March 25, 2016
    Date of Patent: February 20, 2018
    Assignee: SKR Labs, LLC
    Inventor: Zhigang Fan
  • Patent number: 9888184
    Abstract: A light emission control device that is capable of controlling an emission amount of a light emitting unit irrespective of existence of a high-intensity light source. A selecting unit divides each of a non-emission image and a pre-emission image into a predetermined number of block areas, and selects a light-control target area according to a difference between luminance values in the non-emission image and the pre-emission image. A first weighting unit generates first weighting data by allocating a predetermined weight to each the light-control target area. A second weighting unit finds a weighting coefficient for each the light-control target area in the non-emission image, and to generate second weighting data by multiplying the first weighting data by the weighting coefficient. A control unit controls the emission unit according to a main emission amount that makes the light-control target area be proper exposure with reference to the second weighting data.
    Type: Grant
    Filed: January 27, 2016
    Date of Patent: February 6, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yasuyoshi Miyazaki
  • Patent number: 9874630
    Abstract: A gated time of flight (GT-TOF) range camera that transmits a plurality of light pulses to illuminate features in a scene and gates ON a photosensor in the camera for one multi-exposure gate having a plurality of exposure periods following each of the plurality of light pulses to register amounts of light reflected by features in the scene from the light pulses and uses the registered amounts of light to determine distances to the features.
    Type: Grant
    Filed: January 30, 2015
    Date of Patent: January 23, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Michael Hall, Algird Gudaitis
  • Patent number: 9860456
    Abstract: The embodiments described herein perform image infusion on Bayer image data that is coordinated with Clear image data captured with a dual camera. A first image sensor of the dual camera captures a Bayer image, while a second sensor captures a Clear image, where the first sensor and the second sensor are synchronized to capture the images at the same time. Some embodiments generate a relational mapping of Clear luma channel data extracted from the Clear image to Bayer luma channel data extracted from the Bayer image data, and use the relational mapping to generate multiple de-noised luma representations associated with the Bayer image. The multiple de-noised luma representations are then selectively merged together to generate a resultant image that retains a high signal-to-noise radio (SNR) and reduces artifacts obtained by the image processing.
    Type: Grant
    Filed: November 11, 2016
    Date of Patent: January 2, 2018
    Assignee: MOTOROLA MOBILITY LLC
    Inventors: Yuriy Musatenko, Kostyantyn Milshteyn
  • Patent number: 9830690
    Abstract: A method for wide dynamic range imaging is illustrated. A region mapping operation having steps as follows is applied to an image using a plurality of region mapping curves for compensating different luminance associated with a plurality of regions in the image. A low frequency image is obtained. A reference value for each region in the image is obtained according to the low frequency image. One region mapping curve is selected according to the reference value of the region. A gain curve is obtained according to the selected region mapping curve, a gain value of a pixel value or a luminance value of the region is obtained according to the gain curve, an adjusted gain value is obtained according to the luminance corresponding to the pixel value, and the pixel value is adjusted according to the luminance value, the gain value, and the adjusted gain value.
    Type: Grant
    Filed: April 4, 2016
    Date of Patent: November 28, 2017
    Assignee: REALTEK SEMICONDUCTOR CORP.
    Inventors: Hao-Tien Chiang, Shih-Tse Chen
  • Patent number: 9811892
    Abstract: Embodiments of the present disclosure generally relate to image signal processing logic, and in particular, to separating an undecimated image signal data to create two components with lower resolution and full-resolution, generating an interpolation guidance information based on the two components created by separation, forming a difference image data representing the difference between the chroma and luma values of each pixel and its neighboring pixels, and merging the processed image data from the processing pipelines with the unprocessed image data using the interpolation guidance information generated. The generation of the interpolation guidance information is based on determining distances between pixel values from a group comprising pixels from interpolation nodes, pixels diagonally located adjacent to the interpolation nodes, pixels horizontally adjacent to the interpolation nodes, and pixels vertically adjacent to the interpolation nodes.
    Type: Grant
    Filed: June 30, 2016
    Date of Patent: November 7, 2017
    Assignee: Apple Inc.
    Inventors: D. Amnon Silverstein, David R. Pope, Simon W. Butler, Maxim W. Smirnov
  • Patent number: 9807321
    Abstract: An imaging device that reliably images an object flashing at a period closely analogous to an output period of a moving image within a certain period is provided. A first common frame image, which is synthesized from pixel signals produced by photoelectric conversion elements arranged in row selection lines from a second start row selection line to an end row selection line, is extracted from a first frame image synthesized by an image sensor starting at a first start row selection line. As a moving image, a sequence of the first common frame images and second frame images synthesized by the image sensor starting at the second start row selection line is produced. Due to the phase difference between an imaging period of the first common frame image and an imaging period of the second frame image, a flashing object is captured in any of the frame images.
    Type: Grant
    Filed: July 22, 2015
    Date of Patent: October 31, 2017
    Assignee: SMK Corporation
    Inventor: Kazutaka Motohashi
  • Patent number: 9800826
    Abstract: Provided are a method and device for adjusting a frame rate of video recording. According to the method, data collected by a sensor of a terminal is acquired; state information is determined according to the acquired data, wherein the state information is used for adjusting a frame rate of video recording of the terminal; the frame rate of video recording of the terminal is adjusted according to the determined state information, thereby reducing the power consumption of the terminal. The technical solution solves the problem in related art of additional power consumption because the frame rate of video recording is dynamically adjusted based on features of an image frame, reduces the power consumption of a video recording function, and improves the endurance capability of the terminal.
    Type: Grant
    Filed: April 29, 2014
    Date of Patent: October 24, 2017
    Assignee: XI'AN ZHONGXING NEW SOFTWARE CO. LTD
    Inventors: Yulei Wang, Xia Sheng, Shifeng Que, Xiangjie Tong
  • Patent number: 9769394
    Abstract: An image pickup apparatus includes an endoscope configured to have an image pickup section in which a plurality of pixels are provided, and a storage section configured to store scope individual information, a binning processing section configured to split an image into a plurality of regions so that one region includes a plurality of pixel signals, and add up the pixel signals for each region to obtain a binning pixel signal, a binning brightness detection section configured to detect brightness of the region, a blend processing section configured to set a weight in the region on the basis of the brightness, and weight and composite the pixel signals and the binning pixel signal to generate a composite image, and a control section configured to control the binning processing section in accordance with the scope individual information.
    Type: Grant
    Filed: May 24, 2016
    Date of Patent: September 19, 2017
    Assignee: OLYMPUS CORPORATION
    Inventors: Yuji Kutsuma, Kazuma Kaneko, Tomoki Iwasaki, Susumu Hashimoto, Soichiro Koshika
  • Patent number: 9729886
    Abstract: Method and apparatus for the digital encoding of a first raw file, the method includes: a first step of capturing the raw file, the raw file being an audio and/or image and/or video file; a second step of encoding the captured raw file into a second file, in a proprietary format (P); then, a third step for re-encoding the second file into a third file in a compatible format (C).
    Type: Grant
    Filed: November 8, 2013
    Date of Patent: August 8, 2017
    Inventors: Than Marc-Eric Gervais, Bruno Loubet, Nicolas Bessous, Yves Guimiot, Mickael Petitfils, Sebastien Roques
  • Patent number: 9723234
    Abstract: A solid-state imaging device includes a pixel array and a pixel value correcting unit. The pixel array includes a plurality of pixels, the plurality of pixels each having one of a different exposure time and a different exposure sensitivity and being disposed according to a predetermined rule. The pixel value correcting unit is configured to correct, among pixel values obtained from the plurality of pixels in the pixel array, a pixel value of a pixel of the plurality of pixels that applies to a preset condition, by using a pixel value of another pixel of the plurality of pixels.
    Type: Grant
    Filed: June 2, 2016
    Date of Patent: August 1, 2017
    Assignee: Sony Semiconductor Solutions Corporation
    Inventors: Kazuhide Fujita, Kentaro Okamura
  • Patent number: 9659412
    Abstract: Methods and systems are provided for displaying information on a heads up display (HUD). A background image is captured with a camera. A plurality of regions of the background image are analyzed to determine a region-wise image attribute for each of the plurality of regions. A symbology having a symbology attribute is generated and overlaid on an overlay region of the background image to generate a heads up display image. The overlay region is one of the plurality of regions of the background image. The symbology attribute is adjusted based on the region-wise image attribute of the overlay region to generate an adjusted heads up display image. The adjusted heads up display image is displayed on the HUD.
    Type: Grant
    Filed: July 30, 2015
    Date of Patent: May 23, 2017
    Assignee: HONEYWELL INTERNATIONAL INC.
    Inventors: Mohammed Ibrahim Mohideen, Mahesh Kumar Gellaboina, Prasanna Murthy Gurajapu
  • Patent number: 9654700
    Abstract: A camera device includes monochromatic and color image sensors that capture an image as a clear image in monochrome and as a Bayer image. The camera device implements image processing algorithms to produce an enhanced, high-resolution HDR color image. The Bayer image is demosaiced to generate an initial color image, and a disparity map is generated to establish correspondence between pixels of the initial color image and clear image. A mapped color image is generated to map the initial color image onto the clear image. A denoised clear image is applied as a guide image of a guided filter that filters the mapped color image to generate a filtered color image. The filtered color image and the denoised clear image are then fused to produce an enhanced, high-resolution HDR color image, and the disparity map and the mapped color image are updated based on the enhanced, high-resolution HDR color image.
    Type: Grant
    Filed: September 16, 2014
    Date of Patent: May 16, 2017
    Assignee: Google Technology Holdings LLC
    Inventors: Ivan Kovtun, Volodymyr Kysenko, Yuriy Musatenko, Adrian M Proca, Philip S Stetson, Yevhen Ivannikov
  • Patent number: 9639920
    Abstract: In an example, a method for image processing may include inputting a first pixel value corresponding to a first pixel of an image into a LUT. The LUT may map one or more LUT input values to one or more LUT output values. The first pixel value may correspond to a first LUT input value that maps to a first LUT output value in the LUT. The first pixel may include one or more pixel values. The method may include generating a noise value for the first LUT input value. The method may include generating a first interpolated LUT output value for the first LUT input value based on the noise value. The method may include transforming the image into a transformed image using the first interpolated LUT output value.
    Type: Grant
    Filed: November 12, 2015
    Date of Patent: May 2, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Min Dai, Ike Ikizyan, Ai-Mei Huang
  • Patent number: 9626746
    Abstract: An image processing apparatus includes a gain calculation unit that calculates a gain for each of a plurality of pixels of an image signal, respectively, and an addition unit that adds the gain for each pixel to the corresponding pixel of the plurality of pixels of the image signal. The gain calculation unit includes a first order differential operation unit that calculates a first value from first order differential of the image signal for each of the plurality of pixels and second order differential operation unit that calculates a second value from a second order differential of the image signal for each of the plurality of pixels, and calculates the gains for each pixel based on the first and second values for each pixel.
    Type: Grant
    Filed: September 15, 2015
    Date of Patent: April 18, 2017
    Assignee: SAMSUNG DISPLAY CO., LTD.
    Inventor: Masatoshi Sonoda
  • Patent number: 9591211
    Abstract: The present invention discloses a photographing method. The method includes: determining a photographed object in a viewing frame; obtaining characteristic information of the photographed object, where the characteristic information is used to indicate a type of the photographed object; analyzing a behavioral parameter of the photographed object and an environmental parameter in the viewing frame, where the behavioral parameter is used to indicate a behavior type and a behavior speed of the photographed object, and the environmental parameter is used to indicate a color condition and/or a light condition in the viewing frame; determining a photographing parameter that corresponds to the characteristic information, the behavioral parameter, and the environmental parameter; and photographing the photographed object according to the photographing parameter.
    Type: Grant
    Filed: August 13, 2014
    Date of Patent: March 7, 2017
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Zhen He, Jilin Liu, Tengyue Li
  • Patent number: 9491380
    Abstract: A system may include one or more camera modules each containing one or more image sensors. The system may be configured to capture images from light spectra outside the visible band. Therefore, the pixel integration times, and frame rates of the one or more image sensors may be unique and distinct. An image sensor may respond to a trigger control signal by beginning integration of a subset of pixels some duration after an appropriate trigger control signal transitions from low to high. The image sensor may output the frame captured by the pixels a predetermined duration after the trigger control signal transitions, to ensure a deterministic response. Pixels used to generate the image of a subsequent frame may begin integrating during the readout of the current frame. The pixels may be integrated for exactly their programmed integration time, even when the frame rate is varied.
    Type: Grant
    Filed: September 12, 2014
    Date of Patent: November 8, 2016
    Assignee: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC
    Inventors: Sergi Cami, Peter Hall
  • Patent number: 9468074
    Abstract: A vehicle lighting control system includes wearable glasses configured to recognize pupils of a driver in a vehicle in real time, a head unit configured to receive a size of the pupils of the driver from the wearable glasses to acquire brightness control values of a plurality of lighting devices installed in the vehicle according to a predetermined formula, and a controller configured to adjust brightness of the lighting devices installed in the vehicle according to the brightness control values received from the head unit.
    Type: Grant
    Filed: August 24, 2015
    Date of Patent: October 11, 2016
    Assignee: HYUNDAI MOTOR COMPANY
    Inventor: Sung Woo Park
  • Patent number: 9451173
    Abstract: An electronic device and a method of controlling an operation thereof are provided. The method includes acquiring image data using an image sensor comprising a first plurality of pixels configured to have a first identical exposure time and a second plurality of pixels configured to have a second identical exposure time, wherein the acquiring of the image data includes acquiring the image data using the first plurality of pixels and the second plurality of pixels while the first plurality of pixels have the first identical exposure time that is identical to the second identical exposure time of the second plurality of pixels and controlling the image sensor such that the first plurality of pixels has the first identical exposure time different from the second identical exposure time of the second plurality of pixels, at least partially based on the acquired image data.
    Type: Grant
    Filed: August 4, 2014
    Date of Patent: September 20, 2016
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hwa-Young Kang, Young-Kwon Yoon, Jong-Hyub Lee, Moon-Soo Kim, Tae-Ho Kim
  • Patent number: 9438799
    Abstract: A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.
    Type: Grant
    Filed: April 1, 2015
    Date of Patent: September 6, 2016
    Assignee: GoPro, Inc.
    Inventor: David A. Newman
  • Patent number: 9431444
    Abstract: A color imaging element including color filters arranged on pixels, wherein the color filter array includes a basic array pattern including first filters corresponding to a first color that most contributes to obtaining luminance signals and second filters corresponding to two or more second colors other than the first color, the basic array pattern repeatedly arranged in the horizontal and vertical directions, one or more first filters are arranged in each line in horizontal, vertical, and oblique directions of the color filter array, one or more second filters are arranged in each line in the horizontal and vertical directions of the color filter array in the basic array pattern, and a proportion of the number of pixels of the first color corresponding to the first filters is greater than proportions of the numbers of pixels of each color of the second colors corresponding to the second filters.
    Type: Grant
    Filed: May 3, 2013
    Date of Patent: August 30, 2016
    Assignee: FUJIFILM Corporation
    Inventors: Kenkichi Hayashi, Seiji Tanaka
  • Patent number: 9432643
    Abstract: An image processing device includes a demosaicing process device, a luminance system image data acquisition device that acquires luminance system image data as image data regarding the luminance, a point image restoration process execution device, an information acquisition device that acquires control information concerning execution of the point image restoration process on the basis of imaging information concerning an imaging condition of a subject, and a point image restoration process control device.
    Type: Grant
    Filed: July 27, 2015
    Date of Patent: August 30, 2016
    Assignee: FUJIFILM Corporation
    Inventors: Kenkichi Hayashi, Masahiko Sugimoto, Yousuke Naruse
  • Patent number: 9413921
    Abstract: During capturing, image data obtained by applying a simplified development process to RAW image data is recorded together with a RAW image. Afterward, image data obtained by applying a high quality development process to the RAW image data is generated, and this image data replaces the image data obtained by the simplified development. During capturing, a plurality of pieces of image data are generated by using a plurality of different development parameters for RAW image data, and recorded in association with the RAW image data. The development parameter corresponding to image data selected by the user is decided as a development parameter used for the subsequent high quality development process for the RAW image data, thereby facilitating the setting of the development parameters of the RAW image.
    Type: Grant
    Filed: March 12, 2015
    Date of Patent: August 9, 2016
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Kiyonori Matsumoto
  • Patent number: 9391104
    Abstract: A color imaging element including color filters arranged on pixels, wherein the color filter array includes a basic array pattern including first filters corresponding to a first color that most contributes to obtaining luminance signals and second filters corresponding to two or more second colors other than the first color, the basic array pattern repeatedly arranged in the horizontal and vertical directions, one or more first filters are arranged in each line in horizontal, vertical, and oblique directions of the color filter array, one or more second filters are arranged in each line in the horizontal and vertical directions of the color filter array in the basic array pattern, and a proportion of the number of pixels of the first color corresponding to the first filters is greater than proportions of the numbers of pixels of each color of the second colors corresponding to the second filters.
    Type: Grant
    Filed: May 3, 2013
    Date of Patent: July 12, 2016
    Assignee: FUJIFILM Corporation
    Inventors: Kenkichi Hayashi, Seiji Tanaka
  • Patent number: 9386245
    Abstract: A solid-state imaging device includes a pixel array and a pixel value correcting unit. The pixel array includes a plurality of pixels, the plurality of pixels each having one of a different exposure time and a different exposure sensitivity and being disposed according to a predetermined rule. The pixel value correcting unit is configured to correct, among pixel values obtained from the plurality of pixels in the pixel array, a pixel value of a pixel of the plurality of pixels that applies to a preset condition, by using a pixel value of another pixel of the plurality of pixels.
    Type: Grant
    Filed: July 3, 2014
    Date of Patent: July 5, 2016
    Assignee: SONY CORPORATION
    Inventors: Kazuhide Fujita, Kentaro Okamura
  • Patent number: 9379156
    Abstract: Techniques for per-channel image intensity correction includes linear interpolation of each channel of spectral data to generate corrected spectral data.
    Type: Grant
    Filed: April 10, 2008
    Date of Patent: June 28, 2016
    Assignee: NVIDIA CORPORATION
    Inventors: Brian Cabral, Hu He, Elena Ing, Sohei Takemoto
  • Patent number: 9349161
    Abstract: Edge enhancement processing is performed for the luminance of each pixel of an image, and the correction value of the pixel after the edge enhancement processing is decided according to the saturation of each pixel of the image. The value of the pixel after the edge enhancement processing is corrected using the decided correction value.
    Type: Grant
    Filed: June 28, 2013
    Date of Patent: May 24, 2016
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hirokazu Tamura
  • Patent number: 9230297
    Abstract: Methods, systems, and computer program products to obtain a color image from a color filter array, such as, for example, a color filter array comprising a Bayer pattern. A method of image processing includes, for each pixel location (i,j) and for each color channel in a color image, determining a warped location (i?,j?) in a color filter array, and determining a color value of the color channel at location (i?,j?) in the color filter array. The method may further include storing the determined color value. The determining of the color value may include interpolating the color value of the color channel at location (i?,j?) in the color filter array. In this manner, a single interpolation operation set may be needed and an intermediate image may be avoided, saving memory, reducing processing time, minimizing artifacts, and reducing cost.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: January 5, 2016
    Assignee: Intel Corporation
    Inventors: Etienne G. Grossmann, John I. Woodfill, Gaile Gordon
  • Patent number: 9232199
    Abstract: In accordance with an example embodiment a method, apparatus and computer program product are provided. The method comprises receiving a first set of frames corresponding to a scene captured by a color image sensor and a second set of frames corresponding to the scene captured by a panchromatic image sensor. A number of frames in the second set is greater than a number of frames in the first set. The method further comprises generating color frames corresponding to the scene at a frame rate higher than a frame rate of the first set of frames based at least in part on processing of the first set of frames and the second set of frames.
    Type: Grant
    Filed: June 21, 2013
    Date of Patent: January 5, 2016
    Assignee: Nokia Technologies Oy
    Inventor: Krishna Annasagar Govindarao
  • Patent number: 9124835
    Abstract: After accumulating electric charges in pixels in first, second, and third rows, signals are output from the pixels in the first and second rows in a first frame, and thereafter, after accumulating electric charges in the pixels in the first row without accumulating electric charges in the pixels in the second and third rows, signals are output from the pixels in the first and third rows in a second frame following the first frame. Furthermore, the photoelectric conversion units of the pixels in the second and third rows are reset by the resetting units included in the pixels in the second and third rows in the first frame.
    Type: Grant
    Filed: February 12, 2013
    Date of Patent: September 1, 2015
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Yuichiro Yamashita, Yoshihito Harada
  • Patent number: 9113059
    Abstract: There is provided an image pickup apparatus that, even if image data has insufficient depth difference between an object and a background, accurately discriminates a region including an object and a region including a background. The image pickup apparatus includes a generation unit configured to generate image data, and a discrimination unit configured, based on first image data generated by the generation unit, when an in-focus position is at a first focal position at which an object is in-focus state or a second focal position on a short distance side of the first focal position, and second image data generated by the generation unit, when an in-focus position is at a third focal position on a far distance side of a focal position at which a background is in-focus state, to discriminate a first region including the object and a second region including the background.
    Type: Grant
    Filed: November 28, 2012
    Date of Patent: August 18, 2015
    Assignee: Canon Kabushiki Kaisha
    Inventor: Koichiro Ikeda
  • Patent number: 9100530
    Abstract: An image processing apparatus includes an identifier identifying, for each pixel in the frame image, minimum pixel values for each color component from pixel values of surrounding pixels for each color component. The surrounding pixels are positioned around the pixel. The identifier also identifies, as a common pixel value, a minimum value in the minimum pixel values identified for each color component. The apparatus further includes a generator generating a preprocessed image which can be obtained by replacing a pixel value of each pixel in the frame image with the common pixel value identified for the pixel by the identifier, a low pass filter generating a first subframe image by applying a low-pass filter to the preprocessed image, and a subtractor generating, as a second subframe image, a difference image between the frame image and the first subframe image.
    Type: Grant
    Filed: October 14, 2010
    Date of Patent: August 4, 2015
    Assignee: Canon Kabushiki Kaisha
    Inventors: Kazuya Kitada, Eisaku Tatsumi, Makiko Mori