Patents by Inventor Tomoo Mitsunaga

Tomoo Mitsunaga has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 8792746
    Abstract: An image processing apparatus includes an edge strength calculating unit that sets, as an input image, a pixel number reduced image obtained by reducing the total number of pixels of an image captured by an imaging element and calculates edge strengths of a plurality of directions in a unit of a pixel block; an interpolated-pixel value calculating unit that calculates interpolated-pixel values as smoothing components of the plurality of directions in the pixel block; a weight calculating unit that calculates weights for the interpolated-pixel values as the smoothing components of the plurality of directions based on the edge strengths; and a blending processing unit that calculates a pixel value of the correction object pixel which is the center pixel of the pixel block by performing a blending process by weighted addition of the interpolated-pixel values, which are the smoothing components of the plurality of directions, and the calculated weights.
    Type: Grant
    Filed: March 2, 2012
    Date of Patent: July 29, 2014
    Assignee: Sony Corporation
    Inventors: Daisuke Iso, Tomoo Mitsunaga
  • Patent number: 8787697
    Abstract: A normal-phase candidate position selection unit designates a pixel on a horizontal or vertical line in a position separated by two lines from a target position of an input image as a normal-phase candidate pixel, which is a candidate for a pixel at which jaggies are in the same phase as a pixel of the target position. A reverse-phase candidate position selection unit designates a pixel between the target position in the input image and the normal-phase candidate pixel as a reverse-phase candidate pixel. The weight value calculation unit calculates a weight value based on a degree of similarity between an image adjacent to the target position and an image adjacent to the normal-phase candidate pixel. The weighted expected value calculation unit performs weighted addition of reverse-phase candidate pixels using the weight value and generates a reverse-phase image by reversing only the phase of the jaggies in the input image.
    Type: Grant
    Filed: April 9, 2012
    Date of Patent: July 22, 2014
    Assignee: Sony Corporation
    Inventors: Tomoo Mitsunaga, Hiroaki Takahashi
  • Publication number: 20140192235
    Abstract: Systems, methods, and media for reconstructing a space-time volume from a coded image are provided. In accordance with some embodiments, systems for reconstructing a space-time volume from a coded image are provided, the systems comprising: an image sensor that outputs image data; and at least one processor that: causes a projection of the space-time volume to be captured in a single image of the image data in accordance with a coded shutter function; receives the image data; and performs a reconstruction process on the image data to provide a space-time volume corresponding to the image data.
    Type: Application
    Filed: February 27, 2012
    Publication date: July 10, 2014
    Applicants: Sony Corporation, The Trustees of Columbia University in the City of New York
    Inventors: Yasunobu Hitomi, Jinwei Gu, Mohit Gupta, Tomoo Mitsunaga, Shree K. Nayar
  • Publication number: 20140192250
    Abstract: The present disclosure provides an apparatus and a method for generating a wide dynamic range image by executing a pixel value combination process of a plurality of different exposure time setting pixels. Control of a different exposure time is performed for each of a plurality of pixels of the same colors configuring a pixel block and an addition pixel value obtained by adding outputs of the plurality of pixels of the same colors of the pixel block is generated. The generation of the addition pixel value is executed in an operation unit having an adding unit that that adds the outputs of the plurality of pixels of the same colors of the pixel block. Or, the generation of the addition pixel value is executed by a floating diffusion (FD) set in a pixel block unit and a charge output from each of the plurality of pixels of the same colors configuring the pixel block is accumulated and output in the floating diffusion (FD).
    Type: Application
    Filed: June 29, 2012
    Publication date: July 10, 2014
    Applicant: Sony Corporation
    Inventor: Tomoo Mitsunaga
  • Patent number: 8749646
    Abstract: An image processing apparatus includes: a shaking estimating unit configured to estimate the shaking information of an image generated within a predetermined period of time; a short-time-exposure shaking correcting unit configured to correct the shaking of a plurality of short-time-exposure images generated due to intermittent exposure within the predetermined period of time based on the estimated shaking information; a long-time-exposure shaking correcting unit configured to correct the shaking of a long-time-exposure image generated due to consecutive exposure within the predetermined period of time based on the estimated shaking information; and an image synthesizing unit configured to synthesize the corrected short-time-exposure images and the corrected long-time-exposure image.
    Type: Grant
    Filed: September 1, 2009
    Date of Patent: June 10, 2014
    Assignee: Sony Corporation
    Inventor: Tomoo Mitsunaga
  • Publication number: 20140118580
    Abstract: Provided is an image processing device including an image processing unit that sets a RAW image in which a pixel value of a specific color is set in each pixel as an input image and reduces a noise component contained in the input image. The image processing unit includes a local region selection unit, a similar local region selection unit, a band separation unit, a band-classified noise reduction unit, a band combining unit, and a local region combining unit.
    Type: Application
    Filed: September 18, 2013
    Publication date: May 1, 2014
    Applicant: SONY CORPORATION
    Inventors: Hiroaki Ono, Teppei Kurita, Tomoo Mitsunaga
  • Patent number: 8712182
    Abstract: An image processing device includes an image estimation unit that estimates an image prior to the jaggedness occurrence from a jaggedness-occurring image and generates an estimated image prior to the jaggedness occurrence, and a weighting/adding unit that selects a jaggedness-occurring area as a processing target area in the estimated image prior to the jaggedness occurrence, detects a similar area that is a pixel area and similar to the processing target area, and then computes a weight according to the degree of similarity of each detected similar area to the processing target area, and detects a corresponding area in the jaggedness-occurring image to the processing target area and the similar area, and then computes a corrected pixel value of the processing target area of the jaggedness-occurring image through a weighting/adding process to which the weight of a pixel value of the detected corresponding area is applied.
    Type: Grant
    Filed: March 20, 2012
    Date of Patent: April 29, 2014
    Assignee: Sony Corporation
    Inventors: Daisuke Iso, Teppei Kurita, Tomoo Mitsunaga
  • Patent number: 8659675
    Abstract: The present invention relates to an image processing apparatus, an image processing method, and a program that are capable of removing an influence due to illumination components from a plurality of images in which illumination environments are different and generating an image having high color reproducibility. A demosaic processing unit 221 performs a demosaic process on a reference image held in a reference mosaic image holding unit 111. A demosaic processing unit 222 performs a demosaic process on a processing target image that is held in a processing target mosaic image holding unit 112. A white balance calculation unit 230 calculates a white-balance value for each channel with respect to the reference image. A channel gain calculation unit 250 calculates a gain for each channel for converting illumination components on the basis of RGB values of the reference image and the processing target image, and the white balance of the reference image.
    Type: Grant
    Filed: July 7, 2010
    Date of Patent: February 25, 2014
    Assignee: Sony Corporation
    Inventors: Hiroaki Takahashi, Tomoo Mitsunaga
  • Patent number: 8654221
    Abstract: An image processing device extracting a contrast component for each pixel of an input image by removing a low-frequency component of the input image and correcting the contrast component for each pixel based on a gain value, including: an input/output-property generating unit for generating an input/output-property curve, assuming an input contrast component which is the pre-correction contrast component as input, and an output contrast component which is the post-correction contrast component as output, which is an input/output-property curve of which the output contrast component monotonously increases as to the input contrast component; a gain properties generating unit for generating a gain property curve representing properties as to the input contrast component of the gain value for correcting the input contrast component to obtain the output contrast component based on the input/output-property curve; and a gain-value calculating unit for calculating the gain value for each pixel of the input image bas
    Type: Grant
    Filed: April 9, 2008
    Date of Patent: February 18, 2014
    Assignee: Sony Corporation
    Inventor: Tomoo Mitsunaga
  • Patent number: 8610789
    Abstract: The application provides techniques for obtaining a relatively high dynamic range image of a scene using a relatively low dynamic range image sensor exposed to incident light from the scene for capturing an image. The image sensor has a multiplicity of light-sensing elements in an array and each light sensing element has a particular one of a plurality of sensitivity levels to incident light in accordance with a predetermined sensitivity pattern for the array of light-sensing elements and has a response function. Each light sensing element is responsive to incident light from the scene for producing a captured image brightness value at a corresponding one of a multiplicity of pixel positions of a pixel position array. Each one of the multiplicity of pixel positions corresponds to a particular one of the plurality of sensitivity levels of the light sensing elements.
    Type: Grant
    Filed: May 10, 2011
    Date of Patent: December 17, 2013
    Assignees: The Trustees of Columbia University in the City of New York, Sony Corporation
    Inventors: Shree K. Nayar, Tomoo Mitsunaga
  • Publication number: 20130329128
    Abstract: An apparatus and a method are provided, which realize image pickup processing in which setting of an exposure time is performed in units of regions in an image pickup apparatus. An electronic shutter control unit that controls an exposure start time of an image pickup device by an electronic shutter operation and a mechanical shutter control unit that controls an exposure end time of the image pickup device by a mechanical shutter operation. The electronic shutter control unit calculates the exposure start time in units of image regions based on an exposure time individually set in units of image regions, and an operation time of the mechanical shutter in units of image regions, and controls the electronic shutter to operate at the calculated exposure start time in units of image regions.
    Type: Application
    Filed: January 26, 2012
    Publication date: December 12, 2013
    Applicant: Sony Corporation
    Inventors: Shun Kaizu, Tomoo Mitsunaga
  • Publication number: 20130308044
    Abstract: There are provided an imaging apparatus and method which perform different exposure control in pixel group units. Brightness in the pixel group units obtained by dividing a plurality of pixels of an imaging area of the image sensor is evaluated, and pixel group unit exposure control values are calculated according to an evaluation result. The image sensor outputs a control signal matching the calculated pixel group unit exposure control value to each pixel group constituent pixel, and controls exposure in the pixel group units. For example, the exposure control signal including an identical pattern is sequentially output to a plurality of pixels in a pixel group in a time sequence, and exposure control which sets an identical exposure time for a plurality of pixels belonging to one pixel group is realized.
    Type: Application
    Filed: January 26, 2012
    Publication date: November 21, 2013
    Applicant: Sony Corporation
    Inventor: Tomoo Mitsunaga
  • Patent number: 8582923
    Abstract: An image processing apparatus includes: a representative value calculation unit calculating a representative value from an input first image signal; an interpolation unit interpolating the representative value calculated by the representative value calculation unit using a second image signal input after the first image signal; and an adjustment processing unit blending the interpolated image signal and the second image signal so that an output ratio of the image signal interpolated by the interpolation unit is smaller when a variation amount of an image corresponding to the second image signal with respect to an image corresponding to the first image signal is large in comparison to a case when the variation amount is small.
    Type: Grant
    Filed: March 8, 2011
    Date of Patent: November 12, 2013
    Assignee: Sony Corporation
    Inventors: Masafumi Wakazono, Tomoo Mitsunaga
  • Publication number: 20130266219
    Abstract: There is provided an image processing apparatus including a representative pixel calculation unit configured to select some pixels in an input image as representative pixels, a representative pixel update unit configured to update pixel values of the representative pixels, and a corrected image generation unit configured to set pixel values for pixels other than the representative pixels by applying the updated pixel values of the representative pixels. The representative pixel update unit is configured to, based on pixels around a position of the representative pixels in a smoothed image generated based on the input image as reference pixels, execute pixel value correction of the representative pixels by applying the pixel values of the reference pixels.
    Type: Application
    Filed: February 28, 2013
    Publication date: October 10, 2013
    Applicant: Sony Corporation
    Inventors: Teppei Kurita, Tomoo Mitsunaga
  • Publication number: 20130236095
    Abstract: There is provided an image processing device including: an image analysis unit and a pixel value correction unit, wherein the image analysis unit sets a plurality of bins having different bin widths which are set by a luminance range varying in size depending on a luminance value, and generates frequency distribution data obtained by setting the number of pixels contained in a luminance range corresponding to each bin as frequency data, and wherein the pixel value correction unit selects a bin corresponding to a pixel to be corrected which is a bin including the pixel value of the pixel to be subjected to noise reduction and a predetermined number of neighboring bins, and calculates a corrected pixel value of the pixel to be subjected to noise reduction by an arithmetic operation process to which a pixel value of a reference pixel contained in the selected bin is applied.
    Type: Application
    Filed: February 27, 2013
    Publication date: September 12, 2013
    Applicant: Sony Corporation
    Inventors: Yasunobu Hitomi, Tomoo Mitsunaga
  • Patent number: 8526729
    Abstract: An image processing apparatus includes a histogram calculation unit configured to calculate a histogram of a luminance value for each spatial block obtained by dividing an input image in a spatial direction, a gray scale correction coefficient calculation unit configured to calculate a gray scale correction coefficient used for correction of the gray scale of a luminance value for each bin of the histogram, and a gray scale correction unit configured to perform gray scale correction of a luminance value of a target pixel based on the gray scale correction coefficient of the bin to which the target pixel of the input image belongs and the gray scale correction coefficient of a bin adjacent to the bin to which the target pixel belongs in the spatial direction and a luminance direction.
    Type: Grant
    Filed: March 3, 2011
    Date of Patent: September 3, 2013
    Assignee: Sony Corporation
    Inventor: Tomoo Mitsunaga
  • Patent number: 8464025
    Abstract: A signal processing apparatus able to raise a processing capability in processing accompanying access to a storing means is provided. Stream control units (SCU) 203—0 to 203—3 access data at an external memory system or local memories 204—0 to 204—3 according to a thread under control from a host processor. Processor units (PU) arrays 202—0 to 202—3 perform image processing by a different thread from the thread of the SCUs 203—0 to 203—3.
    Type: Grant
    Filed: May 22, 2006
    Date of Patent: June 11, 2013
    Assignee: Sony Corporation
    Inventors: Yuji Yamaguchi, Masatoshi Imai, Toshiharu Noda, Naosuke Asari, Tomoo Mitsunaga, Mitsuharu Ohki, Kazumasa Ito, Hidetoshi Nagano, Sumito Arakawa, Kei Ito
  • Patent number: 8452122
    Abstract: An image processing apparatus includes: an assumed deteriorated image pixel value computing unit configured to calculate a pixel value of an assumed deteriorated image, wherein deterioration of a target image configured of multiple channels is assumed, for each of the channels as an assumed deteriorated image pixel value; a pseudo target image pixel value computing unit configured to calculate, regarding a pixel of interest that is a pixel of the target image corresponding to the assumed deteriorated image, a pixel value estimated for each of the channels as a pseudo target image pixel value for each of the channels based on the pixel values of the pixel of interest, and pixels adjacent thereto; and a restored image creating unit configured to create a restored image restored from the target image based on the calculated assumed deteriorated image pixel value and the calculated pseudo target image pixel value.
    Type: Grant
    Filed: August 21, 2009
    Date of Patent: May 28, 2013
    Assignee: Sony Corporartion
    Inventors: Yasunobu Hitomi, Tomoo Mitsunaga
  • Patent number: 8411991
    Abstract: An image processing apparatus includes: a characteristic value calculation unit calculating a block luminance average value, which is an average value of luminance values in each of spatial blocks obtained by dividing an input image in a space direction, and a block luminance dispersion, which is a dispersion of the luminance values in each of the spatial blocks; and an edge-preserving smoothing unit calculating a general luminance value of pixels of the input image by setting a value obtained by approximately calculating a weighted average value of the luminance values of a noticed block containing noticed pixels of the input image, on the assumption that a distribution of the luminance values of each of the spatial blocks conforms to a Gaussian distribution based on the block luminance average value and the block luminance dispersion of each of the spatial blocks, as the general luminance value of the noticed pixels.
    Type: Grant
    Filed: December 14, 2010
    Date of Patent: April 2, 2013
    Assignee: Sony Corporation
    Inventors: Kensei Jo, Yoshikuni Nomura, Tomoo Mitsunaga
  • Publication number: 20130077862
    Abstract: The present invention provides an apparatus and a method to perform an interpolation process of a color mosaic image generated through an imaging process by a single-plate color imaging element. The color mosaic image generated through the imaging process by the single-plate color imaging element is input, estimation is performed for a pixel value low frequency component and a noise high frequency component corresponding to a pixel interpolation position, and calculation for a pixel value at the pixel interpolation position is performed by applying an addition result thereof. An edge-adaptive interpolation processing unit calculates a pixel value at the pixel interpolation position by using a pixel value of a reference pixel located in an edge direction.
    Type: Application
    Filed: May 9, 2011
    Publication date: March 28, 2013
    Inventors: Yoshikuni Nomura, Tomoo Mitsunaga, Ting Zhang, Nobuyuki Matsushita