Patents by Inventor Tomoo Mitsunaga

Tomoo Mitsunaga has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20050099504
    Abstract: The application provides techniques for obtaining a relatively high dynamic range image of a scene using a relatively low dynamic range image sensor exposed to incident light from the scene for capturing an image. The image sensor has a multiplicity of light-sensing elements in an array and each light sensing element has a particular one of a plurality of sensitivity levels to incident light in accordance with a predetermined sensitivity pattern for the array of light-sensing elements and has a response function. Each light sensing element is responsive to incident light from the scene for producing a captured image brightness value at a corresponding one of a multiplicity of pixel positions of a pixel position array. Each one of the multiplicity of pixel positions corresponds to a particular one of the plurality of sensitivity levels of the light sensing elements.
    Type: Application
    Filed: October 5, 2004
    Publication date: May 12, 2005
    Inventors: Shree Nayar, Tomoo Mitsunaga
  • Publication number: 20050094007
    Abstract: A texture-intensity computation section computes a texture intensity TH and a texture intensity TV using interpolation values GA and EA. A G interpolation section computes an interpolation value GF using a horizontally adjacent interpolation value GA and a signal R. An E interpolation section computes an interpolation value EF using a vertically adjacent interpolation value EA and the signal R. The G interpolation section computes an interpolation value GU using the interpolation values GA, EA, and EF. The E interpolation section computes an interpolation value EU using the interpolation values GA, EA, and GF. A G+E generation section combines the interpolation values GU and EF to compute (G+E)V. A G+E generation section combines the interpolation values GF and EU to compute (G+E)H. A combining section determines the signal G+E using (G+E)H and (G+E)V, the texture intensities TH and TV.
    Type: Application
    Filed: October 27, 2004
    Publication date: May 5, 2005
    Inventors: Yoshikuni Nomura, Tomoo Mitsunaga
  • Publication number: 20050088550
    Abstract: An image processing apparatus is provided which includes: an image obtaining unit for obtaining a mosaic image by an image sensor having at least four kinds of filters with different spectral sensitivities, one of the at least four kinds of filters being used for each pixel; and an image processing unit for generating a color image such that intensity information at a position of each pixel, the intensity information corresponding to a number of colors determined by the spectral sensitivities of the filters, is computed for all pixels, from the mosaic image obtained by the image obtaining unit. In a color filter arrangement of the image sensor of the image obtaining unit, filters possessed by pixels arranged in a checkered manner in half of all the pixels have at least some spectral characteristics having a strong correlation with the spectral characteristic of luminance.
    Type: Application
    Filed: October 25, 2004
    Publication date: April 28, 2005
    Inventors: Tomoo Mitsunaga, Yoshikuni Nomura
  • Patent number: 6864916
    Abstract: Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The image of a scene is captured with an image sensor using a spatially varying exposure function. The spatially varying exposure function can be implemented in a number of ways, such as by using as an optical mask with a fixed spatial attenuation pattern or by using an array of light sensing elements having spatially varying photosensitivities. The captured image is then normalized with respect to the spatially varying exposure function. The normalized image data can be interpolated to account for pixels that are either saturated or blackened to enhance the dynamic range of the image sensor.
    Type: Grant
    Filed: June 4, 1999
    Date of Patent: March 8, 2005
    Assignees: The Trustees of Columbia University in the City of New York, Sony Corporation
    Inventors: Shree K. Nayar, Tomoo Mitsunaga
  • Publication number: 20040239798
    Abstract: Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.
    Type: Application
    Filed: July 7, 2004
    Publication date: December 2, 2004
    Inventors: Shree K. Nayar, Tomoo Mitsunaga
  • Publication number: 20040169747
    Abstract: In an image processing apparatus, a sensitivity compensation unit converts a color-and-sensitivity mosaic image into a color mosaic image. A pixel-of-interest determination unit extracts local area information from the color mosaic image. An edge-direction detector detects an edge of the local area. A G-component computing unit performs weighted interpolation in the edge direction of the green (G) component associated with a pixel of interest. A statistic computing unit computes statistic information of the local area. A first or second R-and-B-component computing unit computes the red (R) and blue (B) components of the pixel of interest on the basis of the statistic information. An inverse gamma conversion unit performs inverse gamma conversion of the red (R), green (G), and blue (B) components of the pixel of interest. The present invention is applicable to, for example, a digital still camera.
    Type: Application
    Filed: December 10, 2003
    Publication date: September 2, 2004
    Applicant: Sony Corporation
    Inventors: Hiroaki Ono, Tomoo Mitsunaga
  • Patent number: 6781595
    Abstract: An image processing apparatus and method and a recording medium therefor control the occurrence of a change in a hue. The histogram of a luminance signal Y is generated in a first step S1. In a second step S2, the histograms of the luminance signals Y are accumulated to generate a cumulative histogram, and the cumulative histogram is subjected to logarithmic approximation thereby to generate a lookup table (LUT) for correcting luminance signals. In a third step S3, a color-difference signal correction parameter LUT is generated by referring to the LUT for correcting luminance signals. In a fourth step S4, an input luminance signal Y is applied to the LUT for correcting luminance signals thereby to acquire a corrected luminance signal Y0. In a fifth step S5, the input luminance signal Y is applied to a color-difference signal correction parameter LUT so as to acquire a correction parameter k.
    Type: Grant
    Filed: October 22, 2001
    Date of Patent: August 24, 2004
    Assignee: Sony Corporation
    Inventors: Seiji Kobayashi, Tomoo Mitsunaga, Hiroaki Ono, Ken Nakajima, Chikako Sano, Nobuyuki Sato
  • Publication number: 20040109068
    Abstract: The present invention relates to an image processing apparatus which can restore, from a color and sensitivity mosaic image acquired using a CCD image sensor of the single plate type or the like, a color image signal of a wide dynamic range wherein the sensitivity characteristics of pixels are uniformized and each of the pixels has all of a plurality of color components.
    Type: Application
    Filed: January 14, 2004
    Publication date: June 10, 2004
    Inventors: Tomoo Mitsunaga, Seiji Kobayashi, Hiroaki Ono
  • Publication number: 20030197793
    Abstract: The present invention relates to an image pickup apparatus which can produce a color and sensitivity mosaic image which can be converted into a color image signal having a wide dynamic range by performing a predetermined image process.
    Type: Application
    Filed: February 25, 2003
    Publication date: October 23, 2003
    Inventors: Tomoo Mitsunaga, Seiji Kobayashi, Hiroaki Ono
  • Publication number: 20030160875
    Abstract: The present invention relates to an image processing apparatus which suppresses appearance of a color moire of a color image signal of a wide dynamic range which is produced using an image signal acquired using, for example, a CCD image sensor of the single plate type or the like.
    Type: Application
    Filed: January 24, 2003
    Publication date: August 28, 2003
    Inventors: Tomoo Mitsunaga, Seiji Kobayashi, Hiroaki Ono
  • Publication number: 20030052976
    Abstract: Disclosed herein is a photographing device that comprises a plurality of light-receiving elements (8a to 8h), a plurality of vertical transfer registers (7a, 7b), a first drive-voltage applying electrode (3a, 3b), and a second drive-voltage applying electrode (1 to 2c). The light-receiving elements (8a to 8h) are arranged in a horizontal direction and a vertical direction. The vertical transfer registers (7a, 7b) transfers the electric charges accumulated in the light-receiving elements in the vertical direction. The first drive-voltage applying electrode (3a, 3b) are arranged parallel to the vertical transfer registers, for applying a drive voltage to a specific one of the vertical transfer registers. The second drive-voltage applying electrode (1 to 2c) is arranged perpendicular to the vertical transfer registers, for applying a second drive voltage to the vertical transfer registers at the same time.
    Type: Application
    Filed: September 25, 2002
    Publication date: March 20, 2003
    Inventors: Kouichi Harada, Tomoo Mitsunaga, Seiji Kobayashi
  • Publication number: 20020171663
    Abstract: An image processing apparatus and method and a recording medium therefor control the occurrence of a change in a hue. The histogram of a luminance signal Y is generated in a first step S1. In a second step S2, the histograms of the luminance signals Y are accumulated to generate a cumulative histogram, and the cumulative histogram is subjected to logarithmic approximation thereby to generate a lookup table (LUT) for correcting luminance signals. In a third step S3, a color-difference signal correction parameter LUT is generated by referring to the LUT for correcting luminance signals. In a fourth step S4, an input luminance signal Y is applied to the LUT for correcting luminance signals thereby to acquire a corrected luminance signal Y0. In a fifth step S5, the input luminance signal Y is applied to a color-difference signal correction parameter LUT so as to acquire a correction parameter k.
    Type: Application
    Filed: October 22, 2001
    Publication date: November 21, 2002
    Inventors: Seiji Kobayashi, Tomoo Mitsunaga, Hiroaki Ono, Ken Nakajima, Chikako Sano, Nobuyuki Sato
  • Publication number: 20020110277
    Abstract: An apparatus and a method as well as a storage device of the present invention transform intensity levels with consideration of both features of the intensity levels in an input image and human visual characteristics, wherein the present invention includes the steps of inputting wider dynamic range digital image data, generating a histogram of intensity levels of the image data, generating a histogram equalization LUT by cumulating the histogram, generating a visual characteristics LUT with reference to the histogram equalization LUT, generating a combined LUT by combining the histogram equalization LUT and the visual characteristics LUT, and correcting the image data.
    Type: Application
    Filed: October 4, 2001
    Publication date: August 15, 2002
    Inventors: Hiroaki Ono, Seiji Kobayashi, Tomoo Mitsunaga, Ken Nakajima, Chikako Sano, Nobuyuki Sato
  • Patent number: 6304672
    Abstract: An edge detecting method and an edge detecting device improve the accuracy in edge detection and extract the outline correctly even in the general image. In the case of detecting the picture element group which is changing rapidly as compared with its surroundings as the edge from within image data in which each picture element is composed of independent N numbers of dark and light data R, G, and B respectively, N sets of coefficients Wr, Wg, Wb corresponding to N numbers of dark and light data It, G, B respectively are calculated, and each picture element is judged whether it is edge or not depending upon N numbers of (lark and light data R, G, B and N sets of coefficients Wr, Wg, Wb.
    Type: Grant
    Filed: April 15, 1999
    Date of Patent: October 16, 2001
    Assignee: Sony Corporation
    Inventors: Takashi Totsuka, Tomoo Mitsunaga
  • Patent number: 6298155
    Abstract: An apparatus and a method for generating time-series data, an apparatus and a method for editing curves and a recording medium having a recorded program in which the corresponding relation between curves at different time junctures is obtained from given corresponding points such as to prevent the curve shape from becoming dull due to smoothing. A candidate point string extraction unit checks the relation between the input point coordinate and the corresponding relation information to set each group of input points having the corresponding relation as a corresponding point string. An interpolation curve generating unit calculates an interpolation curve C(t) interpolating the corresponding point string along the time axis.
    Type: Grant
    Filed: July 29, 1998
    Date of Patent: October 2, 2001
    Assignee: Sony Corporation
    Inventors: Tomoo Mitsunaga, Taku Yokoyama, Takashi Totsuka, Hidehiro Hirase, John Zeiss
  • Patent number: 6252985
    Abstract: An image area extracting method for extracting the desired areas from the image accurately and efficiently. The rough boundary area, in which the boundary area is roughly assigned between the desired area and areas other than the desired area, is divided into a plurality of small areas. The area extracting procedure is executed on each small area and the desired area and areas other than the desired area are detected from each small area. The boundary area mask image is formed based on the detection result and the desired area is extracted based on the boundary area mask image. Thus, the desired area can be extracted from the image accurately and efficiently.
    Type: Grant
    Filed: December 11, 1998
    Date of Patent: June 26, 2001
    Assignee: Sony Corporation
    Inventors: Tomoo Mitsunaga, Takashi Totsuka
  • Patent number: 6128046
    Abstract: In this invention, when the portion from which a key signal .alpha. is to be generated of picture is caused to be foreground F, the portion except for the above is caused to be background B, and pixel value of pixels constituting that picture is designated at C, the key signal .alpha. is generated so as to satisfy the relational expression C'=(F-B).alpha.'('(prime) represents differentiation). In more practical sense, a change detecting section 10 calculates change C' of pixel value between pixels constituting picture, and an F-B detecting section 30 calculates difference F-B between the foreground and the background. In addition, an integral value calculating section 40 divides the change C' by the difference F-B to integrate the result obtained by divisional operation to thereby determine key signal .alpha.. As a result, precise key signal can be obtained in this invention.
    Type: Grant
    Filed: January 6, 1997
    Date of Patent: October 3, 2000
    Assignee: Sony Corporation
    Inventors: Takashi Totsuka, Taku Yokoyama, Tomoo Mitsunaga
  • Patent number: 5995662
    Abstract: An edge detecting method and an edge detecting device detecting from a picture element group which is changing rapidly as compared with its surroundings an edge from within image data in which each picture element is composed of independent N numbers of dark and light data R, G, and B respectively, by calculating N sets of coefficients Wr, Wg, Wb corresponding to N numbers of dark and light data R, G, B respectively, and each picture element is judged whether it is an edge or not depending upon N numbers of dark and light data R, G, B and N sets of coefficients Wr, Wg, Wb.
    Type: Grant
    Filed: October 30, 1997
    Date of Patent: November 30, 1999
    Assignee: Sony Corporation
    Inventors: Takashi Totsuka, Tomoo Mitsunaga
  • Patent number: 5887082
    Abstract: An image area extracting method for extracting the desired areas from the image accurately and efficiently. The rough boundary area, in which the boundary area is roughly assigned between the desired area and areas other than the desired area, is divided into a plurality of small areas. The area extracting procedure is executed on each small area and the desired area and areas other than the desired area are detected from each small area. The boundary area mask image is formed based on the detection result and the desired area is extracted based on the boundary area mask image. Thus, the desired area can be extracted from the image accurately and efficiently.
    Type: Grant
    Filed: November 21, 1995
    Date of Patent: March 23, 1999
    Assignee: Sony Corporation
    Inventors: Tomoo Mitsunaga, Takashi Totsuka