Patents by Inventor Kazunori Kamio

Kazunori Kamio has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240111052
    Abstract: An information processing device (30) includes a signal acquisition unit (31), a passive depth estimation unit (34), and a fusion unit (35). The signal acquisition unit (31) extracts, from light reception data, active information indicating a flight time of reference light (PL) and passive information (PI) indicating two-dimensional image information of a subject (SU) obtained from ambient light (EL). The passive depth estimation unit (34) generates passive depth information (PDI) based on the passive information (PI). The fusion unit (35) fuses the passive depth information (PDI) with active depth information (ADI) generated based on the active information to generate depth information (DI) of the subject (SU).
    Type: Application
    Filed: January 25, 2022
    Publication date: April 4, 2024
    Applicant: Sony Group Corporation
    Inventors: Yuta SAKURAI, Toshiyuki SASAKI, Kazunori KAMIO, Satoshi KAWATA
  • Patent number: 11770614
    Abstract: There is provided an image processing device and method, and a program for enabling improvement in image quality in sensor shift imaging. When performing imaging while shifting the pixel phase of an image sensor having a two-dimensional pixel array, an image processing device adds up, for each pixel phase, a plurality of frames imaged in each pixel phase, and generates an addition frame for each pixel phase. The image processing device then combines the addition frames of the respective pixel phases. The present technology can be applied to a sensor shift imaging system.
    Type: Grant
    Filed: March 18, 2021
    Date of Patent: September 26, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Hideyuki Ichihashi, Kazunori Kamio
  • Publication number: 20230184538
    Abstract: An information processing apparatus (1) according to the present disclosure includes an estimation unit (first MV estimation unit 3 and second MV estimation unit 4) and a correction unit (high-precision restoration unit 7). The estimation unit (first MV estimation unit 3 and second MV estimation unit 4) estimates a motion vector of a distance measurement target based on distance information on a distance to the distance measurement target input from a distance measuring device that measures the distance to the distance measurement target and motion information of the distance measuring device input from a motion detection device that detects a motion of the distance measuring device. The correction unit (high-precision restoration unit 7) corrects the distance information based on the motion vector of the distance measurement target estimated by the estimation unit (first MV estimation unit 3 and second MV estimation unit 4).
    Type: Application
    Filed: May 6, 2021
    Publication date: June 15, 2023
    Inventors: YUTA SAKURAI, KAZUNORI KAMIO, SATOSHI KAWATA, TOSHIYUKI SASAKI
  • Publication number: 20230169674
    Abstract: An information processing device (1) according to the present disclosure includes a prediction unit (occlusion prediction unit 4). The prediction unit (occlusion prediction unit 4) predicts, in a case where a subject (101) in an image captured in time series by an imaging device (100) is hidden behind a foreground, a position of the subject (101) in the image behind the foreground on a basis of an image of the subject (101) in the image before being hidden behind the foreground and motion information of the imaging device (100) detected by a motion detection device (device motion information sensor 111).
    Type: Application
    Filed: May 7, 2021
    Publication date: June 1, 2023
    Inventors: YUTA SAKURAI, KAZUNORI KAMIO
  • Publication number: 20230088836
    Abstract: There is provided an image processing device and method, and a program for enabling improvement in image quality in sensor shift imaging. When performing imaging while shifting the pixel phase of an image sensor having a two-dimensional pixel array, an image processing device adds up, for each pixel phase, a plurality of frames imaged in each pixel phase, and generates an addition frame for each pixel phase. The image processing device then combines the addition frames of the respective pixel phases. The present technology can be applied to a sensor shift imaging system.
    Type: Application
    Filed: March 18, 2021
    Publication date: March 23, 2023
    Applicant: SONY GROUP CORPORATION
    Inventors: Hideyuki ICHIHASHI, Kazunori KAMIO
  • Patent number: 11410337
    Abstract: There is provided an image processing device to which a visible light image and an infrared ray image are input, the visible light image having been obtained corresponding to irradiation of a visible light in a second direction, the infrared ray image having been obtained corresponding to irradiation of an infrared ray in a first direction, which is a direction having an irradiation range larger than an irradiation range of the second direction, and which synthesizes the infrared ray image and the visible light image to generate a color image.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: August 9, 2022
    Assignee: SONY CORPORATION
    Inventors: Kazunori Kamio, Toshiyuki Sasaki
  • Patent number: 11325520
    Abstract: A transmittance estimation unit estimates a transmittance for each of regions from a captured image. The transmittance estimation unit estimates the transmittance for each pixel, using, for example, dark channel processing. A transmittance detection unit detects a transmittance of haze at the time of imaging of the captured image, using the transmittance estimated for each pixel by the transmittance estimation unit and depth information for each pixel. The transmittance detection unit detects the transmittance of the haze on the basis of, for example, a logarithm average value of the transmittances in the whole or a predetermined portion of the captured image, and an average value of depths indicated by the depth information.
    Type: Grant
    Filed: July 12, 2018
    Date of Patent: May 10, 2022
    Assignee: SONY CORPORATION
    Inventors: Satoshi Kawata, Kazunori Kamio, Yuki Tokizaki
  • Publication number: 20220114768
    Abstract: An information processing device according to the present disclosure includes an inference unit that infers, on the basis of a result of checking a first image against a plurality of images taken in the past, a third image that is an image taken in the past at a position corresponding to a second image to be taken at a next timing of the first image, and a generation unit that generates a fourth image that is an image obtained by correcting the second image on the basis of the third image in a case where the second image is acquired.
    Type: Application
    Filed: February 6, 2020
    Publication date: April 14, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Kazunori KAMIO, Toshiyuki SASAKI
  • Publication number: 20210398291
    Abstract: A first motion vector detection unit 50-1 detects a motion vector on the basis of self-motion data Dm of a sensor unit 15 and depth image data S which is generated by the sensor unit 15 and of which the definition is enhanced by a depth processing unit 30. A second motion vector detection unit 60 detects a motion vector on the basis of captured image data Isp detected by the sensor unit 15. A motion vector detection and merging unit 70 merges the motion vector detected by the first motion vector detection unit 50-1 with the motion vector detected by the second motion vector detection unit 60. Even in a case where it is difficult to detect a motion vector on the basis of captured image data owing to the presence of a flat portion or a dark portion in an image, it is possible to accurately detect a motion vector on the basis of the self-motion data Dm and the depth image data S.
    Type: Application
    Filed: August 16, 2019
    Publication date: December 23, 2021
    Inventors: TOSHIYUKI SASAKI, KAZUNORI KAMIO
  • Patent number: 11202045
    Abstract: An apparatus and a method that perform a false color correction according to image characteristics of a color image in units of image regions are provided. Included therein is an image processor that receives inputs of a color image and a white (W) image photographed by a W array imaging element whose all pixels are placed in a white (W) pixel array and executes an image process that reduces false colors included in the color image. Together with a frequency-corresponding parameter calculation unit that receives an input of the white (W) image and calculates a frequency-corresponding parameter in units of image regions, and a positional deviation-corresponding parameter calculation unit that receives inputs of the white (W) image and the color image and calculates a positional deviation-corresponding parameter of the two input images in units of image regions, the image processor executes a blending process and calculates a corrected pixel value.
    Type: Grant
    Filed: December 5, 2016
    Date of Patent: December 14, 2021
    Assignee: SONY CORPORATION
    Inventors: Masatoshi Yokokawa, Kazunori Kamio, Masashi Uchida
  • Publication number: 20210183096
    Abstract: Provided are an apparatus and a method for generating accurate distance information of a subject. The apparatus has an image processing unit which inputs a first image constituted by a visible light component and a second image including a visible light component and an infrared light component to calculate a subject distance, in which an image processing unit calculates two distance information of a TOF distance, which is the subject distance calculated according to a TOF system by utilizing the second image, and a stereo distance calculated according to a stereo system by utilizing the first image and the second image, determines TOF distance reliability indicating reliability of the TOF distance, and generates, as final distance information, the stereo distance, which is the subject distance according to the stereo system, or distance information calculated by synthesis processing of the TOF distance and the stereo distance, for a pixel region in which the reliability of the TOF distance is low.
    Type: Application
    Filed: February 27, 2017
    Publication date: June 17, 2021
    Inventors: MASATOSHI YOKOKAWA, KAZUNORI KAMIO, TAKAHIRO NAGANO
  • Patent number: 11030723
    Abstract: There is provided an apparatus and a method that perform a process of improving the quality of a low-quality image such as a far-infrared image. The apparatus includes an image correction unit that repeatedly performs an image correction process using a plurality of processing units in at least two stages. The image correction unit inputs a low-quality image to be corrected and a high-quality image which is a reference image. Each of the processing units in each stage performs a correction process for the low-quality image, using a class correspondence correction coefficient corresponding to a feature amount extracted from a degraded image of the high-quality image. A processing unit in a previous stage performs the correction process, using a class correspondence correction coefficient corresponding to a feature amount extracted from an image which has a higher degradation level than that in a processing unit in a subsequent stage.
    Type: Grant
    Filed: December 1, 2017
    Date of Patent: June 8, 2021
    Assignee: SONY CORPORATION
    Inventors: Kazunori Kamio, Takahiro Nagano, Yuki Tokizaki, Yiwen Zhu, Satoshi Kawata
  • Patent number: 11024240
    Abstract: Effective image correction processing for reducing flicker is executed according to characteristics of images, and an image to be displayed in a liquid crystal display apparatus is generated. Characteristic amount change rate data that is a change rate between a characteristic amount of a sample image and a characteristic amount of a sample image output to a liquid crystal display device is acquired in advance and stored in a storage unit. The correction parameter for reducing flicker is calculated on the basis of the characteristic amount of the image to be corrected and the characteristic amount change rate data of the sample images stored in the storage unit. The correction processing to which the calculated correction parameter has been applied is executed for the image to be corrected to generate a display image. As the characteristic amount, for example, the interframe luminance change amount, the interline luminance conversion amount, or the interframe motion vector is used.
    Type: Grant
    Filed: February 27, 2017
    Date of Patent: June 1, 2021
    Assignee: SONY CORPORATION
    Inventors: Yiwen Zhu, Kazunori Kamio, Takahiro Nagano
  • Patent number: 11004197
    Abstract: A coefficient calculator calculates a correlation coefficient representing a correlation between a normal frame, which is imaged in a state in which normal light is applied to a subject, and a special frame, which is imaged in a state in which special light is applied to the subject; and a processing unit that applies image processing to the special frame so that a part in which the correlation coefficient is high and a part in which the correlation coefficient is low are displayed differently in the special frame. Further provided are: a first determination unit that calculates, for each pixel or each area of the normal frame, a first determination value representing a probability that a predetermined site is imaged; and a second determination unit that calculates, for each pixel or each area of the special frame, a second determination value representing a probability that a predetermined site is imaged.
    Type: Grant
    Filed: December 14, 2017
    Date of Patent: May 11, 2021
    Assignee: SONY CORPORATION
    Inventors: Koji Kashima, Takami Mizukura, Kazunori Kamio, Yiwen Zhu
  • Publication number: 20210076017
    Abstract: An apparatus and a method that perform a false color correction according to image characteristics of a color image in units of image regions are provided. Included therein is an image processor that receives inputs of a color image and a white (W) image photographed by a W array imaging element whose all pixels are placed in a white (W) pixel array and executes an image process that reduces false colors included in the color image. Together with a frequency-corresponding parameter calculation unit that receives an input of the white (W) image and calculates a frequency-corresponding parameter in units of image regions, and a positional deviation-corresponding parameter calculation unit that receives inputs of the white (W) image and the color image and calculates a positional deviation-corresponding parameter of the two input images in units of image regions, the image processor executes a blending process and calculates a corrected pixel value.
    Type: Application
    Filed: December 5, 2016
    Publication date: March 11, 2021
    Applicant: SONY CORPORATION
    Inventors: Masatoshi YOKOKAWA, Kazunori KAMIO, Masashi UCHIDA
  • Patent number: 10929959
    Abstract: Provided are an apparatus and a method for executing image quality enhancement processing on a fluorescence image. A fluorescence image and a visible light image are input and the image feature amount is extracted, so as to execute pixel value correction processing on the fluorescence image on the basis of a correction parameter determined in accordance with the feature amount. The correction parameter used for pixel value correction is determined by the correction parameter calculation unit on the basis of the feature amount. The image correction unit executes pixel value correction processing that applies the correction parameter determined by the correction parameter calculation unit. For example, blur mode information is obtained as a feature amount from a fluorescence image, and the image correction unit executes pixel value correction processing on the fluorescence image so as to reduce blur of the fluorescence image.
    Type: Grant
    Filed: January 25, 2017
    Date of Patent: February 23, 2021
    Assignee: SONY CORPORATION
    Inventors: Kazunori Kamio, Yiwen Zhu, Takuro Kawai, Takahiro Nagano
  • Publication number: 20210004990
    Abstract: There is provided an image processing device to which a visible light image and an infrared ray image are input, the visible light image having been obtained corresponding to irradiation of a visible light in a second direction, the infrared ray image having been obtained corresponding to irradiation of an infrared ray in a first direction, which is a direction having an irradiation range larger than an irradiation range of the second direction, and which synthesizes the infrared ray image and the visible light image to generate a color image.
    Type: Application
    Filed: December 27, 2018
    Publication date: January 7, 2021
    Inventors: KAZUNORI KAMIO, TOSHIYUKI SASAKI
  • Patent number: 10880498
    Abstract: An image processing apparatus includes a first combination unit that receives a far-infrared image and multiple reference images obtained by capturing the same object as that of the far-infrared image and generates a first composite signal which is a composite signal of the multiple reference images and a second combination unit that combines the far-infrared image and the first composite signal to generate a quality-improved image of the far-infrared image. The first combination unit generates the first composite signal on the basis of a visible image-far-infrared image correlation amount and a near-infrared image-far-infrared image correlation amount. The first combination unit sets a contribution ratio of a reference image, which has a larger amount of correlation with the far-infrared image, of the two reference images, that is, the visible image and the near-infrared image to a large value and generates the first composite signal.
    Type: Grant
    Filed: February 14, 2018
    Date of Patent: December 29, 2020
    Assignee: SONY CORPORATION
    Inventors: Yuki Tokizaki, Kazunori Kamio, Toshiyuki Sasaki
  • Patent number: 10853926
    Abstract: A device includes a feature amount calculating unit for receiving an infrared light image and a visible light image and extracting a feature amount from at least one of the images and an image correcting unit for executing pixel value correction processing on the infrared light image on the basis of a reference area and a correction parameter determined depending on the feature amount. The device further includes a tap selection unit for determining the reference area used for the pixel value correction on the basis of the feature amount and a correction parameter calculating unit for determining the correction parameter used for the pixel value correction on the basis of the feature amount. The image correcting unit executes the pixel value correction processing in which a tap determined by the tap selection unit and the correction parameter determined by the correction parameter calculating unit are applied.
    Type: Grant
    Filed: January 25, 2017
    Date of Patent: December 1, 2020
    Assignee: SONY CORPORATION
    Inventors: Yuki Tokizaki, Kazunori Kamio, Yiwen Zhu, Takahiro Nagano
  • Publication number: 20200349367
    Abstract: The present disclosure relates to an image processing device, an image processing method, and a program that can make it easier to check a surrounding situation. A viewpoint determination part determines a viewpoint of a viewpoint image related to periphery of a moving object in a case where the moving object is viewed from a predetermined viewpoint, according to a speed of a vehicle that can move at an arbitrary speed. Then, an image synthesis part synthesizes an illustrative image of the vehicle at a position where the vehicle can exist in the captured image of the periphery of the vehicle, and a projection conversion part performs projection conversion on an image obtained by the image synthesis part synthesizing the illustrative image of the vehicle to generate the viewpoint image that is a view from the viewpoint determined by the viewpoint determination part. The present technology can be applied to, for example, an image processing device mounted on a vehicle.
    Type: Application
    Filed: January 4, 2019
    Publication date: November 5, 2020
    Inventors: TOSHIYUKI SASAKI, KAZUNORI KAMIO