Patents by Inventor Tomohiro Nishi

Tomohiro Nishi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11974054
    Abstract: An image sensor (IS) includes a plurality of pixel blocks (PB) to which colors different from each other are assigned. Each of the plurality of pixel blocks (PB) includes a plurality of pixels (PX). The plurality of pixels PX provided in at least one pixel block (PB) among the plurality of pixel blocks (PB) includes one or more anomalous pixels (UPX). The anomalous pixel (UPX) detects light of one or more colors assigned to the other one or more pixel blocks (PB).
    Type: Grant
    Filed: March 9, 2021
    Date of Patent: April 30, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Tomohiro Nishi, Masatoshi Yokokawa
  • Patent number: 11792544
    Abstract: A pixel addition processing unit 35 adds pupil division pixel signals with a plurality of different addition patterns in pupil units to generate a pixel addition image for each addition pattern. Further, the pixel addition processing unit 35 may use a pupil division pixel signal in which a sensitivity difference between pupil division pixels has been corrected, and the addition pattern may be set on the basis of image characteristic information calculated by using the pupil division pixel signal. A super-resolution processing unit 36 performs super-resolution processing using a pixel addition image signal generated for each addition pattern by the pixel addition processing unit 35 to generate an image signal with a higher resolution than that of the pixel addition image signal. A high-resolution image can be generated using pupil division.
    Type: Grant
    Filed: December 18, 2019
    Date of Patent: October 17, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Masatoshi Yokokawa, Hideyuki Ichihashi, Tomohiro Nishi, Yiwen Zhu
  • Patent number: 11716552
    Abstract: An imaging element of an imaging unit 24 divides the exit pupil of an imaging optical system 21 into a plurality of regions and generates a pixel signal for each region. An optical axis position adjustment unit 23 adjusts the optical axis position of the imaging optical system with respect to the imaging element. A control unit 26 calculates a parallax on the basis of the pixel signal for each region after the pupil division and performs focus control of the imaging optical system 21. The control unit 26 also moves the optical axis position using the optical axis position adjustment unit 23, and generates, using the imaging element, pixel signals indicating the same subject region in the plurality of regions after the pupil division. An image processing unit 25 performs binning of a plurality of pixel signals indicating the same subject region generated by moving the optical axis position to generate a high-resolution captured image.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: August 1, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Tomohiro Nishi, Hideyuki Ichihashi, Masatoshi Yokokawa, Yiwen Zhu
  • Publication number: 20230177713
    Abstract: An information processing apparatus (IP1) includes a depth information extraction unit (DIE1) and a processing unit (IMP). The depth information extraction unit (DIE1) can extract depth information from a plurality of pieces of infrared image information included in a plurality of pieces of image data. The plurality of pieces of image data is image data captured from a plurality of viewpoints. Each of the plurality of pieces of image data includes visible light image information and infrared image information. Based on the depth information, the processing unit (IMP) processes the visible light image generated using the visible light image information included in at least one piece of image data among the plurality of pieces of image data.
    Type: Application
    Filed: March 16, 2021
    Publication date: June 8, 2023
    Inventors: MASATOSHI YOKOKAWA, TOMOHIRO NISHI
  • Publication number: 20230179878
    Abstract: An image sensor (IS) includes a plurality of pixel blocks (PB) to which colors different from each other are assigned. Each of the plurality of pixel blocks (PB) includes a plurality of pixels (PX). The plurality of pixels PX provided in at least one pixel block (PB) among the plurality of pixel blocks (PB) includes one or more anomalous pixels (UPX). The anomalous pixel (UPX) detects light of one or more colors assigned to the other one or more pixel blocks (PB).
    Type: Application
    Filed: March 9, 2021
    Publication date: June 8, 2023
    Inventors: TOMOHIRO NISHI, MASATOSHI YOKOKAWA
  • Publication number: 20220301193
    Abstract: There is provided an imaging device (10) including: an imaging module (100) including an image sensor (130) in which a plurality of pixels for converting light into an electric signal is arranged; a drive unit (140) that moves a part of the imaging module in a manner that the image sensor can sequentially acquire a reference image under a predetermined pixel phase, a plurality of generation images, and a detection image under the predetermined pixel phase in this order; and a detection unit (220) that detects a moving subject based on a difference between the reference image and the detection image.
    Type: Application
    Filed: July 20, 2020
    Publication date: September 22, 2022
    Inventors: HIDEYUKI ICHIHASHI, MASATOSHI YOKOKAWA, TOMOHIRO NISHI, YIWEN ZHU
  • Publication number: 20220256105
    Abstract: An imaging element of an imaging unit 24 divides the exit pupil of an imaging optical system 21 into a plurality of regions and generates a pixel signal for each region. An optical axis position adjustment unit 23 adjusts the optical axis position of the imaging optical system with respect to the imaging element. A control unit 26 calculates a parallax on the basis of the pixel signal for each region after the pupil division and performs focus control of the imaging optical system 21. The control unit 26 also moves the optical axis position using the optical axis position adjustment unit 23, and generates, using the imaging element, pixel signals indicating the same subject region in the plurality of regions after the pupil division. An image processing unit 25 performs binning of a plurality of pixel signals indicating the same subject region generated by moving the optical axis position to generate a high-resolution captured image.
    Type: Application
    Filed: May 26, 2020
    Publication date: August 11, 2022
    Inventors: TOMOHIRO NISHI, HIDEYUKI ICHIHASHI, MASATOSHI YOKOKAWA, YIWEN ZHU
  • Publication number: 20220159205
    Abstract: A pixel addition processing unit 35 adds pupil division pixel signals with a plurality of different addition patterns in pupil units to generate a pixel addition image for each addition pattern. Further, the pixel addition processing unit 35 may use a pupil division pixel signal in which a sensitivity difference between pupil division pixels has been corrected, and the addition pattern may be set on the basis of image characteristic information calculated by using the pupil division pixel signal. A super-resolution processing unit 36 performs super-resolution processing using a pixel addition image signal generated for each addition pattern by the pixel addition processing unit 35 to generate an image signal with a higher resolution than that of the pixel addition image signal. A high-resolution image can be generated using pupil division.
    Type: Application
    Filed: December 18, 2019
    Publication date: May 19, 2022
    Inventors: MASATOSHI YOKOKAWA, HIDEYUKI ICHIHASHI, TOMOHIRO NISHI, YIWEN ZHU
  • Patent number: 11330191
    Abstract: Provided is an image processing device that includes a wide image capturing unit which captures an image of a wide viewing angle, a tele image capturing unit which captures an image of a narrow viewing angle, and an image processing unit which receives an input of the captured images of the respective imaging units and executes signal processing. In a case where a wide conversion lens is attached to the tele image capturing unit, the image processing unit executes any one of a high-sensitivity image generation processing, a HDR image generation processing, or a high-resolution image generation processing based on the captured images of the wide image capturing unit and the tele image capturing unit according to a situation at the time of imaging with a wide conversion lens attachment detection unit which detects whether the wide conversion lens is attached.
    Type: Grant
    Filed: April 23, 2019
    Date of Patent: May 10, 2022
    Assignee: SONY CORPORATION
    Inventors: Masatoshi Yokokawa, Hideyuki Ichihashi, Yiwen Zhu, Tomohiro Nishi
  • Patent number: 11282223
    Abstract: Provided are a signal processing apparatus, a signal processing method, and an imaging apparatus for estimating depth with a high degree of accuracy from video signals of a plurality of cameras. The signal processing apparatus includes a detection unit that detects depth from video captured by a plurality of cameras, an estimation unit that estimates camera motion by detecting a camera position, a prediction unit that predicts present depth from camera motion and depth obtained previously, and a synthesis unit that synthesizes depth detected by the detection unit and depth predicted by the prediction unit on the basis of a result of estimating the amount of blur that occurs in each image captured by cameras. The amount of blur can be estimated using camera motion, previous depth information, and shutter time.
    Type: Grant
    Filed: January 30, 2019
    Date of Patent: March 22, 2022
    Assignee: Sony Corporation
    Inventors: Tomohiro Nishi, Hideyuki Ichihashi, Yiwen Zhu, Masatoshi Yokokawa
  • Publication number: 20210243351
    Abstract: To realize a device and a method capable of generating a high-quality image similar to that of a same viewing angle compound eye camera by using captured images of a tele/wide compound eye camera. A wide image capturing unit which captures an image of a wide viewing angle, a tele image capturing unit which captures an image of a narrow viewing angle, and an image processing unit which receives an input of the captured images of the respective imaging units and executes signal processing are included.
    Type: Application
    Filed: April 23, 2019
    Publication date: August 5, 2021
    Inventors: MASATOSHI YOKOKAWA, HIDEYUKI ICHIHASHI, YIWEN ZHU, TOMOHIRO NISHI
  • Publication number: 20210174527
    Abstract: Provided are a signal processing apparatus, a signal processing method, and an imaging apparatus for estimating depth with a high degree of accuracy from video signals of a plurality of cameras. The signal processing apparatus includes a detection unit that detects depth from video captured by a plurality of cameras, an estimation unit that estimates camera motion by detecting a camera position, a prediction unit that predicts present depth from camera motion and depth obtained previously, and a synthesis unit that synthesizes depth detected by the detection unit and depth predicted by the prediction unit on the basis of a result of estimating the amount of blur that occurs in each image captured by cameras. The amount of blur can be estimated using camera motion, previous depth information, and shutter time.
    Type: Application
    Filed: January 30, 2019
    Publication date: June 10, 2021
    Applicant: Sony Corporation
    Inventors: Tomohiro NISHI, Hideyuki ICHIHASHI, Yiwen ZHU, Masatoshi YOKOKAWA
  • Publication number: 20200402206
    Abstract: With a wide angle-of-view image acquired by an image pickup unit 21-1 as a reference, a signal processing unit 30 performs super-resolution processing by using a plurality of narrow angle-of-view images acquired by an image pickup unit 21-2 that uses a lens having a higher MTF (Modulation Transfer Function) than the image pickup unit 21-1. A control unit 60 controls the signal processing unit 30 so as to select an image having a range of angle of view according to a zoom magnification indicated by user's operation from the image subjected to the super-resolution processing. In the super-resolution processing, according to a detection result of parallax from a narrow angle-of-view image and the wide angle-of-view image acquired at the same time and a motion detection result for each of the plurality of narrow angle-of-view images, parallax compensation and motion compensation are performed on the plurality of narrow angle-of-view images.
    Type: Application
    Filed: November 28, 2018
    Publication date: December 24, 2020
    Inventors: HIDEYUKI ICHIHASHI, TOMOHIRO NISHI, YIWEN ZHU, MASATOSHI YOKOKAWA
  • Patent number: 10443519
    Abstract: A catalyst deterioration determination system effectively prevents erroneous determination caused by increase of the H2 component in exhaust gas and improves accuracy of determination. A LAF sensor and an O2 sensor are provided on the upstream side and downstream side of a three-way catalyst. Deterioration of the three-way catalyst is determined on the basis of an output of the O2 sensor, which is detected during air-fuel ratio switching control in which an air-fuel ratio is alternately switched to the rich side and lean side of the stoichiometric air-fuel ratio according to a detected equivalent ratio detected by the LAF sensor, on the basis of a result of comparison between an oxygen inflow into the three-way catalyst and a lean side-limiting value and a rich side-limiting value which are target values of the oxygen inflow. Fuel injection timing retardation control and/or divided fuel injection control are prohibited during the deterioration determination.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: October 15, 2019
    Assignee: HONDA MOTOR CO., LTD.
    Inventors: Mitsuo Hashizume, Tomohiro Nishi, Toru Kasai, Hideyuki Yasuda
  • Patent number: 10389976
    Abstract: To achieve a configuration enabling identification of to which viewing user the displayed user displayed on the display unit is speaking. The configuration includes a display image generation unit that generates dialog pair identification information enabling identification of to which viewing user among the plurality of viewing users the displayed user on the display unit is speaking, and outputs the generated information together with the displayed user, to the display unit. The display image generation unit generates, as the dialog pair identification information, an arrow or an icon, a face surrounding frame or a face side line, a virtual viewpoint background image or the like, directed from the displayed user forming the dialog pair to the viewing user forming the dialog pair, and displays the generated dialog pair identification information together with the displayed user, on the display unit.
    Type: Grant
    Filed: January 12, 2017
    Date of Patent: August 20, 2019
    Assignee: SONY CORPORATION
    Inventors: Tomohiro Nishi, Masato Akao
  • Publication number: 20190014288
    Abstract: To achieve a configuration enabling identification of to which viewing user the displayed user displayed on the display unit is speaking. The configuration includes a display image generation unit that generates dialog pair identification information enabling identification of to which viewing user among the plurality of viewing users the displayed user on the display unit is speaking, and outputs the generated information together with the displayed user, to the display unit. The display image generation unit generates, as the dialog pair identification information, an arrow or an icon, a face surrounding frame or a face side line, a virtual viewpoint background image or the like, directed from the displayed user forming the dialog pair to the viewing user forming the dialog pair, and displays the generated dialog pair identification information together with the displayed user, on the display unit.
    Type: Application
    Filed: January 12, 2017
    Publication date: January 10, 2019
    Inventors: TOMOHIRO NISHI, MASATO AKAO
  • Publication number: 20180216553
    Abstract: A catalyst deterioration determination system effectively prevents erroneous determination caused by increase of the H2 component in exhaust gas and improves accuracy of determination. A LAF sensor and an O2 sensor are provided on the upstream side and downstream side of a three-way catalyst. Deterioration of the three-way catalyst is determined on the basis of an output of the O2 sensor, which is detected during air-fuel ratio switching control in which an air-fuel ratio is alternately switched to the rich side and lean side of the stoichiometric air-fuel ratio according to a detected equivalent ratio detected by the LAF sensor, on the basis of a result of comparison between an oxygen inflow into the three-way catalyst and a lean side-limiting value and a rich side-limiting value which are target values of the oxygen inflow. Fuel injection timing retardation control and/or divided fuel injection control are prohibited during the deterioration determination.
    Type: Application
    Filed: February 1, 2018
    Publication date: August 2, 2018
    Applicant: HONDA MOTOR CO., LTD.
    Inventors: Mitsuo Hashizume, Tomohiro Nishi, Toru Kasai, Hideyuki Yasuda
  • Publication number: 20180213139
    Abstract: The present technology relates to an image processing apparatus and method that can reduce a transmission delay of image data items. According to one aspect of the present technology, respective partial images of a plurality of captured images acquired by image capturing units different from each other are integrated and one composited image is generated. The exposure periods of the respective image capturing units may be the same or may be shifted from one another. The exposure periods of only a part of the capturing units may be shifted. The present technology can be applied to an image capturing device, an electronic device using the image capturing device, a computer, a system, or the like that processes the image data items acquired by the image capturing device, for example.
    Type: Application
    Filed: May 27, 2016
    Publication date: July 26, 2018
    Applicant: SONY CORPORATION
    Inventors: ATSUSHI ITO, HIROSHI ORYOJI, TOMOHIRO NISHI
  • Patent number: 10012612
    Abstract: An inside lead portion of a gas sensor element has a lanthanum zirconate layer arranged between an electrically conductive oxide layer and a solid electrolyte member. Meanwhile, an inside detection electrode portion of the gas sensor element is formed such that (i) no lanthanum zirconate layer is formed between an electrically conductive oxide layer and the solid electrolyte member, or (ii) a lanthanum zirconate layer thinner than the lanthanum zirconate layer of the inside lead portion is formed between the electrically conductive oxide layer and the solid electrolyte member.
    Type: Grant
    Filed: July 12, 2016
    Date of Patent: July 3, 2018
    Assignee: NGK SPARK PLUG CO., LTD.
    Inventors: Shigehiro Ohtsuka, Tomohiro Nishi, Keisuke Nakagawa, Kazuma Ito, Ippei Kato
  • Patent number: 9952657
    Abstract: An apparatus includes a display controller configured to control a display state of a transparent display based on a sensor output that contains information regarding an object separated from the apparatus.
    Type: Grant
    Filed: March 25, 2013
    Date of Patent: April 24, 2018
    Assignee: SONY CORPORATION
    Inventors: Tomohiro Nishi, Kazuki Yokoyama, Masuyoshi Kurokawa, Kohei Miyamoto, Takeshi Uemori