Patents by Inventor Tomohiro Nishi
Tomohiro Nishi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11974054Abstract: An image sensor (IS) includes a plurality of pixel blocks (PB) to which colors different from each other are assigned. Each of the plurality of pixel blocks (PB) includes a plurality of pixels (PX). The plurality of pixels PX provided in at least one pixel block (PB) among the plurality of pixel blocks (PB) includes one or more anomalous pixels (UPX). The anomalous pixel (UPX) detects light of one or more colors assigned to the other one or more pixel blocks (PB).Type: GrantFiled: March 9, 2021Date of Patent: April 30, 2024Assignee: SONY GROUP CORPORATIONInventors: Tomohiro Nishi, Masatoshi Yokokawa
-
Patent number: 11792544Abstract: A pixel addition processing unit 35 adds pupil division pixel signals with a plurality of different addition patterns in pupil units to generate a pixel addition image for each addition pattern. Further, the pixel addition processing unit 35 may use a pupil division pixel signal in which a sensitivity difference between pupil division pixels has been corrected, and the addition pattern may be set on the basis of image characteristic information calculated by using the pupil division pixel signal. A super-resolution processing unit 36 performs super-resolution processing using a pixel addition image signal generated for each addition pattern by the pixel addition processing unit 35 to generate an image signal with a higher resolution than that of the pixel addition image signal. A high-resolution image can be generated using pupil division.Type: GrantFiled: December 18, 2019Date of Patent: October 17, 2023Assignee: SONY GROUP CORPORATIONInventors: Masatoshi Yokokawa, Hideyuki Ichihashi, Tomohiro Nishi, Yiwen Zhu
-
Patent number: 11716552Abstract: An imaging element of an imaging unit 24 divides the exit pupil of an imaging optical system 21 into a plurality of regions and generates a pixel signal for each region. An optical axis position adjustment unit 23 adjusts the optical axis position of the imaging optical system with respect to the imaging element. A control unit 26 calculates a parallax on the basis of the pixel signal for each region after the pupil division and performs focus control of the imaging optical system 21. The control unit 26 also moves the optical axis position using the optical axis position adjustment unit 23, and generates, using the imaging element, pixel signals indicating the same subject region in the plurality of regions after the pupil division. An image processing unit 25 performs binning of a plurality of pixel signals indicating the same subject region generated by moving the optical axis position to generate a high-resolution captured image.Type: GrantFiled: May 26, 2020Date of Patent: August 1, 2023Assignee: SONY GROUP CORPORATIONInventors: Tomohiro Nishi, Hideyuki Ichihashi, Masatoshi Yokokawa, Yiwen Zhu
-
Publication number: 20230177713Abstract: An information processing apparatus (IP1) includes a depth information extraction unit (DIE1) and a processing unit (IMP). The depth information extraction unit (DIE1) can extract depth information from a plurality of pieces of infrared image information included in a plurality of pieces of image data. The plurality of pieces of image data is image data captured from a plurality of viewpoints. Each of the plurality of pieces of image data includes visible light image information and infrared image information. Based on the depth information, the processing unit (IMP) processes the visible light image generated using the visible light image information included in at least one piece of image data among the plurality of pieces of image data.Type: ApplicationFiled: March 16, 2021Publication date: June 8, 2023Inventors: MASATOSHI YOKOKAWA, TOMOHIRO NISHI
-
Publication number: 20230179878Abstract: An image sensor (IS) includes a plurality of pixel blocks (PB) to which colors different from each other are assigned. Each of the plurality of pixel blocks (PB) includes a plurality of pixels (PX). The plurality of pixels PX provided in at least one pixel block (PB) among the plurality of pixel blocks (PB) includes one or more anomalous pixels (UPX). The anomalous pixel (UPX) detects light of one or more colors assigned to the other one or more pixel blocks (PB).Type: ApplicationFiled: March 9, 2021Publication date: June 8, 2023Inventors: TOMOHIRO NISHI, MASATOSHI YOKOKAWA
-
Publication number: 20220301193Abstract: There is provided an imaging device (10) including: an imaging module (100) including an image sensor (130) in which a plurality of pixels for converting light into an electric signal is arranged; a drive unit (140) that moves a part of the imaging module in a manner that the image sensor can sequentially acquire a reference image under a predetermined pixel phase, a plurality of generation images, and a detection image under the predetermined pixel phase in this order; and a detection unit (220) that detects a moving subject based on a difference between the reference image and the detection image.Type: ApplicationFiled: July 20, 2020Publication date: September 22, 2022Inventors: HIDEYUKI ICHIHASHI, MASATOSHI YOKOKAWA, TOMOHIRO NISHI, YIWEN ZHU
-
Publication number: 20220256105Abstract: An imaging element of an imaging unit 24 divides the exit pupil of an imaging optical system 21 into a plurality of regions and generates a pixel signal for each region. An optical axis position adjustment unit 23 adjusts the optical axis position of the imaging optical system with respect to the imaging element. A control unit 26 calculates a parallax on the basis of the pixel signal for each region after the pupil division and performs focus control of the imaging optical system 21. The control unit 26 also moves the optical axis position using the optical axis position adjustment unit 23, and generates, using the imaging element, pixel signals indicating the same subject region in the plurality of regions after the pupil division. An image processing unit 25 performs binning of a plurality of pixel signals indicating the same subject region generated by moving the optical axis position to generate a high-resolution captured image.Type: ApplicationFiled: May 26, 2020Publication date: August 11, 2022Inventors: TOMOHIRO NISHI, HIDEYUKI ICHIHASHI, MASATOSHI YOKOKAWA, YIWEN ZHU
-
Publication number: 20220159205Abstract: A pixel addition processing unit 35 adds pupil division pixel signals with a plurality of different addition patterns in pupil units to generate a pixel addition image for each addition pattern. Further, the pixel addition processing unit 35 may use a pupil division pixel signal in which a sensitivity difference between pupil division pixels has been corrected, and the addition pattern may be set on the basis of image characteristic information calculated by using the pupil division pixel signal. A super-resolution processing unit 36 performs super-resolution processing using a pixel addition image signal generated for each addition pattern by the pixel addition processing unit 35 to generate an image signal with a higher resolution than that of the pixel addition image signal. A high-resolution image can be generated using pupil division.Type: ApplicationFiled: December 18, 2019Publication date: May 19, 2022Inventors: MASATOSHI YOKOKAWA, HIDEYUKI ICHIHASHI, TOMOHIRO NISHI, YIWEN ZHU
-
Patent number: 11330191Abstract: Provided is an image processing device that includes a wide image capturing unit which captures an image of a wide viewing angle, a tele image capturing unit which captures an image of a narrow viewing angle, and an image processing unit which receives an input of the captured images of the respective imaging units and executes signal processing. In a case where a wide conversion lens is attached to the tele image capturing unit, the image processing unit executes any one of a high-sensitivity image generation processing, a HDR image generation processing, or a high-resolution image generation processing based on the captured images of the wide image capturing unit and the tele image capturing unit according to a situation at the time of imaging with a wide conversion lens attachment detection unit which detects whether the wide conversion lens is attached.Type: GrantFiled: April 23, 2019Date of Patent: May 10, 2022Assignee: SONY CORPORATIONInventors: Masatoshi Yokokawa, Hideyuki Ichihashi, Yiwen Zhu, Tomohiro Nishi
-
Patent number: 11282223Abstract: Provided are a signal processing apparatus, a signal processing method, and an imaging apparatus for estimating depth with a high degree of accuracy from video signals of a plurality of cameras. The signal processing apparatus includes a detection unit that detects depth from video captured by a plurality of cameras, an estimation unit that estimates camera motion by detecting a camera position, a prediction unit that predicts present depth from camera motion and depth obtained previously, and a synthesis unit that synthesizes depth detected by the detection unit and depth predicted by the prediction unit on the basis of a result of estimating the amount of blur that occurs in each image captured by cameras. The amount of blur can be estimated using camera motion, previous depth information, and shutter time.Type: GrantFiled: January 30, 2019Date of Patent: March 22, 2022Assignee: Sony CorporationInventors: Tomohiro Nishi, Hideyuki Ichihashi, Yiwen Zhu, Masatoshi Yokokawa
-
Publication number: 20210243351Abstract: To realize a device and a method capable of generating a high-quality image similar to that of a same viewing angle compound eye camera by using captured images of a tele/wide compound eye camera. A wide image capturing unit which captures an image of a wide viewing angle, a tele image capturing unit which captures an image of a narrow viewing angle, and an image processing unit which receives an input of the captured images of the respective imaging units and executes signal processing are included.Type: ApplicationFiled: April 23, 2019Publication date: August 5, 2021Inventors: MASATOSHI YOKOKAWA, HIDEYUKI ICHIHASHI, YIWEN ZHU, TOMOHIRO NISHI
-
Publication number: 20210174527Abstract: Provided are a signal processing apparatus, a signal processing method, and an imaging apparatus for estimating depth with a high degree of accuracy from video signals of a plurality of cameras. The signal processing apparatus includes a detection unit that detects depth from video captured by a plurality of cameras, an estimation unit that estimates camera motion by detecting a camera position, a prediction unit that predicts present depth from camera motion and depth obtained previously, and a synthesis unit that synthesizes depth detected by the detection unit and depth predicted by the prediction unit on the basis of a result of estimating the amount of blur that occurs in each image captured by cameras. The amount of blur can be estimated using camera motion, previous depth information, and shutter time.Type: ApplicationFiled: January 30, 2019Publication date: June 10, 2021Applicant: Sony CorporationInventors: Tomohiro NISHI, Hideyuki ICHIHASHI, Yiwen ZHU, Masatoshi YOKOKAWA
-
Publication number: 20200402206Abstract: With a wide angle-of-view image acquired by an image pickup unit 21-1 as a reference, a signal processing unit 30 performs super-resolution processing by using a plurality of narrow angle-of-view images acquired by an image pickup unit 21-2 that uses a lens having a higher MTF (Modulation Transfer Function) than the image pickup unit 21-1. A control unit 60 controls the signal processing unit 30 so as to select an image having a range of angle of view according to a zoom magnification indicated by user's operation from the image subjected to the super-resolution processing. In the super-resolution processing, according to a detection result of parallax from a narrow angle-of-view image and the wide angle-of-view image acquired at the same time and a motion detection result for each of the plurality of narrow angle-of-view images, parallax compensation and motion compensation are performed on the plurality of narrow angle-of-view images.Type: ApplicationFiled: November 28, 2018Publication date: December 24, 2020Inventors: HIDEYUKI ICHIHASHI, TOMOHIRO NISHI, YIWEN ZHU, MASATOSHI YOKOKAWA
-
Patent number: 10443519Abstract: A catalyst deterioration determination system effectively prevents erroneous determination caused by increase of the H2 component in exhaust gas and improves accuracy of determination. A LAF sensor and an O2 sensor are provided on the upstream side and downstream side of a three-way catalyst. Deterioration of the three-way catalyst is determined on the basis of an output of the O2 sensor, which is detected during air-fuel ratio switching control in which an air-fuel ratio is alternately switched to the rich side and lean side of the stoichiometric air-fuel ratio according to a detected equivalent ratio detected by the LAF sensor, on the basis of a result of comparison between an oxygen inflow into the three-way catalyst and a lean side-limiting value and a rich side-limiting value which are target values of the oxygen inflow. Fuel injection timing retardation control and/or divided fuel injection control are prohibited during the deterioration determination.Type: GrantFiled: February 1, 2018Date of Patent: October 15, 2019Assignee: HONDA MOTOR CO., LTD.Inventors: Mitsuo Hashizume, Tomohiro Nishi, Toru Kasai, Hideyuki Yasuda
-
Patent number: 10389976Abstract: To achieve a configuration enabling identification of to which viewing user the displayed user displayed on the display unit is speaking. The configuration includes a display image generation unit that generates dialog pair identification information enabling identification of to which viewing user among the plurality of viewing users the displayed user on the display unit is speaking, and outputs the generated information together with the displayed user, to the display unit. The display image generation unit generates, as the dialog pair identification information, an arrow or an icon, a face surrounding frame or a face side line, a virtual viewpoint background image or the like, directed from the displayed user forming the dialog pair to the viewing user forming the dialog pair, and displays the generated dialog pair identification information together with the displayed user, on the display unit.Type: GrantFiled: January 12, 2017Date of Patent: August 20, 2019Assignee: SONY CORPORATIONInventors: Tomohiro Nishi, Masato Akao
-
Publication number: 20190014288Abstract: To achieve a configuration enabling identification of to which viewing user the displayed user displayed on the display unit is speaking. The configuration includes a display image generation unit that generates dialog pair identification information enabling identification of to which viewing user among the plurality of viewing users the displayed user on the display unit is speaking, and outputs the generated information together with the displayed user, to the display unit. The display image generation unit generates, as the dialog pair identification information, an arrow or an icon, a face surrounding frame or a face side line, a virtual viewpoint background image or the like, directed from the displayed user forming the dialog pair to the viewing user forming the dialog pair, and displays the generated dialog pair identification information together with the displayed user, on the display unit.Type: ApplicationFiled: January 12, 2017Publication date: January 10, 2019Inventors: TOMOHIRO NISHI, MASATO AKAO
-
Publication number: 20180216553Abstract: A catalyst deterioration determination system effectively prevents erroneous determination caused by increase of the H2 component in exhaust gas and improves accuracy of determination. A LAF sensor and an O2 sensor are provided on the upstream side and downstream side of a three-way catalyst. Deterioration of the three-way catalyst is determined on the basis of an output of the O2 sensor, which is detected during air-fuel ratio switching control in which an air-fuel ratio is alternately switched to the rich side and lean side of the stoichiometric air-fuel ratio according to a detected equivalent ratio detected by the LAF sensor, on the basis of a result of comparison between an oxygen inflow into the three-way catalyst and a lean side-limiting value and a rich side-limiting value which are target values of the oxygen inflow. Fuel injection timing retardation control and/or divided fuel injection control are prohibited during the deterioration determination.Type: ApplicationFiled: February 1, 2018Publication date: August 2, 2018Applicant: HONDA MOTOR CO., LTD.Inventors: Mitsuo Hashizume, Tomohiro Nishi, Toru Kasai, Hideyuki Yasuda
-
Publication number: 20180213139Abstract: The present technology relates to an image processing apparatus and method that can reduce a transmission delay of image data items. According to one aspect of the present technology, respective partial images of a plurality of captured images acquired by image capturing units different from each other are integrated and one composited image is generated. The exposure periods of the respective image capturing units may be the same or may be shifted from one another. The exposure periods of only a part of the capturing units may be shifted. The present technology can be applied to an image capturing device, an electronic device using the image capturing device, a computer, a system, or the like that processes the image data items acquired by the image capturing device, for example.Type: ApplicationFiled: May 27, 2016Publication date: July 26, 2018Applicant: SONY CORPORATIONInventors: ATSUSHI ITO, HIROSHI ORYOJI, TOMOHIRO NISHI
-
Patent number: 10012612Abstract: An inside lead portion of a gas sensor element has a lanthanum zirconate layer arranged between an electrically conductive oxide layer and a solid electrolyte member. Meanwhile, an inside detection electrode portion of the gas sensor element is formed such that (i) no lanthanum zirconate layer is formed between an electrically conductive oxide layer and the solid electrolyte member, or (ii) a lanthanum zirconate layer thinner than the lanthanum zirconate layer of the inside lead portion is formed between the electrically conductive oxide layer and the solid electrolyte member.Type: GrantFiled: July 12, 2016Date of Patent: July 3, 2018Assignee: NGK SPARK PLUG CO., LTD.Inventors: Shigehiro Ohtsuka, Tomohiro Nishi, Keisuke Nakagawa, Kazuma Ito, Ippei Kato
-
Patent number: 9952657Abstract: An apparatus includes a display controller configured to control a display state of a transparent display based on a sensor output that contains information regarding an object separated from the apparatus.Type: GrantFiled: March 25, 2013Date of Patent: April 24, 2018Assignee: SONY CORPORATIONInventors: Tomohiro Nishi, Kazuki Yokoyama, Masuyoshi Kurokawa, Kohei Miyamoto, Takeshi Uemori