Patents by Inventor Ryuta SATOH

Ryuta SATOH has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220019813
    Abstract: A device and a method that enable safe driving by performing object recognition using image analysis and inter-vehicle communication information are implemented. Provided are an image analysis unit that analyzes an image captured by a vehicle-mounted camera and performs object recognition in the image, an unknown object identification unit that identifies an unknown object in an image area determined to be an unknown object area as a result of analysis by the image analysis unit, and a communication unit that transmits information to an unknown object such as a second vehicle identified by the unknown object identification unit. The unknown object identification unit identifies the second vehicle, which is an unknown object in the image area determined to be the unknown object area, using the peripheral object information received through the communication unit. The communication unit transmits unknown object information or control information for travel control of the second vehicle to the second vehicle.
    Type: Application
    Filed: November 21, 2019
    Publication date: January 20, 2022
    Inventors: RYUTA SATOH, YUSUKE HIEIDA, YUKI YAMAMOTO, KEITARO YAMAMOTO, SEUNGHA YANG
  • Publication number: 20220012552
    Abstract: An information processing device on a server side includes: a predetermined number of recognition units, for which a model updated by performing image recognition in a predetermined number of vehicles and executing unsupervised learning is each set, configured to perform image recognition on an image, on which image recognition has been performed in a predetermined number of the vehicles; and an evaluation value calculation unit configured to evaluate recognition results obtained in a predetermined number of the recognition units and calculate an evaluation value for each of the recognition units. The information processing device on the vehicle side includes an execution unit that executes unsupervised learning, and a determination unit that determines whether learning has been performed correctly or not for a model updated in the execution unit on the basis of an evaluation value found on the server side.
    Type: Application
    Filed: March 17, 2020
    Publication date: January 13, 2022
    Applicant: Sony Group Corporation
    Inventors: Yuki YAMAMOTO, Ryuta SATOH
  • Publication number: 20220004777
    Abstract: A device and a method for enabling safe traveling by performing image analysis and body identification using inter-vehicle communication information are realized. There are provided: an image analysis unit configured to analyze a captured image of a camera mounted on a mobile device, execute object identification of an image, and set a label as an identification result to an image region; a low-confidence region extraction unit configured to extract a region with low confidence of object identification from an image analysis result; and a label updating unit configured to update a label of the low-confidence region on the basis of information received via a communication unit. The label updating unit updates a label in a case where a matching rate between an object region analyzed from information received via the communication unit and the low-confidence region is equal to or greater than a specified threshold.
    Type: Application
    Filed: October 23, 2019
    Publication date: January 6, 2022
    Inventors: SEUNGHA YANG, RYUTA SATOH
  • Patent number: 11182880
    Abstract: Methods and apparatus for image processing are provided. The method comprises receiving input of a visible-ray image and a far-infrared-ray image obtained by photographing a same subject, estimating a blur estimation result in the visible-ray image, wherein estimating a blur estimation result comprises calculating a correlation between the visible-ray image and each of a plurality of filter-applied far-infrared ray images in which a different filter is applied to the far-infrared-ray image and selecting the filter for which the calculated correlation is highest, and performing a correction process on the visible-ray image based, at least in part, on the blur estimation result to generate a corrected visible-ray image from which the blur is reduced, wherein generating the corrected visible-ray image comprises applying, to the visible ray image, an inverse filter having an inverse characteristic to a characteristic of the selected filter.
    Type: Grant
    Filed: August 30, 2018
    Date of Patent: November 23, 2021
    Assignee: Sony Corporation
    Inventors: Suguru Aoki, Ryuta Satoh, Atsushi Ito, Hideki Oyaizu, Takeshi Uemori
  • Publication number: 20210350578
    Abstract: A comparison area detection unit of image processing circuitry detects an image area of a fading determination object on the basis of an image signal generated by an image capturing unit using a color filter as a comparison area. A color information generation unit generates color information from the image signal of the comparison area and uses the color information as comparison target information. A color information comparison unit compares the color information of the fading determination object as fading determination reference information with the comparison target information. A fading information generation unit generates fading information indicating that a fading level of the color filter exceeds a predetermined level or the fading level of the color filter on the basis of comparison information indicating a comparison result between the fading determination reference information and the comparison target information. The fading state of the color filter can be detected with precision.
    Type: Application
    Filed: September 13, 2019
    Publication date: November 11, 2021
    Applicant: Sony Corporation
    Inventors: Ryuta SATOH, Shun LEE, Keitaro YAMAMOTO
  • Publication number: 20210329164
    Abstract: An imaging apparatus includes: an imaging unit that has a pixel region in which a plurality of pixels is arranged and that reads and outputs a pixel signal from the pixels included in the pixel region; a unit-of-readout controller that controls a unit of readout set as a part of the pixel region: a recognition unit that has learned training data for each of units of readout; a first output unit that outputs a recognition result of recognition performed by the recognition unit for each of the units of readout; a second output unit that outputs the pixel signal to a subsequent stage; and a trigger generator that generates a trigger signal for controlling a first timing at which the first output unit outputs the recognition result and a second timing at which the second output unit outputs the pixel signal.
    Type: Application
    Filed: September 2, 2019
    Publication date: October 21, 2021
    Applicant: Sony Corporation
    Inventors: Ryuta SATOH, Suguru AOKI, Keitaro YAMAMOTO, Ryoji EKI
  • Publication number: 20210329163
    Abstract: An imaging apparatus includes: an imaging unit that has a pixel region in which a plurality of pixels is arranged and reads and outputs a pixel signal from the pixels included in the pixel region; a unit-of-readout controller that controls a unit of readout set as a part of the pixel region; a first unit-of-readout setting unit that sets a first unit of readout that is used for reading out the pixel signal from the pixel region for a recognition process that has learned training data for each of the units of readout; a second unit-of-readout setting unit that sets a second unit of readout that is used for reading out the pixel signal from the pixel region so as to output the pixel signal to a subsequent stage; and a mediation unit that performs mediation between the first unit of readout and the second unit of readout.
    Type: Application
    Filed: September 2, 2019
    Publication date: October 21, 2021
    Applicant: Sony Corporation
    Inventors: Ryuta SATOH, Suguru AOKI, Keitaro YAMAMOTO, Ryoji EKI
  • Publication number: 20210321054
    Abstract: An imaging apparatus according to an embodiment includes: an imaging unit (10) having a pixel region in which a plurality of pixels is arranged; a readout controller (11) that controls readout of pixel signals from pixels included in the pixel region; a unit-of-readout controller (123) that controls a unit of readout that is set as a part of the pixel region and for which the readout controller performs the readout; and a recognition unit (14) that has learned training data for each of the units of readout. The recognition unit performs a recognition process on the pixel signal for each of the units of readout, and outputs a recognition result which is a result of the recognition process.
    Type: Application
    Filed: September 2, 2019
    Publication date: October 14, 2021
    Applicant: Sony Corporation
    Inventors: Suguru AOKI, Ryuta SATOH, Keitaro YAMAMOTO, Ryoji EKI
  • Publication number: 20210306586
    Abstract: An imaging apparatus according to an embodiment includes: an imaging unit having a pixel region in which a plurality of pixels is arranged; a readout controller that controls readout of pixel signals from pixels included in the pixel region; a first unit-of-readout setting unit that sets a unit of readout as a part of the pixel region, for which the readout controller performs readout of the pixel signal; an image output unit that outputs a first image based on the pixel signal read out from the unit of readout to a subsequent stage; a second unit-of-readout controller that controls the unit of readout in which the readout controller performs readout of the pixel signal; and a recognition unit that learns training data for each of the units of readout, performs a recognition process on the pixel signal for each of the units of readout, and outputs a recognition result.
    Type: Application
    Filed: September 2, 2019
    Publication date: September 30, 2021
    Applicant: Sony Corporation
    Inventors: Keitaro YAMAMOTO, Suguru AOKI, Ryuta SATOH, Ryoji EKI
  • Publication number: 20210297585
    Abstract: The present invention suppresses an increase in processing time and power consumption that is associated with function implementation. An electronic device according to an embodiment comprises: an imaging unit (11) that generates image data; a processing unit (14) that executes neural network calculation model-based processing with respect to image data-based data that is read out from the imaging unit; a function execution unit (12) that performs a predetermined function on the basis of the results of the processing; and a detection unit (32) that detects displacement, wherein the processing unit executes the processing when the detection unit detects displacement.
    Type: Application
    Filed: August 29, 2019
    Publication date: September 23, 2021
    Applicants: Sony Semiconductor Solutions Corporation, Sony Corporation
    Inventors: Ryoji EKI, Suguru AOKI, Ryuta SATOH
  • Publication number: 20210264638
    Abstract: Where a highly accurate image analysis is required, for example, only RAW images selected according to specified conditions are selected and transmitted to a server. There are provided an imaging unit that is mounted on a movable device, an image signal processor that generates a color image by signal processing of the RAW image which is an output of an imaging element of the imaging unit, an image analysis unit that executes analysis processing of the color image, a transmission necessity determination unit that determines transmission necessity of the RAW image to the server, and a transmission unit that transmits the RAW image to the external server according to a determination result. The transmission necessity determination unit decides the transmission necessity of the RAW image on the basis of a transmission timing control at constant intervals, imaging and signal processing parameters, an image analysis result, device information, or the like.
    Type: Application
    Filed: May 10, 2019
    Publication date: August 26, 2021
    Applicant: Sony Corporation
    Inventors: Ryuta SATOH, Suguru AOKI, Keitaro YAMAMOTO
  • Publication number: 20210033712
    Abstract: Information acquisition units 11-1 and 11-2 (11-2a) acquire peripheral object information, and information processing units 12-1 and 12-2 (12-2a) generate point cloud data relating to a feature point of a peripheral object on the basis of the peripheral object information. A weight setting unit 13 sets a weight according to a situation between the peripheral object and the information acquisition units when the peripheral object information was acquired. A calibration processing unit 15 uses the point cloud data, the weight, and external parameters stored in a parameter storage unit 14 to calculate new external parameters that minimize an error of the external parameters, on the basis of a cost indicating the error. A parameter update unit 16 updates the external parameters stored in the parameter storage unit 14 using the calculated new external parameters. Since highly accurate external parameters are stored in the parameter storage unit 14, the calibration can be performed stably.
    Type: Application
    Filed: November 16, 2018
    Publication date: February 4, 2021
    Inventors: SEUNGHA YANG, SUGURU AOKI, RYUTA SATOH
  • Publication number: 20200410788
    Abstract: The present technology relates to a management apparatus, a vehicle, an inspection apparatus, and a vehicle inspection system and an information processing method therefor by which more efficient vehicle inspection can be implemented. The vehicle inspection system includes a vehicle that is an inspection target vehicle, an inspection apparatus that inspects, as a third party, the vehicle, and a management apparatus. The management apparatus decides feedback information based on a result of determination obtained when a vehicle state of the vehicle is determined using first inspection data based on a result of inspection of the vehicle and second inspection data based on a result of inspection of the inspection apparatus, and transmits the feedback information to the vehicle. The present technology can be applied, for example, to a vehicle inspection system for inspecting a vehicle and so forth.
    Type: Application
    Filed: August 28, 2018
    Publication date: December 31, 2020
    Applicants: Sony Corporation, Sony Semiconductor Solutions Corporation
    Inventors: Hiromasa UCHIYAMA, Ryuta SATOH, Yukio KINOSHITA
  • Publication number: 20200410274
    Abstract: Provided are an image processing apparatus and an image processing method that process a far-infrared image. The image processing apparatus includes a region extraction section, a modal transformation section, and a superimposition section. The region extraction section extracts a region of interest within a visible-light image captured by a visible-light camera. The modal transformation section receives an image of the region of interest within an infrared image captured by an infrared camera observing the same subject as the visible-light camera, and transforms the received image to a modal image. The superimposition section generates a presentation image by superimposing the modal image on the region of interest within the visible-light image. The modal transformation section transforms a far-infrared image of the region of interest to a modal image including an information modal familiar to humans by using, for example, a database and a conditional probability distribution.
    Type: Application
    Filed: September 4, 2018
    Publication date: December 31, 2020
    Applicant: Sony Corporation
    Inventors: Ryuta SATOH, Suguru AOKI, Atsushi ITO, Takeshi UEMORI, Hideki OYAIZU
  • Publication number: 20200366825
    Abstract: A recognition control unit 40 detects a light amount of an imaging area on the basis of an image signal from a camera unit 20, a control signal from a camera control unit 30, and the like, and generates selection determination information on the basis of a detection result of the light amount. A recognition processing unit 50 performs area division on an image of an imaging area generated by the camera unit 20 on the basis of the selection determination information generated by the recognition control unit 40, and selects a recognizer for each area. Moreover, the recognition processing unit 50 performs a subject recognition process on an image of the corresponding area by using the selected recognizer. Even when a captured image includes a bright area and a dark area, a subject in each area can be easily and accurately recognized.
    Type: Application
    Filed: November 16, 2018
    Publication date: November 19, 2020
    Applicant: Sony Corporation
    Inventors: Suguru AOKI, Ryuta SATOH, Keitaro YAMAMOTO
  • Publication number: 20200294245
    Abstract: An image processing apparatus and an image processing method for processing far-infrared ray images are provided. Specific temperature ranges constituted by pixels having values falling within a temperature range characteristic of a specific target are extracted from a far-infrared ray image captured of the same target. Of the specific temperature ranges, those having motion vectors close to each other are integrated so as to generate integrated ranges. The integrated ranges having motion vectors close to a global motion vector indicative of the motion of the image as a whole are excluded to obtain excluded integrated ranges. Visible light ranges corresponding to the specific temperature ranges in the excluded integrated ranges are extracted from the visible light image to generate visible light motion ranges. The positions of the visible light motion ranges are corrected on the basis of the motion vector of the excluded integrated ranges as a whole.
    Type: Application
    Filed: August 24, 2018
    Publication date: September 17, 2020
    Applicant: Sony Corporation
    Inventors: Hideki OYAIZU, Atsushi ITO, Takeshi UEMORI, Suguru AOKI, Ryuta SATOH
  • Publication number: 20200193570
    Abstract: Image processing methods and apparatus are described. The image processing method comprises receiving input of a visible-ray image and an infrared-ray image obtained by photographing a same subject, estimating, based on the visible-ray image, the infrared-ray image and motion information, a blur estimate associated with the visible-ray image, and generating, based on the estimated blur estimate, a corrected visible-ray image.
    Type: Application
    Filed: August 30, 2018
    Publication date: June 18, 2020
    Applicant: Sony Corporation
    Inventors: Suguru Aoki, Ryuta Satoh, Atsushi Ito, Hideki Oyaizu, Takeshi Uemori
  • Publication number: 20200193569
    Abstract: Methods and apparatus for image processing are provided. The method comprises receiving input of a visible-ray image and a far-infrared-ray image obtained by photographing a same subject, estimating a blur estimation result in the visible-ray image, wherein estimating a blur estimation result comprises calculating a correlation between the visible-ray image and each of a plurality of filter-applied far-infrared ray images in which a different filter is applied to the far-infrared-ray image and selecting the filter for which the calculated correlation is highest, and performing a correction process on the visible-ray image based, at least in part, on the blur estimation result to generate a corrected visible-ray image from which the blur is reduced, wherein generating the corrected visible-ray image comprises applying, to the visible ray image, an inverse filter having an inverse characteristic to a characteristic of the selected filter.
    Type: Application
    Filed: August 30, 2018
    Publication date: June 18, 2020
    Applicant: Sony Corporation
    Inventors: Suguru Aoki, Ryuta Satoh, Atsushi Ito, Hideki Oyaizu, Takeshi Uemori
  • Publication number: 20200172110
    Abstract: An image captured by a far-infrared camera is analyzed to analyze a distribution of a road-surface temperature, and a course of a highest road-surface temperature is determined to be a traveling route. Further, automatic driving along the course of the highest road-surface temperature is performed. Furthermore, a state of the distribution of a road-surface temperature, and a direction of the course of the highest road-surface temperature are displayed on a display section, so that a user (a driver) recognizes them. For example, a state analyzer detects a candidate course travelable for a vehicle, the state analyzer detecting a plurality of the candidate courses, calculates an average value of a road-surface temperature of each of the plurality of the candidate courses, and determines the candidate course having a largest average value of a road-surface temperature to be a traveling route.
    Type: Application
    Filed: July 13, 2018
    Publication date: June 4, 2020
    Applicant: Sony Corporation
    Inventors: Takeshi UEMORI, Atsushi ITO, Hideki OYAIZU, Suguru AOKI, Ryuta SATOH