Patents by Inventor Ryuta SATOH

Ryuta SATOH has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11641492
    Abstract: Provided are an image processing apparatus and an image processing method that process a far-infrared image. The image processing apparatus includes a region extraction section, a modal transformation section, and a superimposition section. The region extraction section extracts a region of interest within a visible-light image captured by a visible-light camera. The modal transformation section receives an image of the region of interest within an infrared image captured by an infrared camera observing the same subject as the visible-light camera, and transforms the received image to a modal image. The superimposition section generates a presentation image by superimposing the modal image on the region of interest within the visible-light image. The modal transformation section transforms a far-infrared image of the region of interest to a modal image including an information modal familiar to humans by using, for example, a database and a conditional probability distribution.
    Type: Grant
    Filed: September 4, 2018
    Date of Patent: May 2, 2023
    Assignee: SONY CORPORATION
    Inventors: Ryuta Satoh, Suguru Aoki, Atsushi Ito, Takeshi Uemori, Hideki Oyaizu
  • Patent number: 11595608
    Abstract: An imaging apparatus according to an embodiment includes: an imaging unit (10) having a pixel region in which a plurality of pixels is arranged; a readout controller (11) that controls readout of pixel signals from pixels included in the pixel region; a unit-of-readout controller (123) that controls a unit of readout that is set as a part of the pixel region and for which the readout controller performs the readout; and a recognition unit (14) that has learned training data for each of the units of readout. The recognition unit performs a recognition process on the pixel signal for each of the units of readout, and outputs a recognition result which is a result of the recognition process.
    Type: Grant
    Filed: September 2, 2019
    Date of Patent: February 28, 2023
    Assignee: SONY CORPORATION
    Inventors: Suguru Aoki, Ryuta Satoh, Keitaro Yamamoto, Ryoji Eki
  • Publication number: 20230005249
    Abstract: An object of the present disclosure is to provide an information processing apparatus, an information processing system, an information processing method, and an information processing program capable of achieving efficient use of training data. An information processing apparatus according to the present disclosure includes: a recognition unit (101) that performs object recognition processing using sensor information acquired by a sensor, the object recognition processing being performed by a first recognizer that has been pretrained; and a training data application determination unit (22d) that determines whether the sensor information is applicable as training data to a second recognizer different from the first recognizer.
    Type: Application
    Filed: December 15, 2020
    Publication date: January 5, 2023
    Inventor: RYUTA SATOH
  • Publication number: 20220335292
    Abstract: The present technology relates to an information processing device, an information processing method, and a program that make it possible to do re-learning when an environment change occurs. A determination unit that determines an action in response to input information on the basis of a predetermined learning model; and a learning unit that performs a re-learning of the learning model when a change in a reward amount for the action is a change exceeding a predetermined standard are included. The learning model is a learning model generated or updated through reinforcement learning. The present technology can be applied to an information processing device that carries out, for example, predetermined reinforcement learning.
    Type: Application
    Filed: October 1, 2020
    Publication date: October 20, 2022
    Applicant: Sony Group Corporation
    Inventors: Suguru AOKI, Ryuta SATOH, Tetsu OGAWA, Itaru SHIMIZU
  • Patent number: 11468574
    Abstract: An image processing apparatus and an image processing method for processing far-infrared ray images are provided. Specific temperature ranges constituted by pixels having values falling within a temperature range characteristic of a specific target are extracted from a far-infrared ray image captured of the same target. Of the specific temperature ranges, those having motion vectors close to each other are integrated so as to generate integrated ranges. The integrated ranges having motion vectors close to a global motion vector indicative of the motion of the image as a whole are excluded to obtain excluded integrated ranges. Visible light ranges corresponding to the specific temperature ranges in the excluded integrated ranges are extracted from the visible light image to generate visible light motion ranges. The positions of the visible light motion ranges are corrected on the basis of the motion vector of the excluded integrated ranges as a whole.
    Type: Grant
    Filed: August 24, 2018
    Date of Patent: October 11, 2022
    Assignee: SONY CORPORATION
    Inventors: Hideki Oyaizu, Atsushi Ito, Takeshi Uemori, Suguru Aoki, Ryuta Satoh
  • Publication number: 20220283584
    Abstract: An information processing device includes a map creating unit that creates a map of a travel range, which is a range over which a mobile body having an image-capturing device performs photography while travelling, a shape extracting unit that extracts a shape present in the map, a composition setting unit that sets a composition of an image to be photographed by the image-capturing device, and a route deciding unit that decides a travel route in the travel range of the mobile body on the basis of the shape and the composition.
    Type: Application
    Filed: May 28, 2020
    Publication date: September 8, 2022
    Applicant: Sony Group Corporation
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Ryuta SATOH, Takuto MOTOYAMA
  • Patent number: 11438517
    Abstract: A recognition control circuitry detects a light amount of an imaging area on the basis of an image signal from a camera, a control signal from a camera control circuitry, and the like, and generates selection determination information on the basis of a detection result of the light amount. A recognition processing circuitry performs area division on an image of an imaging area generated by the camera on the basis of the selection determination information generated by the recognition control circuitry, and selects a recognizer for each area. Moreover, the recognition processing circuitry performs a subject recognition process on an image of the corresponding area by using the selected recognizer. Even when a captured image includes a bright area and a dark area, a subject in each area can be easily and accurately recognized.
    Type: Grant
    Filed: November 16, 2018
    Date of Patent: September 6, 2022
    Assignee: SONY CORPORATION
    Inventors: Suguru Aoki, Ryuta Satoh, Keitaro Yamamoto
  • Patent number: 11417023
    Abstract: A comparison area detection unit of image processing circuitry detects an image area of a fading determination object on the basis of an image signal generated by an image capturing unit using a color filter as a comparison area. A color information generation unit generates color information from the image signal of the comparison area and uses the color information as comparison target information. A color information comparison unit compares the color information of the fading determination object as fading determination reference information with the comparison target information. A fading information generation unit generates fading information indicating that a fading level of the color filter exceeds a predetermined level or the fading level of the color filter on the basis of comparison information indicating a comparison result between the fading determination reference information and the comparison target information. The fading state of the color filter can be detected with precision.
    Type: Grant
    Filed: September 13, 2019
    Date of Patent: August 16, 2022
    Assignee: SONY CORPORATION
    Inventors: Ryuta Satoh, Shun Lee, Keitaro Yamamoto
  • Publication number: 20220185278
    Abstract: An imaging section 20 images a passenger in a moving body. A boarding state detection section 30 detects a boarding state of the passenger on the basis of a captured image acquired by the imaging section 20. An allowable acceleration setting section 40 sets, for each passenger, individual allowable acceleration on the basis of the boarding state of the passenger detected by the boarding state detection section 30, for example, the lateral spacing between the feet of the passenger, the arrangement angle of the feet with respect to the moving direction of the moving body, and the like. Further, integration is performed on the individual allowable acceleration determined for the respective passengers in the moving body, and the acceleration that is allowable for the moving body is set. The allowable acceleration for the moving body is set according to the boarding state of each passenger, thus preventing the moving body from moving at acceleration at which the passengers may be endangered.
    Type: Application
    Filed: February 19, 2020
    Publication date: June 16, 2022
    Inventors: RYUTA SATOH, SUGURU AOKI
  • Publication number: 20220180483
    Abstract: Image processing methods and apparatus are described. The image processing method comprises receiving input of a visible-ray image and an infrared-ray image obtained by photographing a same subject, estimating, based on the visible-ray image, the infrared-ray image and motion information, a blur estimate associated with the visible-ray image, and generating, based on the estimated blur estimate, a corrected visible-ray image.
    Type: Application
    Filed: February 23, 2022
    Publication date: June 9, 2022
    Applicant: Sony Group Corporation
    Inventors: Suguru Aoki, Ryuta Satoh, Atsushi Ito, Hideki Oyaizu, Takeshi Uemori
  • Publication number: 20220169245
    Abstract: A moving range of an object is estimated on the basis of image information. An information processing apparatus includes an input unit that inputs an image, a region estimation unit that estimates a region of an object contained in the image, a moving history information acquisition unit that acquires information associated with a moving history of the object, a contact region determination unit that determines a contact region in contact with the object on the basis of an estimation result obtained by the region estimation unit, and a moving range estimation unit that estimates a moving range of the object on the basis of the moving history containing the contact region of the object. The moving range estimation unit estimates the moving range of the object on the basis of the moving history containing the contact region of the object and a moving track of the object.
    Type: Application
    Filed: January 27, 2020
    Publication date: June 2, 2022
    Inventors: YUSUKE HIEIDA, RYUTA SATOH
  • Publication number: 20220165066
    Abstract: An information processing apparatus includes an input device and a controller. A captured image that is captured by a camera is input to the input device, the captured image including distance information for each pixel. The controller generates a transformed captured image obtained by transforming pairs of coordinates for respective pixels of the captured image on the basis of an amount of movement of the camera or a mobile body on which the camera is mounted. Further, the controller associates a pair of coordinates for a pixel of the transformed captured image with a pair of coordinates for a pixel of a post-movement captured image captured at a position of the camera after the movement, and the controller identifies a non-associated pixel that is included in the post-movement captured image and is not associated with the pixel of the transformed captured image.
    Type: Application
    Filed: March 13, 2020
    Publication date: May 26, 2022
    Inventors: SUGURU AOKI, RYUTA SATOH
  • Publication number: 20220153411
    Abstract: The present technology relates to a moving body, a control method thereof, and a program capable of accurately detecting and avoiding a linear object that can be an obstacle in movement. The moving body detects a line segment in a captured image captured by at least one camera of a stereo camera, and moves a machine body to which the stereo camera is fixed in a direction orthogonal to the line segment. The present technology can be applied to, for example, a moving body and the like that perform autonomous flight, such as a drone.
    Type: Application
    Filed: March 12, 2020
    Publication date: May 19, 2022
    Applicant: Sony Group Corporation
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Shun LEE, Ryuta SATOH, Shinichiro ABE, Takuto MOTOYAMA, Masaki HANDA
  • Patent number: 11332146
    Abstract: An image captured by a far-infrared camera is analyzed to analyze a distribution of a road-surface temperature, and a course of a highest road-surface temperature is determined to be a traveling route. Further, automatic driving along the course of the highest road-surface temperature is performed. Furthermore, a state of the distribution of a road-surface temperature, and a direction of the course of the highest road-surface temperature are displayed on a display section, so that a user (a driver) recognizes them. For example, a state analyzer detects a candidate course travelable for a vehicle, the state analyzer detecting a plurality of the candidate courses, calculates an average value of a road-surface temperature of each of the plurality of the candidate courses, and determines the candidate course having a largest average value of a road-surface temperature to be a traveling route.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: May 17, 2022
    Assignee: SONY CORPORATION
    Inventors: Takeshi Uemori, Atsushi Ito, Hideki Oyaizu, Suguru Aoki, Ryuta Satoh
  • Publication number: 20220148283
    Abstract: An information processing apparatus includes an image processor and a controller. The image processor performs recognition processing of recognizing attributes of predetermined regions that are respectively included in sequentially acquired images captured by a camera. The controller sets a frequency of performing the recognition processing for the predetermined region on the basis of the recognized attribute.
    Type: Application
    Filed: March 13, 2020
    Publication date: May 12, 2022
    Inventors: SUGURU AOKI, RYUTA SATOH
  • Patent number: 11288777
    Abstract: Image processing methods and apparatus are described. The image processing method comprises receiving input of a visible-ray image and an infrared-ray image obtained by photographing a same subject, estimating, based on the visible-ray image, the infrared-ray image and motion information, a blur estimate associated with the visible-ray image, and generating, based on the estimated blur estimate, a corrected visible-ray image.
    Type: Grant
    Filed: August 30, 2018
    Date of Patent: March 29, 2022
    Assignee: Sony Corporation
    Inventors: Suguru Aoki, Ryuta Satoh, Atsushi Ito, Hideki Oyaizu, Takeshi Uemori
  • Publication number: 20220094435
    Abstract: A visible light communication apparatus according to the present disclosure includes an acquisition section configured to acquire an image captured by a sensor included in a mobile object, a first extraction section configured to detect an object included in the image and extract a first region that includes the object, a second extraction section configured to detect a light source from inside the first region and extract a second region that includes the light source, and a visible light communication section configured to perform visible light communication with the light source included in the second region.
    Type: Application
    Filed: January 20, 2020
    Publication date: March 24, 2022
    Inventors: KEITARO YAMAMOTO, RYUTA SATOH
  • Publication number: 20220019813
    Abstract: A device and a method that enable safe driving by performing object recognition using image analysis and inter-vehicle communication information are implemented. Provided are an image analysis unit that analyzes an image captured by a vehicle-mounted camera and performs object recognition in the image, an unknown object identification unit that identifies an unknown object in an image area determined to be an unknown object area as a result of analysis by the image analysis unit, and a communication unit that transmits information to an unknown object such as a second vehicle identified by the unknown object identification unit. The unknown object identification unit identifies the second vehicle, which is an unknown object in the image area determined to be the unknown object area, using the peripheral object information received through the communication unit. The communication unit transmits unknown object information or control information for travel control of the second vehicle to the second vehicle.
    Type: Application
    Filed: November 21, 2019
    Publication date: January 20, 2022
    Inventors: RYUTA SATOH, YUSUKE HIEIDA, YUKI YAMAMOTO, KEITARO YAMAMOTO, SEUNGHA YANG
  • Publication number: 20220012552
    Abstract: An information processing device on a server side includes: a predetermined number of recognition units, for which a model updated by performing image recognition in a predetermined number of vehicles and executing unsupervised learning is each set, configured to perform image recognition on an image, on which image recognition has been performed in a predetermined number of the vehicles; and an evaluation value calculation unit configured to evaluate recognition results obtained in a predetermined number of the recognition units and calculate an evaluation value for each of the recognition units. The information processing device on the vehicle side includes an execution unit that executes unsupervised learning, and a determination unit that determines whether learning has been performed correctly or not for a model updated in the execution unit on the basis of an evaluation value found on the server side.
    Type: Application
    Filed: March 17, 2020
    Publication date: January 13, 2022
    Applicant: Sony Group Corporation
    Inventors: Yuki YAMAMOTO, Ryuta SATOH
  • Publication number: 20220004777
    Abstract: A device and a method for enabling safe traveling by performing image analysis and body identification using inter-vehicle communication information are realized. There are provided: an image analysis unit configured to analyze a captured image of a camera mounted on a mobile device, execute object identification of an image, and set a label as an identification result to an image region; a low-confidence region extraction unit configured to extract a region with low confidence of object identification from an image analysis result; and a label updating unit configured to update a label of the low-confidence region on the basis of information received via a communication unit. The label updating unit updates a label in a case where a matching rate between an object region analyzed from information received via the communication unit and the low-confidence region is equal to or greater than a specified threshold.
    Type: Application
    Filed: October 23, 2019
    Publication date: January 6, 2022
    Inventors: SEUNGHA YANG, RYUTA SATOH