Patents by Inventor Takuto MOTOYAMA

Takuto MOTOYAMA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12229980
    Abstract: An information processing apparatus includes: a plurality of stereo cameras arranged so that directions of baseline lengths of the stereo cameras intersect each other; a depth estimation unit that estimates, from captured images captured by the plurality of stereo cameras, a depth of an object included in the captured images; and an object detection unit that detects the object based on the depth estimated by the depth estimation unit and reliability of the depth, the reliability being determined in accordance with an angle of a direction of an edge line of the object with respect to the directions of the baseline lengths of the plurality of stereo cameras.
    Type: Grant
    Filed: July 17, 2020
    Date of Patent: February 18, 2025
    Assignee: SONY GROUP CORPORATION
    Inventors: Kohei Urushido, Takuto Motoyama, Masahiko Toyoshi, Shun Lee
  • Publication number: 20240416906
    Abstract: The present disclosure relates to an information processing apparatus, an information processing method, and a program that allow for appropriately pulling over to a safe road shoulder when an emergency occurs during automated driving. On the basis of distance information from a depth sensor or the like, a travelable region available for a vehicle to travel is set like an occupancy map, and image attribute information is generated from an image by semantic segmentation. On the basis of the image attribute information, an evacuation space is set in the travelable region in accordance with the situation of the road surface of the travelable region, and thus an evacuation space map is created. The present disclosure can be applied to a mobile object.
    Type: Application
    Filed: August 27, 2024
    Publication date: December 19, 2024
    Inventor: TAKUTO MOTOYAMA
  • Publication number: 20240393805
    Abstract: An information processing method executed by one processor or executed by a plurality of processors in cooperation, the method includes: an estimation step of estimating a relative position or a relative attitude of an aerial vehicle with respect to a moving body; an acquisition step of acquiring information related to a distance between the moving body and the aerial vehicle; and a switching step of switching an estimation method for estimating the relative position or the relative attitude of the aerial vehicle, based on the information related to the distance.
    Type: Application
    Filed: February 2, 2022
    Publication date: November 28, 2024
    Applicant: Sony Group Corporation
    Inventors: Takuto MOTOYAMA, Masaki HANDA, Shinichiro ABE, Masahiko TOYOSHI, Kohei URUSHIDO
  • Patent number: 12097848
    Abstract: There is provided an apparatus and a method that allows appropriate pulling over of a mobile object to a safe road shoulder when an emergency occurs during automated driving. A travelable region available for a vehicle to travel is set like an occupancy map based on distance information from a depth sensor. Image attribute information is generated from an image by semantic segmentation. An evacuation space is set in the travelable region based on the image attribute information that represents the situation of the road surface of the travelable region, and thus an evacuation space map is created.
    Type: Grant
    Filed: June 1, 2020
    Date of Patent: September 24, 2024
    Assignee: SONY GROUP CORPORATION
    Inventor: Takuto Motoyama
  • Patent number: 12073732
    Abstract: The present disclosure relates to action control device and an action control method and a program that enable more appropriate action control to be achieved. An EKF processing unit selects a self-position estimation unit used to estimate a position of a drone from a plurality of the self-position estimation units which is different in estimation accuracy on the basis of waypoints that are indexes when the drone acts, and obtains a state of the drone. Then, a navigator controls an action of the drone according to an action plan created in advance on the basis of the state of the drone. The present technology can be applied to, for example, a mission flight control device that controls a mission flight of a drone.
    Type: Grant
    Filed: February 21, 2020
    Date of Patent: August 27, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Kenichiro Oi, Masaki Handa, Takuto Motoyama, Shun Lee, Masahiko Toyoshi
  • Publication number: 20240231395
    Abstract: An aerial vehicle according to an embodiment of the present technology includes a recording unit, a detection unit, and a reproduction unit. The recording unit records a flight parameter during flight in a state in which no sensor abnormality is detected. The detection unit detects the sensor abnormality. The reproduction unit reproduces the flight parameter on the basis of the sensor abnormality detected by the detection unit.
    Type: Application
    Filed: January 13, 2022
    Publication date: July 11, 2024
    Inventors: MASAKI HANDA, TAKUTO MOTOYAMA, SHINICHIRO ABE, MASAHIKO TOYOSHI, KOHEI URUSHIDO
  • Publication number: 20240219922
    Abstract: The present disclosure relates to a moving body, a movement control method, and a program capable of suppressing erroneous determination in obstacle detection. A normal vector estimation unit estimates a normal vector on the basis of sensor data obtained by sensing an object in a traveling direction of the own device, and a control information estimation unit generates control information for controlling movement of the own device on the basis of the normal vector. Technology according to the present disclosure can be applied to, for example, a moving body such as a drone.
    Type: Application
    Filed: February 1, 2022
    Publication date: July 4, 2024
    Applicant: Sony Group Corporation
    Inventors: Takuto MOTOYAMA, Kohei URUSHIDO, Masaki HANDA, Masahiko TOYOSHI, Shinichiro ABE
  • Patent number: 12018926
    Abstract: A controller includes an acquisition unit that acquires image data captured by an imaging device for photographing disposed in a moving body, and a calculation unit that calculates a relative position of a position of a subject, which is detected by a plurality of distance-measuring imaging devices provided in the moving body, based on the subject included in the image data.
    Type: Grant
    Filed: December 3, 2019
    Date of Patent: June 25, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Takuto Motoyama, Masaki Handa, Shinichiro Abe, Masahiko Toyoshi, Shun Lee, Kenichiro Oi
  • Publication number: 20240169574
    Abstract: A mobile body (1) includes an image slide unit (11), a parallax histogram aggregation unit (13), and a miscalibration detection unit (14). The image slide unit (11) generates a slide image (SLI) obtained by sliding a first viewpoint image (VPI1) in a parallax direction. The parallax histogram aggregation unit (13) generates a parallax histogram (HG) from the slide image (SLI) and a second viewpoint image (VPI2). The miscalibration detection unit (14) determines that the miscalibration has occurred when a lower boundary value of the parallax on the histogram (HG) is smaller than the slide amount of the first viewpoint image (VPI1).
    Type: Application
    Filed: December 21, 2021
    Publication date: May 23, 2024
    Inventors: KOHEI URUSHIDO, MASAKI HANDA, TAKUTO MOTOYAMA, SHINICHIRO ABE, MASAHIKO TOYOSHI
  • Publication number: 20240142995
    Abstract: A configuration is described that is capable of determining a target landing position of a drone according to a sentence indicating a landing position generated by a user.
    Type: Application
    Filed: January 20, 2022
    Publication date: May 2, 2024
    Applicant: Sony Group Corporation
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Shinichiro ABE, Takuto MOTOYAMA, Masaki HANDA
  • Publication number: 20240134397
    Abstract: An aerial vehicle according to an embodiment of the present technology includes a recording unit, a detection unit, and a reproduction unit. The recording unit records a flight parameter during flight in a state in which no sensor abnormality is detected. The detection unit detects the sensor abnormality. The reproduction unit reproduces the flight parameter on the basis of the sensor abnormality detected by the detection unit.
    Type: Application
    Filed: January 13, 2022
    Publication date: April 25, 2024
    Inventors: MASAKI HANDA, TAKUTO MOTOYAMA, SHINICHIRO ABE, MASAHIKO TOYOSHI, KOHEI URUSHIDO
  • Publication number: 20240070873
    Abstract: To enable high-speed autonomous flight of a flight object. A three-dimensional real-time observation result is generated on the basis of self-position estimation information and three-dimensional distance measurement information. A prior map corresponding to a three-dimensional real-time observation result is acquired. The three-dimensional real-time observation result and the prior map are aligned. After the alignment, the three-dimensional real-time observation result is expanded on the basis of the prior map. A flight route is set on the basis of the three-dimensional real-time observation result having been expanded. In the flight object such as a drone, a somewhat long flight route can be accurately calculated at a time in a global behavior plan, which enables high-speed autonomous flight of the flight object.
    Type: Application
    Filed: November 3, 2023
    Publication date: February 29, 2024
    Applicant: SONY GROUP CORPORATION
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Shun LEE, Shinichiro ABE, Takuto MOTOYAMA
  • Patent number: 11860640
    Abstract: On the basis of semantic labeling information in an image captured by a camera an area in which a boundary of a movable area of a mobile body exists in the image is estimated as an image movable area boundary, on the basis of a distance image detected by a depth sensor an area in which the boundary of the movable area of the mobile body exists in the distance image is estimated as a distance image movable area boundary, the boundary of the movable area is determined on the basis of the image movable area boundary and of the distance image movable area boundary, and an environment map is generated on the basis of the determined boundary of the movable area. The present disclosure can be applied to an in-vehicle system.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: January 2, 2024
    Assignee: Sony Corporation
    Inventor: Takuto Motoyama
  • Patent number: 11854210
    Abstract: To enable high-speed autonomous flight of a flight object. A three-dimensional real-time observation result is generated on the basis of self-position estimation information and three-dimensional distance measurement information. A prior map corresponding to a three-dimensional real-time observation result is acquired. The three-dimensional real-time observation result and the prior map are aligned. After the alignment, the three-dimensional real-time observation result is expanded on the basis of the prior map. A flight route is set on the basis of the three-dimensional real-time observation result having been expanded. In the flight object such as a drone, a somewhat long flight route can be accurately calculated at a time in a global behavior plan, which enables high-speed autonomous flight of the flight object.
    Type: Grant
    Filed: October 14, 2020
    Date of Patent: December 26, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Masahiko Toyoshi, Kohei Urushido, Shun Lee, Shinichiro Abe, Takuto Motoyama
  • Patent number: 11814155
    Abstract: A control apparatus includes an acquisition unit that acquires captured data in which an object around a moving object is captured by an imaging unit, where the moving object is one of a moving object that is irradiated with spontaneous emission light and a moving object that moves with a predetermined pattern, and a determination unit that determines that the object is an obstacle if the captured data acquired by the acquisition unit includes a specific pattern.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: November 14, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Masaki Handa, Shinichiro Abe, Masahiko Toyoshi, Takuto Motoyama, Shun Lee, Kenichiro Oi
  • Patent number: 11812197
    Abstract: Provided is an information processing device that includes an acquisition unit that acquires an image captured by an imaging unit, a recognition unit that recognizes attributes of an object shown in the image captured by the imaging unit, and a generation unit that generates a bird's-eye view map showing the attributes of the object on the basis of the image captured by the imaging unit and information on the attributes of the object recognized by the recognition unit.
    Type: Grant
    Filed: July 31, 2019
    Date of Patent: November 7, 2023
    Assignee: SONY CORPORATION
    Inventors: Takuto Motoyama, Yuki Yamamoto, Masahiko Toyoshi, Suguru Aoki
  • Patent number: 11719788
    Abstract: A signal processing apparatus including a first position calculation unit that calculates a three-dimensional position of a target on a first coordinate system from a stereo image captured by a stereo camera, a second position calculation unit that calculates a three-dimensional position of the target on a second coordinate system from a sensor signal of a sensor capable of obtaining position information of at least one of a lateral direction and a longitudinal direction and position information of a depth direction, a correspondence detection unit that detects a correspondence relationship between the target on the first coordinate system and the target on the second coordinate system, and a positional relationship information estimating unit that estimates positional relationship information of the first coordinate system and the second coordinate system on the basis of the detected correspondence relationship.
    Type: Grant
    Filed: December 31, 2020
    Date of Patent: August 8, 2023
    Assignee: Sony Corporation
    Inventors: Takuto Motoyama, Yasuhiro Sutou, Toshio Yamazaki, Hideki Oyaizu, Kenichi Kawasaki
  • Patent number: 11543513
    Abstract: A likelihood calculation unit calculates, from information obtained by each of movement detection methods including a movement detection method for detecting a movement amount of an object using an image and one or more different movement detection methods, movement amount likelihoods with regard to which the movement amount of an object is each of a plurality of movement amounts. An integration unit integrates the movement amount likelihoods according to the plurality of movement detection methods to determine integration likelihoods individually of the plurality of movement amounts. The present technology can be applied, for example, to a case in which a movement amount of an object is determined and a driver who drives an automobile is supported using the movement amount.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: January 3, 2023
    Assignee: Sony Corporation
    Inventors: Yasuhiro Sutou, Hideki Oyaizu, Takuto Motoyama, Toshio Yamazaki
  • Patent number: 11543532
    Abstract: According to some embodiments, there is provided a method comprising labeling each of a plurality of subjects in an image with a label, the label for each subject indicating a kind of the subject, wherein the labeling comprises analyzing the image and/or distance measurement points for an area depicted in the image, and determining additional distance information not included in the distance measurement points, wherein determining the additional distance information comprises interpolating and/or generating a distance to a point based at least in part on at least some of the distance measurement points, wherein the at least some of the distance measurement points are selected based at least in part on labels assigned to one or more of the plurality of subjects.
    Type: Grant
    Filed: July 30, 2018
    Date of Patent: January 3, 2023
    Assignee: SONY CORPORATION
    Inventors: Takuto Motoyama, Shingo Tsurumi
  • Publication number: 20220392079
    Abstract: To enable high-speed autonomous flight of a flight object. A three-dimensional real-time observation result is generated on the basis of self-position estimation information and three-dimensional distance measurement information. A prior map corresponding to a three-dimensional real-time observation result is acquired. The three-dimensional real-time observation result and the prior map are aligned. After the alignment, the three-dimensional real-time observation result is expanded on the basis of the prior map. A flight route is set on the basis of the three-dimensional real-time observation result having been expanded. In the flight object such as a drone, a somewhat long flight route can be accurately calculated at a time in a global behavior plan, which enables high-speed autonomous flight of the flight object.
    Type: Application
    Filed: October 14, 2020
    Publication date: December 8, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Shun LEE, Shinichiro ABE, Takuto MOTOYAMA