Patents by Inventor Takuto MOTOYAMA

Takuto MOTOYAMA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240142995
    Abstract: A configuration is described that is capable of determining a target landing position of a drone according to a sentence indicating a landing position generated by a user.
    Type: Application
    Filed: January 20, 2022
    Publication date: May 2, 2024
    Applicant: Sony Group Corporation
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Shinichiro ABE, Takuto MOTOYAMA, Masaki HANDA
  • Publication number: 20240134397
    Abstract: An aerial vehicle according to an embodiment of the present technology includes a recording unit, a detection unit, and a reproduction unit. The recording unit records a flight parameter during flight in a state in which no sensor abnormality is detected. The detection unit detects the sensor abnormality. The reproduction unit reproduces the flight parameter on the basis of the sensor abnormality detected by the detection unit.
    Type: Application
    Filed: January 13, 2022
    Publication date: April 25, 2024
    Inventors: MASAKI HANDA, TAKUTO MOTOYAMA, SHINICHIRO ABE, MASAHIKO TOYOSHI, KOHEI URUSHIDO
  • Publication number: 20240070873
    Abstract: To enable high-speed autonomous flight of a flight object. A three-dimensional real-time observation result is generated on the basis of self-position estimation information and three-dimensional distance measurement information. A prior map corresponding to a three-dimensional real-time observation result is acquired. The three-dimensional real-time observation result and the prior map are aligned. After the alignment, the three-dimensional real-time observation result is expanded on the basis of the prior map. A flight route is set on the basis of the three-dimensional real-time observation result having been expanded. In the flight object such as a drone, a somewhat long flight route can be accurately calculated at a time in a global behavior plan, which enables high-speed autonomous flight of the flight object.
    Type: Application
    Filed: November 3, 2023
    Publication date: February 29, 2024
    Applicant: SONY GROUP CORPORATION
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Shun LEE, Shinichiro ABE, Takuto MOTOYAMA
  • Patent number: 11860640
    Abstract: On the basis of semantic labeling information in an image captured by a camera an area in which a boundary of a movable area of a mobile body exists in the image is estimated as an image movable area boundary, on the basis of a distance image detected by a depth sensor an area in which the boundary of the movable area of the mobile body exists in the distance image is estimated as a distance image movable area boundary, the boundary of the movable area is determined on the basis of the image movable area boundary and of the distance image movable area boundary, and an environment map is generated on the basis of the determined boundary of the movable area. The present disclosure can be applied to an in-vehicle system.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: January 2, 2024
    Assignee: Sony Corporation
    Inventor: Takuto Motoyama
  • Patent number: 11854210
    Abstract: To enable high-speed autonomous flight of a flight object. A three-dimensional real-time observation result is generated on the basis of self-position estimation information and three-dimensional distance measurement information. A prior map corresponding to a three-dimensional real-time observation result is acquired. The three-dimensional real-time observation result and the prior map are aligned. After the alignment, the three-dimensional real-time observation result is expanded on the basis of the prior map. A flight route is set on the basis of the three-dimensional real-time observation result having been expanded. In the flight object such as a drone, a somewhat long flight route can be accurately calculated at a time in a global behavior plan, which enables high-speed autonomous flight of the flight object.
    Type: Grant
    Filed: October 14, 2020
    Date of Patent: December 26, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Masahiko Toyoshi, Kohei Urushido, Shun Lee, Shinichiro Abe, Takuto Motoyama
  • Patent number: 11814155
    Abstract: A control apparatus includes an acquisition unit that acquires captured data in which an object around a moving object is captured by an imaging unit, where the moving object is one of a moving object that is irradiated with spontaneous emission light and a moving object that moves with a predetermined pattern, and a determination unit that determines that the object is an obstacle if the captured data acquired by the acquisition unit includes a specific pattern.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: November 14, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Masaki Handa, Shinichiro Abe, Masahiko Toyoshi, Takuto Motoyama, Shun Lee, Kenichiro Oi
  • Patent number: 11812197
    Abstract: Provided is an information processing device that includes an acquisition unit that acquires an image captured by an imaging unit, a recognition unit that recognizes attributes of an object shown in the image captured by the imaging unit, and a generation unit that generates a bird's-eye view map showing the attributes of the object on the basis of the image captured by the imaging unit and information on the attributes of the object recognized by the recognition unit.
    Type: Grant
    Filed: July 31, 2019
    Date of Patent: November 7, 2023
    Assignee: SONY CORPORATION
    Inventors: Takuto Motoyama, Yuki Yamamoto, Masahiko Toyoshi, Suguru Aoki
  • Patent number: 11719788
    Abstract: A signal processing apparatus including a first position calculation unit that calculates a three-dimensional position of a target on a first coordinate system from a stereo image captured by a stereo camera, a second position calculation unit that calculates a three-dimensional position of the target on a second coordinate system from a sensor signal of a sensor capable of obtaining position information of at least one of a lateral direction and a longitudinal direction and position information of a depth direction, a correspondence detection unit that detects a correspondence relationship between the target on the first coordinate system and the target on the second coordinate system, and a positional relationship information estimating unit that estimates positional relationship information of the first coordinate system and the second coordinate system on the basis of the detected correspondence relationship.
    Type: Grant
    Filed: December 31, 2020
    Date of Patent: August 8, 2023
    Assignee: Sony Corporation
    Inventors: Takuto Motoyama, Yasuhiro Sutou, Toshio Yamazaki, Hideki Oyaizu, Kenichi Kawasaki
  • Patent number: 11543532
    Abstract: According to some embodiments, there is provided a method comprising labeling each of a plurality of subjects in an image with a label, the label for each subject indicating a kind of the subject, wherein the labeling comprises analyzing the image and/or distance measurement points for an area depicted in the image, and determining additional distance information not included in the distance measurement points, wherein determining the additional distance information comprises interpolating and/or generating a distance to a point based at least in part on at least some of the distance measurement points, wherein the at least some of the distance measurement points are selected based at least in part on labels assigned to one or more of the plurality of subjects.
    Type: Grant
    Filed: July 30, 2018
    Date of Patent: January 3, 2023
    Assignee: SONY CORPORATION
    Inventors: Takuto Motoyama, Shingo Tsurumi
  • Patent number: 11543513
    Abstract: A likelihood calculation unit calculates, from information obtained by each of movement detection methods including a movement detection method for detecting a movement amount of an object using an image and one or more different movement detection methods, movement amount likelihoods with regard to which the movement amount of an object is each of a plurality of movement amounts. An integration unit integrates the movement amount likelihoods according to the plurality of movement detection methods to determine integration likelihoods individually of the plurality of movement amounts. The present technology can be applied, for example, to a case in which a movement amount of an object is determined and a driver who drives an automobile is supported using the movement amount.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: January 3, 2023
    Assignee: Sony Corporation
    Inventors: Yasuhiro Sutou, Hideki Oyaizu, Takuto Motoyama, Toshio Yamazaki
  • Publication number: 20220392079
    Abstract: To enable high-speed autonomous flight of a flight object. A three-dimensional real-time observation result is generated on the basis of self-position estimation information and three-dimensional distance measurement information. A prior map corresponding to a three-dimensional real-time observation result is acquired. The three-dimensional real-time observation result and the prior map are aligned. After the alignment, the three-dimensional real-time observation result is expanded on the basis of the prior map. A flight route is set on the basis of the three-dimensional real-time observation result having been expanded. In the flight object such as a drone, a somewhat long flight route can be accurately calculated at a time in a global behavior plan, which enables high-speed autonomous flight of the flight object.
    Type: Application
    Filed: October 14, 2020
    Publication date: December 8, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Shun LEE, Shinichiro ABE, Takuto MOTOYAMA
  • Publication number: 20220351400
    Abstract: An information processing apparatus includes: a plurality of stereo cameras arranged so that directions of baseline lengths of the stereo cameras intersect each other; a depth estimation unit that estimates, from captured images captured by the plurality of stereo cameras, a depth of an object included in the captured images; and an object detection unit that detects the object based on the depth estimated by the depth estimation unit and reliability of the depth, the reliability being determined in accordance with an angle of a direction of an edge line of the object with respect to the directions of the baseline lengths of the plurality of stereo cameras.
    Type: Application
    Filed: July 17, 2020
    Publication date: November 3, 2022
    Inventors: KOHEI URUSHIDO, TAKUTO MOTOYAMA, MASAHIKO TOYOSHI, SHUN LEE
  • Publication number: 20220342427
    Abstract: The present disclosure relates to an information processing device, an information processing method, and a program that cause a high-speed moving body to appropriately plan a trajectory. A position and distance of an object can be appropriately recognized by extracting feature points in association with a semantic label that is an object certification result by semantic segmentation, connecting feature points of the same semantic label, and forming a Delaunay mesh to form a mesh for each same object, and then a trajectory is planned. The present disclosure can be applied to a moving body.
    Type: Application
    Filed: September 28, 2020
    Publication date: October 27, 2022
    Inventors: TAKUTO MOTOYAMA, MASAHIKO TOYOSHI, SHUN LEE, KOHEI URUSHIDO
  • Publication number: 20220340130
    Abstract: The present disclosure relates to an information processing apparatus, an information processing method, and a program that allow for appropriately pulling over to a safe road shoulder when an emergency occurs during automated driving. On the basis of distance information from a depth sensor or the like, a travelable region available for a vehicle to travel is set like an occupancy map, and image attribute information is generated from an image by semantic segmentation. On the basis of the image attribute information, an evacuation space is set in the travelable region in accordance with the situation of the road surface of the travelable region, and thus an evacuation space map is created. The present disclosure can be applied to a mobile object.
    Type: Application
    Filed: June 1, 2020
    Publication date: October 27, 2022
    Inventor: TAKUTO MOTOYAMA
  • Publication number: 20220283584
    Abstract: An information processing device includes a map creating unit that creates a map of a travel range, which is a range over which a mobile body having an image-capturing device performs photography while travelling, a shape extracting unit that extracts a shape present in the map, a composition setting unit that sets a composition of an image to be photographed by the image-capturing device, and a route deciding unit that decides a travel route in the travel range of the mobile body on the basis of the shape and the composition.
    Type: Application
    Filed: May 28, 2020
    Publication date: September 8, 2022
    Applicant: Sony Group Corporation
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Ryuta SATOH, Takuto MOTOYAMA
  • Patent number: 11427218
    Abstract: A laser range finder projects light while changing a direction in a horizontal direction at a predetermined angle with respect to a vertical direction to also receive reflected light of the light, and detects a direction and a distance in which the light is reflected from an obstacle or the like, according to a difference time between a time of light projection and a time of light reception. A normal direction of a flat plane forming a road surface is detected on the basis of a polarized image. The laser range finder projects light such that the light has a predetermined angle with respect to the vertical direction so as to be orthogonal to the normal direction of the flat plane forming the road surface. The laser range finder can be applied to in-vehicle systems.
    Type: Grant
    Filed: July 25, 2018
    Date of Patent: August 30, 2022
    Assignee: SONY CORPORATION
    Inventors: Takuto Motoyama, Hideki Oyaizu, Yasuhiro Sutou, Toshio Yamazaki, Kentaro Doba
  • Patent number: 11373418
    Abstract: An information processing apparatus capable of detecting a plane constituting a movement-enabling region. A normal direction of a plane constituting a road surface is detected on the basis of polarized images in multiple polarizing directions acquired by a polarization camera. A laser ranging sensor measures a distance to a point on the road surface so as to measure a position of the point. The plane constituting the road surface is identified on the basis of information regarding the normal direction of the plane constituting the road surface and information regarding the position of the point on the road surface.
    Type: Grant
    Filed: July 25, 2018
    Date of Patent: June 28, 2022
    Assignee: SONY CORPORATION
    Inventors: Takuto Motoyama, Hideki Oyaizu, Yasuhiro Sutou, Toshio Yamazaki, Kentaro Doba
  • Publication number: 20220157179
    Abstract: The present disclosure relates to action control device and an action control method and a program that enable more appropriate action control to be achieved. An EKF processing unit selects a self-position estimation unit used to estimate a position of a drone from a plurality of the self-position estimation units which is different in estimation accuracy on the basis of waypoints that are indexes when the drone acts, and obtains a state of the drone. Then, a navigator controls an action of the drone according to an action plan created in advance on the basis of the state of the drone. The present technology can be applied to, for example, a mission flight control device that controls a mission flight of a drone.
    Type: Application
    Filed: February 21, 2020
    Publication date: May 19, 2022
    Applicant: Sony Group Corporation
    Inventors: Kenichiro OI, Masaki HANDA, Takuto MOTOYAMA, Shun LEE, Masahiko TOYOSHI
  • Publication number: 20220153411
    Abstract: The present technology relates to a moving body, a control method thereof, and a program capable of accurately detecting and avoiding a linear object that can be an obstacle in movement. The moving body detects a line segment in a captured image captured by at least one camera of a stereo camera, and moves a machine body to which the stereo camera is fixed in a direction orthogonal to the line segment. The present technology can be applied to, for example, a moving body and the like that perform autonomous flight, such as a drone.
    Type: Application
    Filed: March 12, 2020
    Publication date: May 19, 2022
    Applicant: Sony Group Corporation
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Shun LEE, Ryuta SATOH, Shinichiro ABE, Takuto MOTOYAMA, Masaki HANDA
  • Patent number: 11328444
    Abstract: The present disclosure relates to a signal processing apparatus and system. In calibration, a sensor section is used to acquire a time of day when a stereo camera image capturing a target is acquired and a time of day when a radar image capturing the target is acquired. The target has a radar reflector and a marker. The image acquisition times of day are acquired while at the same time changing a distance between the sensor section and the target so as to find an amount of time-of-day discrepancy, a difference in time of day between the stereo camera image and the radar image at the same distance. At the time of object detection, the radar image acquired first is buffered and then output together with the stereo camera image acquired by the time-of-day discrepancy later, thus combining the stereo camera image and the radar image.
    Type: Grant
    Filed: August 8, 2018
    Date of Patent: May 10, 2022
    Assignee: SONY CORPORATION
    Inventors: Toshio Yamazaki, Takuto Motoyama, Kentaro Doba, Yasuhiro Sutou