Patents by Inventor Masahiko Toyoshi

Masahiko Toyoshi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11948371
    Abstract: The present technique relates to an information processing apparatus, an information processing method, a program, and a mobile body which enable accuracy of detection processing related to a passage around a mobile body to be improved. The information processing apparatus includes: a transforming unit configured to respectively transform a plurality of photographed images with partially overlapping photographing ranges into bird's eye images; a compositing unit configured to generate a composite image by compositing a plurality of the bird's eye images; and a detecting unit configured to perform detection processing related to a passage around a mobile body based on the composite image. For example, the present technique can be applied to an apparatus that detects a lane marking of a road.
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: April 2, 2024
    Assignee: SONY CORPORATION
    Inventor: Masahiko Toyoshi
  • Publication number: 20240070873
    Abstract: To enable high-speed autonomous flight of a flight object. A three-dimensional real-time observation result is generated on the basis of self-position estimation information and three-dimensional distance measurement information. A prior map corresponding to a three-dimensional real-time observation result is acquired. The three-dimensional real-time observation result and the prior map are aligned. After the alignment, the three-dimensional real-time observation result is expanded on the basis of the prior map. A flight route is set on the basis of the three-dimensional real-time observation result having been expanded. In the flight object such as a drone, a somewhat long flight route can be accurately calculated at a time in a global behavior plan, which enables high-speed autonomous flight of the flight object.
    Type: Application
    Filed: November 3, 2023
    Publication date: February 29, 2024
    Applicant: SONY GROUP CORPORATION
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Shun LEE, Shinichiro ABE, Takuto MOTOYAMA
  • Patent number: 11854210
    Abstract: To enable high-speed autonomous flight of a flight object. A three-dimensional real-time observation result is generated on the basis of self-position estimation information and three-dimensional distance measurement information. A prior map corresponding to a three-dimensional real-time observation result is acquired. The three-dimensional real-time observation result and the prior map are aligned. After the alignment, the three-dimensional real-time observation result is expanded on the basis of the prior map. A flight route is set on the basis of the three-dimensional real-time observation result having been expanded. In the flight object such as a drone, a somewhat long flight route can be accurately calculated at a time in a global behavior plan, which enables high-speed autonomous flight of the flight object.
    Type: Grant
    Filed: October 14, 2020
    Date of Patent: December 26, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Masahiko Toyoshi, Kohei Urushido, Shun Lee, Shinichiro Abe, Takuto Motoyama
  • Patent number: 11829851
    Abstract: To provide a configuration that enables recognition of an unknown object included in an image. The configuration includes a network creation unit that creates a network linking a scene node indicating a scene type of an image and a node corresponding to an object, and an unknown object inference unit that compares a created network created by the network creation unit with a large number of reference networks created by learning processing, selects reference networks similar to the created network, selects, from the selected reference networks, a node corresponding to a node of an unknown object in the created network, and infers that an object associated with the selected node is an object corresponding to the unknown object.
    Type: Grant
    Filed: February 13, 2019
    Date of Patent: November 28, 2023
    Assignee: SONY CORPORATION
    Inventor: Masahiko Toyoshi
  • Patent number: 11814155
    Abstract: A control apparatus includes an acquisition unit that acquires captured data in which an object around a moving object is captured by an imaging unit, where the moving object is one of a moving object that is irradiated with spontaneous emission light and a moving object that moves with a predetermined pattern, and a determination unit that determines that the object is an obstacle if the captured data acquired by the acquisition unit includes a specific pattern.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: November 14, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Masaki Handa, Shinichiro Abe, Masahiko Toyoshi, Takuto Motoyama, Shun Lee, Kenichiro Oi
  • Patent number: 11812197
    Abstract: Provided is an information processing device that includes an acquisition unit that acquires an image captured by an imaging unit, a recognition unit that recognizes attributes of an object shown in the image captured by the imaging unit, and a generation unit that generates a bird's-eye view map showing the attributes of the object on the basis of the image captured by the imaging unit and information on the attributes of the object recognized by the recognition unit.
    Type: Grant
    Filed: July 31, 2019
    Date of Patent: November 7, 2023
    Assignee: SONY CORPORATION
    Inventors: Takuto Motoyama, Yuki Yamamoto, Masahiko Toyoshi, Suguru Aoki
  • Publication number: 20220392079
    Abstract: To enable high-speed autonomous flight of a flight object. A three-dimensional real-time observation result is generated on the basis of self-position estimation information and three-dimensional distance measurement information. A prior map corresponding to a three-dimensional real-time observation result is acquired. The three-dimensional real-time observation result and the prior map are aligned. After the alignment, the three-dimensional real-time observation result is expanded on the basis of the prior map. A flight route is set on the basis of the three-dimensional real-time observation result having been expanded. In the flight object such as a drone, a somewhat long flight route can be accurately calculated at a time in a global behavior plan, which enables high-speed autonomous flight of the flight object.
    Type: Application
    Filed: October 14, 2020
    Publication date: December 8, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Shun LEE, Shinichiro ABE, Takuto MOTOYAMA
  • Publication number: 20220351400
    Abstract: An information processing apparatus includes: a plurality of stereo cameras arranged so that directions of baseline lengths of the stereo cameras intersect each other; a depth estimation unit that estimates, from captured images captured by the plurality of stereo cameras, a depth of an object included in the captured images; and an object detection unit that detects the object based on the depth estimated by the depth estimation unit and reliability of the depth, the reliability being determined in accordance with an angle of a direction of an edge line of the object with respect to the directions of the baseline lengths of the plurality of stereo cameras.
    Type: Application
    Filed: July 17, 2020
    Publication date: November 3, 2022
    Inventors: KOHEI URUSHIDO, TAKUTO MOTOYAMA, MASAHIKO TOYOSHI, SHUN LEE
  • Publication number: 20220342427
    Abstract: The present disclosure relates to an information processing device, an information processing method, and a program that cause a high-speed moving body to appropriately plan a trajectory. A position and distance of an object can be appropriately recognized by extracting feature points in association with a semantic label that is an object certification result by semantic segmentation, connecting feature points of the same semantic label, and forming a Delaunay mesh to form a mesh for each same object, and then a trajectory is planned. The present disclosure can be applied to a moving body.
    Type: Application
    Filed: September 28, 2020
    Publication date: October 27, 2022
    Inventors: TAKUTO MOTOYAMA, MASAHIKO TOYOSHI, SHUN LEE, KOHEI URUSHIDO
  • Publication number: 20220283584
    Abstract: An information processing device includes a map creating unit that creates a map of a travel range, which is a range over which a mobile body having an image-capturing device performs photography while travelling, a shape extracting unit that extracts a shape present in the map, a composition setting unit that sets a composition of an image to be photographed by the image-capturing device, and a route deciding unit that decides a travel route in the travel range of the mobile body on the basis of the shape and the composition.
    Type: Application
    Filed: May 28, 2020
    Publication date: September 8, 2022
    Applicant: Sony Group Corporation
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Ryuta SATOH, Takuto MOTOYAMA
  • Patent number: 11386565
    Abstract: The present disclosure relates to a signal processing apparatus and a signal processing method, a program, and a moving body that allow improvement of estimation accuracy for a self-position. One of a plurality of wavelengths of light is selected, and the light with the selected wavelength is projected. Reflected light of the projected light is received that is reflected from a reflector corresponding to an object having a reflectance higher than a predetermined reflectance, and the reflector is detected. This prevents interference of light projected by another vehicle, enabling appropriate detection of the reflector and improvement of estimation accuracy for a self-position. The present disclosure is applicable to an in-vehicle system.
    Type: Grant
    Filed: August 28, 2018
    Date of Patent: July 12, 2022
    Assignee: SONY CORPORATION
    Inventors: Keitaro Yamamoto, Shinichiro Abe, Masahiko Toyoshi, Shun Lee
  • Publication number: 20220157179
    Abstract: The present disclosure relates to action control device and an action control method and a program that enable more appropriate action control to be achieved. An EKF processing unit selects a self-position estimation unit used to estimate a position of a drone from a plurality of the self-position estimation units which is different in estimation accuracy on the basis of waypoints that are indexes when the drone acts, and obtains a state of the drone. Then, a navigator controls an action of the drone according to an action plan created in advance on the basis of the state of the drone. The present technology can be applied to, for example, a mission flight control device that controls a mission flight of a drone.
    Type: Application
    Filed: February 21, 2020
    Publication date: May 19, 2022
    Applicant: Sony Group Corporation
    Inventors: Kenichiro OI, Masaki HANDA, Takuto MOTOYAMA, Shun LEE, Masahiko TOYOSHI
  • Publication number: 20220153411
    Abstract: The present technology relates to a moving body, a control method thereof, and a program capable of accurately detecting and avoiding a linear object that can be an obstacle in movement. The moving body detects a line segment in a captured image captured by at least one camera of a stereo camera, and moves a machine body to which the stereo camera is fixed in a direction orthogonal to the line segment. The present technology can be applied to, for example, a moving body and the like that perform autonomous flight, such as a drone.
    Type: Application
    Filed: March 12, 2020
    Publication date: May 19, 2022
    Applicant: Sony Group Corporation
    Inventors: Masahiko TOYOSHI, Kohei URUSHIDO, Shun LEE, Ryuta SATOH, Shinichiro ABE, Takuto MOTOYAMA, Masaki HANDA
  • Patent number: 11288860
    Abstract: There is provided methods and apparatus for estimating a position of a movable object. A dynamic reference image is generated based on an environment and a reference image extracted from a map. A position of the movable object is estimated based on the dynamic reference image and an observation image of an area around the movable object.
    Type: Grant
    Filed: August 23, 2018
    Date of Patent: March 29, 2022
    Assignee: Sony Corporation
    Inventors: Shinichiro Abe, Masahiko Toyoshi, Shun Lee, Keitaro Yamamoto
  • Publication number: 20220049946
    Abstract: A controller (100) includes: an acquisition unit (121) that acquires image data captured by an imaging device (10) for photographing disposed in a moving body; and a calculation unit (127) that calculates a relative position of a position of a subject, which is detected by a plurality of distance-measuring imaging devices (20-1, 20-2, 20-3, and 20-4) provided in the moving body, based on the subject included in the image data.
    Type: Application
    Filed: December 3, 2019
    Publication date: February 17, 2022
    Inventors: TAKUTO MOTOYAMA, MASAKI HANDA, SHINICHIRO ABE, MASAHIKO TOYOSHI, SHUN LEE, KENICHIRO OI
  • Publication number: 20220024560
    Abstract: A control apparatus (100) includes an acquisition unit (121) that acquires captured data in which an object around a moving object is captured by an imaging unit, where the moving object is one of a moving object that is irradiated with spontaneous emission light and a mobbing object that moves with a predetermined pattern, and a determination unit (122) that determines that the object is an obstacle if the captured data acquired by the acquisition unit (121) includes a specific pattern.
    Type: Application
    Filed: November 26, 2019
    Publication date: January 27, 2022
    Inventors: MASAKI HANDA, SHINICHIRO ABE, MASAHIKO TOYOSHI, TAKUTO MOTOYAMA, SHUN LEE, KENICHIRO OI
  • Patent number: 11216677
    Abstract: To improve estimation accuracy of a self-position. Light at a predetermined wavelength is projected. An image of a reflector with a reflectance higher than a predetermined reflectance is taken by receiving reflected light of the projected light reflected by the reflector. Own orientation is estimated on the basis of the taken image of the reflector. As a result, the self-position can be highly accurately estimated on the basis of the reflector even at night. The present disclosure can be applied to an on-board system.
    Type: Grant
    Filed: August 28, 2018
    Date of Patent: January 4, 2022
    Assignee: Sony Corporation
    Inventors: Keitaro Yamamoto, Shinichiro Abe, Masahiko Toyoshi, Shun Lee
  • Publication number: 20210297633
    Abstract: An information processing device (10) includes: an acquisition unit (181) that acquires an image captured by an imaging unit (13); a recognition unit (182) that recognizes attributes of an object shown in the image captured by the imaging unit (13); and a generation unit (183) that generates a bird's-eye view map showing the attributes of the object on the basis of the image captured by the imaging unit (13) and information on the attributes of the object recognized by the recognition unit.
    Type: Application
    Filed: July 31, 2019
    Publication date: September 23, 2021
    Inventors: TAKUTO MOTOYAMA, YUKI YAMAMOTO, MASAHIKO TOYOSHI, SUGURU AOKI
  • Publication number: 20210295563
    Abstract: A recognition processing section performs subject recognition in a processing area of an image obtained by an imaging section. The recognition processing section determines an image characteristic of the processing area on the basis of a characteristic map indicating an image characteristic of the image obtained by the imaging section and uses a recognizer corresponding to the image characteristic of the processing area. The characteristic map includes a map based on an optical characteristic of an imaging lens used in the imaging section and is stored in a characteristic information storage section. An imaging lens has a winder angle of view in all directions or in a predetermined direction than a standard lens, and the optical characteristic thereof differs depending on a position on the lens. The recognition processing section performs the subject recognition using a recognizer corresponding to resolution or skewness of the processing area, for example.
    Type: Application
    Filed: July 23, 2019
    Publication date: September 23, 2021
    Applicant: Sony Corporation
    Inventors: Suguru AOKI, Takuto MOTOYAMA, Masahiko TOYOSHI, Yuki YAMAMOTO
  • Patent number: 11100675
    Abstract: An information processing apparatus includes a first self-position estimating section configured to estimate a self-position of a moving body using a visible image, a second self-position estimating section configured to estimate the self-position of the moving body using an infrared image, and a combining section configured to set, based on a situation in which the moving body is placed, a first weight for a first estimation result obtained by self-position estimation using the visible image and a second weight for a second estimation result obtained by self-position estimation using the infrared image, to thereby combine the first estimation result and the second estimation result using the first weight and the second weight. The present technology is applicable to moving bodies, for example, vehicles.
    Type: Grant
    Filed: October 11, 2018
    Date of Patent: August 24, 2021
    Assignee: SONY CORPORATION
    Inventors: Masahiko Toyoshi, Shun Lee, Keitaro Yamamoto, Shinichiro Abe