Patents by Inventor Karttikeya MANGALAM

Karttikeya MANGALAM has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11878684
    Abstract: A system for trajectory prediction using a predicted endpoint conditioned network includes one or more processors and a memory that includes a sensor input module, an endpoint distribution module, and a future trajectory module. The modules cause the one or more processors to the one or more processors to obtain sensor data of a scene having a plurality of pedestrians, determine endpoint distributions of the plurality of pedestrians within the scene, the endpoint distributions representing desired end destinations of the plurality of pedestrians from the scene, and determine future trajectory points for at least one of the plurality of pedestrians based on prior trajectory points of the plurality of pedestrians and the endpoint distributions of the plurality of pedestrians. The future trajectory points may be conditioned not only on the pedestrian and their immediate neighbors' histories (observed trajectories) but also on all the other pedestrian's estimated endpoints.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: January 23, 2024
    Assignee: Toyota Research Institute, Inc.
    Inventors: Karttikeya Mangalam, Kuan-Hui Lee, Adrien David Gaidon
  • Patent number: 11447129
    Abstract: A system and related method for predicting movement of a plurality of pedestrians may include one or more processors and a memory. The memory includes an initial trajectory module, an exit point prediction module, a path planning module, and an adjustment module. The modules include instructions that when executed by the one or more processors cause the one or more processors to obtain trajectories of the plurality of pedestrians, predict future exit points for the plurality of pedestrians from a scene based on the trajectories of the plurality of pedestrians, determine trajectory paths of the plurality of pedestrians based on the future exit points and at least one scene element of a map, and adjust the trajectory paths based on at least one predicted interaction between at least two of the plurality of pedestrians.
    Type: Grant
    Filed: February 11, 2020
    Date of Patent: September 20, 2022
    Assignee: Toyota Research Institute, Inc.
    Inventors: Karttikeya Mangalam, Kuan-Hui Lee, Adrien David Gaidon
  • Publication number: 20210295531
    Abstract: A system for trajectory prediction using a predicted endpoint conditioned network includes one or more processors and a memory that includes a sensor input module, an endpoint distribution module, and a future trajectory module. The modules cause the one or more processors to the one or more processors to obtain sensor data of a scene having a plurality of pedestrians, determine endpoint distributions of the plurality of pedestrians within the scene, the endpoint distributions representing desired end destinations of the plurality of pedestrians from the scene, and determine future trajectory points for at least one of the plurality of pedestrians based on prior trajectory points of the plurality of pedestrians and the endpoint distributions of the plurality of pedestrians. The future trajectory points may be conditioned not only on the pedestrian and their immediate neighbors' histories (observed trajectories) but also on all the other pedestrian's estimated endpoints.
    Type: Application
    Filed: September 30, 2020
    Publication date: September 23, 2021
    Inventors: Karttikeya Mangalam, Kuan-Hui Lee, Adrien David Gaidon
  • Publication number: 20210245744
    Abstract: A system and related method for predicting movement of a plurality of pedestrians may include one or more processors and a memory. The memory includes an initial trajectory module, an exit point prediction module, a path planning module, and an adjustment module. The modules include instructions that when executed by the one or more processors cause the one or more processors to obtain trajectories of the plurality of pedestrians, predict future exit points for the plurality of pedestrians from a scene based on the trajectories of the plurality of pedestrians, determine trajectory paths of the plurality of pedestrians based on the future exit points and at least one scene element of a map, and adjust the trajectory paths based on at least one predicted interaction between at least two of the plurality of pedestrians.
    Type: Application
    Filed: February 11, 2020
    Publication date: August 12, 2021
    Inventors: Karttikeya Mangalam, Kuan-Hui Lee, Adrien David Gaidon
  • Patent number: 11074438
    Abstract: A method for predicting spatial positions of several key points on a human body in the near future in an egocentric setting is described. The method includes generating a frame-level supervision for human poses. The method also includes suppressing noise and filling missing joints of the human body using a pose completion module. The method further includes splitting the poses into a global stream and a local stream. Furthermore, the method includes combining the global stream and the local stream to forecast future human locomotion.
    Type: Grant
    Filed: October 1, 2019
    Date of Patent: July 27, 2021
    Assignees: TOYOTA RESEARCH INSTITUTE, INC., THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
    Inventors: Karttikeya Mangalam, Ehsan Adeli-Mosabbeb, Kuan-Hui Lee, Adrien Gaidon, Juan Carlos Niebles Duque
  • Publication number: 20210097266
    Abstract: A method for predicting spatial positions of several key points on a human body in the near future in an egocentric setting is described. The method includes generating a frame-level supervision for human poses. The method also includes suppressing noise and filling missing joints of the human body using a pose completion module. The method further includes splitting the poses into a global stream and a local stream. Furthermore, the method includes combining the global stream and the local stream to forecast future human locomotion.
    Type: Application
    Filed: October 1, 2019
    Publication date: April 1, 2021
    Applicants: TOYOTA RESEARCH INSTITUTE, INC., THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
    Inventors: Karttikeya MANGALAM, Ehsan ADELI-MOSABBEB, Kuan-Hui LEE, Adrien GAIDON, Juan Carlos NIEBLES DUQUE