Patents by Inventor Jonathan DeCastro

Jonathan DeCastro has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250121832
    Abstract: Systems, methods, and other embodiments described herein relate to integrating human decision-making into a model-based system. In one embodiment, a method includes acquiring sensor data, including driver data about a driver of a vehicle and driving data about the vehicle and a surrounding environment of the vehicle. The method includes encoding, using a world encoder, the sensor data into a latent representation. The method includes determining human decision- making characteristics according to the latent representation. The method includes generating a control signal for providing shared control of the vehicle according to the human decision-making characteristics and the latent representation.
    Type: Application
    Filed: March 13, 2024
    Publication date: April 17, 2025
    Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki Kaisha
    Inventors: Jean Marcel dos Reis Costa, Guy Rosman, Deepak Edakkattil Gopinath, Emily Sumner, Thomas Balch, Jonathan DeCastro, Andrew Michael Silva, Laporsha Trinati Dees
  • Publication number: 20250121845
    Abstract: Systems, methods, and other embodiments described herein relate to stylizing messages within a vehicle according to an occupant and a current context. In one embodiment, a method includes determining a style for presenting messages associated with an occupant of a vehicle according to a context defined in relation to an occupant and an environment of the vehicle. The method includes generating a message according to the style for the occupant. The method includes providing the message to the occupant.
    Type: Application
    Filed: March 22, 2024
    Publication date: April 17, 2025
    Applicants: Toyota Research Institute , Inc., Toyota Jidosha Kabushiki Kaisha
    Inventors: Guy Rosman, Jean Marcel dos Reis Costa, Hiroshi Yasuda, Deepak Edakkattil Gopinath, Jonathan DeCastro, Tiffany L. Chen, Avinash Balachandran
  • Publication number: 20240391502
    Abstract: Systems and methods are provided trajectory prediction that leverages game-theory to improve coverage of multi-modal predictions. Examples of the systems and methods include obtaining training data including first trajectories for a first plurality of agent devices and first map information of a first environment for a past time horizon and applying the training data to a game-theoretic mode-finding algorithm to generate a mode-finding model for each agent device that predicts modes of the first trajectories. A trajectory prediction model can be trained on the predicted modes as a coverage loss term between predicted modes. Future trajectories can be predicted for a second plurality of agent devices based on applying observed data to the trajectory prediction model. A control signal can then be generated to effectuate an autonomous driving command on an agent device of the second plurality of agent devices based on the predicted future trajectories.
    Type: Application
    Filed: October 9, 2023
    Publication date: November 28, 2024
    Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki Kaisha, The Trustees of Princeton University
    Inventors: Guy Rosman, Justin Lidard, Oswin So, Yanxia Zhang, Paul M. Drews, Jonathan DeCastro, Xiongyi Cui, Yen-Ling Kuo, John J. Leonard, Avinash Balachandran, Naomi Ehrich Leonard
  • Patent number: 12084080
    Abstract: Systems and methods for learning and managing robot user interfaces are disclosed herein. One embodiment generates, based on input data including information about past interactions of a particular user with a robot and with existing HMIs of the robot, a latent space using one or more encoder neural networks, wherein the latent space is a reduced-dimensionality representation of learned behavior and characteristics of the particular user, and uses the latent space as input to train a decoder neural network associated with (1) a new HMI distinct from the existing HMIs or (2) a particular HMI among the existing HMIs to alter operation of the particular HMI. The trained first decoder neural network is deployed in the robot to control, at least in part, operation of the new HMI or the particular HMI in accordance with the learned behavior and characteristics of the particular user.
    Type: Grant
    Filed: August 26, 2022
    Date of Patent: September 10, 2024
    Assignees: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki Kaisha
    Inventors: Guy Rosman, Daniel J. Brooks, Simon A. I. Stent, Tiffany Chen, Emily Sarah Sumner, Shabnam Hakimi, Jonathan DeCastro, Deepak Edakkattil Gopinath
  • Publication number: 20240249637
    Abstract: A driving simulator may include a controller programmed to simulate operation of a vehicle being driven by a driver, the vehicle including assistive driving technology, receive driver data associated with the driver, determine whether the driver is distracted based on the driver data, and upon determination that the driver is distracted, simulate a particular driving event.
    Type: Application
    Filed: January 19, 2023
    Publication date: July 25, 2024
    Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki Kaisha
    Inventors: Simon Stent, Andrew P. Best, Shabnam Hakimi, Guy Rosman, Emily S. Sumner, Jonathan DeCastro
  • Patent number: 11918535
    Abstract: Systems and methods for a powered, robotic exoskeleton, or exosuit, for a user's limbs and body are provided. The exosuit may be equipped with airbag devices mounted at various locations on the suit. The exosuit may include on-board computing equipment that can sense, compute control commands in real-time, and actuate limbs and airbags to restore stability (fall prevention) and minimize injuries due to falls, should they happen (fall protection).
    Type: Grant
    Filed: April 13, 2020
    Date of Patent: March 5, 2024
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Jonathan Decastro, Soon Ho Kong, Nikos Arechiga Gonzalez, Frank Permenter, Dennis Park
  • Publication number: 20240010218
    Abstract: Systems and methods for learning and managing robot user interfaces are disclosed herein. One embodiment generates, based on input data including information about past interactions of a particular user with a robot and with existing HMIs of the robot, a latent space using one or more encoder neural networks, wherein the latent space is a reduced-dimensionality representation of learned behavior and characteristics of the particular user, and uses the latent space as input to train a decoder neural network associated with (1) a new HMI distinct from the existing HMIs or (2) a particular HMI among the existing HMIs to alter operation of the particular HMI. The trained first decoder neural network is deployed in the robot to control, at least in part, operation of the new HMI or the particular HMI in accordance with the learned behavior and characteristics of the particular user.
    Type: Application
    Filed: August 26, 2022
    Publication date: January 11, 2024
    Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki Kaisha
    Inventors: Guy Rosman, Daniel J. Brooks, Simon A.I. Stent, Tiffany Chen, Emily Sarah Sumner, Shabnam Hakimi, Jonathan DeCastro, Deepak Edakkattil Gopinath
  • Patent number: 11801852
    Abstract: A method performed by an autonomous vehicle includes identifying a condition preventing the autonomous vehicle from proceeding along an intended route. The method also includes prompting a passenger of the autonomous vehicle to interact with a driver of a first vehicle in response to identifying the condition. The method further includes receiving, from the passenger, an input at an interface of the autonomous vehicle indicating a successful interaction or an unsuccessful interaction with the driver. The method also includes controlling the autonomous vehicle to proceed along the intended route based on the input indicating the successful interaction with the driver.
    Type: Grant
    Filed: June 23, 2021
    Date of Patent: October 31, 2023
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Soonho Kong, Jonathan Decastro, Nikos Arechiga, Frank Permenter
  • Publication number: 20230331240
    Abstract: Disclosed are systems and methods for training at least one policy using a framework for encoding human behaviors and preferences in a driving environment. In one example, the method includes the steps of setting parameters of rewards and a Markov Decision Process (MDP) of the at least one policy that models a simulated human driver of a simulated vehicle and an adaptive human-machine interface (HMI) system configured to interact with each other and training the at least one policy to maximize a total reward based on the parameters of the rewards of the at least one policy.
    Type: Application
    Filed: January 19, 2023
    Publication date: October 19, 2023
    Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki Kaisha
    Inventors: Jonathan DeCastro, Guy Rosman, Simon A.I. Stent, Emily Sumner, Shabnam Hakimi, Deepak Edakkattil Gopinath, Allison Morgan
  • Patent number: 11745732
    Abstract: A method for certified control of a self-driving ego vehicle is described. The method includes analyzing a safety situation of the self-driving ego vehicle to determine a proposed vehicle control action using a main controller of the self-driving ego vehicle. The method also includes presenting, by the main controller, the proposed vehicle control action to an interlock controller, including a certificate of the proposed vehicle control action. The method further includes checking a safety certification evidence from the certificate by the interlock controller using a predefined safety argument to verify the safety certification evidence of the certificate. The method also includes directing, by a low-level controller, the self-driving ego vehicle to perform a certified vehicle control action.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: September 5, 2023
    Assignees: TOYOTA RESEARCH INSTITUTE, INC., MASSACHUSETTS INSTITUTE OF TECHNOLOGY
    Inventors: Daniel Jackson, Jonathan Decastro, Soon Ho Kong, Nikos Arechiga Gonzalez, Dimitrios Koutentakis, Feng Ping Angela Leong, Mike Meichang Wang, Xin Zhang
  • Patent number: 11543258
    Abstract: A personalized notification method for a mobility as a service (MaaS) vehicle includes receiving conditional personalized notification features from a passenger of the MaaS vehicle. The method also includes monitoring current driving environment of the MaaS vehicle to determine whether a condition of the conditional personalized notification features is satisfied. The method further includes notifying the passenger when the condition is satisfied via at least one localized output device in a compartment of the MaaS vehicle.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: January 3, 2023
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Soon Ho Kong, Jonathan Decastro, Nikos Arechiga Gonzalez, Frank Permenter
  • Patent number: 11518408
    Abstract: A driver monitor system and method for predicting impairment of a user of a vehicle. The system includes video cameras, an input device for inputting a list of medications being taken by the driver. Processing circuitry predicts side effects of the medications based on the half-life of the medication, detecting eye gaze movement, eye lid position, and facial expression of the user using images from the video camera, predicting whether the user is transitioning into an impaired physical state that is a side effect of the medications, verifying the side effect of the medications, determining whether the user is fit to drive using the verified side effects of the medications, and outputting to the vehicle an instruction to operate the vehicle in a level of automation that makes up for the at least one side effect or to perform a safe pull over operation of the vehicle.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: December 6, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Nikos Arechiga-Gonzalez, Soonho Kong, Jonathan Decastro, Frank Permenter, Dennis Park
  • Patent number: 11479239
    Abstract: Aspects of the disclosure provide a parking method and system for a vehicle. For example, the parking system can include a processor and an output circuit. As another example, the parking system can include the processor and a compelling unit. The processor can be configured to determine whether a first weather condition, such as snowing, raining, icing and hailing, at a first parking location meets a first criterion, and identify, when the first weather condition meets the first criterion, a second parking location at which a second weather condition meets a second criterion different from the first criterion. The output unit can be configured to output an alert to the vehicle parked at the first parking location indicating that the vehicle is to be moved to the second parking location. The compelling unit can be configured to compel the vehicle to move to the second parking location.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: October 25, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Nikos Arechiga-Gonzalez, Soonho Kong, Jonathan Decastro, Frank Permenter, Dennis Park
  • Publication number: 20220153258
    Abstract: Aspects of the disclosure provide a parking method and system for a vehicle. For example, the parking system can include a processor and an output circuit. As another example, the parking system can include the processor and a compelling unit. The processor can be configured to determine whether a first weather condition, such as snowing, raining, icing and hailing, at a first parking location meets a first criterion, and identify, when the first weather condition meets the first criterion, a second parking location at which a second weather condition meets a second criterion different from the first criterion. The output unit can be configured to output an alert to the vehicle parked at the first parking location indicating that the vehicle is to be moved to the second parking location. The compelling unit can be configured to compel the vehicle to move to the second parking location.
    Type: Application
    Filed: November 13, 2020
    Publication date: May 19, 2022
    Applicant: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Nikos ARECHIGA-GONZALEZ, Soonho KONG, Jonathan DECASTRO, Frank PERMENTER, Dennis PARK
  • Publication number: 20220153302
    Abstract: A driver monitor system and method for predicting impairment of a user of a vehicle. The system includes video cameras, an input device for inputting a list of medications being taken by the driver. Processing circuitry predicts side effects of the medications based on the half-life of the medication, detecting eye gaze movement, eye lid position, and facial expression of the user using images from the video camera, predicting whether the user is transitioning into an impaired physical state that is a side effect of the medications, verifying the side effect of the medications, determining whether the user is fit to drive using the verified side effects of the medications, and outputting to the vehicle an instruction to operate the vehicle in a level of automation that makes up for the at least one side effect or to perform a safe pull over operation of the vehicle.
    Type: Application
    Filed: November 13, 2020
    Publication date: May 19, 2022
    Applicant: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Nikos ARECHIGA-GONZALEZ, Soonho KONG, Jonathan DECASTRO, Frank PERMENTER, Dennis PARK
  • Patent number: 11256611
    Abstract: A method for synthesizing parameters for control of a closed loop system based on a differentiable simulation model of the closed loop system includes determining requirements/specifications for the closed loop system in signal temporal logic (STL). The method also includes selecting a parametric control law having a differentiable parameter control function. The method also includes converting the requirements in signal temporal logic into differentiable computational graph. The method further includes building the differentiable simulation model as a differentiable computational graph. Furthermore, the method includes automatically learning values of parameters for the differentiable parameter control function of the closed loop system by backpropagating an error.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: February 22, 2022
    Assignees: TOYOTA RESEARCH INSTITUTE, INC., THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
    Inventors: Nikos Arechiga Gonzalez, Karen Y. Leung, Soon Ho Kong, Jonathan Decastro, Frank Permenter
  • Patent number: 11157756
    Abstract: An artificial intelligence perception system for detecting one or more objects includes one or more processors, at least one sensor, and a memory device. The memory device includes an image capture module, an object identifying module, and a logical scaffold module. The image capture module and the object identifying module cause the one or more processors to obtain sensor information of a field of view from a sensor, identify an object within the sensor information, and determine at least one property of the object. The logical scaffold module causes the one or more processors to determine, by a logical scaffold, when the at least one property of the object as determined by the object identifying module is one of a true condition or a false condition.
    Type: Grant
    Filed: January 17, 2020
    Date of Patent: October 26, 2021
    Assignee: Toyota Research Institute, Inc.
    Inventors: Nikos Arechiga Gonzalez, Soonho Kong, Jonathan DeCastro, Sagar Behere, Dennis Park
  • Publication number: 20210315764
    Abstract: Systems and methods for a powered, robotic exoskeleton, or exosuit, for a user's limbs and body are provided. The exosuit may be equipped with airbag devices mounted at various locations on the suit. The exosuit may include on-board computing equipment that can sense, compute control commands in real-time, and actuate limbs and airbags to restore stability (fall prevention) and minimize injuries due to falls, should they happen (fall protection).
    Type: Application
    Filed: April 13, 2020
    Publication date: October 14, 2021
    Applicant: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Jonathan DECASTRO, Soon Ho KONG, Nikos ARECHIGA GONZALEZ, Frank PERMENTER, Dennis PARK
  • Publication number: 20210316744
    Abstract: A method performed by an autonomous vehicle includes identifying a condition preventing the autonomous vehicle from proceeding along an intended route. The method also includes prompting a passenger of the autonomous vehicle to interact with a driver of a first vehicle in response to identifying the condition. The method further includes receiving, from the passenger, an input at an interface of the autonomous vehicle indicating a successful interaction or an unsuccessful interaction with the driver. The method also includes controlling the autonomous vehicle to proceed along the intended route based on the input indicating the successful interaction with the driver.
    Type: Application
    Filed: June 23, 2021
    Publication date: October 14, 2021
    Applicant: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Soonho KONG, Jonathan DECASTRO, Nikos ARECHIGA, Frank PERMENTER
  • Publication number: 20210302975
    Abstract: Systems and methods for predicting a trajectory of a road agent are disclosed herein. One embodiment receives sensor data from one or more sensors; analyzes the sensor data to generate a predicted trajectory of the road agent, wherein the predicted trajectory includes a sequence of primitives, at least one primitive in the sequence of primitives having an associated duration that is determined in accordance with a dynamic timescale; and controls one or more aspects of the operation of an ego vehicle based, at least in part, on the predicted trajectory of the road agent.
    Type: Application
    Filed: March 26, 2020
    Publication date: September 30, 2021
    Inventors: Stephen G. McGill, JR., Guy Rosman, Xin Huang, Jonathan DeCastro, Luke S. Fletcher, John Joseph Leonard