Patents by Inventor Jonathan DeCastro
Jonathan DeCastro has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11918535Abstract: Systems and methods for a powered, robotic exoskeleton, or exosuit, for a user's limbs and body are provided. The exosuit may be equipped with airbag devices mounted at various locations on the suit. The exosuit may include on-board computing equipment that can sense, compute control commands in real-time, and actuate limbs and airbags to restore stability (fall prevention) and minimize injuries due to falls, should they happen (fall protection).Type: GrantFiled: April 13, 2020Date of Patent: March 5, 2024Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Jonathan Decastro, Soon Ho Kong, Nikos Arechiga Gonzalez, Frank Permenter, Dennis Park
-
Publication number: 20240010218Abstract: Systems and methods for learning and managing robot user interfaces are disclosed herein. One embodiment generates, based on input data including information about past interactions of a particular user with a robot and with existing HMIs of the robot, a latent space using one or more encoder neural networks, wherein the latent space is a reduced-dimensionality representation of learned behavior and characteristics of the particular user, and uses the latent space as input to train a decoder neural network associated with (1) a new HMI distinct from the existing HMIs or (2) a particular HMI among the existing HMIs to alter operation of the particular HMI. The trained first decoder neural network is deployed in the robot to control, at least in part, operation of the new HMI or the particular HMI in accordance with the learned behavior and characteristics of the particular user.Type: ApplicationFiled: August 26, 2022Publication date: January 11, 2024Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Guy Rosman, Daniel J. Brooks, Simon A.I. Stent, Tiffany Chen, Emily Sarah Sumner, Shabnam Hakimi, Jonathan DeCastro, Deepak Edakkattil Gopinath
-
Patent number: 11801852Abstract: A method performed by an autonomous vehicle includes identifying a condition preventing the autonomous vehicle from proceeding along an intended route. The method also includes prompting a passenger of the autonomous vehicle to interact with a driver of a first vehicle in response to identifying the condition. The method further includes receiving, from the passenger, an input at an interface of the autonomous vehicle indicating a successful interaction or an unsuccessful interaction with the driver. The method also includes controlling the autonomous vehicle to proceed along the intended route based on the input indicating the successful interaction with the driver.Type: GrantFiled: June 23, 2021Date of Patent: October 31, 2023Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Soonho Kong, Jonathan Decastro, Nikos Arechiga, Frank Permenter
-
Publication number: 20230331240Abstract: Disclosed are systems and methods for training at least one policy using a framework for encoding human behaviors and preferences in a driving environment. In one example, the method includes the steps of setting parameters of rewards and a Markov Decision Process (MDP) of the at least one policy that models a simulated human driver of a simulated vehicle and an adaptive human-machine interface (HMI) system configured to interact with each other and training the at least one policy to maximize a total reward based on the parameters of the rewards of the at least one policy.Type: ApplicationFiled: January 19, 2023Publication date: October 19, 2023Applicants: Toyota Research Institute, Inc., Toyota Jidosha Kabushiki KaishaInventors: Jonathan DeCastro, Guy Rosman, Simon A.I. Stent, Emily Sumner, Shabnam Hakimi, Deepak Edakkattil Gopinath, Allison Morgan
-
Patent number: 11745732Abstract: A method for certified control of a self-driving ego vehicle is described. The method includes analyzing a safety situation of the self-driving ego vehicle to determine a proposed vehicle control action using a main controller of the self-driving ego vehicle. The method also includes presenting, by the main controller, the proposed vehicle control action to an interlock controller, including a certificate of the proposed vehicle control action. The method further includes checking a safety certification evidence from the certificate by the interlock controller using a predefined safety argument to verify the safety certification evidence of the certificate. The method also includes directing, by a low-level controller, the self-driving ego vehicle to perform a certified vehicle control action.Type: GrantFiled: November 26, 2019Date of Patent: September 5, 2023Assignees: TOYOTA RESEARCH INSTITUTE, INC., MASSACHUSETTS INSTITUTE OF TECHNOLOGYInventors: Daniel Jackson, Jonathan Decastro, Soon Ho Kong, Nikos Arechiga Gonzalez, Dimitrios Koutentakis, Feng Ping Angela Leong, Mike Meichang Wang, Xin Zhang
-
Publication number: 20230185997Abstract: A method for machine-assisted collaborative product design is described. The method includes training a neural network to simulate a plurality of stakeholder personas in a product review process to provide a plurality of stakeholder models. The method also includes simulating, using the plurality of stakeholder models, the plurality of stakeholder personas in the product review process of a potential product. The method further includes aggregating individual scores output from the plurality of stakeholder models corresponding to each of the plurality of stakeholder personas regarding the potential product; wherein each of the individual scores corresponds to a stakeholder persona and that stakeholder persona's reaction to the potential product. The method also includes displaying a summary providing an overview of the aggregated individual scores regarding the potential product to a user.Type: ApplicationFiled: December 14, 2021Publication date: June 15, 2023Applicant: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Shabnam HAKIMI, Scott CARTER, Jonathan A. DECASTRO, Emily S. SUMNER, Yue WENG, Nikos ARECHIGA
-
Patent number: 11654934Abstract: A system and method for generating a predicted vehicle trajectory includes a generative adversarial network configured to receive a trajectory vector of a target vehicle and generate a set of latent state vectors using the received trajectory vector and an artificial neural network. The latent state vectors each comprise a high-level sub-vector, ZH. The GAN enforces ZH to be correlated to an annotation coding representing semantic categories of vehicle trajectories. The GAN selects a subset, from the set of latent state vectors, using farthest point sampling and generates a predicted vehicle trajectory based on the selected subset of latent state vectors.Type: GrantFiled: November 25, 2020Date of Patent: May 23, 2023Assignees: TOYOTA RESEARCH INSTITUTE, INC., MASSACHUSETTS INSTITUTE OF TECHNOLOGYInventors: Xin Huang, Stephen G. McGill, Jonathan A. DeCastro, Brian C. Williams, Luke S. Fletcher, John J. Leonard, Guy Rosman
-
Publication number: 20230127614Abstract: Systems and methods for generating prototypes are disclosed. In one embodiment, a computer-implemented method of creating a prototype includes receiving one or more input design parameters, generating, using a first neural network, a plurality of prototypes based on the one or more input design parameters, generating, using a second neural network, one or more decoy prototypes, and presenting, by an electronic display, a report including at least a portion of the plurality of prototypes and at least one of the one or more decoy prototypes.Type: ApplicationFiled: October 21, 2021Publication date: April 27, 2023Applicant: Toyota Research Institute, Inc.Inventors: Yue Weng, Emily Sumner, Shabnam Hakimi, Nikos Arechiga, Jonathan A. DeCastro
-
Publication number: 20230131741Abstract: Systems and methods for providing a design with consumer feedback are provided. The method may include receiving a design within a design environment, wherein the design comprises a plurality of attributes. The method may further include automatically generating, using a computer model, consumer-based feedback regarding at least one attribute of the plurality of attributes. The method may additionally include presenting the consumer-based feedback within the design environment in real-time.Type: ApplicationFiled: October 22, 2021Publication date: April 27, 2023Applicant: Toyota Research Institute, Inc.Inventors: Jonathan A. DeCastro, Shabnam Hakimi, Emily Sumner, Yue Weng, Nikos Arechiga
-
Publication number: 20230083838Abstract: In accordance with one embodiment, a system includes a processor, a memory module communicatively coupled to the processor, an NLP module communicatively coupled to the processor, and a set of machine-readable instructions stored in the memory module. The machine-readable instructions, when executed by the processor, direct the processor to perform operations including receiving a text data, and receiving a training text data for training one or more models of the NLP module. The operations also include generating, with a novice model of the NLP module, a novice suggestion based on the text data and the training text data to present an idea related to the text data, generating, with an expert model of the NLP module, an expert suggestion based on the text data and the training text data to present an idea elaborating on the text data, and outputting the novice suggestion and/or the expert suggestion.Type: ApplicationFiled: September 14, 2021Publication date: March 16, 2023Applicant: Toyota Research Institute, Inc.Inventors: Emily Sumner, Nikos Arechiga, Yue Weng, Shabnam Hakimi, Jonathan A. DeCastro
-
Patent number: 11543258Abstract: A personalized notification method for a mobility as a service (MaaS) vehicle includes receiving conditional personalized notification features from a passenger of the MaaS vehicle. The method also includes monitoring current driving environment of the MaaS vehicle to determine whether a condition of the conditional personalized notification features is satisfied. The method further includes notifying the passenger when the condition is satisfied via at least one localized output device in a compartment of the MaaS vehicle.Type: GrantFiled: May 15, 2019Date of Patent: January 3, 2023Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Soon Ho Kong, Jonathan Decastro, Nikos Arechiga Gonzalez, Frank Permenter
-
Patent number: 11518408Abstract: A driver monitor system and method for predicting impairment of a user of a vehicle. The system includes video cameras, an input device for inputting a list of medications being taken by the driver. Processing circuitry predicts side effects of the medications based on the half-life of the medication, detecting eye gaze movement, eye lid position, and facial expression of the user using images from the video camera, predicting whether the user is transitioning into an impaired physical state that is a side effect of the medications, verifying the side effect of the medications, determining whether the user is fit to drive using the verified side effects of the medications, and outputting to the vehicle an instruction to operate the vehicle in a level of automation that makes up for the at least one side effect or to perform a safe pull over operation of the vehicle.Type: GrantFiled: November 13, 2020Date of Patent: December 6, 2022Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Nikos Arechiga-Gonzalez, Soonho Kong, Jonathan Decastro, Frank Permenter, Dennis Park
-
Patent number: 11479239Abstract: Aspects of the disclosure provide a parking method and system for a vehicle. For example, the parking system can include a processor and an output circuit. As another example, the parking system can include the processor and a compelling unit. The processor can be configured to determine whether a first weather condition, such as snowing, raining, icing and hailing, at a first parking location meets a first criterion, and identify, when the first weather condition meets the first criterion, a second parking location at which a second weather condition meets a second criterion different from the first criterion. The output unit can be configured to output an alert to the vehicle parked at the first parking location indicating that the vehicle is to be moved to the second parking location. The compelling unit can be configured to compel the vehicle to move to the second parking location.Type: GrantFiled: November 13, 2020Date of Patent: October 25, 2022Assignee: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Nikos Arechiga-Gonzalez, Soonho Kong, Jonathan Decastro, Frank Permenter, Dennis Park
-
Publication number: 20220153302Abstract: A driver monitor system and method for predicting impairment of a user of a vehicle. The system includes video cameras, an input device for inputting a list of medications being taken by the driver. Processing circuitry predicts side effects of the medications based on the half-life of the medication, detecting eye gaze movement, eye lid position, and facial expression of the user using images from the video camera, predicting whether the user is transitioning into an impaired physical state that is a side effect of the medications, verifying the side effect of the medications, determining whether the user is fit to drive using the verified side effects of the medications, and outputting to the vehicle an instruction to operate the vehicle in a level of automation that makes up for the at least one side effect or to perform a safe pull over operation of the vehicle.Type: ApplicationFiled: November 13, 2020Publication date: May 19, 2022Applicant: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Nikos ARECHIGA-GONZALEZ, Soonho KONG, Jonathan DECASTRO, Frank PERMENTER, Dennis PARK
-
Publication number: 20220153258Abstract: Aspects of the disclosure provide a parking method and system for a vehicle. For example, the parking system can include a processor and an output circuit. As another example, the parking system can include the processor and a compelling unit. The processor can be configured to determine whether a first weather condition, such as snowing, raining, icing and hailing, at a first parking location meets a first criterion, and identify, when the first weather condition meets the first criterion, a second parking location at which a second weather condition meets a second criterion different from the first criterion. The output unit can be configured to output an alert to the vehicle parked at the first parking location indicating that the vehicle is to be moved to the second parking location. The compelling unit can be configured to compel the vehicle to move to the second parking location.Type: ApplicationFiled: November 13, 2020Publication date: May 19, 2022Applicant: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Nikos ARECHIGA-GONZALEZ, Soonho KONG, Jonathan DECASTRO, Frank PERMENTER, Dennis PARK
-
Patent number: 11256611Abstract: A method for synthesizing parameters for control of a closed loop system based on a differentiable simulation model of the closed loop system includes determining requirements/specifications for the closed loop system in signal temporal logic (STL). The method also includes selecting a parametric control law having a differentiable parameter control function. The method also includes converting the requirements in signal temporal logic into differentiable computational graph. The method further includes building the differentiable simulation model as a differentiable computational graph. Furthermore, the method includes automatically learning values of parameters for the differentiable parameter control function of the closed loop system by backpropagating an error.Type: GrantFiled: May 29, 2019Date of Patent: February 22, 2022Assignees: TOYOTA RESEARCH INSTITUTE, INC., THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Nikos Arechiga Gonzalez, Karen Y. Leung, Soon Ho Kong, Jonathan Decastro, Frank Permenter
-
Patent number: 11157756Abstract: An artificial intelligence perception system for detecting one or more objects includes one or more processors, at least one sensor, and a memory device. The memory device includes an image capture module, an object identifying module, and a logical scaffold module. The image capture module and the object identifying module cause the one or more processors to obtain sensor information of a field of view from a sensor, identify an object within the sensor information, and determine at least one property of the object. The logical scaffold module causes the one or more processors to determine, by a logical scaffold, when the at least one property of the object as determined by the object identifying module is one of a true condition or a false condition.Type: GrantFiled: January 17, 2020Date of Patent: October 26, 2021Assignee: Toyota Research Institute, Inc.Inventors: Nikos Arechiga Gonzalez, Soonho Kong, Jonathan DeCastro, Sagar Behere, Dennis Park
-
Publication number: 20210315764Abstract: Systems and methods for a powered, robotic exoskeleton, or exosuit, for a user's limbs and body are provided. The exosuit may be equipped with airbag devices mounted at various locations on the suit. The exosuit may include on-board computing equipment that can sense, compute control commands in real-time, and actuate limbs and airbags to restore stability (fall prevention) and minimize injuries due to falls, should they happen (fall protection).Type: ApplicationFiled: April 13, 2020Publication date: October 14, 2021Applicant: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Jonathan DECASTRO, Soon Ho KONG, Nikos ARECHIGA GONZALEZ, Frank PERMENTER, Dennis PARK
-
Publication number: 20210316744Abstract: A method performed by an autonomous vehicle includes identifying a condition preventing the autonomous vehicle from proceeding along an intended route. The method also includes prompting a passenger of the autonomous vehicle to interact with a driver of a first vehicle in response to identifying the condition. The method further includes receiving, from the passenger, an input at an interface of the autonomous vehicle indicating a successful interaction or an unsuccessful interaction with the driver. The method also includes controlling the autonomous vehicle to proceed along the intended route based on the input indicating the successful interaction with the driver.Type: ApplicationFiled: June 23, 2021Publication date: October 14, 2021Applicant: TOYOTA RESEARCH INSTITUTE, INC.Inventors: Soonho KONG, Jonathan DECASTRO, Nikos ARECHIGA, Frank PERMENTER
-
Publication number: 20210302975Abstract: Systems and methods for predicting a trajectory of a road agent are disclosed herein. One embodiment receives sensor data from one or more sensors; analyzes the sensor data to generate a predicted trajectory of the road agent, wherein the predicted trajectory includes a sequence of primitives, at least one primitive in the sequence of primitives having an associated duration that is determined in accordance with a dynamic timescale; and controls one or more aspects of the operation of an ego vehicle based, at least in part, on the predicted trajectory of the road agent.Type: ApplicationFiled: March 26, 2020Publication date: September 30, 2021Inventors: Stephen G. McGill, JR., Guy Rosman, Xin Huang, Jonathan DeCastro, Luke S. Fletcher, John Joseph Leonard