Patents by Inventor John Joseph Leonard

John Joseph Leonard has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11724691
    Abstract: Systems and methods described herein relate to estimating risk associated with a vehicular maneuver. One embodiment acquires a geometric representation of an intersection including a lane in which a vehicle is traveling and at least one other lane; discretizes the at least one other lane into a plurality of segments; determines a trajectory along which the vehicle will travel; estimates a probability density function for whether a road agent external to the vehicle is present in the respective segments; estimates a traffic-conflict probability of a traffic conflict in the respective segments conditioned on whether an external road agent is present; estimates a risk associated with the vehicle following the trajectory by integrating a product of the probability density function and the traffic-conflict probability over the at least one other lane and the plurality of segments; and controls operation of the vehicle based, at least in part, on the estimated risk.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: August 15, 2023
    Assignees: Toyota Research Institute, Inc., Massachusetts Institute of Technology
    Inventors: Stephen G. McGill, Jr., Guy Rosman, Moses Theodore Ort, Alyssa Pierson, Igor Gilitschenski, Minoru Brandon Araki, Luke S. Fletcher, Sertac Karaman, Daniela Rus, John Joseph Leonard
  • Publication number: 20220410938
    Abstract: Systems and methods for predicting a trajectory of a moving object are disclosed herein. One embodiment downloads, to a robot, a probabilistic hybrid discrete-continuous automaton (PHA) model learned as a deep neural network; uses the deep neural network to infer a sequence of high-level discrete modes and a set of associated low-level samples, wherein the high-level discrete modes correspond to candidate maneuvers for the moving object and the low-level samples are candidate trajectories; uses the sequence of high-level discrete modes and the set of associated low-level samples, via a learned proposal distribution in the deep neural network, to adaptively sample the sequence of high-level discrete modes to produce a reduced set of low-level samples; applies a sample selection technique to the reduced set of low-level samples to select a predicted trajectory for the moving object; and controls operation of the robot based, at least in part, on the predicted trajectory.
    Type: Application
    Filed: December 1, 2021
    Publication date: December 29, 2022
    Applicants: Toyota Research Institute, Inc., Massachusetts Institute of Technology
    Inventors: Xin Huang, Igor Gilitschenski, Guy Rosman, Stephen G. McGill, JR., John Joseph Leonard, Ashkan Mohammadzadeh Jasour, Brian C. Williams
  • Patent number: 11531865
    Abstract: Systems and methods for parallel autonomy of a vehicle are disclosed herein. One embodiment receives input data, the input data including at least one of sensor data and structured input data; encodes the input data into an intermediate embedding space using a first neural network; inputs the intermediate embedding space to a first behavior model and a second behavior model, the first behavior model producing a first behavior output, the second behavior model producing a second behavior output; combines the first behavior output and the second behavior output using an ideal-behavior model to produce an ideal behavior for the vehicle; and controls one or more aspects of operation of the vehicle based, at least in part, on the ideal behavior.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: December 20, 2022
    Assignee: Toyota Research Institute, Inc.
    Inventors: Stephen G. McGill, Jr., Guy Rosman, Luke S. Fletcher, John Joseph Leonard
  • Publication number: 20210302975
    Abstract: Systems and methods for predicting a trajectory of a road agent are disclosed herein. One embodiment receives sensor data from one or more sensors; analyzes the sensor data to generate a predicted trajectory of the road agent, wherein the predicted trajectory includes a sequence of primitives, at least one primitive in the sequence of primitives having an associated duration that is determined in accordance with a dynamic timescale; and controls one or more aspects of the operation of an ego vehicle based, at least in part, on the predicted trajectory of the road agent.
    Type: Application
    Filed: March 26, 2020
    Publication date: September 30, 2021
    Inventors: Stephen G. McGill, JR., Guy Rosman, Xin Huang, Jonathan DeCastro, Luke S. Fletcher, John Joseph Leonard
  • Patent number: 11126187
    Abstract: Systems and methods described herein relate to controlling the operation of a vehicle. One embodiment generates predicted trajectories of the vehicle using first trajectory predictors based, at least in part, on first inputs; generates predicted trajectories of a road agent that is external to the vehicle using second trajectory predictors based, at least in part, on second inputs; integrates the predicted trajectories of the road agent into the first inputs to iteratively update the predicted trajectories of the vehicle and integrates the predicted trajectories of the vehicle into the second inputs to iteratively update the predicted trajectories of the road agent; and controls operation of the vehicle based, at least in part, on at least one of (1) the iteratively updated predicted trajectories of the vehicle and (2) the iteratively updated predicted trajectories of the road agent.
    Type: Grant
    Filed: March 7, 2019
    Date of Patent: September 21, 2021
    Assignee: Toyota Research Institute, Inc.
    Inventors: Stephen G. McGill, Jr., Guy Rosman, John Joseph Leonard, Luke S. Fletcher, Yusuke Sawamura, Xin Huang
  • Patent number: 11126186
    Abstract: Systems and methods described herein relate to predicting a trajectory of a road agent external to a vehicle.
    Type: Grant
    Filed: March 7, 2019
    Date of Patent: September 21, 2021
    Assignee: Toyota Research Institute, Inc.
    Inventors: Stephen G. McGill, Jr., Guy Rosman, John Joseph Leonard, Luke S. Fletcher, Yusuke Sawamura, Xin Huang
  • Publication number: 20210269051
    Abstract: Systems and methods for parallel autonomy of a vehicle are disclosed herein. One embodiment receives input data, the input data including at least one of sensor data and structured input data; encodes the input data into an intermediate embedding space using a first neural network; inputs the intermediate embedding space to a first behavior model and a second behavior model, the first behavior model producing a first behavior output, the second behavior model producing a second behavior output; combines the first behavior output and the second behavior output using an ideal-behavior model to produce an ideal behavior for the vehicle; and controls one or more aspects of operation of the vehicle based, at least in part, on the ideal behavior.
    Type: Application
    Filed: February 28, 2020
    Publication date: September 2, 2021
    Inventors: Stephen G. McGill, JR., Guy Rosman, Luke S. Fletcher, John Joseph Leonard
  • Patent number: 10882522
    Abstract: System, methods, and other embodiments described herein relate to modeling dynamic agents in a surrounding environment of an ego vehicle. In one embodiment, a method includes, in response to receiving sensor data including present observations of a road agent of the dynamic agents in the surrounding environment, identifying previous observations of the road agent from an electronic data store. The method includes estimating a future state of the road agent using at least the present observations and the previous observations of the road agent to compute the future state according to a probabilistic model comprised of a transition model that accounts for dynamic behaviors of the road agent to characterize transitions between states, and an agent model that accounts for actions of the road agent. The method includes controlling one or more vehicle systems of the ego vehicle according to the future state of the road agent.
    Type: Grant
    Filed: September 13, 2018
    Date of Patent: January 5, 2021
    Assignee: Toyota Research Institute, Inc.
    Inventors: Guy Rosman, Jonathan DeCastro, Nikos Arechiga Gonzalez, John Joseph Leonard, Luke S. Fletcher, Daniel Stonier
  • Publication number: 20200086863
    Abstract: System, methods, and other embodiments described herein relate to modeling dynamic agents in a surrounding environment of an ego vehicle. In one embodiment, a method includes, in response to receiving sensor data including present observations of a road agent of the dynamic agents in the surrounding environment, identifying previous observations of the road agent from an electronic data store. The method includes estimating a future state of the road agent using at least the present observations and the previous observations of the road agent to compute the future state according to a probabilistic model comprised of a transition model that accounts for dynamic behaviors of the road agent to characterize transitions between states, and an agent model that accounts for actions of the road agent. The method includes controlling one or more vehicle systems of the ego vehicle according to the future state of the road agent.
    Type: Application
    Filed: September 13, 2018
    Publication date: March 19, 2020
    Inventors: Guy Rosman, Jonathan DeCastro, Nikos Arechiga Gonzalez, John Joseph Leonard, Luke S. Fletcher, Daniel Stonier
  • Publication number: 20200086859
    Abstract: Systems and methods described herein relate to estimating risk associated with a vehicular maneuver. One embodiment acquires a geometric representation of an intersection including a lane in which a vehicle is traveling and at least one other lane; discretizes the at least one other lane into a plurality of segments; determines a trajectory along which the vehicle will travel; estimates a probability density function for whether a road agent external to the vehicle is present in the respective segments; estimates a traffic-conflict probability of a traffic conflict in the respective segments conditioned on whether an external road agent is present; estimates a risk associated with the vehicle following the trajectory by integrating a product of the probability density function and the traffic-conflict probability over the at least one other lane and the plurality of segments; and controls operation of the vehicle based, at least in part, on the estimated risk.
    Type: Application
    Filed: June 13, 2019
    Publication date: March 19, 2020
    Inventors: Stephen G. McGill, JR., Guy Rosman, Moses Theodore Ort, Alyssa Pierson, Igor Gilitschenski, Minoru Brandon Araki, Luke S. Fletcher, Sertac Karaman, Daniela Rus, John Joseph Leonard
  • Publication number: 20200089238
    Abstract: Systems and methods described herein relate to predicting a trajectory of a road agent external to a vehicle.
    Type: Application
    Filed: March 7, 2019
    Publication date: March 19, 2020
    Inventors: Stephen G. McGill, JR., Guy Rosman, John Joseph Leonard, Luke S. Fletcher, Yusuke Sawamura, Xin Huang
  • Publication number: 20200089246
    Abstract: Systems and methods described herein relate to controlling the operation of a vehicle. One embodiment generates predicted trajectories of the vehicle using first trajectory predictors based, at least in part, on first inputs; generates predicted trajectories of a road agent that is external to the vehicle using second trajectory predictors based, at least in part, on second inputs; integrates the predicted trajectories of the road agent into the first inputs to iteratively update the predicted trajectories of the vehicle and integrates the predicted trajectories of the vehicle into the second inputs to iteratively update the predicted trajectories of the road agent; and controls operation of the vehicle based, at least in part, on at least one of (1) the iteratively updated predicted trajectories of the vehicle and (2) the iteratively updated predicted trajectories of the road agent.
    Type: Application
    Filed: March 7, 2019
    Publication date: March 19, 2020
    Inventors: Stephen G. McGill, JR., Guy Rosman, John Joseph Leonard, Luke S. Fletcher, Yusuke Sawamura, Xin Huang
  • Patent number: 10477178
    Abstract: A tunable and iterative stereo mapping technique is provided, capable of identifying disparities at or substantially faster than real-time (e.g., frame-rate of 120 Hz). The method includes identifying a plurality of points in an image, determining disparity values for each of the points in the image and generating a piece-wise planar mesh based on the points and their respective disparity values. A disparity interpolation can be performed on candidate planes using estimated plane parameters for the candidate planes and a disparity image can be generated having a plurality of regions based on the disparity interpolation. Multiple iterations can be performed until the image is reconstructed with an appropriate resolution based on predetermined thresholds. The thresholds can be modified to provide a tunable system by changing the threshold values to either increase a resolution of a final reconstructed image and/or increase a computation speed of the tunable and iterative stereo mapping technique.
    Type: Grant
    Filed: June 29, 2017
    Date of Patent: November 12, 2019
    Assignee: Massachusetts Institute of Technology
    Inventors: John Joseph Leonard, Sudeep Pillai
  • Publication number: 20190020861
    Abstract: A tunable and iterative stereo mapping technique is provided, capable of identifying disparities at or substantially faster than real-time (e.g., frame-rate of 120 Hz). The method includes identifying a plurality of points in an image, determining disparity values for each of the points in the image and generating a piece-wise planar mesh based on the points and their respective disparity values. A disparity interpolation can be performed on candidate planes using estimated plane parameters for the candidate planes and a disparity image can be generated having a plurality of regions based on the disparity interpolation. Multiple iterations can be performed until the image is reconstructed with an appropriate resolution based on predetermined thresholds. The thresholds can be modified to provide a tunable system by changing the threshold values to either increase a resolution of a final reconstructed image and/or increase a computation speed of the tunable and iterative stereo mapping technique.
    Type: Application
    Filed: June 29, 2017
    Publication date: January 17, 2019
    Inventors: John Joseph Leonard, Sudeep Pillai
  • Patent number: 9412173
    Abstract: A method for mapping an environment comprises moving a sensor along a path from a start location (P0) through the environment, the sensor generating a sequence of images, each image associated with a respective estimated sensor location and comprising a point cloud having a plurality of vertices, each vertex comprising an (x,y,z)-tuple and image information for the tuple. The sequence of estimated sensor locations is sampled to provide a pose graph (P) comprising a linked sequence of nodes, each corresponding to a respective estimated sensor location. For each node of the pose graph (P), a respective cloud slice (C) comprising at least of portion of the point cloud for the sampled sensor location is acquired. A drift between an actual sensor location (Pi+1) and an estimated sensor location (Pi) on the path is determined.
    Type: Grant
    Filed: April 22, 2014
    Date of Patent: August 9, 2016
    Assignees: National University of Ireland, Maynooth, Massachusetts Institute of Technology
    Inventors: John Joseph Leonard, Michael Kaess, John McDonald, Thomas John Whelan
  • Publication number: 20160071278
    Abstract: A method for mapping an environment comprises moving a sensor along a path from a start location (P0) through the environment, the sensor generating a sequence of images, each image associated with a respective estimated sensor location and comprising a point cloud having a plurality of vertices, each vertex comprising an (x,y,z)-tuple and image information for the tuple. The sequence of estimated sensor locations is sampled to provide a pose graph (P) comprising a linked sequence of nodes, each corresponding to a respective estimated sensor location. For each node of the pose graph (P), a respective cloud slice (C) comprising at least of portion of the point cloud for the sampled sensor location is acquired. A drift between an actual sensor location (Pi+1) and an estimated sensor location (Pi) on the path is determined.
    Type: Application
    Filed: April 22, 2014
    Publication date: March 10, 2016
    Inventors: John Joseph LEONARD, Michael KAESS, John MCDONALD, Thomas John WHELAN
  • Patent number: 5972370
    Abstract: The present invention provides improved compositions for improving the chemical and physical stability of peptides and proteins. The invention provides a liquid beneficial agent formulation containing a liquid suspension comprising at least 5% by weight beneficial agent and having a viscosity and beneficial agent size which minimizes settling of the agent in suspension over the extended delivery period.
    Type: Grant
    Filed: January 28, 1999
    Date of Patent: October 26, 1999
    Assignee: Alza Corporation
    Inventors: James B. Eckenhoff, deceased, Leslie A. Holladay, John Joseph Leonard, Jr., Iris K. M. Leung, Sally A. Tao, Judy A. Magruder, John P. Carr, Jeremy C. Wright
  • Patent number: 5904935
    Abstract: The present invention provides improved compositions for improving the chemical and physical stability of peptides and proteins. The invention provides a liquid beneficial agent formulation containing a liquid suspension comprising at least 5% by weight beneficial agent and having a viscosity and beneficial agent size which minimizes settling of the agent in suspension over the extended delivery period.
    Type: Grant
    Filed: June 7, 1995
    Date of Patent: May 18, 1999
    Assignee: ALZA Corporation
    Inventors: James B. Eckenhoff, deceased, Leslie A. Holladay, John Joseph Leonard, Jr., Iris K. M. Leung, Sally A. Tao, Judy A. Magruder, John P. Carr, Jeremy Wright
  • Patent number: 4097523
    Abstract: A process for the liquid phase oxidation of .alpha.,.beta.-unsaturated aldehydes, and the in situ decomposition of unsaturated intermediate peroxy (peroxide) compounds formed during oxidation, to the corresponding unsaturated aliphatic acid which comprises passing oxygen or an oxygen-containing gas through an inert solvent solution of the aldehyde at a suitable temperature and pressure in the presence of a catalytic amount of a thallium salt. The solvents employed may be mixed with water forming a heterogeneous solvent system.
    Type: Grant
    Filed: January 12, 1977
    Date of Patent: June 27, 1978
    Assignee: Atlantic Richfield Company
    Inventors: Jar-Lin Kao, John Joseph Leonard
  • Patent number: 4093649
    Abstract: A process for the preparation of .alpha.,.beta.-unsaturated aliphatic carboxylic acids by the liquid phase oxidation of the corresponding .alpha.,.beta.-unsaturated aliphatic aldehyde, such as acrolein and methacrolein, and the in situ decomposition or conversion of unsaturated peroxy (peroxide) compounds formed during oxidation, which comprises passing air or oxygen through an inert organic solvent solution of the aldehyde at a suitable temperature and pressure in the presence of a catalytic amount of an organic or inorganic bismuth salt. Heterogeneous solvent systems employing mixtures of the organic solvent and water may be used.
    Type: Grant
    Filed: February 7, 1977
    Date of Patent: June 6, 1978
    Assignee: Atlantic Richfield Company
    Inventors: Jar-lin Kao, John Joseph Leonard