Patents by Inventor Luke S. Fletcher

Luke S. Fletcher has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230415762
    Abstract: A method for indicating occlusion information at an ego agent includes observing a spatial area from a first viewpoint of one or more first sensors associated with the ego agent. The method also includes identifying the spatial area as an occluded area in accordance with observing the spatial area from a second viewpoint of the one or more first sensors after observing the spatial area from the first viewpoint. The method further includes receiving, from a target agent, a message indicating the spatial area is occluded from one or more second sensors associated with the target agent. The method still further includes transmitting, to the target agent in accordance with receiving the message, the occlusion information indicating information associated the spatial area based on identifying the spatial area as the occluded area.
    Type: Application
    Filed: September 8, 2023
    Publication date: December 28, 2023
    Applicant: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. MCGILL, Guy ROSMAN, Luke S. FLETCHER
  • Patent number: 11794762
    Abstract: A method for prioritizing occlusion information is presented. The method includes determining, at a first time period, a first sensor's view of a spatial area is occluded. The method also includes observing, at a second time period, the spatial area. The method further includes determining a level of risk associated with the spatial area based on the observation. The method still further includes prioritizing transmission of the occlusion information corresponding to the spatial area based on the determined level of risk and transmitting the occlusion information corresponding to the spatial area based on the priority.
    Type: Grant
    Filed: April 10, 2020
    Date of Patent: October 24, 2023
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. McGill, Guy Rosman, Luke S. Fletcher
  • Patent number: 11724691
    Abstract: Systems and methods described herein relate to estimating risk associated with a vehicular maneuver. One embodiment acquires a geometric representation of an intersection including a lane in which a vehicle is traveling and at least one other lane; discretizes the at least one other lane into a plurality of segments; determines a trajectory along which the vehicle will travel; estimates a probability density function for whether a road agent external to the vehicle is present in the respective segments; estimates a traffic-conflict probability of a traffic conflict in the respective segments conditioned on whether an external road agent is present; estimates a risk associated with the vehicle following the trajectory by integrating a product of the probability density function and the traffic-conflict probability over the at least one other lane and the plurality of segments; and controls operation of the vehicle based, at least in part, on the estimated risk.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: August 15, 2023
    Assignees: Toyota Research Institute, Inc., Massachusetts Institute of Technology
    Inventors: Stephen G. McGill, Jr., Guy Rosman, Moses Theodore Ort, Alyssa Pierson, Igor Gilitschenski, Minoru Brandon Araki, Luke S. Fletcher, Sertac Karaman, Daniela Rus, John Joseph Leonard
  • Patent number: 11703874
    Abstract: Systems and methods to systematically identify and collect operational vehicle data for selective transmission to a non-local storage location for further analysis and use in training autonomous and semi-autonomous vehicles are provided. The systems and methods provided overcome limitations in storage and transmission of collected data by selectively archiving only that collected driving data warranting further analysis.
    Type: Grant
    Filed: March 10, 2022
    Date of Patent: July 18, 2023
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. McGill, Guy Rosman, Luke S. Fletcher
  • Patent number: 11663860
    Abstract: A method of providing dynamic and variable learning for an ego vehicle by determining and using most-trustworthy inputs includes determining, based on ambient conditions of an environment of the ego vehicle, a level of trustworthiness of sensor values obtained from one or more ego vehicle sensors. The method also includes determining a level of confidence in an accuracy of an output of a subsystem of the ego vehicle. The output of the subsystem is based on the sensor values. The level of confidence is based on the level of trustworthiness of the sensor values.
    Type: Grant
    Filed: October 25, 2019
    Date of Patent: May 30, 2023
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. McGill, Guy Rosman, Luke S. Fletcher
  • Patent number: 11654934
    Abstract: A system and method for generating a predicted vehicle trajectory includes a generative adversarial network configured to receive a trajectory vector of a target vehicle and generate a set of latent state vectors using the received trajectory vector and an artificial neural network. The latent state vectors each comprise a high-level sub-vector, ZH. The GAN enforces ZH to be correlated to an annotation coding representing semantic categories of vehicle trajectories. The GAN selects a subset, from the set of latent state vectors, using farthest point sampling and generates a predicted vehicle trajectory based on the selected subset of latent state vectors.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: May 23, 2023
    Assignees: TOYOTA RESEARCH INSTITUTE, INC., MASSACHUSETTS INSTITUTE OF TECHNOLOGY
    Inventors: Xin Huang, Stephen G. McGill, Jonathan A. DeCastro, Brian C. Williams, Luke S. Fletcher, John J. Leonard, Guy Rosman
  • Patent number: 11548521
    Abstract: Systems, vehicles and methods for determining wrong direction driving are disclosed. In one embodiment, a system for determining a vehicle traveling in a wrong direction includes one or more sensors that produce sensor data, one or more processors, and one or more non-transitory computer-readable medium storing computer readable-instructions. When the computer-readable instructions are executed by the one or more processors, the computer-readable instructions cause the one or more processors to determine one or more lanes within a roadway using the sensor data, determine a direction of travel of the one or more lanes using the sensor data, and identify a non-compliant vehicle traveling in a direction in the one or more lanes that is different from the determined direction of travel in the one or more lanes.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: January 10, 2023
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. McGill, Guy Rosman, Luke S. Fletcher, Simon A. I. Stent
  • Patent number: 11529966
    Abstract: A method for controlling a driving behavior performed by a first agent includes navigating, by the first agent, according to a trajectory and a velocity. The method also includes receiving, from a second agent, a risk identification message identifying a third agent as a potential risk based on the third agent performing a behavior associated with a probability that is less than a threshold. The method further includes autonomously engaging a defensive driving mode in response to receiving the risk identification message. The method still further includes adjusting one or both of the trajectory or the velocity in response to autonomously engaging the defensive driving mode.
    Type: Grant
    Filed: April 1, 2021
    Date of Patent: December 20, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. McGill, Guy Rosman, Luke S. Fletcher
  • Patent number: 11531865
    Abstract: Systems and methods for parallel autonomy of a vehicle are disclosed herein. One embodiment receives input data, the input data including at least one of sensor data and structured input data; encodes the input data into an intermediate embedding space using a first neural network; inputs the intermediate embedding space to a first behavior model and a second behavior model, the first behavior model producing a first behavior output, the second behavior model producing a second behavior output; combines the first behavior output and the second behavior output using an ideal-behavior model to produce an ideal behavior for the vehicle; and controls one or more aspects of operation of the vehicle based, at least in part, on the ideal behavior.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: December 20, 2022
    Assignee: Toyota Research Institute, Inc.
    Inventors: Stephen G. McGill, Jr., Guy Rosman, Luke S. Fletcher, John Joseph Leonard
  • Patent number: 11475720
    Abstract: An embodiment takes the form of a vehicle that generates a data collection configuration for one or more vehicle sensors of a vehicle based on an estimated information gain to a neural network were the vehicle to provision the neural network with notional sensor data, and based on a vehicle resource consumption by the vehicle were the vehicle to provision the neural network with the notional sensor data. The notional sensor data comprises sensor data that would be collected from a given sensor among the vehicle sensors according to a respective sensor configuration of the given sensor. The vehicle collects sensor data from the vehicle sensors according to the generated data collection configuration.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: October 18, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. McGill, Guy Rosman, Luke S. Fletcher, John J. Leonard, Simon Stent
  • Patent number: 11443184
    Abstract: An embodiment takes the form of a prediction system that obtains a respective indicated similarity of trajectories in each of a plurality of combinations of observed vehicle trajectories. The prediction system, for each of the combinations, calculates a distance between respective intermediate representations, generated by a neural network, of the trajectories in the combination, and performs a training of the neural network based on a calculated loss between the distance and the indicated similarity of the trajectories in the combination. The respective calculated losses converge after performing respective trainings for the combinations.
    Type: Grant
    Filed: August 19, 2019
    Date of Patent: September 13, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. McGill, Guy Rosman, Luke S. Fletcher
  • Patent number: 11442451
    Abstract: Systems and methods for generating driving recommendations are disclosed herein. One embodiment divides automatically a roadway into a plurality of lane-level cells; generates a graph network that represents the plurality of lane-level cells; gathers information pertaining to one or more detected road agents; projects onto the graph network the gathered information pertaining to the one or more detected road agents to update a current status of the plurality of lane-level cells; processes the graph network based on the updated current status of the plurality of lane-level cells to predict a future status of the plurality of lane-level cells, the predicted future status including at least occupancy, by a detected road agent, of the respective lane-level cells in the plurality of lane-level cells; and generates a driving recommendation based, at least in part, on the predicted future status of the plurality of lane-level cells.
    Type: Grant
    Filed: March 30, 2020
    Date of Patent: September 13, 2022
    Assignee: Toyota Research Institute, Inc.
    Inventors: Stephen G. McGill, Jr., Guy Rosman, Luke S. Fletcher, Brent Schlotfeldt
  • Publication number: 20220244068
    Abstract: Systems and methods for generating efficient planning routes for vehicles, including autonomous and semi-autonomous vehicles are presented. A route planner may generate dynamic maps and routes that reduces the uncertainty of road-agent environmental and behavioral data in an efficient manner. Route planning may be accomplished using a statistical approach in which known data from one geographic or behavioral feature set may be used and relied upon by a vehicle in another geographical and behavioral context to estimate the environmental and behavioral data relevant to the vehicles current operation.
    Type: Application
    Filed: April 18, 2022
    Publication date: August 4, 2022
    Applicants: TOYOTA RESEARCH INSTITUTE, INC., TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventors: Stephen G. MCGILL, Guy ROSMAN, Luke S. FLETCHER
  • Publication number: 20220197297
    Abstract: Systems and methods to systematically identify and collect operational vehicle data for selective transmission to a non-local storage location for further analysis and use in training autonomous and semi-autonomous vehicles are provided. The systems and methods provided overcome limitations in storage and transmission of collected data by selectively archiving only that collected driving data warranting further analysis.
    Type: Application
    Filed: March 10, 2022
    Publication date: June 23, 2022
    Applicant: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. MCGILL, Guy ROSMAN, Luke S. FLETCHER
  • Patent number: 11335104
    Abstract: An embodiment takes the form of a training server that presents a video comprising a plurality of frames, each comprising a respective scene representation of a scene at a respective time. The scene representations comprise respective representations of a feature in the scene. The training server presents a respective gaze representation of a driver gaze for each frame. The gaze representations comprise respective representations of driver gaze locations at the times of the respective scene representations. The training server generates an awareness prediction via a neural network based on the driver gaze locations, the awareness prediction reflecting a predicted driver awareness of the feature. The training server receives an awareness indication associated with the video and the gaze representations, and trains the neural network based on a comparison of the awareness prediction with the awareness indication.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: May 17, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. McGill, Guy Rosman, Simon Stent, Luke S. Fletcher, Deepak Edakkattil Gopinath
  • Patent number: 11333519
    Abstract: Systems and methods for generating efficient planning routes for vehicles, including autonomous and semi-autonomous vehicles are presented. A route planner may generate dynamic maps and routes that reduces the uncertainty of road-agent environmental and behavioral data in an efficient manner. Route planning may be accomplished using a statistical approach in which known data from one geographic or behavioral feature set may be used and relied upon by a vehicle in another geographical and behavioral context to estimate the environmental and behavioral data relevant to the vehicles current operation.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: May 17, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. McGill, Guy Rosman, Luke S. Fletcher
  • Patent number: 11325603
    Abstract: Systems and methods for estimating lane geometry are disclosed herein. One embodiment receives sensor data from one or more sensors; detects a road agent based on the sensor data; detects, based on the sensor data, that the road agent has performed a lane shift from a first lane of a roadway to a second lane of the roadway; and estimates a boundary line between the first lane of the roadway and the second lane of the roadway based, at least in part, on the detected lane shift.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: May 10, 2022
    Assignee: Toyota Research Institute, Inc.
    Inventors: Stephen G. McGill, Jr., Guy Rosman, Luke S. Fletcher
  • Patent number: 11300967
    Abstract: Systems and methods to systematically identify and collect operational vehicle data for selective transmission to a non-local storage location for further analysis and use in training autonomous and semi-autonomous vehicles are provided. The systems and methods provided overcome limitations in storage and transmission of collected data by selectively archiving only that collected driving data warranting further analysis.
    Type: Grant
    Filed: October 25, 2019
    Date of Patent: April 12, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. McGill, Guy Rosman, Luke S. Fletcher
  • Publication number: 20210316746
    Abstract: A method for prioritizing occlusion information is presented. The method includes determining, at a first time period, a first sensor's view of a spatial area is occluded. The method also includes observing, at a second time period, the spatial area. The method further includes determining a level of risk associated with the spatial area based on the observation. The method still further includes prioritizing transmission of the occlusion information corresponding to the spatial area based on the determined level of risk and transmitting the occlusion information corresponding to the spatial area based on the priority.
    Type: Application
    Filed: April 10, 2020
    Publication date: October 14, 2021
    Applicant: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. MCGILL, Guy ROSMAN, Luke S. FLETCHER
  • Publication number: 20210300400
    Abstract: A method for controlling a driving behavior performed by a first agent includes navigating, by the first agent, according to a trajectory and a velocity. The method also includes receiving, from a second agent, a risk identification message identifying a third agent as a potential risk based on the third agent performing a behavior associated with a probability that is less than a threshold. The method further includes autonomously engaging a defensive driving mode in response to receiving the risk identification message. The method still further includes adjusting one or both of the trajectory or the velocity in response to autonomously engaging the defensive driving mode.
    Type: Application
    Filed: April 1, 2021
    Publication date: September 30, 2021
    Applicant: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Stephen G. MCGILL, Guy ROSMAN, Luke S. FLETCHER