Patents by Inventor Kyle Hollins Wray

Kyle Hollins Wray has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11613269
    Abstract: Traversing a vehicle transportation network includes operating a scenario-specific operational control evaluation module instance. The scenario-specific operational control evaluation module instance includes an instance of a scenario-specific operational control evaluation model of a distinct vehicle operational scenario. Operating the scenario-specific operational control evaluation module instance includes identifying a multi-objective policy for the scenario-specific operational control evaluation model. The multi-objective policy may include a relationship between at least two objectives. Traversing the vehicle transportation network includes receiving a candidate vehicle control action associated with each of the at least two objectives. Traversing the vehicle transportation network includes selecting a vehicle control action based on a buffer value.
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: March 28, 2023
    Assignees: Nissan North America, Inc., The University of Massachusetts, Renault S.A.S.
    Inventors: Kyle Hollins Wray, Stefan Witwicki, Shlomo Zilberstein
  • Patent number: 11608048
    Abstract: A system includes a battery, an engine, and a processor. The processor is configured to plan, according to a model, an activation action of the engine of a vehicle for a next road segment subsequent to a current road segment; and activate, for the next road segment, the engine according to the activation action. The model includes a state space that includes a navigation map, which includes the current road segment of the vehicle, a current charge level of the battery, and whether the engine is currently on or off. The activation action is selected from a set comprising a first action to turn on the engine to charge the battery and a second action to turn off the engine.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: March 21, 2023
    Assignee: Nissan North America, Inc.
    Inventors: Kyle Hollins Wray, Liam Pedersen, Richard Lui, Christopher Ostafew
  • Patent number: 11577746
    Abstract: A processor is configured to execute instructions stored in a memory to determine, in response to identifying vehicle operational scenarios of a scene, an action for controlling the AV, where the action is from a selected decision component that determined the action based on level of certainty associated with a state factor; generate an explanation as to why the action was selected, such that the explanation includes respective descriptors of the action, the selected decision component, and the state factor; and display the explanation in a graphical view that includes a first graphical indicator of a world object of the selected decision component, a second graphical indicator describing the state factor, and a third graphical indicator describing the action.
    Type: Grant
    Filed: March 17, 2020
    Date of Patent: February 14, 2023
    Assignees: Nissan North America, Inc., The University of Massachusetts, United States of America as Represented by the Administrator of NASA, Renault S.A.S.
    Inventors: Kyle Hollins Wray, Omar Bentahar, Astha Vagadia, Laura Cesafsky, Arec Jamgochian, Stefan Witwicki, Najamuddin Mirza Baig, Julius S. Gyorfi, Shlomo Zilberstein, Sparsh Sharma
  • Publication number: 20220382279
    Abstract: Real-time decision-making for a vehicle using belief state determination is described. Operational environment data is received while the vehicle is traversing a vehicle transportation network, where the data includes data associated with an external object. An operational environment monitor establishes an observation that relates the object to a distinct vehicle operation scenario. A belief state model of the monitor computes a belief state for the observation directly from the operational environment data. The monitor provides the computed belief state to a decision component implementing a policy that maps a respective belief state for the object within the distinct vehicle operation scenario to a respective candidate vehicle control action. A candidate vehicle control action is received from the policy of the decision component, and a vehicle control action is selected for traversing the vehicle transportation from any available candidate vehicle control actions.
    Type: Application
    Filed: May 28, 2021
    Publication date: December 1, 2022
    Inventors: Kyle Hollins Wray, Stefan Witwicki, Shlomo Zilberstein
  • Publication number: 20220371612
    Abstract: Vehicle guidance with systemic optimization may include traversing, by a current vehicle, a vehicle transportation network, by obtaining, by the current vehicle, systemic-utility vehicle guidance data for a current portion of the vehicle transportation network and traversing, by the current vehicle, the current portion of the vehicle transportation network in accordance with the systemic-utility vehicle guidance data. Obtaining the systemic-utility vehicle guidance data may include obtaining vehicle operational data for a region of a vehicle transportation network, wherein the vehicle operational data includes current operational data for a plurality of vehicles operating in the region, operating a systemic-utility vehicle guidance model for the region, obtaining systemic-utility vehicle guidance data for the region from the systemic-utility vehicle guidance model in response to the vehicle operational data, and outputting the systemic-utility vehicle guidance data to the current vehicle.
    Type: Application
    Filed: April 29, 2021
    Publication date: November 24, 2022
    Inventors: Kyle Hollins Wray, Liam Pedersen, Erik Vinkhuyzen, Stefan Witwicki
  • Publication number: 20220315000
    Abstract: Providing explanations in route planning includes determining a route based on at least two objectives received from a user, where a second objective of the at least two objectives is constrained to within a slack value of a first objective of the at least two objectives; receiving, from the user, a request for an explanation as to an action along the route; and providing the explanation to the user. The explanation describes an extent of violating the slack value.
    Type: Application
    Filed: March 31, 2021
    Publication date: October 6, 2022
    Inventors: Kyle Hollins Wray, Stefan Witwicki, Shlomo Zilberstein
  • Publication number: 20220306156
    Abstract: Route planning in automated driving of an autonomous vehicle includes obtaining an indication that a standard definition map is to be used in addition to a high definition map for obtaining a route; obtaining the route for automatically driving a vehicle to a destination, where the route includes a road of the standard definition map; obtaining a policy from a safety decision component, where the policy provides actions for states the road, and the actions constrain a trajectory of the autonomous vehicle along the road; receiving the actions from the safety decision component; and autonomously traversing the road according to the actions.
    Type: Application
    Filed: March 29, 2021
    Publication date: September 29, 2022
    Inventors: Kyle Hollins Wray, David Ilstrup, Atsuhide Kobashi
  • Publication number: 20220276653
    Abstract: Route planning includes receiving a destination, obtaining a lane-level route to the destination using a map, and controlling an autonomous vehicle (AV) to traverse the lane-level route. The lane-level route includes a transition from a first segment of a first lane of a road to a second segment of a second lane of the road.
    Type: Application
    Filed: February 26, 2021
    Publication date: September 1, 2022
    Inventors: Kyle Hollins Wray, Stefan Witwicki, Shlomo Zilberstein
  • Publication number: 20220274623
    Abstract: Systems and methods are provide an incentive for a driver to improve power systems, safety systems, and autonomous driving systems of a vehicle. A method includes determining a learning goal for the vehicle. The method includes generating a request based on the learning goal. The method includes calculating a reward value. The method includes displaying a task on a user interface of the vehicle. The task may be based on the request, the reward value, or both. The method includes obtaining sensor data. The sensor data may be obtained based on an initiation of the task. The method includes determining progress of the task. The method includes transmitting a notification based on a determination that the task is completed.
    Type: Application
    Filed: February 26, 2021
    Publication date: September 1, 2022
    Inventors: Kyle Hollins Wray, Erik Stayton, Stefan Witwicki
  • Publication number: 20220274624
    Abstract: Lane-level route planning includes obtaining lane-level information of a road, where the road includes a first lane and a second lane and the lane-level information includes first lane information related to the first lane and second lane information related to the second lane; converting the lane-level information to probabilities for a state transition function; receiving a destination; and obtaining a policy as a solution to a model that uses the state transition function.
    Type: Application
    Filed: February 26, 2021
    Publication date: September 1, 2022
    Inventors: Kyle Hollins Wray, Stefan Witwicki, Shlomo Zilberstein
  • Publication number: 20220205796
    Abstract: Route planning for a hybrid electric vehicle (HEV) includes obtaining a route between an origin and a destination, where the route is optimized for at least one of a noise level or energy consumption of an engine of the HEV that is used to charge a battery of the HEV, and where the route comprises respective engine activation actions for at least some segments of the route; and controlling the HEV to follow the segments of the route and to activate the engine according to the respective engine activation actions.
    Type: Application
    Filed: December 22, 2020
    Publication date: June 30, 2022
    Inventors: Kyle Hollins Wray, Liam Pedersen, Richard Lui, Christopher Ostafew
  • Publication number: 20220194355
    Abstract: A system includes a battery, an engine, and a processor. The processor is configured to plan, according to a model, an activation action of the engine of a vehicle for a next road segment subsequent to a current road segment; and activate, for the next road segment, the engine according to the activation action. The model includes a state space that includes a navigation map, which includes the current road segment of the vehicle, a current charge level of the battery, and whether the engine is currently on or off. The activation action is selected from a set comprising a first action to turn on the engine to charge the battery and a second action to turn off the engine.
    Type: Application
    Filed: December 22, 2020
    Publication date: June 23, 2022
    Inventors: Kyle Hollins Wray, Liam Pedersen, Richard Lui, Christopher Ostafew
  • Publication number: 20220196418
    Abstract: Activating an engine of a HEV to charge a battery includes obtaining a first GPS trace from a first trip of the HEV along a first route, where the first GPS trace includes first trace metadata; obtaining a second GPS trace from a second trip, where the second GPS trace includes second trace metadata; adding, to a navigation map, an aggregation of the first trace metadata and the second trace metadata for edges of the navigation map; using the navigation map to obtain an activation action of the engine, where the activation action is selected from a set that includes a first activation action of turning the engine on and a second activation action of turning the engine off; and activating the engine according to the activation action, where activating the engine using the first activation action causes the engine to turn on to charge the battery of the HEV.
    Type: Application
    Filed: December 22, 2020
    Publication date: June 23, 2022
    Inventors: Kyle Hollins Wray, David Ilstrup, Liam Pedersen, Richard Lui, Christopher Ostafew
  • Patent number: 11307585
    Abstract: A first method includes detecting, based on sensor data, an environment state; selecting an action based on the environment state; determining an autonomy level associated with the environment state and the action; and performing the action according to the autonomy level. The autonomy level can be selected based at least on an autonomy model and a feedback model. A second method includes calculating, by solving an extended Stochastic Shortest Path (SSP) problem, a policy for solving a task. The policy can map environment states and autonomy levels to actions and autonomy levels. Calculating the policy can include generating plans that operate across multiple levels of autonomy.
    Type: Grant
    Filed: October 30, 2019
    Date of Patent: April 19, 2022
    Assignees: Nissan North America, Inc., The University of Massachusetts, Renault S.A.S.
    Inventors: Connor Basich, Kyle Hollins Wray, Stefan Witwicki, Shlomo Zilberstein
  • Patent number: 11300957
    Abstract: A vehicle traversing a vehicle transportation network may use a scenario-specific operational control evaluation model instance. A multi-objective policy for the model is received, wherein the policy includes at least a first objective, a second objective, and a priority of the first objective relative to the second objective. A representation of the policy (e.g., the first objective, the second objective, and the priority) is generated using a user interface. Based on feedback to the user interface, a change to the multi-objective policy for the scenario-specific operational control evaluation model is received. The change is to the first objective, the second objective, the priority, of some combination thereof. Then, for determining a vehicle control action for traversing the vehicle transportation network, an updated multi-objective policy for the scenario-specific operational control evaluation model is generated to include the change to the policy.
    Type: Grant
    Filed: December 26, 2019
    Date of Patent: April 12, 2022
    Assignees: Nissan North America, Inc., The University of Massachusetts, Renault S.A.S.
    Inventors: Kyle Hollins Wray, Stefan Witwicki, Shlomo Zilberstein
  • Publication number: 20220101723
    Abstract: A vehicle receives sensor data from at least one of its sensors as it approaches an intersection and determines whether a traffic flow control device for the intersection is detected. When detected, a detected type, a detected state, or both of the traffic flow control device is determined. Using a type of the intersection, at least one of an existing type or an existing state of the traffic flow control device is determined, where the traffic flow control device is undetected or the detected type, the detected state, or both are determined with a detection confidence less than a defined level of detection confidence. The traffic flow control device is tagged with a label including its location and existing type, the existing state, or both within at least one control system for the vehicle. The vehicle is operated within vehicle transportation network using a control system that incorporates the label.
    Type: Application
    Filed: September 30, 2020
    Publication date: March 31, 2022
    Inventors: Luis Lorenzo Bill, David Ilstrup, Stefan Witwicki, Kyle Hollins Wray
  • Publication number: 20210294323
    Abstract: An apparatus for post-processing of a decision-making model of an autonomous vehicle receives a decision-making model including a plurality of states. The model is processed using multivariate data that comprises values for at least three observations of a vehicle operational scenario. A slice of the model decision space is generated by fixing values of all except two observations, and modifying the values of the two observations to obtain multiple alternative solutions for the model. The alternative solutions and the modified values form the slice. Each alternative solution is associated with a respective first value of a first observation and a respective second value of a second observation. The apparatus also generates a solution to a modified decision-making model that is the model modified by, for at least one state and at least one of the two observations, modifying a probabilistic transition matrix, a probabilistic observation matrix, or both.
    Type: Application
    Filed: March 17, 2020
    Publication date: September 23, 2021
    Inventors: Omar Bentahar, Arec Jamgochian, Kyle Hollins Wray, Stefan Witwicki
  • Patent number: 11120688
    Abstract: Traversing, by an autonomous vehicle, a vehicle transportation network, may include identifying a policy for a scenario-specific operational control evaluation model of a distinct vehicle operational scenario, receiving a candidate vehicle control action from the policy, wherein, in response to a determination that an uncertainty value for the distinct vehicle operational scenario exceeds a defined uncertainty threshold, the candidate vehicle control action is an orientation-adjust vehicle control action, and traversing a portion of the vehicle transportation network in accordance with the candidate vehicle control action, wherein the portion of the vehicle transportation network includes the distinct vehicle operational scenario.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: September 14, 2021
    Assignees: Nissan North America, Inc., The University of Massachusetts
    Inventors: Kyle Hollins Wray, Stefan Witwicki, Shlomo Zilberstein, Melissa Cefkin
  • Patent number: 11110941
    Abstract: Centralized shared scenario-specific operational control management includes receiving, at a centralized shared scenario-specific operational control management device, shared scenario-specific operational control management input data, from an autonomous vehicle, validating the shared scenario-specific operational control management input data, identifying a current distinct vehicle operational scenario based on the shared scenario-specific operational control management input data, generating shared scenario-specific operational control management output data based on the current distinct vehicle operational scenario, and transmitting the shared scenario-specific operational control management output data.
    Type: Grant
    Filed: February 26, 2018
    Date of Patent: September 7, 2021
    Assignees: Renault S.A.S., Nissan North America, Inc., The University of Massachusetts
    Inventors: Kyle Hollins Wray, Stefan Witwicki, Shlomo Zilberstein
  • Publication number: 20210271249
    Abstract: A first method includes identifying an occlusion in the vehicle transportation network; identifying, for a first world object that is on a first side of the occlusion, a visibility grid on a second side of the occlusion; and altering a driving behavior of the first vehicle based on the visibility grid. The visibility grid is used in determining whether other world objects exist on the second side of the occlusion. A second includes identifying a first trajectory of a first world object in the vehicle transportation network; identifying a visibility grid of the first world object; identifying, using the visibility grid, a second world object that is invisible to the first world object; and, in response to determining that the first world object is predicted to collide with the second world object, alerting at least one of the first world object or the second world object.
    Type: Application
    Filed: February 28, 2020
    Publication date: September 2, 2021
    Inventors: Atsuhide Kobashi, Stefan Witwicki, Christopher Ostafew, Kyle Hollins Wray, Kuniaki Noda