Abstract: Trajectory generation for controlling motion or other behavior of an autonomous vehicle may include alternately determining a candidate action and predicting a future state based on that candidate action. The technique may include determining a cost associated with the candidate action that may include an estimation of a transition cost from a current or former state to a next state of the vehicle. This cost estimate may be a lower bound cost or an upper bound cost and the tree search may alternately apply the lower bound cost or upper bound cost exclusively or according to a ratio or changing ratio. The prediction of the future state may be based at least in part on a machine-learned model's classification of a dynamic object as being a reactive object or a passive object, which may change how the dynamic object is modeled for the prediction.

Abstract: Techniques are discussed for generating and optimizing a trajectory using closed-form numerical integration in route-relative coordinates. A decision planner component of an autonomous vehicle, for example, can receive or generate a reference trajectory, which may correspond to an ideal route for an autonomous vehicle to traverse through an environment, such as a center of a road segment. Lateral dynamics (e.g., steering angles, curvature values of trajectory segments) and longitudinal dynamics (e.g., velocity and acceleration) can be represented in a single algorithm such that optimizing the reference trajectory (e.g., based on loss functions or costs) can substantially simultaneously optimize the lateral dynamics and longitudinal dynamics in a single convergence operation. In some cases, the trajectory can be used to control the autonomous vehicle to traverse an environment.

Abstract: A trajectory for an autonomous vehicle (AV) can be generated using curvature segments. A decision planner component can receive a reference trajectory for the AV to follow in an environment. A number of subdivisions (frames) of the reference trajectory may be associated with a curvature value and a tangent vector. Starting with an initial position of the AV, a candidate trajectory can be determined by continuously intersecting a segment with an origin at the initial position of the AV and a reference line associated with a particular frame. The reference line can be substantially perpendicular to the tangent vector of the particular frame. A location of the intersection between the segment and the reference line can be based on a curvature value of the segment. Optimizing a candidate trajectory can include varying curvature values associated with various segments and determining costs of the various candidate trajectories.

Abstract: Techniques for accurately predicting and avoiding collisions with objects detected in an environment of a vehicle are discussed herein. A vehicle computing device can implement a model to output data indicating costs for potential intersection points between the object and the vehicle in the future. The model may employ a control policy and a time-step integrator to determine whether an object may intersect with the vehicle, in which case the techniques may include predicting vehicle actions by the vehicle computing device to control the vehicle.

Abstract: The techniques discussed herein may comprise an autonomous vehicle guidance system that generates a path for controlling an autonomous vehicle based at least in part on a static object map and/or one or more dynamic object maps. The guidance system may identify a path based at least in part on determining set of nodes and a cost map associated with the static and/or dynamic object, among other costs, pruning the set of nodes, and creating further nodes from the remaining nodes until a computational or other limit is reached. The path output by the techniques may be associated with a cheapest node of the sets of nodes that were generated.

Abstract: A method for autonomously operating a driverless vehicle along a path between a first geographic location and a destination may include receiving communication signals from the driverless vehicle. The communication signals may include sensor data from the driverless vehicle and data indicating occurrence of an event associated with the path. The communication signals may also include data indicating that a confidence level associated with the path is less than a threshold confidence level due to the event. The method may also include determining, via a teleoperations system, a level of guidance to provide the driverless vehicle based on data associated with the communication signals, and transmitting teleoperations signals to the driverless vehicle. The teleoperations signals may include guidance to operate the driverless vehicle according to the determined level of guidance, so that a vehicle controller maneuvers the driverless vehicle to avoid, travel around, or pass through the event.

Abstract: Generating a lane reference from a roadway shape and/or generating a trajectory for controlling an autonomous vehicle may include determining a predicted state of the lane reference and/or a candidate trajectory by an integrator. The disclosed integrator is implemented as a numerical integrator in predominantly closed-form that is able to avoid singularities while maintaining no approximation error. The disclosed integrator is also more robust to poor initial estimations, high curvature roadways, and zero-velocity conditions.

Abstract: Techniques for determining a trajectory for an autonomous vehicle are described herein. In general, determining a route can include utilizing a search algorithm such as Monte Carlo Tree Search (MCTS) to search for possible trajectories, while using temporal logic formulas, such as Linear Temporal Logic (LTL), to validate or reject the possible trajectories. Trajectories can be selected based on various costs and constraints optimized for performance. Determining a trajectory can include determining a current state of the autonomous vehicle, which can include determining static and dynamic symbols in an environment. A context of an environment can be populated with the symbols, features, predicates, and LTL formula. Rabin automata can be based on the LTL formula, and the automata can be used to evaluate various candidate trajectories. Nodes of the MCTS can be generated and actions can be explored based on machine learning implemented as, for example, a deep neural network.

Abstract: Techniques for representing sensor data and predicted behavior of various objects in an environment are described herein. For example, an autonomous vehicle can represent prediction probabilities as an uncertainty model that may be used to detect potential collisions, define a safe operational zone or drivable area, and to make operational decisions in a computationally efficient manner. The uncertainty model may represent a probability that regions within the environment are occupied using a heat map type approach in which various intensities of the heat map represent a likelihood of a corresponding physical region being occupied at a given point in time.

Abstract: Techniques for representing sensor data and predicted behavior of various objects in an environment are described herein. For example, an autonomous vehicle can represent prediction probabilities as an uncertainty model that may be used to detect potential collisions, define a safe operational zone or drivable area, and to make operational decisions in a computationally efficient manner. The uncertainty model may represent a probability that regions within the environment are occupied using a heat map type approach in which various intensities of the heat map represent a likelihood of a corresponding physical region being occupied at a given point in time.

Abstract: A method for autonomously operating a driverless vehicle along a path between a first geographic location and a destination may include receiving communication signals from the driverless vehicle. The communication signals may include sensor data from the driverless vehicle and data indicating occurrence of an event associated with the path. The communication signals may also include data indicating that a confidence level associated with the path is less than a threshold confidence level due to the event. The method may also include determining, via a teleoperations system, a level of guidance to provide the driverless vehicle based on data associated with the communication signals, and transmitting teleoperations signals to the driverless vehicle. The teleoperations signals may include guidance to operate the driverless vehicle according to the determined level of guidance, so that a vehicle controller maneuvers the driverless vehicle to avoid, travel around, or pass through the event.

Abstract: Techniques for determining predictions on a top-down representation of an environment based on object movement are discussed herein. Sensors of a first vehicle (such as an autonomous vehicle) may capture sensor data of an environment, which may include object(s) separate from the first vehicle (e.g., a vehicle, a pedestrian, a bicycle). A multi-channel image representing a top-down view of the object(s) and the environment may be generated based in part on the sensor data. Environmental data (object extents, velocities, lane positions, crosswalks, etc.) may also be encoded in the image. Multiple images may be generated representing the environment over time and input into a prediction system configured to output a trajectory template (e.g., general intent for future movement) and a predicted trajectory (e.g., more accurate predicted movement) associated with each object. The prediction system may include a machine learned model configured to output the trajectory template(s) and the predicted trajector(ies).

Abstract: Command determination for controlling a vehicle, such as an autonomous vehicle, is described. In an example, individual requests for controlling the vehicle relative to each of multiple objects or conditions in an environment are received (substantially simultaneously) and based on the request type and/or additional information associated with a request, command controllers can determine control commands (e.g., different accelerations, steering angles, steering rates, and the like) associated with each of the one or more requests. The command controllers may have different controller gains (which may be based on functions of distance, distance ratios, time to estimated collisions, etc.) for determining the controls and a control command may be determined based on the all such determined controls.

Abstract: The techniques discussed herein may comprise an autonomous vehicle guidance system that generates a path for controlling an autonomous vehicle based at least in part on a static object map and/or one or more dynamic object maps. The guidance system may identify a path based at least in part on determining set of nodes and a cost map associated with the static and/or dynamic object, among other costs, pruning the set of nodes, and creating further nodes from the remaining nodes until a computational or other limit is reached. The path output by the techniques may be associated with a cheapest node of the sets of nodes that were generated.

Abstract: A vehicle computing system may implement techniques to determine an action for a vehicle to take based on a cost associated therewith. The cost may be based in part on the effect of the action on an object (e.g., another vehicle, bicyclist, pedestrian, etc.) operating in the environment. The vehicle computing system may detect the object based on sensor data and determine an object trajectory based on a predicted reaction of the object to the vehicle performing the action. The vehicle computing system may determine costs associated with safety, comfort, progress, and/or operating rules for each action the vehicle could take based on the action and/or the predicted object trajectory. In some examples, the lowest cost action may be selected for the vehicle to perform.

Abstract: Techniques for controlling a vehicle on and off a route structure in an environment are discussed herein. A vehicle computing system controls the vehicle along a route based on a route-based reference system. The vehicle computing system may determine to operate off the route, such as to operate in reverse, park, etc. The vehicle computing system may modify vehicle operations to an inertial-based reference system to navigate to a location off the route. The vehicle computing system may determine a vehicle trajectory to the location off the route based on a reference trajectory between a location on the route and the location off the route and a corridor associated therewith. The vehicle computing system may transition between the route-based reference system and the inertial-based reference system, based on a determination to operate on or off the route.

Abstract: Techniques are discussed for predicting occluded regions along a trajectory in an environment, a probability of occupancy associated with the predicted occluded regions, and controlling a vehicle to minimize occlusions and/or probabilities of occupancy. A vehicle may capture sensor data. Portions of an environment may be occluded by an object and may not be represented in the sensor data, and may be referred to as occluded regions. A candidate trajectory can be received and vehicle motion can be simulated to determine predicted occluded regions associated with the candidate trajectory. Data representing a predicted environment can be input to a machine learned model that can output information associated with the predicted occluded regions, such as a probability that the region is occupied by a vehicle or a pedestrian, for example. The candidate trajectory can be evaluated based on such probabilities, and the vehicle can be controlled based on the candidate trajectory.

Abstract: Command determination for controlling a vehicle, such as an autonomous vehicle, is described. In an example, individual requests for controlling the vehicle relative to each of multiple objects or conditions in an environment are received (substantially simultaneously) and based on the request type and/or additional information associated with a request, command controllers can determine control commands (e.g., different accelerations, steering angles, steering rates, and the like) associated with each of the one or more requests. The command controllers may have different controller gains (which may be based on functions of distance, distance ratios, time to estimated collisions, etc.) for determining the controls and a control command may be determined based on the all such determined controls.

Abstract: Techniques for compensating for errors in position of a vehicle are discussed herein. In some cases, a discrepancy may exist between a measured state of the vehicle and a desired state as determined by a system of the vehicle. Techniques and methods for a planning architecture of an autonomous vehicle that is able to provide maintain a smooth trajectory as the vehicle follows a planned path or route. In some cases, a planning architecture of the autonomous vehicle may compensate for differences between an estimated state and a planned path without the use of a separate system. In this example process, the planning architecture may include a mission planning system, a decision system, and a tracking system that together output a trajectory for a drive system.

Abstract: Techniques for determining predictions on a top-down representation of an environment based on vehicle action(s) are discussed herein. Sensors of a first vehicle (such as an autonomous vehicle) can capture sensor data of an environment, which may include object(s) separate from the first vehicle (e.g., a vehicle or a pedestrian). A multi-channel image representing a top-down view of the object(s) and the environment can be generated based on the sensor data, map data, and/or action data. Environmental data (object extents, velocities, lane positions, crosswalks, etc.) can be encoded in the image. Action data can represent a target lane, trajectory, etc. of the first vehicle. Multiple images can be generated representing the environment over time and input into a prediction system configured to output prediction probabilities associated with possible locations of the object(s) in the future, which may be based on the actions of the autonomous vehicle.