Abstract: Techniques for generating simulations to evaluate an update to a controller. The controller may be configured to control one or more functionalities of an autonomous and/or a semi-autonomous vehicle. A simulation computing system may receive a request to evaluate a first controller. The simulation computing system may generate a simulation based on data associated with a previous operation of the vehicle in an environment, the previous operation being controlled by a second controller (e.g., standard for evaluation, control version, etc.). The simulation computing device may cause the first controller to control a simulated vehicle in the simulation and may determine whether to validate the update to the controller based on a difference between first metrics associated with a control of the simulated vehicle by the first controller and second metrics associated with a control of the vehicle by the second controller.

Abstract: Techniques for determining unified futures of objects in an environment are discussed herein. Techniques may include determining a first feature associated with an object in an environment and a second feature associated with the environment and based on a position of the object in the environment, updating a graph neural network (GNN) to encode the first feature and second feature into a graph node representing the object and encode relative positions of additional objects in the environment into one or more edges attached to the node. The GNN may be decoded to determine a distribution of predicted positions for the object in the future that meet a criterion, allowing for more efficient sampling. A predicted position of the object in the future may be determined by sampling from the distribution.

Abstract: Techniques for determining unified futures of objects in an environment are discussed herein. Techniques may include determining a first feature associated with an object in an environment and a second feature associated with the environment and based on a position of the object in the environment, updating a graph neural network (GNN) to encode the first feature and second feature into a graph node representing the object and encode relative positions of additional objects in the environment into one or more edges attached to the node. The GNN may be decoded to determine a predicted position of the object at a subsequent timestep. Further, a predicted trajectory of the object may be determined using predicted positions of the object at various timesteps.