Abstract: A remote computer system may receive data associated with an autonomous vehicle traversing an environment along a route in accordance with a planned trajectory and data associated with an event within the environment and cause a display to display a representation of the autonomous vehicle. A request to generate an intermittent stopping action message comprising one or more of a position or orientation, a period of time, or a condition is received by the remote computer system and transmitted to the autonomous vehicle, wherein the autonomous vehicle is configured to move to the one or more of position or orientation for the period of time or until the condition is met, such that the vehicle moves to or is at the one or more of position or orientation prior to the event occurring.

Abstract: A reward determined as part of a machine learning technique, such as reinforcement learning, may be used to control an adversarial agent in a simulation such that a component for controlling motion of the adversarial agent is trained to reduce the reward. Training the adversarial agent component may be subject to one or more constraints and/or may be balanced against one or more additional goals. Additionally or alternatively, the reward may be used to alter scenario data so that the scenario data reduces the reward, allowing the discovery of difficult scenarios and/or prospective events.

Abstract: Techniques for providing remote assistance to a vehicle are discussed. The techniques include receiving, from a vehicle, an indication of an event and displaying, on a display and to a user, a portion of an environment including the vehicle. The techniques further determine a valid region in the portion of the environment associated with a location at which the vehicle is capable of navigating. The techniques also display, on the display a footprint of the vehicle, where the footprint is associated with a position and orientation. The techniques further include transmitting the position and orientation of the footprint to the vehicle, which causes the vehicle to traverse in the environment to the position and orientation.

Abstract: Techniques for requesting remote assistance from a vehicle are discussed. The techniques include receiving, from a remote computing device, coordinates of a footprint in which the vehicle is capable of stopping. The techniques further include receiving, from the remote computing device, a target orientation associated with the footprint. The techniques may determine a path to the footprint based to achieve target orientation associated with the footprint.