Abstract: An obstacle state evolution of a spatial position of a moving obstacle over a period of time is determined. A lane-obstacle relation evolution of the moving obstacle with each of one or more lanes near the moving obstacle over the period of time is further determined. An intended movement of the moving obstacle is predicted based on the obstacle state evolution and the lane-obstacle evolution. Thereafter, a trajectory of the ADV is planned to control the ADV to avoid a collision with the moving obstacle based on the predicted intended movement of the moving obstacle. The above process is iteratively performed for each of the moving obstacles detected within a predetermined proximity of the ADV.

Abstract: A driving environment is perceived based on sensor data obtained from a plurality of sensors mounted on the ADV. In response to a request for changing lane from a first lane to a second lane, path planning is performed. The path planning includes identifying a first lane change point for the ADV to change from the first lane to the second lane in a first trajectory of the ADV, determining a lane change preparation distance with respect to the first lane change point, and generating a second trajectory based on the lane change preparation distance, where the second trajectory having a second lane change point delayed from the first lane change point. Speed planning is performed on the second trajectory to control the ADV to change lane according to the second trajectory with different speeds at different point in time.

Abstract: A moving obstacle such as a vehicle within a proximity of an intersection and one or more exits of the intersection are identified. An obstacle state evolution of a spatial position of the moving obstacle over a period of time is determined. For each of the exits, an intersection exit encoding of the exit is determined based on intersection exit features of the exit. An aggregated exit encoding based on aggregating all of the intersection exit encodings for the exits is determined. For each of the exits, an exit probability of the exit that the moving obstacle likely exits the intersection through the exit is determined based on the obstacle state evolution and the aggregated exit encoding. Thereafter, a trajectory of the ADV is planned to control the ADV to avoid a collision with the moving obstacle based on the exit probabilities of the exits.

Abstract: In one embodiment, a process is performed during controlling Autonomous Driving Vehicle (ADV). Microphone signals sense sounds in an environment of the ADV. The microphone signals are combined and filtered to form an audio signal having the sounds sensed in the environment of the ADV. A neural network is applied to the audio signal to detect a presence of an audio signature of an emergency vehicle siren. If the siren is detected, a change in the audio signature to make a determination as to whether the emergency vehicle siren is a) moving towards the ADV, or b) not moving towards the ADV. The ADV can make a driving decision, such as slowing down, stopping, and/or steering to a side, based on if the emergency vehicle siren is moving towards the ADV.

Abstract: In one embodiment, a method of generating control effort to control an autonomous driving vehicle (ADV) includes determining a gear position (forward or reverse) in which the ADV is driving and selecting a driving model and a predictive model based upon the gear position. In a forward gear, the driving model is a dynamic model, such as a “bicycle model,” and the predictive model is a look-ahead model. In a reverse gear, the driving model is a hybrid dynamic and kinematic model and the predictive model is a look-back model. A current and predicted lateral error and heading error are determined using the driving model and predictive model, respectively A linear quadratic regulator (LQR) uses the current and predicted lateral error and heading errors, to determine a first control effort, and an augmented control logic determines a second, additional, control effort, to determine a final control effort that is output to a control module of the ADV to drive the ADV.

Abstract: In one embodiment, a method, apparatus, and system may predict behavior of environmental objects using machine learning at an autonomous driving vehicle (ADV). A data processing architecture comprising at least a first neural network and a second neural network is generated, the first and the second neural networks having been trained with a training data set. Behavior of one or more objects in the ADV's environment is predicted using the data processing architecture comprising the trained neural networks. Driving signals are generated based at least in part on the predicted behavior of the one or more objects in the ADV's environment to control operations of the ADV.

Abstract: A method of navigating an autonomous driving vehicle (ADV) includes determining a target function for an open space model based on one or more obstacles and map information within a proximity of the ADV, then iteratively performing first and second quadratic programming (QP) optimizations on the target function. Then, generating a second trajectory based on results of the first and second QP optimizations to control the ADV autonomously using the second trajectory. The first QP optimization is based on fixing a first set of variables of the target function. The second QP optimization is based on maximizing a sum of the distances from the ADV to each of the obstacles over a plurality of points of the first trajectory, and minimizing a difference between a target end-state of the ADV and a determined final state of the ADV using the first trajectory.

Abstract: In one embodiment, a set of parameters representing a first state of an autonomous driving vehicle (ADV) to be simulated and a set of control commands to be issued at a first point in time. In response, a localization predictive model is applied to the set of parameters to determine a first position (e.g., x, y) of the ADV. A localization correction model is applied to the set of parameters to determine a set of localization correction factors (e.g., ?x, ?y). The correction factors may represent the errors between the predicted position of the ADV by the localization predictive model and the ground truth measured by sensors of the vehicle. Based on the first position of the ADV and the correction factors, a second position of the ADV is determined as the simulated position of the ADV.

Abstract: In one embodiment, an autonomous driving system of an autonomous driving vehicle perceives a driving environment surrounding the autonomous driving vehicle traveling along a path, including perceiving an obstacle in the driving environment. The system detects a vertical acceleration of the autonomous driving vehicle based on sensor data obtained from a sensor on the autonomous driving vehicle. The system further calibrates the perceived obstacle based on the vertical acceleration of the autonomous driving vehicle. The system then controls the autonomous driving vehicle to navigate through the driving environment in view of the calibrated perceived obstacle.

Abstract: In one embodiment, a computer-implemented method for calibrating autonomous driving vehicles at a cloud-based server includes receiving, at the cloud-based server, one or more vehicle calibration requests from at least one user, each vehicle calibration request including calibration data for one or more vehicles and processing in parallel, by the cloud-based server, the one or more vehicle calibration requests for the at least one user to generate a calibration result for each vehicle. The method further includes sending, by the cloud-based server, the calibration result for each vehicle to the at least one user.

Abstract: In one embodiment, an autonomous driving system of an ADV perceives a driving environment surrounding the ADV based on sensor data obtained from various sensors, including detecting one or more lanes and at least a moving obstacle or moving object. For each of the lanes identified, an NN lane feature encoder is applied to the lane information of the lane to extract a set of lane features. For a given moving obstacle, an NN obstacle feature encoder is applied to the obstacle information of the obstacle to extract a set of obstacle features. Thereafter, a lane selection predictive model is applied to the lane features of each lane and the obstacle features of the moving obstacle to predict which of the lanes the moving obstacle intends to select.

Abstract: In one embodiment, a system uses an actor-critic reinforcement learning model to generate a trajectory for an autonomous driving vehicle (ADV) in an open space. The system perceives an environment surrounding an ADV. The system applies a RL algorithm to an initial state of a planning trajectory based on the perceived environment to determine a plurality of controls for the ADV to advance to a plurality of trajectory states based on map and vehicle control information for the ADV. The system determines a reward prediction by the RL algorithm for each of the plurality of controls in view of a target destination state. The system generates a first trajectory from the trajectory states by maximizing the reward predictions to control the ADV autonomously according to the first trajectory.

Abstract: In one embodiment, a system generates a plurality of driving scenarios to train a reinforcement learning (RL) agent and replays each of the driving scenarios to train the RL agent by: applying a RL algorithm to an initial state of a driving scenario to determine a number of control actions from a number of discretized control/action options for the ADV to advance to a number of trajectory states which are based on a number of discretized trajectory state options, determining a reward prediction by the RL algorithm for each of the controls/actions, determining a judgment score for the trajectory states, and updating the RL agent based on the judgment score.

Abstract: In one embodiment, an open space model is generated for a system to plan trajectories for an ADV in an open space. The system perceives an environment surrounding an ADV including one or more obstacles. The system determines a target function for the open space model based on constraints for the one or more obstacles and map information. The system iteratively, performs a first quadratic programming (QP) optimization on the target function based on a first trajectory while fixing a first set of variables, and performs a second QP optimization on the target function based on a result of the first QP optimization while fixing a second set of variables. The system generates a second trajectory based on results of the first and the second QP optimizations to control the ADV autonomously according to the second trajectory.

Abstract: In one embodiment, a method of training dynamic models for autonomous driving vehicles includes the operations of receiving a first set of training data from a training data source, the first set of training data representing driving statistics for a first set of features; training a dynamic model based on the first set of training data for the first set of features; determining a second set of features as a subset of the first set of features based on evaluating the dynamic model, each of the second set of features representing a feature whose performance score is below a predetermined threshold. The method further includes the following operations for each of the second set of features: retrieving a second set of training data associated with the corresponding feature of the second set of features, and retraining the dynamic model using the second set of training data.

Abstract: A moving object such as a vehicle is identified within an intersection having multiple exits. The moving object and the intersection and its exits may be identified based on sensor data obtained from various sensors mounted on an ADV. An exit coordinate map is generated based on the orientation of the moving object and a relative position of each of the exits of the intersection with respect to the current position of the moving object. For each of the exits, an exit probability of the exit that the moving object likely exits the intersection using the exit coordinate map. Thereafter, a trajectory of the ADV is planned to navigate through the intersection to avoid the collision with the moving object based on the exit probabilities of the exits of the intersection. The above process is iteratively performed for each of the moving objects detected within the proximity of the intersection.

Abstract: In one embodiment, a computer-implemented method of autonomously parking an autonomous driving vehicle, includes generating environment descriptor data describing a driving environment surrounding the autonomous driving vehicle (ADV), including identifying a parking space and one or more obstacles within a predetermined proximity of the ADV, generating a parking trajectory of the ADV based on the environment descriptor data to autonomously park the ADV into the parking space, including optimizing the parking trajectory in view of the one or more obstacles, segmenting the parking trajectory into one or more trajectory segments based on a vehicle state of the ADV, and controlling the ADV according to the one or more trajectory segments of the parking trajectory to autonomously park the ADV into the parking space without collision with the one or more obstacles.

Abstract: In one embodiment, a computer-implemented method of operating an autonomous driving vehicle (ADV) includes perceiving a driving environment surrounding the ADV based on sensor data obtained from one or more sensors mounted on the ADV, determining a driving scenario, in response to a driving decision based on the driving environment, applying a predetermined machine-learning model to data representing the driving environment and the driving scenario to generate a set of one or more driving parameters, and planning a trajectory to navigate the ADV using the set of the driving parameters according to the driving scenario through the driving environment.

Abstract: In response to perceiving a moving object, one or more possible object paths of the moving object are determined based on the prior movement predictions of the moving object, for example, using a machine-learning model, which may be created based on a large amount of driving statistics of different vehicles. For each of the possible object paths, a set of trajectory candidates is generated based on a set of predetermined accelerations. Each of the trajectory candidates corresponds to one of the predetermined accelerations. A trajectory cost is calculated for each of the trajectory candidates using a predetermined cost function. One of the trajectory candidates having the lowest trajectory cost amongst the trajectory candidates is selected. An ADV path is planned to navigate the ADV to avoid collision with the moving object based on the lowest costs of the possible object paths of the moving object.

Abstract: An autonomous driving vehicle (ADV) receives instructions for a human test driver to drive the ADV in manual mode and to collect a specified amount of driving data for one or more specified driving categories. As the user drivers the ADV in manual mode, driving data corresponding to the one or more driving categories is logged. A user interface of the ADV displays the one or more driving categories that the human driver is instructed collect data upon, and a progress indicator for each of these categories as the human driving progresses. The driving data is uploaded to a server for machine learning. If the server machine learning achieves a threshold grading amount of the uploaded data to variables of a dynamic self-driving model, then the server generates an ADV self-driving model, and distributes the model to one or more ADVs that are navigated in the self-driving mode.