Abstract: In one embodiment, a computer-implemented method for calibrating autonomous driving vehicles at a cloud-based server includes receiving, at the cloud-based server, one or more vehicle calibration requests from at least one user, each vehicle calibration request including calibration data for one or more vehicles and processing in parallel, by the cloud-based server, the one or more vehicle calibration requests for the at least one user to generate a calibration result for each vehicle. The method further includes sending, by the cloud-based server, the calibration result for each vehicle to the at least one user.

Abstract: In one embodiment, a system generates an occupancy grid map based on an initial frame of point clouds. The system receives one or more subsequent frames of the point clouds. For each of the subsequent frames, the system updates an occupancy grid map based on the subsequent frame. The system identifies one or more problematic voxels based on the update, the system determines whether the problematic voxels belong to a wall object, and in response to determining that the problematic voxels belong to a wall object, the system flags the problematic voxels as ghost effect voxels for the subsequent frame.

Abstract: In one embodiment, a set of parameters representing a first state of an autonomous driving vehicle (ADV) to be simulated and a set of control commands to be issued at a first point in time. In response, a localization predictive model is applied to the set of parameters to determine a first position (e.g., x, y) of the ADV. A localization correction model is applied to the set of parameters to determine a set of localization correction factors (e.g., ?x, ?y). The correction factors may represent the errors between the predicted position of the ADV by the localization predictive model and the ground truth measured by sensors of the vehicle. Based on the first position of the ADV and the correction factors, a second position of the ADV is determined as the simulated position of the ADV.

Abstract: In one embodiment, a system receives a number of point clouds captured by one or more LIDAR sensors of an ADV and corresponding poses. The system receives a number of RGB images from one or more image capturing sensors of the ADV. The system synchronizes the RGB images with the point clouds to obtain RGB point clouds. The system extracts features from the RGB point clouds, the features including contextual and spatial information of the RGB point clouds. The system registers the RGB point clouds based on the extracted features and generates a point cloud map based on the registration of the RGB point clouds.

Abstract: In one embodiment, a system receives a stream of frames of point clouds from one or more LIDAR sensors of an ADV and corresponding poses in real-time. The system extracts segment information for each frame of the stream based on geometric or spatial attributes of points in the frame, where the segment information includes one or more segments of at least a first frame corresponding to a first pose. The system registers the stream of frames based on the segment information. The system generates a first point cloud map for the stream of frames based on the frame registration.

Abstract: According to one embodiment, in response to a request to park an ADV into a parking lot, a remote server is accessed over a network (e.g., a VX2 link) to obtain a list of parking spaces that appear to be available in the parking lot. Based on the list of available parking spaces and the map associated with the parking lot, a route is generated to navigate through at least the available parking spaces. The ADV is driven according to the route to locate at least one of the available parking spaces and to park the ADV into the located available parking space. The centralized server is configured to periodically receive signals from a number of parking lots indicating which of the parking spaces of the parking lots are apparently available.

Abstract: In one embodiment, a system identifies a road to be navigated by an ADV, the road being captured by one or more point clouds from one or more LIDAR sensors. The system extracts road marking information of the identified road from the point clouds, the road marking information describing one or more road markings of the identified road. The system partitions the road into one or more road partitions based on the road markings. The system generates a point cloud map based on the road partitions, where the point cloud map is utilized to perceive a driving environment surrounding the ADV.

Abstract: In one embodiment, a system receives a number of point clouds captured by one or more LIDAR sensors of an ADV and corresponding poses. The system receives a number of RGB images from one or more image capturing sensors of the ADV. The system synchronizes the RGB images with the point clouds to obtain RGB point clouds. The system extracts features from the RGB point clouds, the features including contextual and spatial information of the RGB point clouds. The system registers the RGB point clouds based on the extracted features and generates a point cloud map based on the registration of the RGB point clouds.

Abstract: In one embodiment, a system is disclosed for registration of point clouds for autonomous driving vehicles (ADV). The system receives a number of point clouds and corresponding poses from ADVs equipped with LIDAR sensors capturing point clouds of a navigable area to be mapped, where the point clouds correspond to a first coordinate system. The system partitions the point clouds and the corresponding poses into one or more loop partitions based on navigable loop information captured by the point clouds. For each of the loop partitions, the system applies an optimization model to point clouds corresponding to the loop partition to register the point clouds. They system merges the one or more loop partitions together using a pose graph algorithm, where the merged partitions of point clouds are utilized to perceive a driving environment surrounding the ADV.

Abstract: In one embodiment, a system generates an occupancy grid map based on an initial frame of point clouds. The system receives one or more subsequent frames of the point clouds. For each of the subsequent frames, the system updates an occupancy grid map based on the subsequent frame. The system identifies one or more problematic voxels based on the update, the system determines whether the problematic voxels belong to a wall object, and in response to determining that the problematic voxels belong to a wall object, the system flags the problematic voxels as ghost effect voxels for the subsequent frame.

Abstract: In one embodiment, a system and method for point cloud registration of LIDAR poses of an autonomous driving vehicle (ADV) is disclosed. The method selects poses of the point clouds that possess higher confidence level during the data capture phase as fixed anchor poses. The fixed anchor points are used to estimate and optimize the poses of non-anchor poses during point cloud registration. The method may partition the points clouds into blocks to perform the ICP algorithm for each block in parallel by minimizing the cost function of the bundle adjustment equation updated with a regularity term. The regularity term may measure the difference between current estimates of the poses and previous or the initial estimates. The method may also minimize the bundle adjustment equation updated with a regularity term when solving the pose graph problem to merge the optimized poses from the blocks to make connections between the blocks.

Abstract: In one embodiment, a system and method for partitioning a region for point cloud registration of LIDAR poses of an autonomous driving vehicle (ADV) using a regional iterative closest point (ICP) algorithm is disclosed. The method determines the frame pair size of one or more pairs of related LIDAR poses of a region of an HD map to be constructed. If the frame pair size is greater than a threshold, the region is further divided into multiple clusters. The method may perform the ICP algorithm for each cluster. Inside a cluster, the ICP algorithm focuses on a partial subset of the decision variables and assumes the rest of the decision variables are fixed. To construct the HD map, the method may determine if the results of the ICP algorithms from the clusters converge. If the solutions converge, a solution to the point cloud registration for the region is found.

Abstract: In one embodiment, a method of generating control effort to control an autonomous driving vehicle (ADV) includes determining a gear position (forward or reverse) in which the ADV is driving and selecting a driving model and a predictive model based upon the gear position. In a forward gear, the driving model is a dynamic model, such as a “bicycle model,” and the predictive model is a look-ahead model. In a reverse gear, the driving model is a hybrid dynamic and kinematic model and the predictive model is a look-back model. A current and predicted lateral error and heading error are determined using the driving model and predictive model, respectively A linear quadratic regulator (LQR) uses the current and predicted lateral error and heading errors, to determine a first control effort, and an augmented control logic determines a second, additional, control effort, to determine a final control effort that is output to a control module of the ADV to drive the ADV.

Abstract: In one embodiment, a set of parameters representing a first state of an autonomous driving vehicle (ADV) to be simulated and a set of control commands to be issued at a first point in time. In response, a localization predictive model is applied to the set of parameters to determine a first position (e.g., x, y) of the ADV. A localization correction model is applied to the set of parameters to determine a set of localization correction factors (e.g., ?x, ?y). The correction factors may represent the errors between the predicted position of the ADV by the localization predictive model and the ground truth measured by sensors of the vehicle. Based on the first position of the ADV and the correction factors, a second position of the ADV is determined as the simulated position of the ADV.

Abstract: A method of navigating an autonomous driving vehicle (ADV) includes determining a target function for an open space model based on one or more obstacles and map information within a proximity of the ADV, then iteratively performing first and second quadratic programming (QP) optimizations on the target function. Then, generating a second trajectory based on results of the first and second QP optimizations to control the ADV autonomously using the second trajectory. The first QP optimization is based on fixing a first set of variables of the target function. The second QP optimization is based on maximizing a sum of the distances from the ADV to each of the obstacles over a plurality of points of the first trajectory, and minimizing a difference between a target end-state of the ADV and a determined final state of the ADV using the first trajectory.

Abstract: In one embodiment, a computer-implemented method for calibrating autonomous driving vehicles at a cloud-based server includes receiving, at the cloud-based server, one or more vehicle calibration requests from at least one user, each vehicle calibration request including calibration data for one or more vehicles and processing in parallel, by the cloud-based server, the one or more vehicle calibration requests for the at least one user to generate a calibration result for each vehicle. The method further includes sending, by the cloud-based server, the calibration result for each vehicle to the at least one user.

Abstract: In one embodiment, an autonomous driving system of an autonomous driving vehicle perceives a driving environment surrounding the autonomous driving vehicle traveling along a path, including perceiving an obstacle in the driving environment. The system detects a vertical acceleration of the autonomous driving vehicle based on sensor data obtained from a sensor on the autonomous driving vehicle. The system further calibrates the perceived obstacle based on the vertical acceleration of the autonomous driving vehicle. The system then controls the autonomous driving vehicle to navigate through the driving environment in view of the calibrated perceived obstacle.

Abstract: In one embodiment, a system generates a plurality of driving scenarios to train a reinforcement learning (RL) agent and replays each of the driving scenarios to train the RL agent by: applying a RL algorithm to an initial state of a driving scenario to determine a number of control actions from a number of discretized control/action options for the ADV to advance to a number of trajectory states which are based on a number of discretized trajectory state options, determining a reward prediction by the RL algorithm for each of the controls/actions, determining a judgment score for the trajectory states, and updating the RL agent based on the judgment score.

Abstract: In one embodiment, a system uses an actor-critic reinforcement learning model to generate a trajectory for an autonomous driving vehicle (ADV) in an open space. The system perceives an environment surrounding an ADV. The system applies a RL algorithm to an initial state of a planning trajectory based on the perceived environment to determine a plurality of controls for the ADV to advance to a plurality of trajectory states based on map and vehicle control information for the ADV. The system determines a reward prediction by the RL algorithm for each of the plurality of controls in view of a target destination state. The system generates a first trajectory from the trajectory states by maximizing the reward predictions to control the ADV autonomously according to the first trajectory.

Abstract: In one embodiment, an open space model is generated for a system to plan trajectories for an ADV in an open space. The system perceives an environment surrounding an ADV including one or more obstacles. The system determines a target function for the open space model based on constraints for the one or more obstacles and map information. The system iteratively, performs a first quadratic programming (QP) optimization on the target function based on a first trajectory while fixing a first set of variables, and performs a second QP optimization on the target function based on a result of the first QP optimization while fixing a second set of variables. The system generates a second trajectory based on results of the first and the second QP optimizations to control the ADV autonomously according to the second trajectory.