Abstract: Disclosed is a high-precision dynamic real-time 360-degree omnidirectional point cloud acquisition method based on fringe projection. The method comprises: firstly, by means of the fringe projection technology based on a stereoscopic phase unwrapping method, and with the assistance of an adaptive dynamic depth constraint mechanism, acquiring high-precision three-dimensional (3D) data of an object in real time without any additional auxiliary fringe pattern; and then, after a two-dimensional (2D) matching points optimized by the means of corresponding 3D information is rapidly acquired, by means of a two-thread parallel mechanism, carrying out coarse registration based on Simultaneous Localization and Mapping (SLAM) technology and fine registration based on Iterative Closest Point (ICP) technology.

Abstract: In one embodiment, a process is performed during controlling Autonomous Driving Vehicle (ADV). A confidence level associated with a sensed obstacle is determined. If the confidence level is below a confidence threshold, and a distance between the ADV and a potential point of contact with the sensed obstacle is below a distance threshold, then performance of a driving decision is delayed. Otherwise, the driving decision is performed to reduce risk of contact with the sensed obstacle.

Abstract: In one embodiment, a control command is generated with an MPC controller, the MPC controller including a cost function with weights associated with cost terms of the cost function. The control command is applied to a dynamic model of an autonomous driving vehicle (ADV) to simulate behavior of the ADV. One or more of the weights are based on evaluation of the dynamic model in response to the control command, resulting in an adjusted cost function of the MPC controller. Another control command is generated with the MPC controller having the adjusted cost function. This second control command can be used to effect movement of the ADV.

Abstract: An information display method includes receiving a comment display instruction triggered by a user operation and determining key information involved in a video, determining a target comment according to the key information and existing comments of the video, and displaying the target comment according to a target display mode. The key information is key information involved in a first time period of the video.

Abstract: In one embodiment, control of an autonomous driving vehicle (ADV) includes determining a current scenario of the ADV. Based on the scenario, a control algorithm is selected among a plurality of distinct control algorithms as the active control algorithm. One or more control commands are generated using the active control algorithm, based one or more target inputs. The control commands are applied to effect movement of the ADV.

Abstract: In one embodiment, a computer-implemented method for optimizing a controller of an autonomous driving vehicle (ADV) includes obtaining several samples, each sample having a set of parameters, iteratively performing, until a predetermined condition is satisfied: determining, for each sample, a score according to a configuration of the controller based on the set of parameters of the sample, applying a machine learning model to the samples and corresponding scores to determine a mean function and a variance function, producing a new sample as a minimum of a function of the mean function and the variance function with respect to an input space of the set of parameters, adding the new sample to the several samples, and outputting the new sample as an optimal sample, where parameters of the optimal sample are utilized to configure the controller to autonomously drive the ADV.

Abstract: In one embodiment, an ADV is routed by executing a first driving scenario that is active. The first driving scenario is one of a plurality of driving scenario types, each driving scenario type being associated with one or more stages to be executed while a corresponding driving scenario type is active. Based on an environmental condition around the ADV, a second driving scenario is set as active. The ADV is routed by executing the second driving scenario. When the second driving scenario exits, execution of the first driving scenario resumes at the one or more stages of the first driving scenario that remains to be executed.

Abstract: According to one embodiment, during a first planning cycle, a first lane boundary of a driving environment perceived by an ADV is determined using a first lane boundary determination scheme (e.g., current lane boundary), which has been designated as a current lane boundary determination scheme. A first trajectory is planned based on the first lane boundary to drive the ADV to navigate through the driving environment. The first trajectory is evaluated against a predetermined set of safety rules (e.g., whether it will collide or get too close to an object) to avoid a collision with an object detected in the driving environment. In response to determining that the first trajectory fails to satisfy the safety rules, a second lane determination boundary of the driving environment is determined using a second lane boundary determination scheme and a second trajectory is planned based on the second lane boundary to drive the ADV.

Abstract: In one embodiment, a method determines a route from a first location of an autonomous driving vehicle (ADV) to a second location within an open space, the first location being a current location of the ADV. The method determines an objective function based on the route, the objective function having a set of costs for maneuvering the ADV from the first location to the second location. The method determines environmental conditions of the open space and uses the environmental conditions to determine a set of weights, each weight to be applied to a corresponding cost of the objective function. The method optimizes the objective function in view of one or more constraints, such that an output of the objective function reaches minimum while the one or more constraints are satisfied and generates a path trajectory with the optimized objective function to control the ADV autonomously according to the path trajectory.

Abstract: In one embodiment, a system/method generates a driving trajectory for an autonomous driving vehicle (ADV). The system perceives an environment of an autonomous driving vehicle (ADV). The system determines one or more bounding conditions based on the perceived environment. The system generates a first trajectory using a neural network model, wherein the neural network model is trained to generate a driving trajectory. The system evaluates/determines if the first trajectory satisfies the one or more bounding conditions. If the first trajectory satisfies the one or more bounding conditions, the system controls the ADV autonomously according to the first trajectory. Otherwise, the system controls the ADV autonomously according to a second trajectory, where the second trajectory is generated based on an objective function, where the objective function is determined based on at least the one or more bounding conditions.

Abstract: In one embodiment, an exemplary method includes receiving, at a simulation platform, a record file recorded by a manually-driving ADV on a road segment, the simulation platform including a first encoder, a second encoder, and a performance evaluator; simulating automatic driving operations of a dynamic model of the ADV on the road segment based on the record file, the dynamic model including an autonomous driving module to be evaluated. The method further includes: for each trajectory generated by the autonomous driving module during the simulation: extracting a corresponding trajectory associated with the manually-driving ADV from the record file, encoding the trajectory into a first semantic map and the corresponding trajectory into a second semantic map, and generating a similarity score based on the first semantic map and the second semantic map. The method also includes generating an overall performance score based on each similarity score.

Abstract: In one embodiment, method performed by an autonomous driving vehicle (ADV) that determines, within a driving space, a plurality of routes from a current location of the ADV to a desired location. The method determines, for each route of the plurality of routes, an objective function to control the ADV autonomously along the route and, for each of the objective functions, performs Differential Dynamic Programming (DDP) optimization in view of a set of constraints to produce a path trajectory. The method determines whether at least one of the path trajectories satisfies each constraint and, in response to a path trajectory satisfying each of the constraints, selects the path trajectory for navigating the ADV from the current location to the desired location.

Abstract: One or more outputs from a planning module of an ADV are received. Data of a driving environment of the ADV is received. A performance of the planning module is evaluated by determining a score of the performance of the planning module based on the data of the driving environment and the one or more outputs from the planning module. Whether the one or more outputs from the planning module violates at least one of a set of safety rules is determined. The score is determined being larger than a predetermined threshold in response to determining that the one or more outputs from the planning module violate at least one of the set of safety rules. Otherwise, the score is determined based on a machine learning model. The planning module is modified by tuning a set of parameters of the planning module based on the score.

Abstract: In one embodiment, when an autonomous driving vehicle (ADV) is parked, the ADV can determine, based on criteria, whether to operate in an open-space mode or an on-lane mode. The criteria can include whether the ADV is within a threshold distance and threshold heading relative to a vehicle lane. If the criteria are not satisfied, then the ADV can enter the open-space mode. While in the open-space mode, the ADV can maneuver it is within the threshold distance and the threshold heading relative to the vehicle lane. In response to the criteria being satisfied, the ADV can enter and operate in the on-lane mode for the ADV to resume along the vehicle lane.

Abstract: In one embodiment, a plurality of obstacles is sensed in an environment of an automated driving vehicle (ADV). One or more representations are formed to represent corresponding groupings of the plurality of obstacles. A vehicle route is determined in view of the one or more representations, rather than each and every one of the obstacles individually.

Abstract: According to various embodiments, systems and methods described in the disclosure combine mapped features with point cloud features to improve object detection precision of an autonomous driving vehicle (ADV). The map features and the point cloud features can be extracted from a perception area of the ADV within a particular angle view at each driving cycle based on a position of the ADV. The map features and the point cloud features can be concatenated and provided to a neutral network for object detections.

Abstract: An ADV may determine whether there is preexisting map data for an environment or geographical area/location where the ADV is located/travelling. If there is no preexisting data, the ADV may generate map data based on sensor data obtained from one or more sensors of the ADV. The ADV may determine a path for the ADV based on the generated map data. If there is preexisting map data, the ADV may determine a path for the ADV based on the preexisting map data.

Abstract: According to some embodiments, described herein is a system and method for handling sensor failures in autonomous driving vehicles (ADV) that is navigating in a world coordination as an absolute coordination system. When the ADV encounters a sensor failure, but still has at least one camera working properly, the sensor failure handling system can switch the ADV from navigating in the world coordination to a local coordination, in which the ADV relies camera-based obstacle detection and lane mark detection to drive safely until human dis-engagement or until the ADV is parked along a road side.

Abstract: A perception module is configured to perceive a driving environment surrounding an autonomous driving vehicle (ADV) based on sensor data, and to generate perception information using various perception models or methods. The perception information describes the perceived driving environment. Based on the perception information, a planning module is configured to plan a trajectory representing a route or a path for a current planning cycle. The ADV is then controlled and driven based on the trajectory. In addition, the planning module determines a critical region (also referred to as a critical area) surrounding the ADV based on the trajectory in view of a current location or position of the ADV. The metadata describing the critical region is transmitted to the perception module via an application programming interface (API) to allow the perception module to generate perception information for a next planning cycle in view of the critical region.

Abstract: In one embodiment, a lateral drifting error is determined based on at least a current location of an ADV. The lateral drifting error is segmented into a first drifting error and a second drifting error using a predetermined segmentation algorithm. A planning module plans a path or trajectory for a current driving cycle (e.g., planning cycle) to drive the ADV from the current location for a predetermined period of time. The planning module performs a first drifting error correction on the trajectory by modifying at least a starting point of the trajectory based on the first drifting error to generate a modified trajectory. A control module controls the ADV to drive according to the modified trajectory, including performing a second drifting error correction based on the second drifting error.