Abstract: In one embodiment, a system receives a stream of frames of point clouds from one or more LIDAR sensors of an ADV and corresponding poses in real-time. The system extracts segment information for each frame of the stream based on geometric or spatial attributes of points in the frame, where the segment information includes one or more segments of at least a first frame corresponding to a first pose. The system registers the stream of frames based on the segment information. The system generates a first point cloud map for the stream of frames based on the frame registration.

Abstract: Embodiments of the present application disclose a positioning method and apparatus, an autonomous driving vehicle, an electronic device and a storage medium, relating to the field of autonomous driving technologies, comprising: collecting first pose information measured by an inertial measurement unit within a preset time period, and collecting second pose information measured by a wheel tachometer within the time period; generating positioning information according to the first pose information, the second pose information and the adjacent frame images; controlling driving of the autonomous driving vehicle according to the positioning information. The positioning information is estimated by combining the first pose information and the second pose information corresponding to the inertial measurement unit and the wheel tachometer respectively. Compared with the camera, the inertial measurement unit and the wheel tachometer are not prone to be interfered by the external environment.

Abstract: In one embodiment, a method for solution inference using neural networks in LiDAR localization includes constructing a cost volume in a solution space for a predicted pose of an autonomous driving vehicle (ADV), the cost volume including a number of sub volumes, each sub volume representing a matching cost between a keypoint from an online point cloud and a corresponding keypoint on a pre-built point cloud map. The method further includes regularizing the cost volume using convention neural networks (CNNs) to refine the matching costs; and inferring, from the regularized cost volume, an optimal offset of the predicted pose.

Abstract: In one embodiment, a method for extracting point cloud features for use in localizing an autonomous driving vehicle (ADV) includes selecting a first set of keypoints from an online point cloud, the online point cloud generated by a LiDAR device on the ADV for a predicted pose of the ADV; and extracting a first set of feature descriptors from the first set of keypoints using a feature learning neural network running on the ADV, The method further includes locating a second set of keypoints on a pre-built point cloud map, each keypoint of the second set of keypoints corresponding to a keypoint of the first set of keypoint; extracting a second set of feature descriptors from the pre-built point cloud map; and estimating a position and orientation of the ADV based on the first set of feature descriptors, the second set of feature descriptors, and a predicted pose of the ADV.

Abstract: In one embodiment, a method for temporal smoothness in localization results for an autonomous driving vehicle includes: creating a probability offset volume that represents an overall matching cost between a first set of keypoints from the online point cloud and a second set of keypoints from a pre-built point cloud map for each of a series of sequential light detection and ranging (LiDAR) frames in an online point cloud. The method also includes compressing the probability offset volume into multiple probability vectors across a X dimension, a Y dimension and a yaw dimension; providing each probability vector of the probability offset volume to a number of recurrent neural networks (RNNs); and generating, by the RNNs, a trajectory of location results across the plurality of sequential LiDAR frames.

Abstract: A method, an electronic device and a readable storage medium for point cloud data processing, which may be used for autonomous driving, are disclosed. The feature vectors of respective points in the first point cloud data and second point cloud data are pre-learned, and thus the feature vectors of the first key points may be determined directly based on the learnt second feature vectors of respective first neighboring points of the respective first key points in the first point cloud data, and the feature vectors of the candidate key points may be determined directly based on the learnt third feature vectors of the respective second neighboring points of respective candidate key points in the second point cloud data corresponding to the first key points.

Abstract: In one embodiment, a system identifies a road to be navigated by an ADV, the road being captured by one or more point clouds from one or more LIDAR sensors. The system extracts road marking information of the identified road from the point clouds, the road marking information describing one or more road markings of the identified road. The system partitions the road into one or more road partitions based on the road markings. The system generates a point cloud map based on the road partitions, where the point cloud map is utilized to perceive a driving environment surrounding the ADV.

Abstract: In one embodiment, a system receives a number of point clouds captured by one or more LIDAR sensors of an ADV and corresponding poses. The system receives a number of RGB images from one or more image capturing sensors of the ADV. The system synchronizes the RGB images with the point clouds to obtain RGB point clouds. The system extracts features from the RGB point clouds, the features including contextual and spatial information of the RGB point clouds. The system registers the RGB point clouds based on the extracted features and generates a point cloud map based on the registration of the RGB point clouds.

Abstract: In one embodiment, a system is disclosed for registration of point clouds for autonomous driving vehicles (ADV). The system receives a number of point clouds and corresponding poses from ADVs equipped with LIDAR sensors capturing point clouds of a navigable area to be mapped, where the point clouds correspond to a first coordinate system. The system partitions the point clouds and the corresponding poses into one or more loop partitions based on navigable loop information captured by the point clouds. For each of the loop partitions, the system applies an optimization model to point clouds corresponding to the loop partition to register the point clouds. They system merges the one or more loop partitions together using a pose graph algorithm, where the merged partitions of point clouds are utilized to perceive a driving environment surrounding the ADV.

Abstract: In one embodiment, a system generates an occupancy grid map based on an initial frame of point clouds. The system receives one or more subsequent frames of the point clouds. For each of the subsequent frames, the system updates an occupancy grid map based on the subsequent frame. The system identifies one or more problematic voxels based on the update, the system determines whether the problematic voxels belong to a wall object, and in response to determining that the problematic voxels belong to a wall object, the system flags the problematic voxels as ghost effect voxels for the subsequent frame.

Abstract: Embodiments of the present disclosure provide a method and a device for positioning a vehicle, a device, and a computer readable storage medium. The method includes: determining first edge information of a vehicle from an image related to the vehicle and acquired by a sensing device; determining a contour model corresponding to the vehicle; determining second edge information that matches the first edge information from an edge information set associated with the contour model, in which each edge information in the edge information set corresponds to a position of the contour model relative to the sensing device; and determining a position of the vehicle relative to the sensing device based on a position corresponding to the second edge information.

Abstract: A method and apparatus for identifying laser point cloud data of an autonomous vehicle provided with a lidar. A specific implementation of the method includes: acquiring current pose information of the autonomous vehicle in a world coordinate system in response to receiving a latest frame of laser point cloud data collected by the lidar; acquiring from the cache, based on the current pose information, N×N map blocks centered on map blocks corresponding to the current pose information in a preset three-dimensional grid map and pre-loaded into a cache and are; and executing, for each laser point data in the received laser point cloud data, the laser point data identification operations. The implementation realizes identifying whether each laser point data is a static laser point, and can improve the accuracy rate of identifying a laser point data obstacle.

Abstract: A method and apparatus for annotating a virtual lane at a crossing is provided, which relates to the field of intelligent transportation, and specifically includes: calculating a virtual connecting probability of various lanes that do not connected to each other at the crossing based on driving trajectory data of a vehicles that passing through the crossing within a detection time, and generating the virtual lane at the crossing for two disconnected lanes whose virtual connecting probability is greater than a threshold, and annotating the virtual lane on a map. In this process, the virtual lane at the crossing can be automatically generated according to the driving trajectory data of the vehicles passing through the crossing, and because the driving trajectory data of the vehicles passing through the crossing is real trajectory data, which is more in conformity with actual driving rules of the vehicles, and has a higher annotation accuracy.

Abstract: A method and an apparatus for processing information are provided. A method may include: sending a preset data acquisition request to a target data transmission end included in at least two preset data transmission ends; receiving feedback information from the target data transmission end, and determining whether the feedback information includes the acquired data; determining, in response to determining that the feedback information does not include the acquired data, whether the feedback information includes first fault information for indicating that the target data transmission end malfunctions; and selecting, in response to determining that the feedback information includes the first fault information, a data transmission end other than the target data transmission end from the at least two data transmission ends as a new target data transmission end.

Abstract: The present disclosure provides a method, an apparatus, a computing device and a computer readable storage medium for detecting an environmental change, and relates to the field of autonomous driving. The method obtains a global map for an area and a first local map built in real time for a sub-area in the area; and determines an environmental change in the first sub-area by comparing the first local map and the global map and determining a first probability of the environmental change. Techniques of the present disclosure can automatically detect environmental changes that affect the positioning of autonomous driving, thereby facilitating the updating of positioning maps.

Abstract: The present disclosure provides a method, an apparatus, a computer device and a computer-readable storage medium for positioning, and relates to the field of autonomous driving. The method obtains inertial measurement data of a device to be positioned at a current time and point cloud data collected by a LiDAR on the device at the current time; determines, by integrating the inertial measurement data, inertial positioning information of the device in an inertial coordinate system at the current time; and determines, based on the inertial positioning information, the point cloud data and at least one local map built in a local coordinate system, a positioning result of the device in the local coordinate system at the current time. Techniques of the present disclosure can provide an effective and stable local positioning result.

Abstract: The present disclosure provides a method, an apparatus, a computer device and a computer-readable storage medium for positioning, and relates to the field of autonomous driving. The method obtains point cloud data collected by a LiDAR on a device at a current time; determines, based on the point cloud data and a global map built in a global coordinate system, global positioning information of the device in the global coordinate system at the current time; and determine, based on the point cloud data and a local map built in a local coordinate system, local positioning information of the device in the local coordinate system at the current time. A positioning result of the device at the current time is determined based on at least the global positioning information and the local positioning information. Techniques of the present disclosure can provide an effective and stable positioning service.

Abstract: The present disclosure provides a point cloud data processing method, apparatus, electronic device and computer readable storage medium, which relates to computer vision technology and may be used for autonomous driving.

Abstract: Embodiments of the present disclosure relate to a method, apparatus, device and computer readable storage medium for reconstructing a three-dimensional scene. The method for reconstructing a three-dimensional scene includes acquiring a point cloud data frame set for a three-dimensional scene, point cloud data frames in the point cloud data frame set respectively having a pose parameter. The method further comprises determining a subset corresponding to a part of the three-dimensional scene from the point cloud data frame set. The method further comprises adjusting a pose parameter of a point cloud data frame in the subset to obtain an adjusted subset, the adjusted subset including at least two point cloud data frames having matching overlapping parts. The method further comprises updating the point cloud data frame set using the adjusted subset. In this way, distributed processing on a large amount of point cloud data may be realized.

Abstract: The present disclosure provides an integrated positioning method and system. The method comprises: receiving IMU data, and solving for the IMU data in a first Kalman filter to obtain a system state variable of an autonomous vehicle; receiving and buffering measurement data, and regarding the measurement data as current measurement data; performing measurement updating: obtaining the system state variable at a measurement time of current measurement data, and solving in the second Kalman filter to obtain an updated system state variable; if measurement data after the measurement time of the measurement data is already buffered, regarding the already-buffered measurement data after the measurement time as current measurement data, and performing the measurement update. The present disclosure can solve the problem about measurement information disorder caused by inconsistency of time delay in solving between different sensors, and improve real time and accuracy of the positioning.