Abstract: An image processing method includes performing, using images obtained from one or more sensors onboard a vehicle, a 2-dimensional (2D) feature extraction; performing, a 3-dimensional (3D) feature extraction on the images; detecting objects in the images by fusing detection results from the 2D feature extraction and the 3D feature extraction.

Abstract: A method of processing point cloud information includes converting points in a point cloud obtained from a lidar sensor into a voxel grid, generating, from the voxel grid, sparse voxel features by applying a multi-layer perceptron and one or more max pooling layers that reduce dimension of input data; applying a cascade of an encoder that performs a N-stage sparse-to-dense feature operation, a global context pooling (GCP) module, and an M-stage decoder that performs a dense-to-sparse feature generation operation. The GCP module bridges an output of a last stage of the N-stages with an input of a first stage of the M-stages, where N and M are positive integers. The GCP module comprises a multi-scale feature extractor; and performing one or more perception operations on an output of the M-stage decoder and/or an output of the GCP module.

Abstract: Autonomous vehicles can include systems and apparatus for performing signal processing on point cloud data from Light Detection and Ranging (LiDAR) devices located on the autonomous vehicles. A method includes obtaining, by a computer located in an autonomous vehicle, a combined point cloud data that describes a plurality of areas of an environment in which the autonomous vehicle is operating; determining that a first set of points from the combined point cloud data are located within fields of view of cameras located on the autonomous vehicle; assigning one or more labels to a second set of points from the first set of points in response to determining that the second set of points are located within bounding box(es) around object(s) in images obtained from the cameras; and causing the autonomous vehicle to operate based on characteristic(s) of the object(s) determined from the second set of points.