Abstract: Techniques for controlling a vehicle based on height data and/or classification data being determined utilizing multi-channel image data are discussed herein. The vehicle can capture lidar data as it traverses an environment. The lidar data can be associated with a voxel space as three-dimensional data. Semantic information can be determined and associated with the lidar data and/or the three-dimensional voxel space. A multi-channel input image can be determined based on the three-dimensional voxel space and input into a machine learned (ML) model. The ML model can output data to determine height data and/or classification data associated with a ground surface of the environment. The height data and/or classification data can be utilized to determine a mesh associated with the ground surface. The mesh can be used to control the vehicle and/or determine additional objects proximate the vehicle.

Abstract: Techniques for estimating ground height based on lidar data are discussed herein. A vehicle captures lidar data as it traverses an environment. The lidar data can be associated with a voxel space as three-dimensional data. Semantic information can be determined and associated with the lidar data and/or the three-dimensional voxel space. A multi-channel input image can be determined based on the three-dimensional voxel space and input into a machine learned (ML) model. The ML model can output data to determine height data and/or classification data associated with a ground surface of the environment. The height data and/or classification data can be utilized to determine a mesh associated with the ground surface. The mesh can be used to control the vehicle and/or determine additional objects proximate the vehicle.

Abstract: A multiresolution voxel space is discussed herein. Data can be represented in individual levels in the multiresolution voxel space. A first level can correspond to a first region of an environment and a second level can correspond to a second region of an environment, the second region corresponding to a subset of the first region. In some examples, the levels can comprise a same number of voxels, such that the first level covers a large, low resolution region, while the second level covers a smaller, higher resolution region, though more levels are contemplated. Data represented in the voxel spaces can be processed at higher resolution where available and at a lower resolution where a data density is lower and combined in an intelligent manner. Voxel spaces can be updated based on movement of the sensor providing the data.