Abstract: In various examples, data collection vehicles or machines may be equipped with one or more LiDAR sensors (and/or other sensors), and the LiDAR sensor(s) may be used to collect frames of LiDAR data representing various real-world conditions. The LiDAR data may be processed using one or more deep neural networks (DNNs) such as a transformer neural network to generate auto-labels representing detected dynamic obstacles of any designated class. Tracking may be applied to generate object tracks (tracklines), estimate velocity, and/or handle occlusions. In some embodiments, the object tracks may be refined based on geometry and/or confidence to improve their accuracy. In some embodiments, the auto-labels are classified to generate an estimated representation of quality, and auto-labels with at least a threshold quality score may be skipped during human labeling. As such, auto-label quality scores may be used to accelerate human validation of auto-labeled scenes by skipping high quality auto-labels.