Abstract: A computer-implemented method. Includes determining an estimate of a state of an object detected at a first time step, based on a pointwise estimate of the state of the object at the first time step and pointwise measurements of the state of the object at a plurality of further time steps. Includes generating, using the estimate of the state of the object, a proposed annotation associated with the object at the first time step. Includes rendering, via a user interface, a visual representation of the environment at the first time step and a visual representation of the proposed annotation. Includes receiving, via the user interface, user input indicating a user-approved annotation associated with the object at the first time step. Includes generating training data for a machine learning model for use in controlling an autonomous vehicle, based at least in part on the user-approved annotation.

Abstract: Techniques for representing a scene or map based on statistical data of captured environmental data are discussed herein. In some cases, the data (such as covariance data, mean data, or the like) may be stored as a multi-resolution voxel space that includes a plurality of semantic layers. In some instances, individual semantic layers may include multiple voxel grids having differing resolutions. Multiple multi-resolution voxel spaces may be merged or aligned to generate combined scenes based on detected voxel covariances at one or more resolutions.

Abstract: Techniques for representing a scene or map based on statistical data of captured environmental data are discussed herein. In some cases, the data (such as covariance data, mean data, or the like) may be stored as a multi-resolution voxel space that includes a plurality of semantic layers. In some instances, individual semantic layers may include multiple voxel grids having differing resolutions. Multiple multi-resolution voxel spaces may be merged to generate combined scenes based on detected voxel covariances at one or more resolutions.

Abstract: Techniques for representing a scene or map based on statistical data of captured environmental data are discussed herein. In some cases, the data (such as covariance data, mean data, or the like) may be stored as a multi-resolution voxel space that includes a plurality of semantic layers. In some instances, individual semantic layers may include multiple voxel grids having differing resolutions. Multiple multi-resolution voxel spaces may be merged to generate combined scenes based on detected voxel covariances at one or more resolutions.

Abstract: Techniques for representing a scene or map based on statistical data of captured environmental data are discussed herein. In some cases, the data (such as covariance data, mean data, or the like) may be stored as a multi-resolution voxel space that includes a plurality of semantic layers. In some instances, individual semantic layers may include multiple voxel grids having differing resolutions. Multiple multi-resolution voxel spaces may be merged or aligned to generate combined scenes based on detected voxel covariances at one or more resolutions.

Abstract: Techniques associated with generating and maintaining sparse geographic and map data. In some cases, the system may maintain a factor graph comprising a plurality of nodes. In some cases, the nodes may comprise pose data and sensor data associated with an autonomous vehicle at the geographic position represented by the node. The nodes may be linked based on shared trajectories and shared sensor data.

Abstract: Techniques for estimating vehicle poses are described herein. A pose may refer to the inertial pose or position of a vehicle. The pose of the vehicle may be used to determine a position of the vehicle in an environment, for determining a trajectory of the vehicle through the environment, or the like. In examples, a pose determination component of an autonomous vehicle can determine a pose at a frequency that is different from other systems on the vehicle and/or that is not synchronized with those systems. The techniques described herein allow for estimating poses at any measurement time, e.g., to determine a pose at a measurement time at which other data is measured, generated, or the like.

Abstract: Techniques for determining errors or drifts between maps used for updating maps and/or controlling a system which uses the map. In some examples, a first, global, map may be received or determined. Sensor data may then be used to localize a system with respect to the first map and to generate a first trajectory relative to the first map. The sensor data may be used to create a second map and a second trajectory for navigating the system relative to the second map. Differences between the first and second trajectories (or portions thereof), when compared in a common reference frame, may be used as an indication of drift between various processes or errors in the maps and, subsequently, be used for updating the first map and/or controlling the system.

Abstract: Techniques associated with generating and maintaining sparse geographic and map data. In some cases, the system may maintain a factor graph comprising a plurality of nodes. In some cases, the nodes may comprise pose data and sensor data associated with an autonomous vehicle at the geographic position represented by the node. The nodes may be linked based on shared trajectories and shared sensor data.

Abstract: Relocating and/or re-sizing map elements using an updated pose graph without introducing abnormalities to the map data may comprise determining a transformation between a source node of a first pose graph and a target node of a second pose graph and determining a modification to a map element based at least in part on the transformation. The techniques may include determining a stress on the map based at least in part on one or more modifications to map elements and determining if the stress meets or exceeds a threshold. In instances where the stress meets or exceeds a threshold, a modification may be altered, reversed, and/or indicated in a notification transmitted to a user interface.

Abstract: Techniques for representing a scene or map based on statistical data of captured environmental data are discussed herein. In some cases, the data (such as covariance data, mean data, or the like) may be stored as a multi-resolution voxel space that includes a plurality of semantic layers. In some instances, individual semantic layers may include multiple voxel grids having differing resolutions. Multiple multi-resolution voxel spaces may be merged or aligned to generate combined scenes based on detected voxel covariances at one or more resolutions.

Abstract: Techniques for integrating sensor data into a scene or map based on statistical data of captured environmental data are discussed herein. The data may be stored as a multi-resolution voxel space and the techniques may comprise first applying a pre-alignment or localization technique prior to fully integrating the sensor data.

Abstract: Techniques described are related to determining when a discrepancy between data of multiple sensors (e.g., IMUs) might be attributable to a sensor error, as opposed to operating conditions, such as sensor bias or noise. For example, the sensor data is passed through one or more filters (e.g., bandpass filter) that model the bias or noise, and the filtered data may then be compared for consistency. In some examples, consistency may be based on residuals or some other metric describing discrepancy among the filtered sensor data.

Abstract: Systems and methods for calibrating multiple inertial measurement units on a system include calibrating a first of the inertial measurement units relative to the system using a first calibration model, and calibrating the remaining inertial measurement unit(s) relative to the first inertial measurement unit using a second calibration model. The calibration of the remaining inertial measurement unit(s) to the first inertial measurement unit can be based on a rigid body model by aligning a rotational velocity of the first inertial measurement unit with a rotational velocity of the remaining inertial measurement unit(s).

Abstract: A soft-constraint technique for refining an initial pose graph may eschew using a hard constraint that identifies different sensor data and/or poses as necessarily being associated with a same portion of an environment. Instead, the soft-constraint technique may employ a loss function with a convergence basin that may be defined based at least in part on an object classification that strongly penalizes candidate locations within a distance associated with the convergence basin. These candidate locations may be based at least in part on one or more object detections associated (1:1) with one or more poses of the initial pose graph. This may result in one or more candidate locations that do not merge with other candidate locations, giving the pose graph optimization the permissiveness or softness according to the techniques described herein.

Abstract: Techniques for using a set of variables to estimate a vehicle velocity of a vehicle are discussed herein. A system may determine an estimated velocity of the vehicle using a minimization based on an initial estimated velocity, steering angle data and wheel speed data. The system may then control an operation of the vehicle based at least in part on the estimated velocity.

Abstract: Techniques for utilizing microphone or audio data to detect and responding to low velocity impacts to a system such as an autonomous vehicle. In some cases, the system may be equipped with a plurality of microphones that may be used to detect impacts that fail to register on the data captured by the vehicle's inertial measurement units and may go undetected by the vehicle's perception system and sensors. In one specific example, the perception system of the autonomous vehicle may identify a period of time in which a potential low velocity impact may occur. The autonomous vehicle may then utilize the microphone or audio data associated with the period of time to determine if an impact occurred.

Abstract: Techniques are described for determining whether a point cloud registration (e.g., alignment) between two sets of data points is valid. Such techniques can include determining voxelized representations of the sets of data points, and comparing characteristics of spatially aligned voxels within the voxelized representations. Characteristics of voxels to be compared can include classification labels of data points associated with voxels, including whether or not voxels correspond to free space. Point cloud registrations determined to be invalid can be given a weighting to be used in a subsequent high definition (HD) map building process. Generated maps can then be deployed for use in autonomous vehicles.

Abstract: Techniques associated with generating and maintaining sparse geographic and map data. In some cases, the system may maintain a factor graph comprising a plurality of nodes. In some cases, the nodes may comprise pose data and sensor data associated with an autonomous vehicle at the geographic position represented by the node. The nodes may be linked based on shared trajectories and shared sensor data.

Abstract: Techniques are described for using variables associated with vehicle wheels (e.g., linear velocity at a wheel and orientation of the wheel) to estimate velocity of a vehicle during a turn maneuver. In examples of the disclosure, in association with one or more wheels, a wheel orientation during the maneuver and a linear speed during the maneuver may be determined, and well as a yaw rate (e.g., from an inertial measurement unit, gyroscope, etc.) of the vehicle. Examples of the present disclosure include, based on the variables associated with the wheel(s) and the yaw rate associated with the turn maneuver, estimating a vehicle velocity, which may be used by various downstream components, such as to determine or update a pose of a vehicle as part of a localization operation.