Abstract: Various embodiments relate generally to autonomous vehicles and associated mechanical, electrical and electronic hardware, computer software and systems, and wired and wireless network communications to provide an autonomous vehicle fleet as a service. In particular, a method may include receiving data associated with a sensor measurement of a perceived object, determining a label associated with the perceived object based on an initial calibration, retrieving log file data associated with the label, determining a calibration parameter associated with the sensor measurement based on the retrieved log file data, and storing the calibration parameter in association with a sensor associated with the sensor measurement. Sensors may be calibrated on the fly while the autonomous vehicle is in operation using one or more other sensors and/or fused data from multiple types of sensors.

Abstract: Techniques are discussed for modifying map elements associated with map data. Map data can include three-dimensional data (e.g., LIDAR data) representing an environment, while map elements can be associated with the map data to identify locations and semantic information associated with an environment, such as regions that correspond to driving lanes or crosswalks. A trajectory associated with the map data can be updated, such as when aligning one or more trajectories in response to a loop closure, updated calibration, etc. The transformation between a trajectory and an updated trajectory can be applied to map elements to warp the map elements so that they correspond to the updated map data, thereby providing automatic and accurate techniques for updating map elements associated with map data.

Abstract: A method for autonomously operating a driverless vehicle along a path between a first geographic location and a destination may include receiving communication signals from the driverless vehicle. The communication signals may include sensor data from the driverless vehicle and data indicating occurrence of an event associated with the path. The communication signals may also include data indicating that a confidence level associated with the path is less than a threshold confidence level due to the event. The method may also include determining, via a teleoperations system, a level of guidance to provide the driverless vehicle based on data associated with the communication signals, and transmitting teleoperations signals to the driverless vehicle. The teleoperations signals may include guidance to operate the driverless vehicle according to the determined level of guidance, so that a vehicle controller maneuvers the driverless vehicle to avoid, travel around, or pass through the event.

Abstract: Various embodiments relate generally to autonomous vehicles and associated mechanical, electrical and electronic hardware, computer software and systems, and wired and wireless network communications to provide an autonomous vehicle fleet as a service. In particular, a method may include monitoring a fleet of vehicles, at least one of which is configured to autonomously transit from a first geographic region to a second geographic region, detecting data indicating an event associated with the vehicle having a calculated confidence level, receiving data representing a subset of candidate trajectories responsive to detecting the event, which is associated with a planned path for the vehicle, identifying guidance data to select from one or more of the candidate trajectories as a guided trajectory, receiving data representing a selection of a candidate trajectory, and transmitting the selection of the candidate trajectory as of the guided trajectory to the vehicle.

Abstract: Techniques for generating maps without shadows are discussed herein. A plurality of images can be captured by a vehicle traversing an environment representing various perspectives and/or lighting conditions in the environment. A shadow within an image can be identified by a machine learning algorithm trained to detect shadows in images and/or by projecting the image onto a three-dimensional (3D) map of the environment and identifying candidate shadow regions based on the geometry of the 3D map and the location of the light source. Shadows can be removed or minimized by utilizing blending or duplicating techniques. Color information and reflectance information can be added to the 3D map to generate a textured 3D map. A textured 3D map without shadows can be used to simulate the environment under different lighting conditions.

Abstract: Techniques and methods for storing data. For instance, a vehicle can receive sensor data generated by one or more sensors. The vehicle can then detect that an event is occurring and/or has occurred using the sensor data. Based on detecting the event, the vehicle can flag a first portion of the sensor data as corresponding to the event. The vehicle can then store the first portion of the sensor data according to a first storage rule and a second portion of the sensor data according to a second storage rule. In some instances, the storage rules may indicate when sensor data is to be overwritten, lengths of time that the sensor data is to be stored, formats for storing the sensor data, and/or when the sensor data is to be sent to one or more computing devices.

Abstract: A driverless vehicle may include a processor, a sensor, a network interface, and a memory having stored thereon processor-executable instructions. The driverless vehicle may be configured to obtain a stream of sensor signals including sensor data related to operation of the driverless vehicle from the sensor and/or the network interface. The driverless vehicle may be configured to determine a confidence level associated with operation of the driverless vehicle from the sensor data, and store the confidence level and at least a portion of the sensor data. The driverless vehicle may also be configured to transmit via the network interface a request for teleoperator assistance, and the request may include the portion of the sensor data and the confidence level.

Abstract: Techniques are discussed for modifying map elements associated with map data. Map data can include three-dimensional data (e.g., LIDAR data) representing an environment, while map elements can be associated with the map data to identify locations and semantic information associated with an environment, such as regions that correspond to driving lanes or crosswalks. A trajectory associated with the map data can be updated, such as when aligning one or more trajectories in response to a loop closure, updated calibration, etc. The transformation between a trajectory and an updated trajectory can be applied to map elements to warp the map elements so that they correspond to the updated map data, thereby providing automatic and accurate techniques for updating map elements associated with map data.

Abstract: A method for autonomously operating a driverless vehicle along a path between a first geographic location and a destination may include receiving communication signals from the driverless vehicle. The communication signals may include sensor data from the driverless vehicle and data indicating occurrence of an event associated with the path. The communication signals may also include data indicating that a confidence level associated with the path is less than a threshold confidence level due to the event. The method may also include determining, via a teleoperations system, a level of guidance to provide the driverless vehicle based on data associated with the communication signals, and transmitting teleoperations signals to the driverless vehicle. The teleoperations signals may include guidance to operate the driverless vehicle according to the determined level of guidance, so that a vehicle controller maneuvers the driverless vehicle to avoid, travel around, or pass through the event.

Abstract: A method includes receiving a first signal from a first sensor, the first signal including data representing an environment. The method also includes receiving a second signal from a second sensor, the second signal including data representing the environment. The method further includes determining a group of objects based at least in part on the received data, and identifying an error associated with data included in the first signal and/or the second signal.

Abstract: A system, an apparatus or a process may be configured to implement an application that applies artificial intelligence and/or machine-learning techniques to predict an optimal course of action (or a subset of courses of action) for an autonomous vehicle system (e.g., one or more of a planner of an autonomous vehicle, a simulator, or a teleoperator) to undertake based on suboptimal autonomous vehicle performance and/or changes in detected sensor data (e.g., new buildings, landmarks, potholes, etc.). The application may determine a subset of trajectories based on a number of decisions and interactions when resolving an anomaly due to an event or condition. The application may use aggregated sensor data from multiple autonomous vehicles to assist in identifying events or conditions that might affect travel (e.g., using semantic scene classification). An optimal subset of trajectories may be formed based on recommendations responsive to semantic changes (e.g., road construction).

Abstract: Various embodiments relate generally to autonomous vehicles and associated mechanical, electrical and electronic hardware, computer software and systems, and wired and wireless network communications to provide an autonomous vehicle fleet as a service. More specifically, systems, devices, and methods are configured to simulate navigation of autonomous vehicles in various simulated environments. In particular, a method may include receiving data representing characteristics of a dynamic object, calculating a classification of a dynamic object to identify a classified dynamic object, identifying data representing dynamic-related characteristics associated with the classified dynamic object, forming a data model of the classified dynamic object, simulating a predicted range of motion of the classified dynamic object in a simulated environment to form a simulated dynamic object, and simulating a predicted response of a data representation of a simulated autonomous vehicle.

Abstract: A driverless vehicle may include a processor, a sensor, a network interface, and a memory having stored thereon processor-executable instructions. The driverless vehicle may be configured to obtain a stream of sensor signals including sensor data related to operation of the driverless vehicle from the sensor and/or the network interface. The driverless vehicle may be configured to determine a confidence level associated with operation of the driverless vehicle from the sensor data, and store the confidence level and at least a portion of the sensor data. The driverless vehicle may also be configured to transmit via the network interface a request for teleoperator assistance, and the request may include the portion of the sensor data and the confidence level.

Abstract: Systems and methods implemented in algorithms, software, firmware, logic, or circuitry may be configured to process data and sensory input to determine whether an object external to an autonomous vehicle (e.g., another vehicle, a pedestrian, road debris, a bicyclist, etc.) may be a potential collision threat to the autonomous vehicle. The autonomous vehicle may be configured to implement active safety measures to avoid the potential collision and/or mitigate the impact of an actual collision to passengers in the autonomous vehicle and/or to the autonomous vehicle itself. Interior safety systems, exterior safety systems, a drive system or some combination of those systems may be activated to implement active safety measures in the autonomous vehicle.

Abstract: Systems, methods, and apparatuses described herein are directed to performing segmentation on voxels representing three-dimensional data to identify static and dynamic objects. LIDAR data may be captured by a perception system for an autonomous vehicle and represented in a voxel space. Operations may include determining a drivable surface by parsing individual voxels to determine an orientation of a surface normal of a planar approximation of the voxelized data relative to a reference direction. Clustering techniques can be used to grow a ground plane including a plurality of locally flat voxels. Ground plane data can be set aside from the voxel space, and the remaining voxels can be clustered to determine objects. Voxel data can be analyzed over time to determine dynamic objects. Segmentation information associated with ground voxels, static object, and dynamic objects can be provided to a tracker and/or planner in conjunction with operating the autonomous vehicle.

Abstract: Various embodiments relate generally to autonomous vehicles and associated mechanical, electrical and electronic hardware, computer software and systems, and wired and wireless network communications to provide an autonomous vehicle fleet as a service. More specifically, systems, devices, and methods are configured to initiate modification of trajectories to influence navigation of autonomous vehicles. In particular, a method may include receiving a teleoperation message via a communication link from an autonomous vehicle, detecting data from the teleoperation message specifying an event associated with the autonomous vehicle, identifying one or more courses of action to perform responsive to detecting the data specifying the event, and generating visualization data to present information associated with the event to a display of a teleoperator computing device.

Abstract: Techniques for generating maps without shadows are discussed herein. A plurality of images can be captured by a vehicle traversing an environment representing various perspectives and/or lighting conditions in the environment. A shadow within an image can be identified by a machine learning algorithm trained to detect shadows in images and/or by projecting the image onto a three-dimensional (3D) map of the environment and identifying candidate shadow regions based on the geometry of the 3D map and the location of the light source. Shadows can be removed or minimized by utilizing blending or duplicating techniques. Color information and reflectance information can be added to the 3D map to generate a textured 3D map. A textured 3D map without shadows can be used to simulate the environment under different lighting conditions.

Abstract: Various embodiments relate generally to autonomous vehicles and associated mechanical, electrical and electronic hardware, computer software and systems, and wired and wireless network communications to provide an autonomous vehicle fleet as a service. More specifically, systems, devices, and methods are configured to simulate navigation of autonomous vehicles in various simulated environments. In particular, a method may include receiving data representing characteristics of a dynamic object, calculating a classification of a dynamic object to identify a classified dynamic object, identifying data representing dynamic-related characteristics associated with the classified dynamic object, forming a data model of the classified dynamic object, simulating a predicted range of motion of the classified dynamic object in a simulated environment to form a simulated dynamic object, and simulating a predicted response of a data representation of a simulated autonomous vehicle.

Abstract: A system, an apparatus or a process may be configured to implement an application that applies artificial intelligence and/or machine-learning techniques to predict an optimal course of action (or a subset of courses of action) for an autonomous vehicle system (e.g., one or more of a planner of an autonomous vehicle, a simulator, or a teleoperator) to undertake based on suboptimal autonomous vehicle performance and/or changes in detected sensor data (e.g., new buildings, landmarks, potholes, etc.). The application may determine a subset of trajectories based on a number of decisions and interactions when resolving an anomaly due to an event or condition. The application may use aggregated sensor data from multiple autonomous vehicles to assist in identifying events or conditions that might affect travel (e.g., using semantic scene classification). An optimal subset of trajectories may be formed based on recommendations responsive to semantic changes (e.g., road construction).

Abstract: Vehicle ride can be improved using perception based suspension control on a vehicle. A computing system on the vehicle may receive a map of a road surface. The computing system may identify a trajectory of the vehicle relative to the road surface, and determine if a deformation exists in a track of one of the vehicle tires. The deformation may include a depression and/or a raised portion from the road surface. The computing system may calculate an adjustment to make to one or more suspension system components to negate or minimize the effects of the vehicle traveling over the deformation or roughness of the road, and may send an instruction to adjust the suspension components accordingly. Additionally, or alternatively, the computing system may determine that the deformation may be avoidable, in whole or in part, and may cause the vehicle to maneuver around the deformation.