Abstract: Systems and methods are disclosed for detecting crosswalk locations. Crosswalk locations can be detected by determining at least two painted lines on a road surface, and then combining the at least two painted lines on the road surface into a grouping of related elements. The grouping of related elements can be classified into a crosswalk (or in some embodiments a type of crosswalk) based on attributes of the grouping of related elements, where the attributes of the grouping of the elements includes a distance between the at least two painted lines, and an orientation of the grouping of related elements on the road surface.

Abstract: Systems, methods, and computer-readable media are provided for detecting a pavement marking around an autonomous vehicle, comparing the detected pavement marking with a pavement marking present in a semantic data map, determining whether a change has occurred between the detected pavement marking and the pavement marking present in the semantic data map, and updating the semantic data map based on the determining of whether the change has occurred between the detected pavement marking and the pavement marking present in the semantic data map.

Abstract: System, methods, and computer-readable media for a calibration check process of sensors on an autonomous vehicle (AV) via a drive-through environment mapped with a series of targets. The targets are used to check the calibration of the sensors on the AV as a quality check before the AV is determined fit to drive autonomously. Supervising a calibration process that collects data from the sensors on the AV based on exposure to a series of targets or augmented camera targets. The collected data may be used for extrinsic calibration aimed to determine that extrinsic parameters that define the rigid relationship between sensors are in set checker bounds.

Abstract: The subject technology is related to autonomous vehicles (AV) and, in particular, to calibration of an sensors of an AV on open roads after calibrating the sensors in an undefined training area. An example method includes calibrating a plurality of sensors of the AV based on performing a plurality of training steps of increasing complexity within the undefined environment, wherein the plurality of sensors of the AV are uncalibrated with respect to each other, determining that the AV satisfies an open road requirement to navigate an open road based on completing the plurality of training steps in the undefined environment, and operating the AV on open roads subject to at least one constraint. The method of claim 1, wherein the at least one constraint comprises a list of prohibited maneuvers that limit operation of the AV on open roads. The constraints are configured to dynamically change.

Abstract: The subject technology is related to autonomous vehicles (AV) and, in particular, to calibrating multiple sensors of an AV in an undefined training area. An example method includes instructing the AV to pilot itself in an undefined training area subject to at least one constraint, wherein the AV is instructed to pilot itself along a path until the AV has overlapped at least a portion of the path, and at a location at which the AV has overlapped at least the portion of the path, determining that first returns from a previous LIDAR scan overlaps with second returns from a subsequent LIDAR scan taken when the AV has overlapped at least the portion of the path. Initially, the AV does not include a location reference to identify locations of objects in the undefined training area and a plurality of sensors of the AV are uncalibrated with respect to each other.

Abstract: Systems and methods for collision imminent detection are provided. A method includes collecting sensor data generated by one or more sensors of a vehicle; detecting, by a fallback control system of the vehicle based on the sensor data, an imminent collision between the vehicle and an object in an environment of the vehicle using a first process different from a second process of a primary control system of the vehicle, wherein the first process and the second process are associated with at least one of a perception or a prediction; and transmitting, by the fallback control system to the primary control system, an indication of the detected imminent collision.

Abstract: Systems and methods for a vehicle to use a fallback control system orthogonal to a primary control system are provided. A method includes collecting, by a fallback control system of a vehicle, sensor data generated by one or more sensors of the vehicle; determining, by the fallback control system using a first process different from a second process of a primary control system of the vehicle, an alternative action for the vehicle based on the sensor data; and sending, by the fallback control system based on the alternative action, an instruction for modifying an action associated with the primary control system upon a faulty condition associated with the primary control system.

Abstract: A method is described and includes receiving a frame of point cloud data from at least one onboard light detection and ranging (LIDAR) sensor of a vehicle; discarding points of the received frame of point cloud data that are outside a defined geographic area around the vehicle; and, subsequent to the discarding, performing ray tracing in connection with the remaining points of the received frame of point cloud data. The method may further include characterizing an occupancy condition of each of a plurality of cells of a three-dimensional (3D) grid corresponding to the defined geographic area based on the ray tracing of the received frame of point cloud data, wherein the 3D grid corresponds to the received frame of point cloud data.

Abstract: A method is described and includes receiving an indication that a collision between a vehicle and an object is predicted; processing first sensor data obtained from a first onboard sensor of the vehicle to determine whether an actual occurrence of the predicted collision can be confirmed from the first sensor data and if not, processing second sensor data obtained from a second onboard sensor of the vehicle to determine whether the actual occurrence of the predicted collision can be confirmed from the second sensor data. If the actual occurrence of the predicted collision is confirmed from one of the first sensor data and the second sensor data, determining a severity of the collision based on the indication and the one of the first sensor data and the second sensor data; and prompting an action to be based on the determined severity of the collision.

Abstract: Disclosed are systems and methods for specifying goals and behavioral parameters for planning systems of autonomous vehicles. In some aspects, a method includes receiving, by a mission manager in an autonomous vehicle (AV), a mission from an input source of the AV, the mission comprising a request for a task that the AV is to fulfill; deconflicting the mission with one or more other missions of the AV to generate a ranked list of missions; selecting a target mission from the ranked list of missions in accordance with priorities corresponding to each mission in the ranked list of missions; generating one or more scenarios based on the target mission, the one or more scenarios comprising encoded representations of local and geometric terms to cause the target mission to be fulfilled by the AV; and dispatching the one or more scenarios to a planner layer of the AV.

Abstract: Systems, methods, and computer-readable media are provided for detecting a pavement marking around an autonomous vehicle, comparing the detected pavement marking with a pavement marking present in a semantic data map, determining whether a change has occurred between the detected pavement marking and the pavement marking present in the semantic data map, and updating the semantic data map based on the determining of whether the change has occurred between the detected pavement marking and the pavement marking present in the semantic data map.

Abstract: Systems and methods are disclosed for detecting crosswalk locations. Crosswalk locations can be detected by determining at least two painted lines on a road surface, and then combining the at least two painted lines on the road surface into a grouping of related elements. The grouping of related elements can be classified into a crosswalk (or in some embodiments a type of crosswalk) based on attributes of the grouping of related elements, where the attributes of the grouping of the elements includes a distance between the at least two painted lines, and an orientation of the grouping of related elements on the road surface.

Abstract: The disclosed technology provides solutions for enhanced road paint feature detection, for example, in an autonomous vehicle (AV) deployment. A process of the disclosed technology can include steps for receiving image data from a vehicle mounted camera, receiving height map data corresponding to a location associated with the image data, and calculating a region of interest that includes a portion of the image data determined based on the height map data. An image patch is generated by projecting the portion of image data included within the region of interest into a top-down view. The image patch is analyzed to detect one or more road paint features in the top-down view, and, in response to detecting an unlabeled road paint feature, the unlabeled road paint feature is localized based at least in part on the height map data. Systems and machine-readable media are also provided.

Abstract: Apparatus and methods are provided for using a retroflected target for calibrating environmental geometric sensing systems. In particular, apparatus and methods are provided for unstructured calibrations using a plurality of spatial sensing data acquisitions and the data correlations thereof. In various implementations, a combined LiDAR-RADAR detector is used to associate one with the other. According to one aspect of the present disclosure, a predetermined LiDAR detector is used as a reference frame for RADAR segmentation. Specifically, a LiDAR point-of-interest is conveyed to RADAR system for unstructured calibration. To that end, RADAR and LiDAR can be calibrated with one another without the need for absolute positioning.

Abstract: Systems and methods are disclosed for detecting crosswalk locations. Crosswalk locations can be detected by determining at least two painted lines on a road surface, and then combining the at least two painted lines on the road surface into a grouping of related elements. The grouping of related elements can be classified into a crosswalk (or in some embodiments a type of crosswalk) based on attributes of the grouping of related elements, where the attributes of the grouping of the elements includes a distance between the at least two painted lines, and an orientation of the grouping of related elements on the road surface.

Abstract: Systems, methods, and computer-readable media are provided for detecting a pavement marking around an autonomous vehicle, comparing the detected pavement marking with a pavement marking present in a semantic data map, determining whether a change has occurred between the detected pavement marking and the pavement marking present in the semantic data map, and updating the semantic data map based on the determining of whether the change has occurred between the detected pavement marking and the pavement marking present in the semantic data map.

Abstract: The present technology provides systems, methods, and devices that can update aspects of a map as an autonomous vehicle navigates a route, and therefore avoids the need for dispatching a special purpose mapping vehicle for these updates. As the autonomous vehicle navigates the route, data captured by at least one sensor of an autonomous vehicle can indicate an inconsistency between pre-mapped from a high-resolution sensor system describing a location on a map, and current data describing a new feature of the location. The current data can be clustered together based on a threshold spatial closeness, where the clustering describes the new feature, and semantic labels of the pre-mapped data from the high-resolution sensor system can be updated based on the new feature described by the clustered current data.

Abstract: The present technology provides systems, methods, and devices that can update aspects of a map as an autonomous vehicle navigates a route, and therefore avoids the need for dispatching a special purpose mapping vehicle for these updates. As the autonomous vehicle navigates the route, data captured by at least one sensor of an autonomous vehicle can indicate an inconsistency between pre-mapped from a high-resolution sensor system describing a location on a map, and current data describing a new feature of the location. A type of the new feature can be classified in accordance with an analysis of a structure of the current data that has been clustered together based on a threshold spatial closeness, and semantic labels of the pre-mapped data from the high-resolution sensor system can be updated based on the new feature described by the clustered current data.

Abstract: The present technology provides systems, methods, and devices that can update aspects of a map as an autonomous vehicle navigates a route, and therefore avoids the need for dispatching a special purpose mapping vehicle for these updates. As the autonomous vehicle navigates the route, data captured by at least one sensor of an autonomous vehicle can indicate an inconsistency between pre-mapped from a high-resolution sensor system describing a location on a map, and current data describing a new feature of the location. The current data can be clustered together based on a threshold spatial closeness, where the clustering describes the new feature, and semantic labels of the pre-mapped data from the high-resolution sensor system can be updated based on the new feature described by the clustered current data.

Abstract: The disclosed technology provides solutions for updating high definition maps based on low resolution map assets. In some aspects, a process of receiving a change detection relating to a change in the real world is provided. The process can include steps for receiving autonomous vehicle drive data based on the change in the real world, generating low resolution tile data based on the autonomous vehicle drive data based on the change in the real world, generating updated semantic data based on the low resolution tile data generated, and providing the updated semantic data to an autonomous vehicle to update a proximate area of the change in the real world of a base map of the autonomous vehicle. Systems and machine-readable media are also provided.