Abstract: Devices, systems and methods for fusing scenes from real-time image feeds from on-vehicle cameras in autonomous vehicles to reduce redundancy of the information processed to enable real-time autonomous operation are described. One example of a method for improving perception in an autonomous vehicle includes receiving a plurality of cropped images, wherein each of the plurality of cropped images comprises one or more bounding boxes that correspond to one or more objects in a corresponding cropped image; identifying, based on the metadata in the plurality of cropped images, a first bounding box in a first cropped image and a second bounding box in a second cropped image, wherein the first and second bounding boxes correspond to a common object; and fusing the metadata corresponding to the common object from the first cropped image and the second cropped image to generate an output result for the common object.

Abstract: Techniques are described for managing temperature in an autonomous vehicle. An exemplary method comprises performing autonomous driving operations that operate the autonomous vehicle in an autonomous mode, receiving one or more messages from a temperature sensor associated with an electrical device located on or in the autonomous vehicle while the autonomous vehicle is operated in the autonomous mode, determining a cooling technique to reduce the temperature of electrical device, and performing the cooling technique.

Abstract: Techniques are described to enable a vehicle, such as an autonomous vehicle, to steer and/or apply brakes on a road when a failure condition occurs. An example method for autonomous driving operation includes receiving a reduced set of location information that describes a location of the autonomous vehicle on a road; receiving a reduced set of trajectory information where the autonomous vehicle is expected to be driven; determining a driving path information where the autonomous vehicle is expected to be driven; and in response to determining an occurrence of a fault condition: sending a first instruction to cause the autonomous vehicle to steer the autonomous vehicle using at least the driving path information and the reduced set of location information, and sending a second instruction to cause the autonomous vehicle to apply brakes.

Abstract: Disclosed are devices, systems and methods for the operational testing on autonomous vehicles. One exemplary method includes configuring a primary vehicular model with an algorithm, calculating one or more trajectories for each of one or more secondary vehicular models that exclude the algorithm, configuring the one or more secondary vehicular models with a corresponding trajectory of the one or more trajectories, generating an updated algorithm based on running a simulation of the primary vehicular model interacting with the one or more secondary vehicular models that conform to the corresponding trajectory in the simulation, and integrating the updated algorithm into an algorithmic unit of the autonomous vehicle.

Abstract: Described are devices, systems and methods for managing a supplemental brake control system in autonomous vehicles. In some aspects, a supplemental brake management system includes brake control hardware and software that operates with a sensing mechanism for determining the brake operational status and a control mechanism for activating the supplemental brake control in an autonomous vehicle, which can be implemented in addition to the vehicle's primary brake control system.

Abstract: Image processing techniques are described to obtain an image from a camera located on a vehicle while the vehicle is being driven, cropping a portion of the obtained image corresponding to a region of interest, detecting an object in the cropped portion, adding a bounding box around the detected object, determining position(s) of reference point(s) on the bounding box, and determining a location of the detected object in a spatial region where the vehicle is being driven based on the determined one or more positions of the second set of one or more reference points on the bounding box.

Abstract: Disclosed are distributed computing systems and methods for controlling multiple autonomous control modules and subsystems in an autonomous vehicle. In some aspects of the disclosed technology, a computing architecture for an autonomous vehicle includes distributing the complexity of autonomous vehicle operation, thereby avoiding the use of a single high-performance computing system and enabling off-the-shelf components to be use more readily and reducing system failure rates.

Abstract: Technique for performing camera calibration on a vehicle is disclosed. A method of performing camera calibration includes emitting, by a laser emitter located on a vehicle and pointed towards a road, a first laser pulse group towards a first location on a road and a second laser pulse group towards a second location on the road, where each laser pulse group includes one or more laser spots. For each laser pulse group: a first set of distances are calculated from a location of a laser receiver to the one or more laser spots, and a second set of distances are determined from an image obtained from a camera, where the second set of distances are from a location of the camera to the one or more laser spots. The method also includes determining two camera calibration parameters of the camera by solving two equations.

Abstract: Disclosed are devices, systems and methods for the operational testing on autonomous vehicles. One exemplary method includes configuring a primary vehicular model with an algorithm, calculating one or more trajectories for each of one or more secondary vehicular models that exclude the algorithm, configuring the one or more secondary vehicular models with a corresponding trajectory of the one or more trajectories, generating an updated algorithm based on running a simulation of the primary vehicular model interacting with the one or more secondary vehicular models that conform to the corresponding trajectory in the simulation, and integrating the updated algorithm into an algorithmic unit of the autonomous vehicle.

Abstract: A system installed in a vehicle includes a first group of sensing devices configured to allow a first level of autonomous operation of the vehicle; a second group of sensing devices configured to allow a second level of autonomous operation of the vehicle, the second group of sensing devices including primary sensing devices and backup sensing devices; a third group of sensing devices configured to allow the vehicle to perform a safe stop maneuver; and a control element communicatively coupled to the first group of sensing devices, the second group of sensing devices, and the third group of sensing devices. The control element is configured to: receive data from at least one of the first group, the second group, or the third group of sensing devices, and provide a control signal to a sensing device based on categorization information indicating a group to which the sensing device belongs.

Abstract: Described are devices, systems and methods for managing a supplemental brake control system in autonomous vehicles. In some aspects, a supplemental brake management system includes brake control hardware and software that operates with a sensing mechanism for determining the brake operational status and a control mechanism for activating the supplemental brake control in an autonomous vehicle, which can be implemented in addition to the vehicle's primary brake control system.

Abstract: Techniques are described to enable a vehicle, such as an autonomous vehicle, to steer and/or apply brakes on a road when a failure condition occurs. An example method for autonomous driving operation includes receiving a reduced set of location information that describes a location of the autonomous vehicle on a road; receiving a reduced set of trajectory information where the autonomous vehicle is expected to be driven; determining a driving path information where the autonomous vehicle is expected to be driven; and in response to determining an occurrence of a fault condition: sending a first instruction to cause the autonomous vehicle to steer the autonomous vehicle using at least the driving path information and the reduced set of location information, and sending a second instruction to cause the autonomous vehicle to apply brakes.

Abstract: Image processing techniques are described to obtain an image from a camera located on a vehicle while the vehicle is being driven, cropping a portion of the obtained image corresponding to a region of interest, detecting an object in the cropped portion, adding a bounding box around the detected object, determining position(s) of reference point(s) on the bounding box, and determining a location of the detected object in a spatial region where the vehicle is being driven based on the determined one or more positions of the second set of one or more reference points on the bounding box.

Abstract: Techniques are described for managing temperature in an autonomous vehicle. An exemplary method comprises performing autonomous driving operations that operate the autonomous vehicle in an autonomous mode, receiving one or more messages from a temperature sensor associated with an electrical device located on or in the autonomous vehicle while the autonomous vehicle is operated in the autonomous mode, determining a cooling technique to reduce the temperature of electrical device, and performing the cooling technique.

Abstract: Disclosed are distributed computing systems and methods for controlling multiple autonomous control modules and subsystems in an autonomous vehicle. In some aspects of the disclosed technology, a computing architecture for an autonomous vehicle includes distributing the complexity of autonomous vehicle operation, thereby avoiding the use of a single high-performance computing system and enabling off-the-shelf components to be use more readily and reducing system failure rates.

Abstract: A system comprises a headlight mounted on an autonomous vehicle. The headlight is configured to illuminate at least a portion of a road the autonomous vehicle is on. The system further comprises a control device associated with the autonomous vehicle. The processor obtains information about an environment around the autonomous vehicle. The processor determines that at least a portion of the road should be illuminated if the information indicates that an illumination level of the portion of the road is less than a threshold illumination level. The processor adjusts the headlight to illuminate at least the portion of the road in response to determining that at least the portion of the road should be illuminated.

Abstract: Techniques are described for estimating road friction between a road and tires of a vehicle. A method includes receiving, from a temperature sensor on a vehicle, a temperature value that indicates a temperature of an environment in which a vehicle is operated, determining a first range of friction values that quantify a friction between a road and tires of a vehicle based on a function of the temperature value and an extent of precipitation in a region that indicate a hazardous driving condition, obtaining, from the first range of friction values, a value that quantifies the friction between the road and the tires of the vehicle, where the value is obtained based on a driving related behavior of the vehicle, and causing the vehicle to operate on the road based on the value obtained from the first range of friction values.

Abstract: Techniques are described for transitioning control of a steering system from an autonomous mode in a vehicle to a driver-controlled mode where the driver can control the steering wheel of the steering system. A method includes receiving values that describe an amount of torque and a direction of torque in response to a torque applied to a steering wheel of a steering system operated in an autonomous mode, determining that the values are either greater than or equal to a threshold value or are less than or equal to a negative of the threshold value, determining that the values are measured over a period of time greater than or equal to a pre-determined amount of time, and transitioning the steering system from being operated in the autonomous mode to being operated in a driver-controlled mode in which the steering system is under manual control.

Abstract: A system includes an autonomous vehicle and a control device associated with the autonomous vehicle. The control device obtains a plurality of sensor data captured by sensors of the autonomous vehicle. The control device determines a plurality of rainfall levels based on the sensor data. Each rainfall level is captured by a different sensor. the control device determines an aggregated rainfall level in a particular time period by combining the plurality of rainfall levels determined during the particular time period. The control device selects a particular object detection algorithm for detecting objects by at least one sensor. The particular object detection algorithm is configured to filter at least a portion of interference caused by the aggregated rainfall level in the sensor data. The control device causes the particular object detection algorithm to be implemented for the at least one sensor.

Abstract: A system method for occluding contour detection using a fully convolutional neural network is disclosed. A particular embodiment includes: receiving an input image; producing a feature map from the input image by semantic segmentation; learning an array of upscaling filters to upscale the feature map into a final dense feature map of a desired size; applying the array of upscaling filters to the feature map to produce contour information of objects and object instances detected in the input image; and applying the contour information onto the input image.