Abstract: A system comprises an autonomous vehicle (AV) and a control device operably coupled with the AV. The control device detects a series of events within a threshold period of time, where a number of series of events in the series of events is above a threshold number. The series of events taken in the aggregate within the threshold period of time deviates from a normalcy mode. The normalcy mode comprises events that are expected to the encountered by the AV. The control device determines whether the series of events corresponds to a malicious event, where the malicious event indicates tampering with the AV. In response to determining that the series of events corresponds to the malicious event, the series of events are escalated to be addressed.

Abstract: A system and method for determining car to lane distance is provided. In one aspect, the system includes a camera configured to generate an image, a processor, and a computer-readable memory. The processor is configured to receive the image from the camera, generate a wheel segmentation map representative of one or more wheels detected in the image, and generate a lane segmentation map representative of one or more lanes detected in the image. For at least one of the wheels in the wheel segmentation map, the processor is also configured to determine a distance between the wheel and at least one nearby lane in the lane segmentation map. The processor is further configured to determine a distance between a vehicle in the image and the lane based on the distance between the wheel and the lane.

Abstract: Described are devices, systems and methods for managing a supplemental brake control system in autonomous vehicles. In some aspects, a supplemental brake management system includes brake control hardware and software that operates with a sensing mechanism for determining the brake operational status and a control mechanism for activating the supplemental brake control in an autonomous vehicle, which can be implemented in addition to the vehicle's primary brake control system.

Abstract: Devices, systems and methods for using system-level malfunction indicators to monitor the operation and resiliency of the autonomous driving system components are described. One example of a method for diagnosing a fault in a component of an autonomous vehicle includes receiving, from an electrical sub-component of the component, an electrical signal, receiving, from an electronic sub-component of the component, a message, and determining, based on the electrical signal and the message, an operational status of the component.

Abstract: Disclosed are devices and systems for an optimized sensor layout for an autonomous or semi-autonomous vehicle. In one aspect, the system includes a vehicle capable of semi-autonomous or autonomous operation. A plurality of forward-facing cameras is coupled to the vehicle and configured to have a field of view in front of the vehicle. At least three forward-facing cameras of the plurality of forward-facing cameras have different focal lengths. A right-side camera is coupled to the right side of the vehicle, the right-side camera configured to have a field of view to the right of the vehicle. A left-side camera is coupled to the left side of the vehicle, the left-side camera is configured to have a field of view to the left of the vehicle.

Abstract: A system and method for three-dimensional (3D) object detection is disclosed. A particular embodiment can be configured to: receive image data from a camera associated with a vehicle, the image data representing an image frame; use a machine learning module to determine at least one pixel coordinate of a two-dimensional (2D) bounding box around an object in the image frame; use the machine learning module to determine at least one vertex of a three-dimensional (3D) bounding box around the object; obtain camera calibration information associated with the camera; and determine 3D attributes of the object using the 3D bounding box and the camera calibration information.

Abstract: Techniques are described to enable a vehicle, such as an autonomous vehicle, to steer and/or apply brakes on a road when a failure condition occurs. An example method for autonomous driving operation includes receiving a reduced set of location information that describes a location of the autonomous vehicle on a road; receiving a reduced set of trajectory information where the autonomous vehicle is expected to be driven; determining a driving path information where the autonomous vehicle is expected to be driven; and in response to determining an occurrence of a fault condition: sending a first instruction to cause the autonomous vehicle to steer the autonomous vehicle using at least the driving path information and the reduced set of location information, and sending a second instruction to cause the autonomous vehicle to apply brakes.

Abstract: Disclosed are devices, systems and methods for an audio assistant in an autonomous or semi-autonomous vehicle. In one aspect the informational audio assistant receives a first set of data from a vehicle sensor and identifies an object or condition using the data from the vehicle sensor. Audio is generated representative of a perceived danger of an object or condition. A second set of data from the vehicle sensor subsystem is received and the informational audio assistant determines whether an increased danger exists based on a comparison of the first set of data to the second set of data. The informational audio assistant will apply a sound profile to the generated audio based on the increased danger.

Abstract: Techniques are described to estimate orientation of one or more cameras located on a vehicle. The orientation estimation technique can include obtaining an image from a camera located on a vehicle while the vehicle is being driven on a road, determining, from a terrain map, a location of a landmark located at a distance from a location of the vehicle on the road, determining, in the image, pixel locations of the landmark, selecting one pixel location from the determined pixel locations; and calculating values that describe an orientation of the camera using at least an intrinsic matrix and a previously known extrinsic matrix of the camera, where the intrinsic matrix is characterized based on at least the one pixel location and the location of the landmark.

Abstract: A method of retrieving a map is disclosed. The method includes receiving a grid data of the map comprising lane segments, wherein the grid data includes an array of grids each associated with a list including none or at least one of the lane segments intersecting the respective grid; receiving coordinates of a location; identifying a first grid including the location based on the grid data; identifying a target grid that has an associated list including at least one of the lane segments as first lane segment; and outputting the first lane segment.

Abstract: Disclosed are methods and devices related to autonomous driving. In one aspect, a method is disclosed. The method includes determining three-dimensional bounding indicators for one or more first objects in road target information captured by a light detection and ranging (LIDAR) sensor; determining camera bounding indicators for one or more second objects in road image information captured by a camera sensor; processing the road image information to generate a camera matrix; determining projected bounding indicators from the camera matrix and the three-dimensional bounding indicators; determining, from the projected bounding indicators and the camera bounding indicators, associations between the one or more first objects and the one or more second objects to generate combined target information; and applying, by the autonomous driving system, the combined target information to produce a vehicle control signal.

Abstract: Each of a plurality of landing pads is sized and shaped to accommodate an AV. Landing pad sensor(s) are located in or around each landing pad. A control subsystem receives landing pad sensor data from the one or more landing pad sensors and receives, from a first AV traveling to a location of the plurality of landing pads, a request for an assigned landing pad in which the first AV should park. In response to this request, the control subsystem determines, based on the received landing pad sensor data, whether a first landing pad is free of obstructions that would prevent receipt of the first AV. If the first landing pad is free of obstructions, an indication is provided to the AV that the first landing pad is the assigned landing pad.

Abstract: The angle of a trailer with respect to a tow vehicle is an important parameter to the stability of the vehicle and trailer. A tow vehicle pulling a trailer in a straight line is generally more stable than when the vehicle is turning. While turning, the angle between the tow vehicle and the trailer is not a straight line but is another angle depending on how sharply the tow vehicle is turning. To safely operate a vehicle towing a trailer, for a given steering input and speed, there is a maximum angle between the tow vehicle and trailer whereby exceeding the angle causes instability and may cause the trailer or tow vehicle to roll over or jackknife. Accordingly, the angle between the trailer and tow vehicle must be determined to ensure the vehicle and trailer will continue to be in control.

Abstract: Image processing techniques are described to obtain an image from a camera located on a vehicle while the vehicle is being driven, cropping a portion of the obtained image corresponding to a region of interest, detecting an object in the cropped portion, adding a bounding box around the detected object, determining position(s) of reference point(s) on the bounding box, and determining a location of the detected object in a spatial region where the vehicle is being driven based on the determined one or more positions of the second set of one or more reference points on the bounding box.

Abstract: Techniques are described for managing temperature in an autonomous vehicle. An exemplary method comprises performing autonomous driving operations that operate the autonomous vehicle in an autonomous mode, receiving one or more messages from a temperature sensor associated with an electrical device located on or in the autonomous vehicle while the autonomous vehicle is operated in the autonomous mode, determining a cooling technique to reduce the temperature of electrical device, and performing the cooling technique.

Abstract: Devices, systems and methods for operating a rear-facing perception system for vehicles are described. An exemplary rear-facing perception system contains two corner units and a center unit, with each of the two corner units and the center unit including a camera module and a dual-band transceiver. A method for operating the rear-facing perception system includes pairing with a control unit by communicating, using the dual-band transceiver, over at least a first frequency band, transmitting a first trigger signal to the two corner units over a second frequency band non-overlapping with the first frequency band, and switching to an active mode. In an example, the first trigger signal causes the two corner units to switch to the active mode, which includes orienting the camera modules on the center unit and the two corner units to provide an unobstructed view of an area around a rear of the vehicle.

Abstract: Disclosed are distributed computing systems and methods for controlling multiple autonomous control modules and subsystems in an autonomous vehicle. In some aspects of the disclosed technology, a computing architecture for an autonomous vehicle includes distributing the complexity of autonomous vehicle operation, thereby avoiding the use of a single high-performance computing system and enabling off-the-shelf components to be use more readily and reducing system failure rates.

Abstract: Techniques are described for measuring angle and/or orientation of a rear drivable section (e.g., a trailer unit of a semi-trailer truck) relative to a front drivable section (e.g., a tractor unit of the semi-trailer truck) using an example rotary encoder assembly. The example rotary encoder assembly comprises a base surface; a housing that includes a second end that is connected to the base surface and a first end that is at least partially open and is coupled to a housing cap; and a rotary encoder that is located in the housing in between the base surface and the housing cap, where the rotary encoder includes a rotatable shaft that protrudes from a first hole located in the housing cap, and where a top of the rotatable shaft located away from the rotary encoder is coupled to magnet(s).

Abstract: Devices, systems, and methods for constant and reliable power distribution, using a redundant power bridge battery architecture, in autonomous vehicles are described. An example method includes determining that each of a plurality of sensors is operating within in a nominal range for the respective sensor, and distributing, based on the determining, power from at least one alternating current (AC) power source or at least one direct current (DC) power source to at least one power distribution unit (PDU), wherein a first power bridge is coupled to the at least one AC power source and the at least one DC power source and a second power bridge is coupled to the at least one DC power source and the at least one PDU, and wherein the plurality of sensors is used to monitor a health of the vehicle and any single point failure is detectable.