Abstract: Embodiments for operational envelope detection (OED) with situational assessment are disclosed. Embodiments herein relate to an operational envelope detector that is configured to receive, as inputs, information related to sensors of the system and information related to operational design domain (ODD) requirements. The OED then compares the information related to sensors of the system to the information related to the ODD requirements, and identifies whether the system is operating within its ODD or whether a remedial action is appropriate to adjust the ODD requirements based on the current sensor information. Other embodiments are described and/or claimed.

Abstract: Among other things, we describe systems and method for improving vehicle operations using movable sensors. A vehicle can be configured with one or more sensors having the capability to be extended and/or rotated. The one or more movable sensors can be caused to move based on a determined context of the vehicle, to capture additional data associated with the environment in which the vehicle is operating.

Abstract: The subject matter described in this specification is directed to a system and techniques for operating an autonomous vehicle (AV) at a multi-way stop intersection. After detecting the AV is at a primary stopline of the multi-way stop intersection, a planned travel path though the multi-way stop intersection is obtained. If the planned travel path of the AV through the multi-way stop intersection satisfies a set of one or more clearance criteria, the AV proceeds past the primary stopline. The clearance criteria include a criterion that is satisfied in response to detecting the AV is clear to safely merge into a travel lane corresponding to the planned travel path.

Abstract: Among other things, we describe techniques for adjusting lateral clearance for a vehicle using a multi-dimensional envelope. A trajectory is generated for the vehicle. A multi-dimensional envelope is generated indicating a drivable region for the vehicle and containing the trajectory. One or more objects are identified located along or adjacent to the trajectory. At least one dimension of the generated multi-dimensional envelope is adjusted to adjust a lateral clearance between the vehicle and the identified one or more objects. A control module of the vehicle navigates the vehicle along the multi-dimensional envelope.

Abstract: Among other things, we describe techniques for estimating a speed profile for a proposed trajectory for a vehicle and operating the vehicle along the proposed trajectory according to the speed profile, including a method for: obtaining, by a planning circuit on a vehicle, a proposed trajectory for the vehicle in response to a driving scenario; obtaining, by the planning circuit, an estimated speed profile, and a confidence score, wherein the confidence score represents a similarity of the estimated speed profile to an actual speed profile that would be generated by a control circuit for the proposed trajectory; determining whether the confidence score meets a confidence threshold; and in accordance with a determination that the confidence score exceeds the confidence threshold, operating, by a control circuit on the vehicle, the vehicle along the proposed trajectory.

Abstract: Among other things, techniques are described for conditional motion predictions. The techniques include generating, by a planning circuit, a set of candidate trajectories for a vehicle based on possible macro actions by the vehicle, predicting, by the planning circuit and for at least some trajectories in the set of candidate trajectories, a response by a target vehicle to the respective trajectory and a probability of the response by the target vehicle, selecting, by the planning circuit, a trajectory from the set of candidate trajectories based at least in part on the response by the target vehicle to the trajectory, the probability of the response by the target vehicle, and characteristics of the trajectory, and operating, by a control circuit, the vehicle based on the selected trajectory.

Abstract: A method includes transmitting a first transmitted signal corresponding to a first range rate window size; receiving a first received signal; determining a first detected range rate of an object based on the first received signal; transmitting a second transmitted signal corresponding to a second range rate window size; receiving a second received signal; determining a second detected range rate of the object based on the second received signal; computing a first range rate window index based on a first range rate window index difference; in accordance with a determination that the first range rate window index meets predefined criteria, computing an estimated range rate based on the first range rate window index difference; and in accordance with a determination that the first range rate window index does not meet the predefined criteria, foregoing computing an estimated range rate based on the first range rate window index difference.

Abstract: Methods for operating a vehicle in an environment include receiving light detection and ranging (LiDAR) data from a LiDAR of the vehicle. The LiDAR data represents objects located in the environment. A dynamic occupancy grid (DOG) is generated based on a semantic map. The DOG includes multiple grid cells. Each grid cell represents a portion of the environment. For each grid cell, a probability density function is generated based on the LiDAR data. The probability density function represents a probability that the portion of the environment represented by the grid cell is occupied by an object. A time-to-collision (TTC) of the vehicle and the object less than a threshold time is determined based on the probability density function. Responsive to determining that the TTC is less than the threshold time, a control circuit of the vehicle operates the vehicle to avoid a collision of the vehicle and the object.

Abstract: Provided are methods for determination and correction of boresight shift caused by the installation of an optical layer over a camera assembly. Some methods described include performing a first calibration prior to installation of the window, performing a second calibration after installation of the window, and comparing the first and second calibrations to determine a transformation that corrects for the boresight shift. Systems and computer program products are also provided.

Abstract: In an embodiment, a method comprises: capturing, by one or more microphone arrays of a vehicle, sound signals in an environment; extracting frequency spectrum features from the sound signals; predicting, using an acoustic scene classifier and the frequency spectrum features, one or more siren signal classifications; converting the one or more siren signal classifications into one or more siren signal event detections; computing time delay of arrival estimates for the one or more detected siren signals; estimating one or more bearing angles to one or more sources of the one or more detected siren signals using the time delay of arrival estimates and a known geometry of the microphone array; and tracking, using a Bayesian filter, the one or more bearing angles. If a siren is detected, actions are performed by the vehicle depending on the location of the emergency vehicle and whether the emergency vehicle is active or inactive.

Abstract: Among other things, methods for generating maps using hyper-graph data structures are disclosed. The method can include receiving and storing data from at least one sensor of a vehicle in an environment. The method can include generating, based on the received data, a graph, having at least one node corresponding to at least one subgraph. The at least one subgraph can include subgraph nodes corresponding to geographical and/or logical positions. The subgraph nodes can be connected by subgraph edges representing spatial constraints and/or logical connections. The at least one subgraph can include contextual data classifying each of the subgraph nodes according to a property of the environment associated with the subgraph.

Abstract: A sensor data fusion system for a vehicle with multiple sensors includes a first-sensor, a second-sensor, and a controller-circuit. The first-sensor is configured to output a first-frame of data and a subsequent-frame of data indicative of objects present in a first-field-of-view. The first-frame is characterized by a first-time-stamp, the subsequent-frame of data characterized by a subsequent-time-stamp different from the first-time-stamp. The second-sensor is configured to output a second-frame of data indicative of objects present in a second-field-of-view that overlaps the first-field-of-view. The second-frame is characterized by a second-time-stamp temporally located between the first-time-stamp and the subsequent-time-stamp. The controller-circuit is configured to synthesize an interpolated-frame from the first-frame and the subsequent-frame. The interpolated-frame is characterized by an interpolated-time-stamp that corresponds to the second-time-stamp.

Abstract: Among other things, techniques for detecting objects in the environment surrounding a vehicle are described. A computer system is configured to receive a set of measurements from a sensor of a vehicle. The set of measurements includes a plurality of data points that represent a plurality of objects in a 3D space surrounding the vehicle. The system divides the 3D space into a plurality of pillars. The system then assigns each data point of the plurality of data points to a pillar in the plurality of pillars. The system generates a pseudo-image based on the plurality of pillars. The pseudo-image includes, for each pillar of the plurality of pillars, a corresponding feature representation of data points assigned to the pillar. The system detects the plurality of objects based on an analysis of the pseudo-image. The system then operates the vehicle based upon the detecting of the objects.

Abstract: The subject matter described in this specification is generally directed control architectures for an autonomous vehicle. In one example, a reference trajectory, a set of lateral constraints, and a set of speed constraints are received using a control circuit. The control circuit determines a set of steering commands based at least in part on the reference trajectory and the set of lateral constraints and a set of speed commands based at least in part on the set of speed constraints. The vehicle is navigated, using the control circuit, according to the set of steering commands and the set of speed commands.

Abstract: Provided is a silicon photomultiplier (SiPM) device and a silicon photomultiplier based LiDAR. The SiPM device includes a first sub-region and a second sub-region. In the first sub-region, the photodiode is operated with a first internal gain. In the second sub-region, the photodiode is operated with a second internal gain and the second internal gain in smaller than the first internal gain. A first anode generates current from the first sub-region in response to a low flux event, and the second anode generates current from the second sub-region in response to a high flux event. A common cathode outputs current generated from the first sub-region or the second sub-region.

Abstract: Techniques for generation of an optimal trajectory for a vehicle include receiving, using one or more processors of the vehicle, an instruction for the vehicle to travel from an initial spatiotemporal location to a destination spatiotemporal location. One or more processors are used to generate a trajectory including travel segments. The trajectory begins at the initial spatiotemporal location and terminates at the destination spatiotemporal location. Each travel segment begins at a first spatiotemporal location and terminates at a second spatiotemporal location. Each travel segment is associated with operational metrics. The operational metrics are associated with navigating the vehicle from the first spatiotemporal location to the second spatiotemporal location. Each operational metric is optimized across the travel segments to generate the trajectory.

Abstract: Methods, apparatus, and systems for session key generation for AV operation are disclosed. In an embodiment, a vehicle service subscriber system generates an entropy. The vehicle service subscriber system is associated with a vehicle service subscriber. The vehicle service subscriber system transmits a synchronization message to a vehicle service provider system associated with at least one vehicle. The synchronization message includes the entropy. The vehicle service subscriber system receives a salt from the vehicle service provider system. The vehicle service subscriber system verifies that the salt was generated using the entropy. The vehicle service subscriber system calculates session keys using the salt. The vehicle service subscriber system receives a protected message from the vehicle service provider system. The vehicle service subscriber system authenticates the protected message using the session keys. The protected message is used to provide a ride involving the at least one vehicle.

Abstract: Among other things, techniques are described for provisioning and authentication of devices in vehicles. In one aspect, a device in a vehicle establishes a communication session with a network server that manages provisioning of devices corresponding to an enterprise associated with the vehicle. The device receives instructions from the network server to generate cryptographic keys, and in response, generates a public and private key pair. The device sends, to the network server, a certificate signing request that includes the public key and an identifier of the device. In response, the device receives a digital security certificate for the device, and a security certificate of a signing certificate authority. The device authenticates the security certificate of the certificate authority using a known enterprise root certificate, and upon successful authentication, stores the device security certificate and the security certificate of the signing certificate authority.

Abstract: Provided are methods for Silicon Photomultiplier (SiPM)-based sensor for low-level fusion, which can include mitigating a Light Detection and Ranging (LiDAR) sensor processing path to provide high-confidence, low-level fusion between the camera (passive) and LiDAR (active) imaging. Systems and computer program products are also provided.

Abstract: An operating system for an automated vehicle includes a failure-detector and a controller. The failure-detector detects a component-failure on a host-vehicle. Examples of the component-failure include a flat-tire and engine trouble that reduces engine-power. The controller operates the host-vehicle based on a dynamic-model. The dynamic-model is varied based on the component-failure detected by the failure-detector.