Abstract: Presented are automated driving systems and control logic for intelligent vehicle operation in transient driving conditions, methods for constructing/operating such systems, and vehicles equipped with such systems. A method for controlling an automated driving operation includes a vehicle controller receiving path plan data with location, destination, and predicted path data for a vehicle. From the received path plan data, the controller predicts an upcoming maneuver for driving the vehicle between start and goal lane segments. The vehicle controller determines a predicted route with lane segments connecting the start and goal lane segments, and segment maneuvers for moving the vehicle between the start, goal, and route lane segments. A cost value is calculated for each segment maneuver; the controller determines if a cost values exceeds a corresponding criticality value.

Abstract: An adaptive sensor control system for a vehicle includes a controller and a steerable sensor system. The controller generates a perception of the vehicle's environment, including providing at least one perception datum and an associated uncertainty factor for different areas within the perception of the environment of the vehicle. The controller also determines one or more relevance factor for the different areas within the perception of the environment. Furthermore, the controller generates control commands for steering the sensor system toward a physical space in the environment as a function of the uncertainty factor and one or more relevance factors. Accordingly, the sensor system obtains updated sensor input for the physical space to update the perception datum and the associated uncertainty factor for the physical space.

Abstract: Technical solutions are described for controlling an automated driving system of a vehicle. An example method includes computing a complexity metric of an upcoming region along a route that the vehicle is traveling along. The method further includes, in response to the complexity metric being below a predetermined low-complexity threshold, determining a trajectory for the vehicle to travel in the upcoming region using a computing system of the vehicle. Further, the method includes in response to the complexity metric being above a predetermined high-complexity threshold, instructing an external computing system to determine the trajectory for the vehicle to travel in the upcoming region. If the trajectory cannot be determined by the external computing system a minimal risk condition maneuver of the vehicle is performed.

Abstract: Technical solutions are described for vehicle collision prevention for a vehicle when the vehicle is in a parked condition. An example method includes performing a stationary safety monitoring when the vehicle is in parked condition. The stationary safety monitoring includes detecting presence of a moving object within a predetermined region from the vehicle. Further, the method includes, in response to detecting the moving object in the predetermined region initiating a notification for the moving object to prevent collision with the vehicle.

Abstract: The present application generally relates to a method and apparatus for generating an action policy for controlling an autonomous vehicle. In particular, the system performs a deep learning algorithm in order to determine the action policy and an automatically generated curriculum system to determine a number of increasingly difficult tasks in order to refine the action policy.

Abstract: A method of updating an identification algorithm of a vehicle includes sensing an image and drawing boundary boxes in the image. The algorithm attempts to identify an object-of-interest within each respective boundary box. The algorithm also attempts to identify a component of the object-of-interest within each respective boundary box, and if component is identified, calculates an excluded amount of a component boundary that is outside an object boundary. When the excluded amount is greater than a coverage threshold, the algorithm communicates the image to a processing center, which may identify a previously un-identified the object-of-interest in the image. The processing center may add the image to a training set of images to define a revised training set of images, and retrain the identification algorithm using the revised training set of images. The updated identification algorithm may then be uploaded onto the vehicle.

Abstract: A system and method for generating a range image using sparse depth data is disclosed. The method includes receiving, by a controller, image data of a scene. The image data includes a first set of pixels. The method also includes receiving, by the controller, a sparse depth data of the scene. The sparse depth data includes a second set of pixels, and the number of the second set of pixels is less than the number of first set of pixels. The method also includes combining the image data and the sparse depth data into a combined data. The method also includes generating a range image using the combined data.

Abstract: Systems and methods are provided for controlling an autonomous vehicle (AV). A map generator module processes sensor data to generate a world representation of a particular driving scenario (PDS). A scene understanding module (SUM) processes navigation route data, position information and a feature map to define an autonomous driving task (ADT), and decomposes the ADT into a sequence of sub-tasks. The SUM selects a particular combination of sensorimotor primitive modules (SPMs) to be enabled and executed for the PDS. Each one of the SPMs addresses a sub-task in the sequence. A primitive processor module executes the particular combination of the SPMs such that each generates a vehicle trajectory and speed (VTS) profile. A selected one of the VTS profiles is then processed to generate the control signals, which are then processed at a low-level controller to generate commands that control one or more of actuators of the AV.

Abstract: Systems and method are provided for controlling a vehicle.

Abstract: Systems and methods are provided for end-to-end learning of commands for controlling an autonomous vehicle. A pre-processor pre-processes image data acquired by sensors at a current time step (CTS) to generate pre-processed image data that is concatenated with additional input(s) (e.g., a segmentation map and/or optical flow map) to generate a dynamic scene output. A convolutional neural network (CNN) processes the dynamic scene output to generate a feature map that includes extracted spatial features that are concatenated with vehicle kinematics to generate a spatial context feature vector. An LSTM network processes, during the (CTS), the spatial context feature vector at the (CTS) and one or more previous LSTM outputs at corresponding previous time steps to generate an encoded temporal context vector at the (CTS). The fully connected layer processes the encoded temporal context vector to learn control command(s) (e.g., steering angle, acceleration rate and/or a brake rate control commands).

Abstract: Systems and methods are provided that employ spatial and temporal attention-based deep reinforcement learning of hierarchical lane-change policies for controlling an autonomous vehicle. An actor-critic network architecture includes an actor network that process image data received from an environment to learn the lane-change policies as a set of hierarchical actions, and a critic network that evaluates the lane-change policies to calculate loss and gradients to predict an action-value function (Q) that is used to drive learning and update parameters of the lane-change policies. The actor-critic network architecture implements a spatial attention module to select relevant regions in the image data that are of importance, and a temporal attention module to learn temporal attention weights to be applied to past frames of image data to indicate relative importance in deciding which lane-change policy to select.

Abstract: A method for controlling an operating vehicle includes: (a) determining, via a controller, a confidence level that the light of the other vehicle is ON based on images captured by a camera of the operating vehicle; and (b) controlling, via the controller, an alarm of the operating vehicle based on the confidence level that the light of the other vehicle is ON.

Abstract: An electric power system includes an energy recovery system that is operable to convert kinetic energy into electric energy at a first voltage. A primary energy storage device is electrically connected to the energy recovery system at the first voltage. A first voltage autonomous driving system load is disposed in a parallel circuit with the energy recovery system and the primary energy storage device. A bi-directional DC-DC converter is electrically connected to the energy recovery system and the primary energy storage device for converting the electric energy between the first voltage and a second voltage. A secondary energy storage device is electrically connected to the bi-directional DC-DC converter at the second voltage. A second voltage autonomous driving system load is disposed in a parallel circuit with the secondary energy storage device.

Abstract: Systems and methods are provided for controlling a vehicle. Control signals are generated at a high-level controller based on one or more sources of input data, comprising at least one of: sensors that provide sensor output information, map data and goals. The high-level controller comprises first controller modules comprising: an input processing module, a projection module, a memories module, a world model module, and a decision processing module that comprises a control model executor module. The control signals are processed at a low-level controller to generate commands that control a plurality of vehicle actuators of the vehicle in accordance with the control signals to execute one or more scheduled actions to be performed to automate driving tasks.

Abstract: Described herein are systems, methods, and computer-readable media for generating and training a high precision low bit convolutional neural network (CNN). A filter of each convolutional layer of the CNN is approximated using one or more binary filters and a real-valued activation function is approximated using a linear combination of binary activations. More specifically, a non-1×1 filter (e.g., a k×k filter, where k>1) is approximated using a scaled binary filter and a 1×1 filter is approximated using a linear combination of binary filters. Thus, a different strategy is employed for approximating different weights (e.g., 1×1 filter vs. a non-1×1 filter). In this manner, convolutions performed in convolutional layer(s) of the high precision low bit CNN become binary convolutions that yield a lower computational cost while still maintaining a high performance (e.g., a high accuracy).

Abstract: Systems and methods are provided autonomous driving policy generation. The system can include a set of autonomous driver agents, and a driving policy generation module that includes a set of driving policy learner modules for generating and improving policies based on the collective experiences collected by the driver agents. The driver agents can collect driving experiences to create a knowledge base. The driving policy learner modules can process the collective driving experiences to extract driving policies. The driver agents can be trained via the driving policy learner modules in a parallel and distributed manner to find novel and efficient driving policies and behaviors faster and more efficiently. Parallel and distributed learning can enable accelerated training of multiple autonomous intelligent driver agents.

Abstract: Systems, methods and controllers are provided for controlling autonomous vehicles. The systems, methods and controllers implement autonomous driver agents and a policy server for serving policies to autonomous driver agents for controlling an autonomous vehicle. The system can include a set of autonomous driver agents, an experience memory that stores experiences captured by the driver agents, a set of driving policy learner modules for generating and improving policies based on the collective experiences stored in the experience memory, and a policy server that serves parameters for policies to the driver agents. The driver agents can collect driving experiences to create a knowledge base that is stored in an experience memory. The driving policy learner modules can process the collective driving experiences to extract driving policies.

Abstract: A method in an autonomous vehicle (AV) is provided. The method includes determining, from vehicle sensor data and road geometry data, a plurality of range measurements and obstacle velocity data; determining vehicle state data wherein the vehicle state data includes a velocity of the AV, a distance to a stop line, a distance to a midpoint of an intersection, and a distance to a goal; determining, based on the plurality of range measurements, the obstacle velocity data and the vehicle state data, a set of discrete behavior actions and a unique trajectory control action associated with each discrete behavior action; choosing a discrete behavior action and a unique trajectory control action to perform; and communicating a message to vehicle controls conveying the unique trajectory control action associated with the discrete behavior action.

Abstract: A crowdsourced virtual sensor generator is provided which could be generated by a vehicle or provided to the vehicle as, for example, a service. The crowdsourced virtual sensor generator may include, but is not limited to, a communication system configured to receive contributing vehicle sensor data from one or more contributing vehicles, a location of the one or more contributing vehicles and a target vehicle, and a processor, the processor configured to filter the received contributing vehicle sensor data based upon the location of the one or more contributing vehicles and the location of the target vehicle, aggregate the filtered contributing vehicle sensor data into at least one of a data-specific dataset and an application-specific data set, and generate a virtual sensor for the target vehicle, the virtual sensor processing the filtered and aggregated contributing vehicle sensor data to generate output data relative to the location of the target vehicle.

Abstract: Methods and systems are provided for processing attention data. In one embodiment, a method includes: receiving, by a processor, object data associated with at least one object of an exterior environment of the vehicle; receiving upcoming behavior data determined from a planned route of the vehicle; receiving gaze data sensed from an occupant of the vehicle; processing, by the processor, the object data, the upcoming behavior data, and the gaze data to determine an attention score associated with an attention of the occupant of the vehicle; and selectively generating, by the processor, signals to at least one of notify the occupant and control the vehicle based on the attention score.