Abstract: The technology disclosed teaches a system and methods for providing driver assistance alerts to a driver using an end-to-end artificially-intelligent advanced driver assistance system. The technology disclosed further includes receiving environmental data for a sequence of driving states including at least video from a camera, returns from an optical sensor, and location data from a GNSS receiver, wherein the camera, the optical sensor, and the GNSS receiver are coupled to a processor carried by a vehicle, processing the environmental data as input to an end-to-end neural network, wherein the end-to-end neural network is trained to generate prescriptive steering and speed control actions in response to a present driving state, analyzing hidden layer data and output data from the end-to-end neural network to estimate collision avoidance data, and presenting, to the driver, a user interface including driver assistance alerts based on the collision avoidance data.

Abstract: The technology disclosed comprises systems and methods for the training and validation for an end-to-end neural-network learning model configured for autonomous driving. The end-to-end neural-network learning model is trained using human-operated driving demonstration data to curate training data examples of driving tasks and driving routes, as well as curation of particularly difficult driving tasks. The determination of difficulty of driving tasks uses a combination of entropy measurements in training, evaluation of model performance, and manual labeling. The conditional imitation learning model can be configured as a memory-augmented transformer model that leverages a memory-cached frame buffer to access previous states in a driving trajectory. The disclosed technology can be applied to passenger vehicles or autonomous robots for delivery tasks.

Abstract: The technology disclosed teaches a system and methods for providing driver assistance alerts to a driver using an end-to-end artificially-intelligent advanced driver assistance system. The technology disclosed further includes receiving environmental data for a sequence of driving states including at least video from a camera, returns from an optical sensor, and location data from a GNSS receiver, wherein the camera, the optical sensor, and the GNSS receiver are coupled to a processor carried by a vehicle, processing the environmental data as input to an end-to-end neural network, wherein the end-to-end neural network is trained to generate prescriptive steering and speed control actions in response to a present driving state, analyzing hidden layer data and output data from the end-to-end neural network to estimate collision avoidance data, and presenting, to the driver, a user interface including driver assistance alerts based on the collision avoidance data.