Abstract: The described aspects and implementations enable efficient calibration of a sensing system of a vehicle. In one implementation, disclosed is a method and a system to perform the method, the system including the sensing system configured to collect sensing data, characterizing an environment of the vehicle, the sensing data including infrared sensing data. The system further includes a data processing system operatively coupled to the sensing system and configured to process the sensing data using a classifier machine-learning model to obtain a classification of one or more vulnerable road users present in the environment of the vehicle.

Abstract: A computer-implemented method for generating a unified machine learning model using a neural network on a data processing apparatus is described. The method includes the data processing apparatus determining respective learning targets for each of a plurality of object verticals. The data processing apparatus determines the respective learning targets based on two or more embedding outputs of the neural network. The method also includes the data processing apparatus training the neural network to identify data associated with each of the plurality of object verticals. The data processing apparatus trains the neural network using the respective learning targets and based on a first loss function. The data processing apparatus uses the neural network trained to generate a unified machine learning model, where the model is configured to identify particular data items associated with each of the plurality of object verticals.

Abstract: Systems and methods are disclosed to provide an Advanced Warning System (AWS) for a driver of a vehicle, by capturing traffic scene types from a single camera video; generating real-time monocular SFM and 2D object detection from the single camera video; detecting a ground plane from the real-time monocular SFM and the 2D object detection; performing dense 3D estimation from the real-time monocular SFM and the 2D object detection; generating a joint 3D object localization from the ground plane and dense 3D estimation; and communicating a situation that requires caution to the driver.

Abstract: Systems and methods are disclosed to provide an Advanced Warning System (AWS) for a driver of a vehicle, by capturing traffic scene types from a single camera video; generating real-time monocular SFM and 2D object detection from the single camera video; detecting a ground plane from the real-time monocular SFM and the 2D object detection; performing dense 3D estimation from the real-time monocular SFM and the 2D object detection; generating a joint 3D object localization from the ground plane and dense 3D estimation; and communicating a situation that requires caution to the driver.