Abstract: A vehicle for collecting image data of a target object for generating a classifier. The vehicle includes an image sensor and an electronic processor. The electronic processor is configured to determine a plurality of potential trajectories of the vehicle, determine, for each of the plurality of potential trajectories of the vehicle, a total number of views including the target object that would be captured by the image sensor as the vehicle moved along the respective trajectory, and determine a key trajectory of the vehicle from the plurality of potential trajectories based on the total number of views including the target of the key trajectory.

Abstract: A method and system are disclosed for monitoring passengers in within a cabin of a vehicle and determining whether the passengers are engaging in abnormal behavior. The method and system uses a novel vector to robustly and numerically represent the activity of the passengers in a respective frame, which is referred to herein as an “activity vector.” Additionally, a Gaussian Mixture Model is utilized by the method and system to distinguish between normal and abnormal passenger behavior. Cluster components of the Gaussian Mixture Model are advantageously learned using an unsupervised approach in which training data is not labeled or annotated to indicate normal and abnormal passenger behavior. In this way, the Gaussian Mixture Model can be trained at a very low cost.

Abstract: Identifying key frames of a video for use in training a machine learning model is provided. Object detection is performed to identify frames of a video including target classes of objects of interest. Feature extraction is performed on the identified frames to generate raw feature vectors. The feature vectors are compressed into lower dimension vectors. The compressed feature vectors are compressed into a plurality of clusters. The clustered compressed feature vectors are filtered to identify the key frames from each of the plurality of clusters. The key frames may be provided as a representative data set of the video.

Abstract: A computer-implemented method includes communicating with a remote network, capturing one or more images or video recordings, receiving one or more images from the camera, wherein the one or more images from the camera is a high resolution image (HRI), compressing the HRI via a compression model to a low resolution image (LRI), encoding the LRI to obtain an encoded LRI, sending the encoded LRI to a super resolution model at the remote network, decoding the encoded LRI at the remote network to obtain a reconstructed HRI, and outputting the reconstructed HRI.

Abstract: A system and method for generating a robust pseudo-label dataset where a labeled source dataset (e.g., video) may be received and used to train a teacher neural network. A pseudo-labeled dataset may then be output from the teacher network and provided to a similarity-aware weighted box fusion (SWBF) algorithm along with an unlabeled dataset. A robust pseudo-label dataset may then be generated by the SWBF algorithm from and used to train a student neural network. The student neural network may also be further tuned using the labeled source dataset. Lastly, the teacher neural network may be replaced using the student neural network. It is contemplated the system and method may be iteratively repeated.

Abstract: A vehicle for collecting image data of a target object for generating a classifier. The vehicle includes an image sensor and an electronic processor. The electronic processor is configured to determine a plurality of potential trajectories of the vehicle, determine, for each of the plurality of potential trajectories of the vehicle, a total number of views including the target object that would be captured by the image sensor as the vehicle moved along the respective trajectory, and determine a key trajectory of the vehicle from the plurality of potential trajectories based on the total number of views including the target of the key trajectory.

Abstract: A method and system is disclosed for creating a machine learning model that is reconfigurable. A fixed parameter model is created to include fixed feature values obtained during a training process for the machine learning model. The fixed parameter model may include a fixed base classifier used by the machine learning model to classify objects detected by an ultra-sonic system within a vicinity of a vehicle. A configurable parameter model may be created to include feature values that are different from the fixed feature values, the configurable parameter model including a modified base classifier. A vehicle controller may receive and update the fixed parameter model with the configurable parameter model. The machine learning model may be updated to use the configurable parameter model to classify the objects detected by the ultra-sonic system.

Abstract: A method and system is disclosed for tuning a machine learning classifier. An object class requirement may be provided and include rank thresholds. The object class requirements may also include a range goal that defines a minimum distance from the object the machine learning algorithm should not provide false positive results. A base classifier may be trained using a weighted loss function that includes one or more weight values that are computed using the one or more object class requirements. An output of the weighted loss function may be evaluated using an objective function which may be established using the one or more object class requirements. The one or more weights may also be re-tuned using the weighted loss function if the output of the weighted loss function does not converge within a predetermined loss threshold.

Abstract: A system and method is disclosed for classifying one or more objects within a vicinity of a vehicle. Ultra-sonic data may be received from a plurality of ultra-sonic sensors and may comprise echo signals indicating one or more objects that are proximally located within a vicinity of a vehicle. One or more features may be calculated from the ultra-sonic data using one or more signal processing algorithms unique to each of the plurality of ultra-sonic sensors. The one more features may be combined using a second-level signal processing algorithm to determine geometric relations for the one or more objects. The one or more features may then be statistically aggregated at an object level. The one or more objects may then be classified using a machine learning algorithm that compares an input of each of the one or more features to a trained classifier.

Abstract: A method and system are disclosed for monitoring passengers in within a cabin of a vehicle and determining whether the passengers are engaging in abnormal behavior. The method and system uses a novel vector to robustly and numerically represent the activity of the passengers in a respective frame, which is referred to herein as an “activity vector.” Additionally, a Gaussian Mixture Model is utilized by the method and system to distinguish between normal and abnormal passenger behavior. Cluster components of the Gaussian Mixture Model are advantageously learned using an unsupervised approach in which training data is not labeled or annotated to indicate normal and abnormal passenger behavior. In this way, the Gaussian Mixture Model can be trained at a very low cost.

Abstract: A method and system are disclosed for monitoring passengers in within a cabin of a vehicle and determining whether the passengers are engaging in abnormal behavior. The method and system uses a novel vector to robustly and numerically represent the activity of the passengers in a respective frame, which is referred to herein as an “activity vector.” Additionally, a Gaussian Mixture Model is utilized by the method and system to distinguish between normal and abnormal passenger behavior. Cluster components of the Gaussian Mixture Model are advantageously learned using an unsupervised approach in which training data is not labeled or annotated to indicate normal and abnormal passenger behavior. In this way, the Gaussian Mixture Model can be trained at a very low cost.

Abstract: A method and system are disclosed for monitoring passengers in within a cabin of a vehicle and determining whether the passengers are engaging in abnormal behavior. The method and system uses a novel vector to robustly and numerically represent the activity of the passengers in a respective frame, which is referred to herein as an “activity vector.” Additionally, a Gaussian Mixture Model is utilized by the method and system to distinguish between normal and abnormal passenger behavior. Cluster components of the Gaussian Mixture Model are advantageously learned using an unsupervised approach in which training data is not labeled or annotated to indicate normal and abnormal passenger behavior. In this way, the Gaussian Mixture Model can be trained at a very low cost.

Abstract: A search framework for finding effective architectural building blocks for deep convolutional neural networks is disclosed. The search framework described herein utilizes a building block which incorporates branch and skip connections. At least some operations of the architecture of the building block are undefined and treated as hyperparameters which can be automatically selected and optimized for a particular task. The search framework uses random search over the reduced search space to generate a building block and repeats the building block multiple times to create a deep convolutional neural network.

Abstract: A search framework for finding effective architectural building blocks for deep convolutional neural networks is disclosed. The search framework described herein utilizes a building block which incorporates branch and skip connections. At least some operations of the architecture of the building block are undefined and treated as hyperparameters which can be automatically selected and optimized for a particular task. The search framework uses random search over the reduced search space to generate a building block and repeats the building block multiple times to create a deep convolutional neural network.