Abstract: Aspects of the present disclosure describe systems, methods and structures for classification of higher-order spatial modes using machine learning systems and methods in which the classification of high-order spatial modes emitted from a multimode optical fiber does not require indirect measurement of the complex amplitude of a light beam's electric field using interferometry or, holographic techniques via unconventional optical devices/elements, which have prohibitive cost and efficacy; classification of high-order spatial modes emitted from a multimode optical fiber is not dependent on a light beam's alignment, size, wave front (e.g. curvature, etc.

Abstract: A method is provided for model training to detect defective products. The method includes sampling training images of a product to (i) extract image portions therefrom made of a center patch and its context and (ii) black-out the center patch. The method further includes performing unsupervised back-propagation training of a Contextual Auto-Encoder (CAE) model using (i) the image portions with the blacked-out center patch as an input and, (ii) the center patch as a target output and, (iii) an image-based loss function, to obtain a trained CAE model. The method also includes sampling positive and negative center-patch-sized portions from the training images. The method additionally includes normalizing, using the trained CAE model, the positive and negative center-patch-sized portions.

Abstract: Systems and methods for diagnosing a patient condition include a medical imaging device for generating an anatomical image. A reconstructor reconstructs the anatomical image by reconstructing portions of the anatomical image to be a healthy representation of the portions and merging the portions into the anatomical image to generate a reconstructed image. A contrastor contrasts the anatomical image with the reconstructed image to generate an anomaly map indicating locations of difference between the anatomical image and the reconstructed image. An anomaly tagging device tags the locations of difference as anomalies corresponding to anatomical abnormalities in the anatomical image, and a display displays the anatomical image with tags corresponding to the anatomical abnormalities.

Abstract: A computer-implemented method and system are provided. The system includes an image capture device configured to capture image data relative to an ambient environment of a user. The system further includes a processor configured to detect and localize objects, in a real-world map space, from the image data using a trainable object localization Convolutional Neural Network (CNN). The CNN is trained to detect and localize the objects from image and radar pairs that include the image data and radar data for different scenes of a natural environment. The processor is further configured to perform a user-perceptible action responsive to a detection and a localization of an object in an intended path of the user.

Abstract: Methods and systems for detecting and correcting anomalous inputs include training a neural network to embed high-dimensional input data into a low-dimensional space with an embedding that preserves neighbor relationships. Input data items are embedded into the low-dimensional space to form respective low-dimensional codes. An anomaly is determined among the high-dimensional input data based on the low-dimensional codes. The anomaly is corrected.

Abstract: A computer-implemented method and system are provided for video-based anomaly detection. The method includes forming, by a processor, a Deep High-Order Convolutional Neural Network (DHOCNN)-based model having a one-class Support Vector Machine (SVM) as a loss layer of the DHOCNN-based model. An objective of the SVM is configured to perform the video-based anomaly detection. The method further includes generating, by the processor, one or more predictions of an impending anomaly based on the high-order deep learning based model applied to an input image. The method also includes initiating, by the processor, an action to a hardware device to mitigate expected harm to at least one item selected from the group consisting of the hardware device, another hardware device related to the hardware device, and a person related to the hardware device.

Abstract: A false alarm reduction system and method are provided for reducing false alarms in an automatic defect detection system. The false alarm reduction system includes a defect detection system, generating a list of image boxes marking detected potential defects in an input image. The false alarm reduction system further includes a feature extractor, transforming each of the image boxes in the list into a respective set of numerical features. The false alarm reduction system also includes a classifier, computing as a classification outcome for the each of the image boxes whether the detected potential defect is a true defect or a false alarm responsive to the respective set of numerical features for each of the image boxes.

Abstract: A false alarm reduction system is provided that includes a processor cropping each input image at randomly chosen positions to form cropped images of a same size at different scales in different contexts. The system further includes a CONDA-GMM, having a first and a second conditional deep autoencoder for respectively (i) taking each cropped image without a respective center block as input for measuring a discrepancy between a reconstructed and a target center block, and (ii) taking an entirety of cropped images with the target center block. The CONDA-GMM constructs density estimates based on reconstruction error features and low-dimensional embedding representations derived from image encodings. The processor determines an anomaly existence based on a prediction of a likelihood of the anomaly existing in a framework of a CGMM, given the context being a representation of the cropped image with the center block removed and having a discrepancy above a threshold.

Abstract: Systems and methods are disclosed to assist a driver with a dangerous condition by creating a graph representation where traffic participants and static elements are the vertices and the edges are relations between pairs of vertices; adding attributes to the vertices and edges of the graph based on information obtained on the driving vehicle, the traffic participants and additional information; creating a codebook of dangerous driving situations, each represented as graphs; performing subgraph matching between the graphs in the codebook and the graph representing a current driving situation to select a set of matching graphs from the codebook; determining a distance metric between each selected codebook graphs and the matching subgraph of the current driving situation; from codebook graphs with a low distance, determining potential dangers; and generating an alert if one or more of the codebook dangers are imminent.

Abstract: Systems and methods are disclosed for operating a Restricted Boltzmann Machine (RBM) by determining a corrected energy function of high-order semi-RBMs (hs-RBMs) without self-interaction; performing distributed pre-training of the hs-RBM; adjusting weights of the hs-RBM using contrastive divergence; generating predictions by Gibbs Sampling or by determining conditional probabilities with hidden units integrated out; and generating predictions.

Abstract: Methods and systems for detecting and correcting anomalies include predicting normal behavior of a monitored system based on training data that includes only sensor data collected during normal behavior of the monitored system. The predicted normal behavior is compared to recent sensor data to determine that the monitored system is behaving abnormally. A corrective action is performed responsive to the abnormal behavior to correct the abnormal behavior.

Abstract: A computer-implemented method and system are provided for driving assistance. The system includes an image capture device configured to capture image data relative to an outward view from a motor vehicle. The system further includes a processor configured to detect and localize objects, in a real-world map space, from the image data using a trainable object localization Convolutional Neural Network (CNN). The CNN is trained to detect and localize the objects from image and radar pairs that include the image data and radar data for different driving scenes of a natural driving environment. The processor is further configured to provide a user-perceptible object detection result to a user of the motor vehicle.

Abstract: A video device for predicting driving situations while a person drives a car is presented. The video device includes multi-modal sensors and knowledge data for extracting feature maps, a deep neural network trained with training data to recognize real-time traffic scenes (TSs) from a viewpoint of the car, and a user interface (UI) for displaying the real-time TSs. The real-time TSs are compared to predetermined TSs to predict the driving situations. The video device can be a video camera. The video camera can be mounted to a windshield of the car. Alternatively, the video camera can be incorporated into the dashboard or console area of the car. The video camera can calculate speed, velocity, type, and/or position information related to other cars within the real-time TS. The video camera can also include warning indicators, such as light emitting diodes (LEDs) that emit different colors for the different driving situations.

Abstract: A method, a computer program product, and a system are provided for video based action recognition. The system includes a processor. One or more frames from one or more video sequences are received. A feature vector for each patch of the one or more frames is generated using a deep convolutional neural network. An attention factor for the feature vectors is generated based on a within-frame attention and a between-frame attention. A target action is identified using a multi-layer deep long short-term memory process applied to the attention factor, said target action representing at least one of the one or more video sequences. An operation of a processor-based machine is controlled to change a state of the processor-based machine, responsive to the at least one of the one or more video sequences including the identified target action.

Abstract: Systems and methods for detecting and correcting defective products include capturing at least one image of a product with at least one image sensor to generate an original image of the product. An encoder encodes portions of an image extracted from the original image to generate feature space vectors. A decoder decodes the feature space vectors to reconstruct the portions of the image into reconstructed portions by predicting defect-free structural features in each of the portions according to hidden layers trained to predict defect-free products. Each of the reconstructed portions are merged into a reconstructed image of a defect-free representation of the product. The reconstructed image is communicated to a contrastor to detect anomalies indicating defects in the product.

Abstract: Systems and methods for diagnosing a patient condition include a medical imaging device for generating an anatomical image. A reconstructor reconstructs the anatomical image by reconstructing portions of the anatomical image to be a healthy representation of the portions and merging the portions into the anatomical image to generate a reconstructed image. A contrastor contrasts the anatomical image with the reconstructed image to generate an anomaly map indicating locations of difference between the anatomical image and the reconstructed image. An anomaly tagging device tags the locations of difference as anomalies corresponding to anatomical abnormalities in the anatomical image, and a display displays the anatomical image with tags corresponding to the anatomical abnormalities.

Abstract: A computer-implemented method executed by a processor for training a neural network to recognize driving scenes from sensor data received from vehicle radar is presented. The computer-implemented method includes extracting substructures from the sensor data received from the vehicle radar to define a graph having a plurality of nodes and a plurality of edges, constructing a neural network for each extracted substructure, combining the outputs of each of the constructed neural networks for each of the plurality of edges into a single vector describing a driving scene of a vehicle, and classifying the single vector into a set of one or more dangerous situations involving the vehicle.

Abstract: A computer-implemented method and system are provided for driving assistance. The system includes an image capture device configured to capture image data relative to an outward view from a motor vehicle. The system further includes a processor configured to detect and localize objects, in a real-world map space, from the image data using a trainable object localization Convolutional Neural Network (CNN). The CNN is trained to detect and localize the objects from image and radar pairs that include the image data and radar data for different driving scenes of a natural driving environment. The processor is further configured to provide a user-perceptible object detection result to a user of the motor vehicle.

Abstract: A computer-implemented method and system are provided. The system includes an image capture device configured to capture image data relative to an ambient environment of a user. The system further includes a processor configured to detect and localize objects, in a real-world map space, from the image data using a trainable object localization Convolutional Neural Network (CNN). The CNN is trained to detect and localize the objects from image and radar pairs that include the image data and radar data for different scenes of a natural environment. The processor is further configured to perform a user-perceptible action responsive to a detection and a localization of an object in an intended path of the user.

Abstract: A video camera is provided for video-based anomaly detection that includes at least one imaging sensor configured to capture video sequences in a workplace environment having a plurality of machines therein. The video camera further includes a processor. The processor is configured to generate one or more predictions of an impending anomaly affecting at least one item selected from the group consisting of (i) at least one of the plurality of machines and (ii) at least one operator of the at least one of the plurality of machines, using a Deep High-Order Convolutional Neural Network (DHOCNN)-based model applied to the video sequences. The DHOCNN-based model has a one-class SVM as a loss layer of the model. The processor is further configured to generate a signal for initiating an action to the at least one of the plurality of machines to mitigate expected harm to the at least one item.