Abstract: Described is a system for optimizing controllers for micro-air vehicles. The system identifies binary rules that lead to a desired behavior of a micro-air vehicle. The binary rules are identified by sampling rule-sets from a probability distribution over a search space. A fitness value of each rule-set for the desired behavior is determined, and top-performing rule-sets are selected. The top-performing rule-sets are used to update the probability distribution over the search space until a convergence criterion is met, resulting in a fittest rule-set. A control signal based on the identified binary rules is transmitted to one or more actuators of the micro-air vehicle.

Abstract: Described is a system for automatically identifying chemical properties of a molecule. A chemical representation of a molecular structure is converted into atomic features and an adjacency matrix. The atomic features and the adjacency matrix are processed with a neural network, resulting in neural activations corresponding to each atom in the molecular structure. The system determines a probability for each atom quantifying its relevance for a given chemical characteristic. The probabilities are displayed as a graphical representation on the molecular structure, and groups of atoms are identified for the given chemical characteristic from the graphical representation. The identified groups of atoms for the given chemical characteristic are stored in a database, and a new molecule having the given chemical characteristic is designed based on the stored identified groups of atoms.

Abstract: Described is a system for detecting adversarial activities. During operation, the system generates a multi-layer temporal graph tensor (MTGT) representation based on an input tag stream of activities. The MTGT representation is decomposed to identify normal activities and abnormal activities, with the abnormal activities being designated as adversarial activities. A device can then be controlled based on the designation of the adversarial activities.

Abstract: An apparatus for detecting a fault state of an aircraft is provided. The apparatus accesses a training set of flight data for the aircraft. The training set includes observations of the flight data, each observation of the flight data includes measurements of properties selected and transformed into a set of features. The apparatus builds a generative adversarial network including a generative model and a discriminative model using the training set and the set of features, and builds an anomaly detection model to predict the fault state of the aircraft. The anomaly detection model is trained using the training set of flight data, simulated flight data generated by the generative model, and a subset of features from the set of features. The apparatus deploys the anomaly detection model to predict the fault state of the aircraft using additional observations of the flight data.

Abstract: A method includes obtaining sensor data captured by a sensor of an aircraft during a power up event. The sensor data includes multiple parameter values, each corresponding to a sample period. The method further includes determining a set of delta values, each indicating a difference between parameter values for consecutive sample periods of the sensor data. The method further includes determining a set of quantized delta values by assigning the delta values to quantization bins based on magnitudes of the delta values. The method further includes determining a normalized count of delta values for each quantization bin. The method further includes comparing the normalized counts of delta values to anomaly detection thresholds. The method further includes generating, based on the comparisons, output indicating whether the sensor data is indicative of an operational anomaly.

Abstract: A prediction system for simulating effects of a real-world event can be used for autonomous driving. In operation, the system receives input data regarding a complex system (e.g., roadways) and various real-world events. A full-scale network is constructed of the complex system, such that nodes represent road intersections and edges between nodes represent road segments linking the road intersections. The network is reduced is scaled down to generate a multi-layer model of the complex system. Each layer in the model is simulated to identify equilibrium flows, with the model thereafter destabilized by applying stimuli to reflect the real-world event. An autonomous vehicle can then be caused to chart and traverse a road path based on road segments and intersections that are least affected by the real-world event.

Abstract: Described is a system for health assessment. The system is implemented on a mobile device having at least one of an accelerometer, a geographic location sensor, and a camera. In operation, the system obtains sensor data related to an operator of the mobile device from one of the sensors. A network of networks (NoN) is generated based on the sensor data, the NoN having a plurality of layers with linked nodes. Tuples are thereafter generated. Each tuple contains a node from each layer that optimizes importance, diversity, and coherence. Storylines are created based on the tuples that solves a longest path problem for each tuple. The storylines track multiple symptom progressions of the operator. Finally, a disease prediction of the operator is provided based on the storylines.

Abstract: An autonomous navigation system for a vehicle includes a controller configured to control the vehicle, sensors configured to detect objects in a path of the vehicle, nonvolatile memory including an artificial neural network configured to classify the objects detected by the sensors, and a processor. The artificial neural network includes a series of neurons in each of an input layer, at least one hidden layer, and an output layer. The memory includes instructions which, when executed by the processor, cause the processor to train the artificial neural network on a first task, identify, utilizing a contrastive excitation backpropagation algorithm, important neurons for the first task, identify, utilizing a learning algorithm, important synapses between the neurons for the first task based on the important neurons identified, and rigidify the important synapses to achieve selective plasticity of the series of neurons in the artificial neural network.

Abstract: Described is an audio classification system for classifying audio signals. In operation, the system extracts salient patches from an intensity spectrogram of an audio signal. Thereafter, multi-scale global average pooling (GAP) features are extracted for all salient patches. The GAP features are clustered, with each cluster becoming a key attribute. A test audio signal can then be mapped onto a histogram of key attributes. Based on the histogram, the test audio signal can then be classified as a sound class, allowing for operation of a device based on the classification of the sound class.

Abstract: A method includes obtaining sensor data captured by a sensor of an aircraft during a power up event. The sensor data includes multiple parameter values, each corresponding to a sample period. The method further includes determining a set of delta values, each indicating a difference between parameter values for consecutive sample periods of the sensor data. The method further includes determining a set of quantized delta values by assigning the delta values to quantization bins based on magnitudes of the delta values. The method further includes determining a normalized count of delta values for each quantization bin. The method further includes comparing the normalized counts of delta values to anomaly detection thresholds. The method further includes generating, based on the comparisons, output indicating whether the sensor data is indicative of an operational anomaly.

Abstract: A method for determining a vehicle system prognosis includes detecting a predetermined characteristic of a vehicle with one or more sensors, receiving a plurality of sensor signals from the one or more sensors and determining an input time series of data based on the sensor signals, clustering a matrix of time series data, generated from the input time series of data, into a predetermined number of hyperplanes, extracting extracted features that are indicative of an operation of a vehicle system from a sparse temporal matrix based on data point behavior with respect to two or more hyperplanes within the sparse temporal matrix and determining an operational status of the vehicle system based on the extracted features, the sparse temporal matrix being based on the predetermined number of hyperplanes; and communicating the operational status of the vehicle system to an operator or crew member of the vehicle.

Abstract: A fault detection system including one or more sensors onboard a vehicle to detect a characteristic of the vehicle and generate sensor signals corresponding to the characteristic, a processor onboard the vehicle to receive the sensor signals, generate one or more fast Fourier transform vectors based on the sensor signals so that the one or more fast Fourier transform vectors are representative of the characteristic, generate an analysis model from a time history of the fast Fourier transform vectors, and determine, using the analysis model, a degree to which the one or more fast Fourier transform vectors could have been generated by the analysis model, and an indicator to communicate an operational status of the vehicle to an operator or crew member of the vehicle based on the degree to which the one or more fast Fourier transform vectors could have been generated by the analysis model.

Abstract: A method for retraining an artificial neural network trained on data from an old task includes training the artificial neural network on data from a new task different than the old task, calculating a drift, utilizing Sliced Wasserstein Distance, in activation distributions of a series of hidden layer nodes during the training of the artificial neural network with the new task, calculating a number of additional nodes to add to at least one hidden layer based on the drift in the activation distributions, resetting connection weights between input layer nodes, hidden layer nodes, and output layer nodes to values before the training of the artificial neural network on the data from the new task, adding the additional nodes to the at least one hidden layer, and training the artificial neural network on data from the new task.

Abstract: Described is a system for classifying objects and scenes in images. The system identifies salient regions of an image based on activation patterns of a convolutional neural network (CNN). Multi-scale features for the salient regions are generated by probing the activation patterns of the CNN at different layers. Using an unsupervised clustering technique, the multi-scale features are clustered to identify key attributes captured by the CNN. The system maps from a histogram of the key attributes onto probabilities for a set of object categories. Using the probabilities, an object or scene in the image is classified as belonging to an object category, and a vehicle component is controlled based on the object category causing the vehicle component to perform an automated action.

Abstract: Disclosed are methods and systems for continuously determining remaining useful lives (RULs) of vehicle components during operation of these vehicles. A method involves obtaining reference sensor data as well as operational sensor data (both of which are multidimensional) and constructing distributions of these respective data sets. The operational sensor data is obtained from a plurality of sensors, operationally coupled to a vehicle component and continuously obtaining real-time characteristics of this component. The reference sensor data is obtained, in some examples, from a database for equivalent components, long before the end of life or required replacements. Sliced-Wasserstein distances are computed between these distributions and early notification signals (ENS) are determined on these distances. Finally, a RUL of the vehicle component is determined based on the ENS using a RUL model.

Abstract: In an example, a method for identifying associated events in an aircraft is described. The method includes obtaining sensor data, obtaining fault code data, generating a set of events, where each event occurs over a time interval over which either (i) the sensor data indicates an anomalous measurement or (ii) a fault code associated with a particular aircraft subsystem of the aircraft was signaled, calculating a value of statistical dependence between the set, based on the value exceeding a threshold, constructing a network representing the set as a sequence of related events and further representing a temporal order in which the sequence occurred, indexing, in a summary table stored in memory and separate from the sensor data and the fault code data, the sequence and the value, and controlling a display device to display the summary table and a visual representation of the network.

Abstract: Described is system for mapping user behavior to brain regions of interest. Using a cognitive-behavior model, a behavioral task is selected that is suited for a desired brain state. Using a functional-anatomical model coupled to the cognitive-behavior model, a set of high-definition neurostimulations is selected to be applied to the user during performance of the selected behavioral task. The selected set of high-definition neurostimulations targets specific regions of the user's brain. Changes in the user's brain state are sensed during application of the set of high-definition neurostimulations and performance of the selected behavioral task using at least one brain monitoring technique. The coupled functional-anatomical and cognitive-behavior models are adapted until the desired brain state is reached.

Abstract: Described is a system for detecting change of context in a video stream on an autonomous platform. The system extracts salient patches from image frames in the video stream. Each salient patch is translated to a concept vector. A recurrent neural network is enervated with the concept vector, resulting in activations of the recurrent neural network. The activations are classified, and the classified activations are mapped onto context classes. A change in context class is detected in the image frames, and the system causes the autonomous platform to perform an automatic operation to adapt to the change of context class.

Abstract: Described is a system for understanding machine-learning decisions. In an unsupervised learning phase, the system extracts, from input data, concepts represented by a machine-learning (ML) model in an unsupervised manner by clustering patterns of activity of latent variables of the concepts, where the latent variables are hidden variables of the ML model. The extracted concepts are organized into a concept network by learning functional semantics among the extracted concepts. In an operational phase, a subnetwork of the concept network is generated. Nodes of the subnetwork are displayed as a set of visual images that are annotated by weights and labels, and the ML model per the weights and labels.

Abstract: Described is an automatic anomaly detector that receives a time-series of normal and abnormal activities that include features related to entities within a computing system. A feature coherence graph for the features is constructed, with the graph then clustered such that feature spaces of entities are expanded to include features that live within a same cluster but belong to separate entities. The feature spaces are unified by mapping representations of the features spaces into a Euclidean space of feature vectors. The feature vectors related to each feature are then aligned. Sets of clusters of related abnormal activities are then generated by regressing each feature vector over only those features that it possesses. The sets of clusters are used to detect anomalous behavior. The system then identifies a node within the computer system generating the anomalous behavior and initiates an action to minimize a threat posed by the node.