Patents by Inventor Soheil Kolouri
Soheil Kolouri has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11791018Abstract: Described is a system for automatically identifying chemical properties of a molecule. A chemical representation of a molecular structure is converted into atomic features and an adjacency matrix. The atomic features and the adjacency matrix are processed with a neural network, resulting in neural activations corresponding to each atom in the molecular structure. The system determines a probability for each atom quantifying its relevance for a given chemical characteristic. The probabilities are displayed as a graphical representation on the molecular structure, and groups of atoms are identified for the given chemical characteristic from the graphical representation. The identified groups of atoms for the given chemical characteristic are stored in a database, and a new molecule having the given chemical characteristic is designed based on the stored identified groups of atoms.Type: GrantFiled: July 16, 2019Date of Patent: October 17, 2023Assignee: HRL LABORATORIES, LLCInventors: Soheil Kolouri, Phillip E. Pope, Mohammad Rostami, Charles E. Martin, Heiko Hoffmann
-
Patent number: 11645544Abstract: Described is a system for continual learning using experience replay. In operation, the system receives a plurality of tasks sequentially, from which a current task is fed to an encoder. The current task has data points associated with the current task. The encoder then maps the data points into an embedding space, which reflects the data points as discriminative features. A decoder then generates pseudo-data points from the discriminative features, which are provided back to the encoder. The discriminative features are updated in the embedding space based on the pseudo-data points. The encoder then learns (updates) a classification of a new task by matching the new task with the discriminative features in the embedding space.Type: GrantFiled: May 15, 2020Date of Patent: May 9, 2023Assignee: HRL LABORATORIES, LLCInventors: Mohammad Rostami, Soheil Kolouri, Praveen K. Pilly
-
Patent number: 11625557Abstract: Described is a system for learning object labels for control of an autonomous platform. Pseudo-task optimization is performed to identify an optimal pseudo-task for each source model of one or more source models. An initial target network is trained using the optimal pseudo-task. Source image components are extracted from source models, and an attribute dictionary of attributes is generated from the source image components. Using zero-shot attribution distillation, the unlabeled target data is aligned with the source models similar to the unlabeled target data. The unlabeled target data are mapped onto attributes in the attribute dictionary. A new target network is generated from the mapping, and the new target network is used to assign an object label to an object in the unlabeled target data. The autonomous platform is controlled based on the object label.Type: GrantFiled: October 26, 2020Date of Patent: April 11, 2023Assignee: HRL LABORATORIES, LLCInventors: Heiko Hoffmann, Soheil Kolouri
-
Publication number: 20230105700Abstract: A computing system including a processor configured to train a synthetic aperture radar (SAR) classifier neural network. The SAR classifier neural network is trained at least in part by, at a SAR encoder, receiving training SAR range profiles that are tagged with respective first training labels, and, at an image encoder, receiving training two-dimensional images that are tagged with respective second training labels. Training the SAR classifier neural network further includes, at a shared encoder, computing shared latent representations based on the SAR encoder outputs and the image encoder outputs, and, at a classifier, computing respective classification labels based on the shared latent representations. Training the SAR classifier neural network further includes computing a value of a loss function based on the plurality of first training labels, the plurality of second training labels, and the plurality of classification labels and performing backpropagation based on the value of the loss function.Type: ApplicationFiled: October 6, 2021Publication date: April 6, 2023Inventors: David Payton, Soheil Kolouri, Kangyu Ni, Qin Jiang
-
Patent number: 11620527Abstract: Described is a system for adapting a deep convolutional neural network (CNN). A deep CNN is first trained on an annotated source image domain. The deep CNN is adapted to a new target image domain without requiring new annotations by determining domain agnostic features that map from the annotated source image domain and a target image domain to a joint latent space, and using the domain agnostic features to map the joint latent space to annotations for the target image domain.Type: GrantFiled: January 30, 2019Date of Patent: April 4, 2023Assignee: HRL LABORATORIES, LLCInventors: Zachary Murez, Soheil Kolouri, Kyungnam Kim, Mohammad Rostami
-
Patent number: 11574679Abstract: A memory circuit configured to perform multiply-accumulate (MAC) operations for performance of an artificial neural network includes a series of synapse cells arranged in a cross-bar array. Each cell includes a memory transistor connected in series with a memristor. The memory circuit also includes input lines connected to the source terminal of the memory transistor in each cell, output lines connected to an output terminal of the memristor in each cell, and programming lines coupled to a gate terminal of the memory transistor in each cell. The memristor of each cell is configured to store a conductance value representative of a synaptic weight of a synapse connected to a neuron in the artificial neural network, and the memory transistor of each cell is configured to store a threshold voltage representative of a synaptic importance value of the synapse connected to the neuron in the artificial neural network.Type: GrantFiled: May 4, 2022Date of Patent: February 7, 2023Assignee: HRL LABORATORIES, LLCInventors: Wei Yi, Charles Martin, Soheil Kolouri, Praveen Pilly
-
Patent number: 11550914Abstract: Described is a system for detecting backdoor attacks in deep convolutional neural networks (CNNs). The system compiles specifications of a pretrained CNN into an executable model, resulting in a compiled model. A set of Universal Litmus Patterns (ULPs) are fed through the compiled model, resulting in a set of model outputs. The set of model outputs are classified and used to determine presence of a backdoor attack in the pretrained CNN. The system performs a response based on the presence of the backdoor attack.Type: GrantFiled: April 21, 2020Date of Patent: January 10, 2023Assignee: HRL LABORATORIES, LLCInventors: Soheil Kolouri, Heiko Hoffmann
-
Publication number: 20220375520Abstract: A memory circuit configured to perform multiply-accumulate (MAC) operations for performance of an artificial neural network includes a series of synapse cells arranged in a cross-bar array. Each cell includes a memory transistor connected in series with a memristor. The memory circuit also includes input lines connected to the source terminal of the memory transistor in each cell, output lines connected to an output terminal of the memristor in each cell, and programming lines coupled to a gate terminal of the memory transistor in each cell. The memristor of each cell is configured to store a conductance value representative of a synaptic weight of a synapse connected to a neuron in the artificial neural network, and the memory transistor of each cell is configured to store a threshold voltage representative of a synaptic importance value of the synapse connected to the neuron in the artificial neural network.Type: ApplicationFiled: May 4, 2022Publication date: November 24, 2022Inventors: Wei Yi, Charles Martin, Soheil Kolouri, Praveen Pilly
-
Patent number: 11494486Abstract: Described is a system for continuously predicting and adapting optimal strategies for attacker elicitation. The system includes a global bot controlling processor unit and one or more local bot controlling processor units. The global bot controlling processor unit includes a multi-layer network software unit for extracting attacker features from diverse, out-of-band (OOB) media sources. The global controlling processing unit further includes an adaptive behavioral game theory (GT) software unit for determining a best strategy for eliciting identifying information from an attacker. Each local bot controlling processor unit includes a cognitive model (CM) software unit for estimating a cognitive state of the attacker and predicting attacker behavior. A generative adversarial network (GAN) software unit predicts the attacker's strategies.Type: GrantFiled: November 14, 2019Date of Patent: November 8, 2022Assignee: HRL LABORATORIES, LLCInventors: Hyun (Tiffany) J. Kim, Rajan Bhattacharyya, Samuel D. Johnson, Soheil Kolouri, Christian Lebiere, Jiejun Xu
-
Patent number: 11448753Abstract: Described is a system for transferring learned knowledge from an electro-optical (EO) domain to a synthetic-aperture-radar (SAR) domain. The system uses a measured similarity between the EO domain and the SAR domain to train a model for classifying SAR images using knowledge previously learned from the electro-optical (EO) domain. Using the trained model, a SAR image is processed to determine regions of interest in the SAR image. A region of interest is classified to determine whether the region of interest corresponds to an object of interest, and classified regions of interest that contain the object of interest are output. The object of interest is displayed on a visualization map, and the visualization map is automatically updated to reflect a change in position of the object of interest.Type: GrantFiled: January 24, 2020Date of Patent: September 20, 2022Assignee: HRL LABORATORIES, LLCInventors: Mohammad Rostami, Soheil Kolouri
-
Publication number: 20220229173Abstract: Disclosed is a synthetic aperture radar (SAR) system for target recognition with complex range profile. The SAR system comprising a memory, a recurrent neural network (RNN), a multi-layer linear network in signal communication the RNN, and a machine-readable medium on the memory. The machine-readable medium is configured to store instructions that, when executed by the RNN, cause the SAR system to perform various operations. The various operation comprise: receiving raw SAR data associated with observed views of a scene, wherein the raw SAR data comprises information captured via the SAR system; radio frequency (RF) preprocessing the received raw SAR data to produce a processed raw SAR data; converting the processed raw SAR data to a complex SAR range profile data; processing the complex SAR range profile data with the RNN having RNN states; and mapping the RNN states to a target class with the multi-layer linear network.Type: ApplicationFiled: November 23, 2021Publication date: July 21, 2022Inventors: Qin Jiang, David Wayne Payton, Soheil Kolouri, Adour Vahe Kabakian, Brian N. Limketkai
-
Publication number: 20220221578Abstract: Described is a method for extraction of a region of interest (ROI) from a composite synthetic aperture radar (SAR) phase history data. The method comprising receiving, with a system comprising a processor, the composite SAR phase history data of a plurality of backscattered return signals produced by a SAR system illuminating a scene with a SAR beam. The method also comprises obtaining a location of a first ROI within the scene and extracting from the composite SAR phase history data a first component SAR phase history data corresponding to the ROI at the location of the ROI.Type: ApplicationFiled: December 7, 2021Publication date: July 14, 2022Inventors: Adour Vahe Kabakian, David Wayne Payton, Brian N. Limketkai, Soheil Kolouri, Qin Jiang
-
Patent number: 11333753Abstract: Described is a stripmap SAR system on a vehicle comprising an antenna that is fixed and directed outward from the side of the vehicle, a SAR sensor, a storage, and a computing device. The computing device comprises a memory, one or more processing units, and a machine-readable medium on the memory. The machine-readable medium stores instructions that, when executed by the one or more processing units, cause the stripmap SAR system to perform various operations. The operations comprise: receiving stripmap range profile data associated with observed views of a scene; transforming the received stripmap range profile data into partial circular range profile data; comparing the partial circular range profile data to a template range profile data of the scene; and estimating registration parameters associated with the partial circular range profile data relative to the template range profile data to determine a deviation from the template range profile data.Type: GrantFiled: October 14, 2019Date of Patent: May 17, 2022Assignee: The Boeing CompanyInventors: Adour V. Kabakian, Soheil Kolouri, Brian N. Limketkai, Shankar R. Rao
-
Patent number: 11288498Abstract: Described is a system for learning actions for image-based action recognition in an autonomous vehicle. The system separates a set of labeled action image data from a source domain into components. The components are mapped onto a set of action patterns, thereby creating a dictionary of action patterns. For each action in the set of labeled action data, a mapping is learned from the action pattern representing the action onto a class label for the action. The system then maps a set of new unlabeled target action image data onto a shared embedding feature space in which action patterns can be discriminated. For each target action in the set of new unlabeled target action image data, a class label for the target action is identified. Based on the identified class label, the autonomous vehicle is caused to perform a vehicle maneuver corresponding to the identified class label.Type: GrantFiled: July 16, 2020Date of Patent: March 29, 2022Assignee: HRL Laboratories, LLCInventors: Amir M. Rahimi, Hyukseong Kwon, Heiko Hoffmann, Soheil Kolouri
-
Patent number: 11255960Abstract: A synthetic aperture radar (SAR) system is disclosed. The SAR comprises a memory, a convolutional neural network (CNN), a machine-readable medium on the memory, and a machine-readable medium on the memory. The machine-readable medium storing instructions that, when executed by the CNN, cause the SAR system to perform operations. The operation comprises: receiving range profile data associated with observed views of a scene; concatenating the range profile data with a template range profile data of the scene; and estimating registration parameters associated with the range profile data relative to the template range profile data to determine a deviation from the template range profile data.Type: GrantFiled: January 24, 2020Date of Patent: February 22, 2022Assignee: The Boeing CompanyInventors: Soheil Kolouri, Shankar R. Rao
-
Patent number: 11210559Abstract: An autonomous navigation system for a vehicle includes a controller configured to control the vehicle, sensors configured to detect objects in a path of the vehicle, nonvolatile memory including an artificial neural network configured to classify the objects detected by the sensors, and a processor. The artificial neural network includes a series of neurons in each of an input layer, at least one hidden layer, and an output layer. The memory includes instructions which, when executed by the processor, cause the processor to train the artificial neural network on a first task, identify, utilizing a contrastive excitation backpropagation algorithm, important neurons for the first task, identify, utilizing a learning algorithm, important synapses between the neurons for the first task based on the important neurons identified, and rigidify the important synapses to achieve selective plasticity of the series of neurons in the artificial neural network.Type: GrantFiled: August 23, 2019Date of Patent: December 28, 2021Assignee: HRL Laboratories, LLCInventors: Soheil Kolouri, Nicholas A. Ketz, Praveen K. Pilly, Charles E. Martin, Michael D. Howard
-
Patent number: 11194330Abstract: Described is an audio classification system for classifying audio signals. In operation, the system extracts salient patches from an intensity spectrogram of an audio signal. Thereafter, multi-scale global average pooling (GAP) features are extracted for all salient patches. The GAP features are clustered, with each cluster becoming a key attribute. A test audio signal can then be mapped onto a histogram of key attributes. Based on the histogram, the test audio signal can then be classified as a sound class, allowing for operation of a device based on the classification of the sound class.Type: GrantFiled: August 30, 2018Date of Patent: December 7, 2021Assignee: HRL Laboratories, LLCInventors: Charles E. Martin, Soheil Kolouri, Heiko Hoffmann
-
Patent number: 11176477Abstract: Described is a system for unsupervised domain adaptation in an autonomous learning agent. The system adapts a learned model with a set of unlabeled data from a target domain, resulting in an adapted model. The learned model was previously trained to perform a task using a set of labeled data from a source domain. The set of labeled data has a first input data distribution, and the set of unlabeled target data has a second input data distribution that is distinct from the first input data distribution. The adapted model is implemented in the autonomous learning agent, causing the autonomous learning agent to perform the task in the target domain.Type: GrantFiled: December 18, 2019Date of Patent: November 16, 2021Assignee: HRL Laboratories, LLCInventors: Alexander J. Gabourie, Mohammad Rostami, Soheil Kolouri, Kyungnam Kim
-
Patent number: 11169258Abstract: Systems and methods according to one or more embodiments are provided for registration of synthetic aperture range profile data to aid in SAR-based navigation. In one example, a SAR-based navigation system includes a memory comprising a plurality of executable instructions. The SAR-based navigation system further includes a processor adapted to receive range profile data associated with observed views of a scene, compare the range profile data to a template range profile data of the scene, and estimate registration parameters associated with the range profile data relative to the template range profile data to determine a deviation from the template range profile data.Type: GrantFiled: May 9, 2019Date of Patent: November 9, 2021Assignee: The Boeing CompanyInventors: Shankar R. Rao, Kang-Yu Ni, Soheil Kolouri
-
Patent number: 11113597Abstract: A method for retraining an artificial neural network trained on data from an old task includes training the artificial neural network on data from a new task different than the old task, calculating a drift, utilizing Sliced Wasserstein Distance, in activation distributions of a series of hidden layer nodes during the training of the artificial neural network with the new task, calculating a number of additional nodes to add to at least one hidden layer based on the drift in the activation distributions, resetting connection weights between input layer nodes, hidden layer nodes, and output layer nodes to values before the training of the artificial neural network on the data from the new task, adding the additional nodes to the at least one hidden layer, and training the artificial neural network on data from the new task.Type: GrantFiled: September 5, 2019Date of Patent: September 7, 2021Assignee: HRL Laboratories, LLCInventors: Charles E. Martin, Nicholas A. Ketz, Praveen K. Pilly, Soheil Kolouri, Michael D. Howard, Nigel D. Stepp