Patents Examined by Alexey Shmatov
  • Patent number: 12242975
    Abstract: Techniques regarding identifying candidate knowledge graph subgraphs in a question answering over knowledge graph task are provided. For example, one or more embodiments described herein can comprise a system, which can comprise a memory that can store computer executable components. The system can also comprise a processor, operably coupled to the memory, and that can execute the computer executable components stored in the memory. The computer executable components can comprise a question answering over knowledge graph component that encodes graph structure information of a knowledge graph subgraph and a question graph into neural network embeddings.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: March 4, 2025
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Lingfei Wu, Chen Wang
  • Patent number: 12229653
    Abstract: Systems, methods, apparatuses, and computer program products for tracking weak signal traces under severe noise and/or distortions. A method may include tracking at least one candidate frequency trace from a time-frequency representation of a signal. The method may also include identifying a frequency trace of the signal based on tracking results. In addition, the method may include outputting an estimated frequency vector related to the frequency trace. Further, the tracking may be performed under a noisy condition environment.
    Type: Grant
    Filed: September 19, 2019
    Date of Patent: February 18, 2025
    Assignee: UNIVERSITY OF MARYLAND, COLLEGE PARK
    Inventors: Qiang Zhu, Mingliang Chen, Min Wu, Chau-Wai Wong
  • Patent number: 12230366
    Abstract: A method for employee biometric tracking is provided. The method comprises providing to a user a plurality of wearable devices capable of being connected to the user, establishing a wireless connection between the plurality of wearable devices and a mobile device, collecting by the plurality of wearable devices a plurality of biometric data from the user, receiving by an application stored on the mobile device the plurality of biometric data, inputting into a predictive engine biometric data selected from the plurality of biometric data, determining by the predictive engine in response to the biometric data whether the user is at, or soon will be at, an alert level, creating an alert signal, and displaying the alert signal to the user.
    Type: Grant
    Filed: October 4, 2022
    Date of Patent: February 18, 2025
    Assignee: BlyncSync Technologies, LLC
    Inventors: Austin Green, Steven Kastelic
  • Patent number: 12223438
    Abstract: One or more computer processors identify one or more similar, historical regression tests and historical builds utilizing a computed similarity measure between a regressed build and one or more historical builds conducted on a same release cycle, wherein the identified one or more similar historical regression tests and historical builds are K closest neighbors to the regressed build; predict an elapsed time of the one or more profiled regression tests utilizing a KNN algorithm comprising the K closest neighbors each weighted by a corresponding average distance from a test point and the elapsed time as a target variable; responsive to the predicted elapsed time exceeding an actual elapsed time associated with the regressed build, determine that the regressed build is an actual regression; responsive to determining that the regressed build is not due to variability, apply one or more mitigation actions to the regressed build.
    Type: Grant
    Filed: July 23, 2020
    Date of Patent: February 11, 2025
    Assignee: International Business Machines Corporation
    Inventors: Sweta Singh, Manish Anand, Vaibhav Murlidhar Kulkarni
  • Patent number: 12223407
    Abstract: In automated machine learning, an approximate best configuration can be selected among multiple candidate machine-learning configurations by progressively sampling training and test datasets for the iterative training and testing of the configurations while progressively pruning the set of candidate configurations based on associated estimated confidence intervals for their respective performance.
    Type: Grant
    Filed: August 23, 2018
    Date of Patent: February 11, 2025
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Chi Wang, Silu Huang, Surajit Chaudhuri, Bolin Ding
  • Patent number: 12210952
    Abstract: A reorganizable neural network computing device is provided. The computing device includes a data processing array unit including a plurality of operators disposed at locations corresponding to a row and a column. One or more chaining paths which transfer the first input data from the operator of the first row of the data processing array to the operator of the second row are optionally formed. The plurality of first data input processors of the computing device transfer the first input data for a layer of the neural network to the operators along rows of the data processing array unit, and the plurality of second data input processors of the computing device transfer the second input data to the operators along the columns of the data processing array.
    Type: Grant
    Filed: November 27, 2018
    Date of Patent: January 28, 2025
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Young-Su Kwon, Chan Kim, Hyun Mi Kim, Jeongmin Yang, Chun-Gi Lyuh, Jaehoon Chung, Yong Cheol Peter Cho
  • Patent number: 12210954
    Abstract: A point estimate value for an individual is computed using a Bayesian neural network model (BNN) by training a first BNN model that computes a weight mean value, a weight standard deviation value, a bias mean value, and a bias standard deviation value for each neuron of a plurality of neurons using observations. A plurality of BNN models is instantiated using the first BNN model. Instantiating each BNN model of the plurality of BNN models includes computing, for each neuron, a weight value using the weight mean value, the weight standard deviation value, and a weight random draw and a bias value using the bias mean value, the bias standard deviation value, and a bias random draw. Each instantiated BNN model is executed with the observations to compute a statistical parameter value for each observation vector of the observations. The point estimate value is computed from the statistical parameter value.
    Type: Grant
    Filed: December 6, 2023
    Date of Patent: January 28, 2025
    Assignee: SAS Institute Inc.
    Inventors: Sylvie Tchumtchoua Kabisa, Xilong Chen, Gunce Eryuruk Walton, David Bruce Elsheimer, Ming-Chun Chang
  • Patent number: 12198060
    Abstract: Embodiments described herein combine both masked reconstruction and predictive coding. Specifically, unlike contrastive learning, the mutual information between past states and future states are directly estimated. The context information can also be directly captured via shifted masked reconstruction—unlike standard masked reconstruction, the target reconstructed observations are shifted slightly towards the future to incorporate more predictability. The estimated mutual information and shifted masked reconstruction loss can then be combined as the loss function to update the neural model.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: January 14, 2025
    Assignee: Salesforce, Inc.
    Inventors: Junwen Bai, Weiran Wang, Yingbo Zhou, Caiming Xiong
  • Patent number: 12190222
    Abstract: A design optimization method based on active learning, which involves dynamic exploration and exploitation of the design space of interest using an ensemble of machine learning algorithms. In this approach, a hybrid methodology incorporating an explorative weak learner which fits high-level information about the response surface, and an exploitative strong learner (based on committee machine) that fits finer details around promising regions identified by the weak learner, is employed. For each design iteration, an aristocratic approach is used to select a set of nominees, where points that meet a threshold merit value as predicted by the weak learner are selected to be evaluated using function evaluation. In addition to these points, the global optimum as predicted by the strong learner is also evaluated to enable rapid convergence to the actual global optimum once the most promising region has been identified by the optimizer.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: January 7, 2025
    Assignee: UChicago Argonne, LLC
    Inventors: Opeoluwa Olawale Owoyele, Pinaki Pal
  • Patent number: 12190223
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training an action selection neural network. One of the methods includes maintaining a replay memory that stores trajectories generated as a result of interaction of an agent with an environment; and training an action selection neural network having policy parameters on the trajectories in the replay memory, wherein training the action selection neural network comprises: sampling a trajectory from the replay memory; and adjusting current values of the policy parameters by training the action selection neural network on the trajectory using an off-policy actor critic reinforcement learning technique.
    Type: Grant
    Filed: May 28, 2020
    Date of Patent: January 7, 2025
    Assignee: DeepMind Technologies Limited
    Inventors: Ziyu Wang, Nicolas Manfred Otto Heess, Victor Constant Bapst
  • Patent number: 12182686
    Abstract: Networks and encodings therefor are provided that are adapted to provide increased energy efficiency and speed for convolutional operations. In various embodiments, a neural network comprises a plurality of neural cores. Each of the plurality of neural cores comprises a memory. A network interconnects the plurality of neural cores. The memory of each of the plurality of neural cores comprises at least a portion of a weight tensor. The weight tensor comprising a plurality of weights. Each neural core is adapted to retrieve locally or receive a portion of an input image, apply the portion of the weight tensor thereto, and store locally or send a result therefrom via the network to other of the plurality of neural cores.
    Type: Grant
    Filed: April 30, 2018
    Date of Patent: December 31, 2024
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventor: Dharmendra S. Modha
  • Patent number: 12174908
    Abstract: Disclosed is a method for convolution calculation in a neural network, comprising: reading an input feature map, depthwise convolution kernels and pointwise convolution kernels from a dynamic random access memory (DRAM); performing depthwise convolution calculations and pointwise convolution calculations by depthwise convolution calculation units and pointwise convolution calculation units, according to the input feature map, the depthwise convolution kernels and the pointwise convolution kernels to obtain output feature values of a first predetermined number p of points on all pointwise convolution output channels; storing the output feature values of a first predetermined number p of points on all pointwise convolution output channels into an on-chip memory; and repeating above operation to obtain output feature values of all points on all point wise convolution output channels. Therefore, the storage space for storing intermediate results may be reduced.
    Type: Grant
    Filed: December 17, 2018
    Date of Patent: December 24, 2024
    Assignee: Nanjing Horizon Robotics Technology Co., Ltd.
    Inventors: Liang Chen, Chang Huang, Kun Ling, Jianjun Li, Delin Li, Heng Luo
  • Patent number: 12165069
    Abstract: Some embodiments provide a compiler for optimizing the implementation of a machine-trained network (e.g., a neural network) on an integrated circuit (IC). The compiler of some embodiments receives a specification of a machine-trained network including multiple layers of computation nodes and generates a graph representing options for implementing the machine-trained network in the IC. In some embodiments, the graph includes nodes representing options for implementing each layer of the machine-trained network and edges between nodes for different layers representing different implementations that are compatible. In some embodiments, the graph is populated according to rules relating to memory use and the numbers of cores necessary to implement a particular layer of the machine trained network such that nodes for a particular layer, in some embodiments, represent fewer than all the possible groupings of sets of clusters.
    Type: Grant
    Filed: July 29, 2019
    Date of Patent: December 10, 2024
    Assignee: Amazon Technologies, Inc.
    Inventors: Brian Thomas, Steven L. Teig
  • Patent number: 12165052
    Abstract: In some examples, an individually-pruned neural network can estimate blood pressure from a seismocardiogram (SCG). In some examples, a baseline model can be constructed by training the model with SCG data and blood pressure measurement from a plurality of subjects. One or more filters (e.g., the filters in the top layer of the network) can be ranked by separability, which can be used to prune the model for each unseen user that uses the model thereafter, for example. In some examples, individuals can use individually-pruned models to calculate blood pressure using SCG data without corresponding blood pressure measurements.
    Type: Grant
    Filed: July 31, 2020
    Date of Patent: December 10, 2024
    Assignee: Apple Inc.
    Inventors: Siddharth Khullar, Nicholas E. Apostoloff, Amruta Pai
  • Patent number: 12159717
    Abstract: A technology for obtaining a respiratory rate from a photoplethysmogram (PPG) signal. In one example, an artificial neural network model can be trained to predict a respiratory rate using a training dataset containing PPG data. The artificial neural network model can include a first series of convolutional layers to remove artifacts from a PPG signal, a fast Fourier transform (FFT) layer to convert the PPG signal to PPG frequency representations, and a dense layer to decode the PPG frequency representations to respiratory rate predictions. After training the artificial neural network model, PPG data generated by a pulse oximeter monitor can be obtained, and the PPG data can be input to the artificial neural network model. The artificial neural network model outputs a respiratory rate prediction, wherein the respiratory rate prediction represents the respiratory rate obtained from the PPG signal.
    Type: Grant
    Filed: October 7, 2020
    Date of Patent: December 3, 2024
    Assignee: OWLET BABY CARE, INC.
    Inventors: Sean Kerman, Tanner Christensen, Chris Hettinger, Jeffrey Humpherys
  • Patent number: 12159237
    Abstract: Methods and apparatus are provided for real-time anomaly detection over sets of time-series data. One method comprises: obtaining a state-space representation of a plurality of states and transitions between said states based on sets of historical time-series data; obtaining an anomaly detection model trained using a supervised learning technique, wherein the anomaly detection model associates sequences of states in the state-space representation with annotated anomalies in the sets of historical time-series data and assigns a probability to said sequences of states; and, for incoming real-time time-series data, determining a likelihood of a current state belonging to a plurality of possible states in the state-space representation; and determining a probability of incurring said annotated anomalies based on a plurality of likely current state sequences that satisfy a predefined likelihood criteria.
    Type: Grant
    Filed: January 31, 2018
    Date of Patent: December 3, 2024
    Assignee: EMC IP Holding Company LLC
    Inventors: Tiago Salviano Calmon, VinĂ­cius Michel Gottin, John Cardente
  • Patent number: 12159716
    Abstract: A system for generating an alimentary instruction set identifying an individual prognostic mitigation plan, the system comprising a computing device; a diagnostic engine operating on the computing device, wherein the diagnostic engine is configured to receive information related to a biological extraction of a user, wherein the biological extraction contains an element of user physiological state data; generate a diagnostic output based upon the information related to the biological extraction, and an alimentary instruction set generator module operating on the computing device, wherein the alimentary instruction set is configured to identify an element of user wellness behavior data; generate a nutrition instruction set utilizing the diagnostic output, the element of user wellness behavior data and a first machine-learning process; and customize the ameliorative output to identify a prognostic mitigation plan utilizing the element of user wellness data, and the nutrition instruction set.
    Type: Grant
    Filed: April 1, 2020
    Date of Patent: December 3, 2024
    Assignee: KPN INNOVATIONS, LLC.
    Inventor: Kenneth Neumann
  • Patent number: 12154025
    Abstract: Systems and methods are provided for optimizing GPU memory allocation for high-performance applications such as deep learning (DL) computing. For example, a DL task is executed using GPU resources (GPU device and GPU memory) to process a DL model having functional layers that are processed in a predefined sequence. A current functional layer of the DL model is invoked and processed using the GPU device. In response to the invoking, a data compression operation is performed to compress data of a previous functional layer of the DL model, and store the compressed data in the GPU memory. Responsive to the invoking, compressed data of a next functional layer of the DL model is accessed from the GPU memory and a data decompression operation is performed to decompress the compressed data for subsequent processing of the next functional layer of the DL model by the GPU device.
    Type: Grant
    Filed: February 13, 2018
    Date of Patent: November 26, 2024
    Assignee: EMC IP Holding Company LLC
    Inventors: Dragan Savic, Junping Zhao
  • Patent number: 12141678
    Abstract: A device, system, and method for approximating a neural network comprising N synapses or filters. The neural network may be partially-activated by iteratively executing a plurality of M partial pathways of the neural network to generate M partial outputs, wherein the M partial pathways respectively comprise M different continuous sequences of synapses or filters linking an input layer to an output layer. The M partial pathways may cumulatively span only a subset of the N synapses or filters such that a significant number of the remaining the N synapses or filters are not computed. The M partial outputs of the M partial pathways may be aggregated to generate an aggregated output approximating an output generated by fully-activating the neural network by executing a single instance of all N synapses or filters of the neural network. Training or prediction of the neural network may be performed based on the aggregated output.
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: November 12, 2024
    Assignee: NANO DIMENSION TECHNOLOGIES, LTD.
    Inventors: Eli David, Eri Rubin
  • Patent number: 12141676
    Abstract: Systems and methods for mitigating defects in a crossbar-based computing environment are disclosed. In some implementations, an apparatus comprises: a plurality of row wires; a plurality of column wires connecting between the plurality of row wires; a plurality of non-linear devices formed in each of a plurality of column wires configured to receive an input signal, wherein at least one of the non-linear device has a characteristic of activation function and at least one of the non-linear device has a characteristic of neuronal function.
    Type: Grant
    Filed: January 14, 2019
    Date of Patent: November 12, 2024
    Assignee: TETRAMEM INC.
    Inventor: Ning Ge