Patents Examined by Alexey Shmatov
-
Patent number: 12242975Abstract: Techniques regarding identifying candidate knowledge graph subgraphs in a question answering over knowledge graph task are provided. For example, one or more embodiments described herein can comprise a system, which can comprise a memory that can store computer executable components. The system can also comprise a processor, operably coupled to the memory, and that can execute the computer executable components stored in the memory. The computer executable components can comprise a question answering over knowledge graph component that encodes graph structure information of a knowledge graph subgraph and a question graph into neural network embeddings.Type: GrantFiled: October 1, 2020Date of Patent: March 4, 2025Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Lingfei Wu, Chen Wang
-
Patent number: 12229653Abstract: Systems, methods, apparatuses, and computer program products for tracking weak signal traces under severe noise and/or distortions. A method may include tracking at least one candidate frequency trace from a time-frequency representation of a signal. The method may also include identifying a frequency trace of the signal based on tracking results. In addition, the method may include outputting an estimated frequency vector related to the frequency trace. Further, the tracking may be performed under a noisy condition environment.Type: GrantFiled: September 19, 2019Date of Patent: February 18, 2025Assignee: UNIVERSITY OF MARYLAND, COLLEGE PARKInventors: Qiang Zhu, Mingliang Chen, Min Wu, Chau-Wai Wong
-
Patent number: 12230366Abstract: A method for employee biometric tracking is provided. The method comprises providing to a user a plurality of wearable devices capable of being connected to the user, establishing a wireless connection between the plurality of wearable devices and a mobile device, collecting by the plurality of wearable devices a plurality of biometric data from the user, receiving by an application stored on the mobile device the plurality of biometric data, inputting into a predictive engine biometric data selected from the plurality of biometric data, determining by the predictive engine in response to the biometric data whether the user is at, or soon will be at, an alert level, creating an alert signal, and displaying the alert signal to the user.Type: GrantFiled: October 4, 2022Date of Patent: February 18, 2025Assignee: BlyncSync Technologies, LLCInventors: Austin Green, Steven Kastelic
-
Patent number: 12223438Abstract: One or more computer processors identify one or more similar, historical regression tests and historical builds utilizing a computed similarity measure between a regressed build and one or more historical builds conducted on a same release cycle, wherein the identified one or more similar historical regression tests and historical builds are K closest neighbors to the regressed build; predict an elapsed time of the one or more profiled regression tests utilizing a KNN algorithm comprising the K closest neighbors each weighted by a corresponding average distance from a test point and the elapsed time as a target variable; responsive to the predicted elapsed time exceeding an actual elapsed time associated with the regressed build, determine that the regressed build is an actual regression; responsive to determining that the regressed build is not due to variability, apply one or more mitigation actions to the regressed build.Type: GrantFiled: July 23, 2020Date of Patent: February 11, 2025Assignee: International Business Machines CorporationInventors: Sweta Singh, Manish Anand, Vaibhav Murlidhar Kulkarni
-
Patent number: 12223407Abstract: In automated machine learning, an approximate best configuration can be selected among multiple candidate machine-learning configurations by progressively sampling training and test datasets for the iterative training and testing of the configurations while progressively pruning the set of candidate configurations based on associated estimated confidence intervals for their respective performance.Type: GrantFiled: August 23, 2018Date of Patent: February 11, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Chi Wang, Silu Huang, Surajit Chaudhuri, Bolin Ding
-
Patent number: 12210952Abstract: A reorganizable neural network computing device is provided. The computing device includes a data processing array unit including a plurality of operators disposed at locations corresponding to a row and a column. One or more chaining paths which transfer the first input data from the operator of the first row of the data processing array to the operator of the second row are optionally formed. The plurality of first data input processors of the computing device transfer the first input data for a layer of the neural network to the operators along rows of the data processing array unit, and the plurality of second data input processors of the computing device transfer the second input data to the operators along the columns of the data processing array.Type: GrantFiled: November 27, 2018Date of Patent: January 28, 2025Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTEInventors: Young-Su Kwon, Chan Kim, Hyun Mi Kim, Jeongmin Yang, Chun-Gi Lyuh, Jaehoon Chung, Yong Cheol Peter Cho
-
Patent number: 12210954Abstract: A point estimate value for an individual is computed using a Bayesian neural network model (BNN) by training a first BNN model that computes a weight mean value, a weight standard deviation value, a bias mean value, and a bias standard deviation value for each neuron of a plurality of neurons using observations. A plurality of BNN models is instantiated using the first BNN model. Instantiating each BNN model of the plurality of BNN models includes computing, for each neuron, a weight value using the weight mean value, the weight standard deviation value, and a weight random draw and a bias value using the bias mean value, the bias standard deviation value, and a bias random draw. Each instantiated BNN model is executed with the observations to compute a statistical parameter value for each observation vector of the observations. The point estimate value is computed from the statistical parameter value.Type: GrantFiled: December 6, 2023Date of Patent: January 28, 2025Assignee: SAS Institute Inc.Inventors: Sylvie Tchumtchoua Kabisa, Xilong Chen, Gunce Eryuruk Walton, David Bruce Elsheimer, Ming-Chun Chang
-
Patent number: 12198060Abstract: Embodiments described herein combine both masked reconstruction and predictive coding. Specifically, unlike contrastive learning, the mutual information between past states and future states are directly estimated. The context information can also be directly captured via shifted masked reconstruction—unlike standard masked reconstruction, the target reconstructed observations are shifted slightly towards the future to incorporate more predictability. The estimated mutual information and shifted masked reconstruction loss can then be combined as the loss function to update the neural model.Type: GrantFiled: August 28, 2020Date of Patent: January 14, 2025Assignee: Salesforce, Inc.Inventors: Junwen Bai, Weiran Wang, Yingbo Zhou, Caiming Xiong
-
Patent number: 12190222Abstract: A design optimization method based on active learning, which involves dynamic exploration and exploitation of the design space of interest using an ensemble of machine learning algorithms. In this approach, a hybrid methodology incorporating an explorative weak learner which fits high-level information about the response surface, and an exploitative strong learner (based on committee machine) that fits finer details around promising regions identified by the weak learner, is employed. For each design iteration, an aristocratic approach is used to select a set of nominees, where points that meet a threshold merit value as predicted by the weak learner are selected to be evaluated using function evaluation. In addition to these points, the global optimum as predicted by the strong learner is also evaluated to enable rapid convergence to the actual global optimum once the most promising region has been identified by the optimizer.Type: GrantFiled: November 26, 2019Date of Patent: January 7, 2025Assignee: UChicago Argonne, LLCInventors: Opeoluwa Olawale Owoyele, Pinaki Pal
-
Patent number: 12190223Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training an action selection neural network. One of the methods includes maintaining a replay memory that stores trajectories generated as a result of interaction of an agent with an environment; and training an action selection neural network having policy parameters on the trajectories in the replay memory, wherein training the action selection neural network comprises: sampling a trajectory from the replay memory; and adjusting current values of the policy parameters by training the action selection neural network on the trajectory using an off-policy actor critic reinforcement learning technique.Type: GrantFiled: May 28, 2020Date of Patent: January 7, 2025Assignee: DeepMind Technologies LimitedInventors: Ziyu Wang, Nicolas Manfred Otto Heess, Victor Constant Bapst
-
Patent number: 12182686Abstract: Networks and encodings therefor are provided that are adapted to provide increased energy efficiency and speed for convolutional operations. In various embodiments, a neural network comprises a plurality of neural cores. Each of the plurality of neural cores comprises a memory. A network interconnects the plurality of neural cores. The memory of each of the plurality of neural cores comprises at least a portion of a weight tensor. The weight tensor comprising a plurality of weights. Each neural core is adapted to retrieve locally or receive a portion of an input image, apply the portion of the weight tensor thereto, and store locally or send a result therefrom via the network to other of the plurality of neural cores.Type: GrantFiled: April 30, 2018Date of Patent: December 31, 2024Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventor: Dharmendra S. Modha
-
Patent number: 12174908Abstract: Disclosed is a method for convolution calculation in a neural network, comprising: reading an input feature map, depthwise convolution kernels and pointwise convolution kernels from a dynamic random access memory (DRAM); performing depthwise convolution calculations and pointwise convolution calculations by depthwise convolution calculation units and pointwise convolution calculation units, according to the input feature map, the depthwise convolution kernels and the pointwise convolution kernels to obtain output feature values of a first predetermined number p of points on all pointwise convolution output channels; storing the output feature values of a first predetermined number p of points on all pointwise convolution output channels into an on-chip memory; and repeating above operation to obtain output feature values of all points on all point wise convolution output channels. Therefore, the storage space for storing intermediate results may be reduced.Type: GrantFiled: December 17, 2018Date of Patent: December 24, 2024Assignee: Nanjing Horizon Robotics Technology Co., Ltd.Inventors: Liang Chen, Chang Huang, Kun Ling, Jianjun Li, Delin Li, Heng Luo
-
Patent number: 12165069Abstract: Some embodiments provide a compiler for optimizing the implementation of a machine-trained network (e.g., a neural network) on an integrated circuit (IC). The compiler of some embodiments receives a specification of a machine-trained network including multiple layers of computation nodes and generates a graph representing options for implementing the machine-trained network in the IC. In some embodiments, the graph includes nodes representing options for implementing each layer of the machine-trained network and edges between nodes for different layers representing different implementations that are compatible. In some embodiments, the graph is populated according to rules relating to memory use and the numbers of cores necessary to implement a particular layer of the machine trained network such that nodes for a particular layer, in some embodiments, represent fewer than all the possible groupings of sets of clusters.Type: GrantFiled: July 29, 2019Date of Patent: December 10, 2024Assignee: Amazon Technologies, Inc.Inventors: Brian Thomas, Steven L. Teig
-
Patent number: 12165052Abstract: In some examples, an individually-pruned neural network can estimate blood pressure from a seismocardiogram (SCG). In some examples, a baseline model can be constructed by training the model with SCG data and blood pressure measurement from a plurality of subjects. One or more filters (e.g., the filters in the top layer of the network) can be ranked by separability, which can be used to prune the model for each unseen user that uses the model thereafter, for example. In some examples, individuals can use individually-pruned models to calculate blood pressure using SCG data without corresponding blood pressure measurements.Type: GrantFiled: July 31, 2020Date of Patent: December 10, 2024Assignee: Apple Inc.Inventors: Siddharth Khullar, Nicholas E. Apostoloff, Amruta Pai
-
Patent number: 12159717Abstract: A technology for obtaining a respiratory rate from a photoplethysmogram (PPG) signal. In one example, an artificial neural network model can be trained to predict a respiratory rate using a training dataset containing PPG data. The artificial neural network model can include a first series of convolutional layers to remove artifacts from a PPG signal, a fast Fourier transform (FFT) layer to convert the PPG signal to PPG frequency representations, and a dense layer to decode the PPG frequency representations to respiratory rate predictions. After training the artificial neural network model, PPG data generated by a pulse oximeter monitor can be obtained, and the PPG data can be input to the artificial neural network model. The artificial neural network model outputs a respiratory rate prediction, wherein the respiratory rate prediction represents the respiratory rate obtained from the PPG signal.Type: GrantFiled: October 7, 2020Date of Patent: December 3, 2024Assignee: OWLET BABY CARE, INC.Inventors: Sean Kerman, Tanner Christensen, Chris Hettinger, Jeffrey Humpherys
-
Patent number: 12159237Abstract: Methods and apparatus are provided for real-time anomaly detection over sets of time-series data. One method comprises: obtaining a state-space representation of a plurality of states and transitions between said states based on sets of historical time-series data; obtaining an anomaly detection model trained using a supervised learning technique, wherein the anomaly detection model associates sequences of states in the state-space representation with annotated anomalies in the sets of historical time-series data and assigns a probability to said sequences of states; and, for incoming real-time time-series data, determining a likelihood of a current state belonging to a plurality of possible states in the state-space representation; and determining a probability of incurring said annotated anomalies based on a plurality of likely current state sequences that satisfy a predefined likelihood criteria.Type: GrantFiled: January 31, 2018Date of Patent: December 3, 2024Assignee: EMC IP Holding Company LLCInventors: Tiago Salviano Calmon, VinĂcius Michel Gottin, John Cardente
-
Patent number: 12159716Abstract: A system for generating an alimentary instruction set identifying an individual prognostic mitigation plan, the system comprising a computing device; a diagnostic engine operating on the computing device, wherein the diagnostic engine is configured to receive information related to a biological extraction of a user, wherein the biological extraction contains an element of user physiological state data; generate a diagnostic output based upon the information related to the biological extraction, and an alimentary instruction set generator module operating on the computing device, wherein the alimentary instruction set is configured to identify an element of user wellness behavior data; generate a nutrition instruction set utilizing the diagnostic output, the element of user wellness behavior data and a first machine-learning process; and customize the ameliorative output to identify a prognostic mitigation plan utilizing the element of user wellness data, and the nutrition instruction set.Type: GrantFiled: April 1, 2020Date of Patent: December 3, 2024Assignee: KPN INNOVATIONS, LLC.Inventor: Kenneth Neumann
-
Patent number: 12154025Abstract: Systems and methods are provided for optimizing GPU memory allocation for high-performance applications such as deep learning (DL) computing. For example, a DL task is executed using GPU resources (GPU device and GPU memory) to process a DL model having functional layers that are processed in a predefined sequence. A current functional layer of the DL model is invoked and processed using the GPU device. In response to the invoking, a data compression operation is performed to compress data of a previous functional layer of the DL model, and store the compressed data in the GPU memory. Responsive to the invoking, compressed data of a next functional layer of the DL model is accessed from the GPU memory and a data decompression operation is performed to decompress the compressed data for subsequent processing of the next functional layer of the DL model by the GPU device.Type: GrantFiled: February 13, 2018Date of Patent: November 26, 2024Assignee: EMC IP Holding Company LLCInventors: Dragan Savic, Junping Zhao
-
Patent number: 12141678Abstract: A device, system, and method for approximating a neural network comprising N synapses or filters. The neural network may be partially-activated by iteratively executing a plurality of M partial pathways of the neural network to generate M partial outputs, wherein the M partial pathways respectively comprise M different continuous sequences of synapses or filters linking an input layer to an output layer. The M partial pathways may cumulatively span only a subset of the N synapses or filters such that a significant number of the remaining the N synapses or filters are not computed. The M partial outputs of the M partial pathways may be aggregated to generate an aggregated output approximating an output generated by fully-activating the neural network by executing a single instance of all N synapses or filters of the neural network. Training or prediction of the neural network may be performed based on the aggregated output.Type: GrantFiled: December 28, 2020Date of Patent: November 12, 2024Assignee: NANO DIMENSION TECHNOLOGIES, LTD.Inventors: Eli David, Eri Rubin
-
Patent number: 12141676Abstract: Systems and methods for mitigating defects in a crossbar-based computing environment are disclosed. In some implementations, an apparatus comprises: a plurality of row wires; a plurality of column wires connecting between the plurality of row wires; a plurality of non-linear devices formed in each of a plurality of column wires configured to receive an input signal, wherein at least one of the non-linear device has a characteristic of activation function and at least one of the non-linear device has a characteristic of neuronal function.Type: GrantFiled: January 14, 2019Date of Patent: November 12, 2024Assignee: TETRAMEM INC.Inventor: Ning Ge