Patents Examined by Paul J Breene
-
Patent number: 12748989Abstract: In an approach for dynamic augmentation based on data sample hardness for training a learning model, a processor defines one or more augmentations for a dataset for training the learning model. A processor applies the one or more augmentations to the dataset. A processor trains the learning model with the one or more augmentations. A processor measures hardness of one or more data samples in the dataset. A processor adjusts the one or more augmentations for the one or more data samples based on corresponding hardness of the one or more data samples. A processor applies the adjusted one or more augmentations to the dataset. A processor trains the learning model with the adjusted one or more augmentations applied to the dataset.Type: GrantFiled: July 30, 2020Date of Patent: September 29, 2026Assignee: International Business Machines CorporationInventors: Lior Ness, Yoel Shoshan
-
Patent number: 12743641Abstract: An example method for abnormality detection based on causal graphs representing causal relationships of abnormalities includes detecting an abnormality in a test data set and generating a counterfactual data set for the test data set. The method further includes determining a quantitative feature dependence between the test data set and the counterfactual data set and determining a causal relationship of the abnormality based on the quantitative feature dependence. The method also includes generating a causal graph that represents the causal relationship of the abnormality. The method may also implement an action to mitigate the abnormality based on the causal graph.Type: GrantFiled: February 5, 2021Date of Patent: September 22, 2026Assignee: R&B TECHNOLOGY HOLDING CO. LTD.Inventors: Mingming Zuo, Gang Wu, Charles Ho Yuen Wong
-
Patent number: 12737586Abstract: An encoder for encoding weight parameters of a neural network is configured to obtain a plurality of weight parameters of the neural network, to encode the weight parameters of the neural network using a context-dependent arithmetic coding, to select a context for an encoding of a weight parameter, or for an encoding of a syntax element of a number representation of the weight parameter, in dependence on one or more previously encoded weight parameters and/or in dependence on one or more previously encoded syntax elements of a number representation of one or more weight parameters, and to encode the weight parameter, or a syntax element of the weight parameter, using the selected context. Corresponding decoder, quantizer, methods and computer programs are also described.Type: GrantFiled: May 16, 2025Date of Patent: September 15, 2026Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.Inventors: Paul Haase, Arturo Marban Gonzalez, Heiner Kirchhoffer, Talmaj Marinc, Detlev Marpe, Stefan Matlage, David Neumann, Hoang Tung Nguyen, Wojciech Samek, Thomas Schierl, Heiko Schwarz, Simon Wiedemann, Thomas Wiegand
-
Patent number: 12726184Abstract: A novel and useful system and method of accelerated learning in neural networks using silicon based quantum dot arrays. Unitary noise is derived from a probability of detecting a particle within a quantum dot array structure comprising position based charge qubits with two time independent basis states |0> and |1>. A two level electron tunneling device such as an interface device, qubit or other quantum structure is used to generate quantum noise. The electron tunneling device includes a reservoir of particles, a quantum dot, and a barrier that is used to control tunneling between the reservoir and the quantum dot. Controlling the bias applied to the barrier controls the probability of detection. Thus, the probability density function (PDF) of the output unitary noise can be controlled to correspond to a desired probability. The quantum unitary noise is injected into one or more layers of an artificial neural network (ANN) to improve the learning and training process.Type: GrantFiled: November 9, 2021Date of Patent: September 1, 2026Assignee: Equal1.Labs Inc.Inventors: David J. Redmond, Dirk Robert Walter Leipold, Imran Bashir, Robert Bogdan Staszewski
-
Patent number: 12725008Abstract: Disclosed herein are techniques for detecting invalid web traffic. A method described herein involves obtaining an input sequence. The method further includes inputting the input sequence to an encoder model configured to generate an embedding from the input sequence. The method includes generating, as an output of the encoder model, an embedding. The method includes inputting the embedding to a classifier model configured to predict a vector of probability values corresponding to a plurality of classes using the embedding. A first class of the plurality of classes may be attributed to variable traffic and a second class of the plurality of classes may be attributed to repetitive traffic. The method includes predicting, as an output of the classifier, the vector of probability values. The method includes determining a machine-actor score from the vector of probability values. The method also includes outputting the machine-actor score.Type: GrantFiled: March 9, 2022Date of Patent: September 1, 2026Assignee: Oracle International CorporationInventors: Siddharth Pramod, Samuel Bald
-
Patent number: 12718055Abstract: An encoder for encoding weight parameters of a neural network is configured to obtain a plurality of weight parameters of the neural network, to encode the weight parameters of the neural network using a context-dependent arithmetic coding, to select a context for an encoding of a weight parameter, or for an encoding of a syntax element of a number representation of the weight parameter, in dependence on one or more previously encoded weight parameters and/or in dependence on one or more previously encoded syntax elements of a number representation of one or more weight parameters, and to encode the weight parameter, or a syntax element of the weight parameter, using the selected context. Corresponding decoder, quantizer, methods and computer programs are also described.Type: GrantFiled: May 16, 2025Date of Patent: August 25, 2026Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.Inventors: Paul Haase, Arturo Marban Gonzalez, Heiner Kirchhoffer, Talmaj Marinc, Detlev Marpe, Stefan Matlage, David Neumann, Hoang Tung Nguyen, Wojciech Samek, Thomas Schierl, Heiko Schwarz, Simon Wiedemann, Thomas Wiegand
-
Patent number: 12705491Abstract: Disclosed herein are techniques for generating embedded data for cursor-trail data including identifications of sequential positions of a cursor. A method described herein involves obtaining cursor-trail data identifying sequential positions of the cursor. The method further includes using a generative machine learning model to generate an embedding of the cursor-trail data. The generative machine learning model was previously trained using a machine learning model. The training using the machine learning model was unsupervised training including generating embeddings of training cursor-trail data, generating predicted cursor-trail data using a decoder neural network, and comparing the predicted cursor-trail data to the training cursor-trail data to determine a loss function for refining the generative machine learning model.Type: GrantFiled: October 1, 2021Date of Patent: August 11, 2026Assignee: Oracle International CorporationInventors: Samuel Bald, Siddharth Pramod
-
Patent number: 12690795Abstract: A reinforcement learning (RL) based adaptive state observation model usable for implementing a brain machine interface (BMI) is proposed for decoding a brain signal to determine a movement action and controlling a machine to perform the movement action. In the model, the brain signal is processed by a neural network (NN) for applying a nonlinear mapping defined by NN weights to the brain signal to thereby yield a transformed brain signal. The NN learns the nonlinear mapping by RL, allowing the weights to be adaptively and continuously updated to follow nonlinearity and non-stationarity of the brain signal. The transformed brain signal is processed by a Kalman filter (KF) to yield a control signal for controlling the machine to perform the movement action, thereby utilizing the KF to provide smooth generation of the control signal while blocking adverse influence of nonlinearity and non-stationarity of the brain signal to the KF.Type: GrantFiled: May 25, 2022Date of Patent: July 28, 2026Assignee: The Hong Kong University of Science and TechnologyInventors: Xiang Zhang, Zhiwei Song, Yiwen Wang
-
Patent number: 12694280Abstract: An explanation of a detection/classification algorithm made using a deep learning neural network clarifies the results that are formed and helps a user to identify the root cause of defect detection/classification model performance issues. A relevance map is determined based on a layer-wise relevance propagation algorithm. A mean intersection over union score between the relevance map and a ground truth is determined. A part of one of the semiconductor images that contributed to the classification using the deep learning model based on the relevance map and the mean intersection over union score is determined.Type: GrantFiled: September 27, 2020Date of Patent: July 28, 2026Assignee: KLA CORPORATIONInventors: Xu Zhang, Li He, Sankar Venkataraman
-
Patent number: 12694261Abstract: An encoder for encoding weight parameters of a neural network is configured to obtain a plurality of weight parameters of the neural network, to encode the weight parameters of the neural network using a context-dependent arithmetic coding, to select a context for an encoding of a weight parameter, or for an encoding of a syntax element of a number representation of the weight parameter, in dependence on one or more previously encoded weight parameters and/or in dependence on one or more previously encoded syntax elements of a number representation of one or more weight parameters, and to encode the weight parameter, or a syntax element of the weight parameter, using the selected context. Corresponding decoder, quantizer, methods and computer programs are also described.Type: GrantFiled: September 17, 2021Date of Patent: July 28, 2026Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.Inventors: Paul Haase, Arturo Marban Gonzalez, Heiner Kirchhoffer, Talmaj Marinc, Detlev Marpe, Stefan Matlage, David Neumann, Hoang Tung Nguyen, Wojciech Samek, Thomas Schierl, Heiko Schwarz, Simon Wiedemann, Thomas Wiegand
-
Patent number: 12664396Abstract: One example method includes performing the various operations concerning a model that is operable to predict resource usage and execution time of computing workloads. The operations include extracting a fingerprint associated with telemetry data, and the telemetry data was generated based on performance of one of the computing workloads, in a constrained infrastructure, checking a fingerprint catalog to determine if there is a same or similar fingerprint to the fingerprint, when the same or similar fingerprint is found in the fingerprint catalog, inferring that the model includes information about the computing workload and the model is able to predict telemetry data and execution time for the computing workload in a target infrastructure, and when the same or similar fingerprint is not found, inserting the extracted fingerprint into the fingerprint catalog, and generating a retrained model by retraining the model using the telemetry data associated with the extracted fingerprint.Type: GrantFiled: October 8, 2021Date of Patent: June 23, 2026Assignee: EMC IP Holding Company LLCInventor: Eduardo Vera Sousa
-
Patent number: 12664430Abstract: A neural network processor is configured to execute instructions in parallel on different computing engines (CEs) to perform convolution operations on an input dataset. The input dataset is divided into overlapping chunks, including a first chunk and a second chunk. Each CE processes a last portion of a respective chunk to compute respective shared states and receives additional shared states for processing. The first chunk is the respective chunk for a first CE. The second chunk is the respective chunk for a second CE. The additional shared states received by the second CE are the respective shared states computed by the first CE. The second CE receives the respective shared states computed by the first CE as a substitute for intermediate states that would otherwise have been computed by the second CE using a first portion of the second chunk.Type: GrantFiled: April 30, 2024Date of Patent: June 23, 2026Assignee: Amazon Technologies, Inc.Inventors: Thiam Khean Hah, Randy Renfu Huang, Richard John Heaton, Ron Diamant, Vignesh Vivekraja
-
Patent number: 12585959Abstract: A method includes receiving a source data set and a target data set and identifying a loss function for a deep learning model based on the source data set and the target data set. The loss function includes encoder weights, source classifier layer weights, target classifier layer weights, coefficients, and a policy weight. During a first phase of each of a plurality of learning iterations for a learning to transfer learn (L2TL) architecture, the method also includes: applying gradient decent-based optimization to learn the encoder weights, the source classifier layer weights, and the target classifier weights that minimize the loss function; and determining the coefficients by sampling actions of a policy model. During a second phase of each of the plurality of learning iterations, determining the policy weight that maximizes an evaluation metric.Type: GrantFiled: August 24, 2023Date of Patent: March 24, 2026Assignee: Google LLCInventors: Sercan Omer Arik, Tomas Jon Pfister, Linchao Zhu
-
Patent number: 12578718Abstract: A model construction support system supports searching for a feature used to construct a prediction model that outputs an objective variable related to a predicted event for a machine based on explanatory variables, and a division method for dividing the explanatory variables into groups to improve calculation accuracy of the objective variables based on the prediction model. The system divides the explanatory variables into a plurality of groups, calculates accuracy of the features set based on the explanatory variable in the groups, and calculates a score of the feature in the groups based on the accuracy and a support ratio of the explanatory variable to all of the explanatory variables before division. The system calculates accuracy of a group division feature used to divide the explanatory variables, and a score in the groups based on the score and the accuracy in the groups.Type: GrantFiled: February 28, 2022Date of Patent: March 17, 2026Assignee: Hitachi, Ltd.Inventor: Keiro Muro
-
Patent number: 12579427Abstract: Methods, systems, and computer programs are presented for determining parameters of neural networks and selecting embedding dimensions for the feature fields. One method includes an operation for initializing parameters of a neural network and weights for embedding sizes for each feature associated with the neural network. The parameters of the neural network and the weights are iteratively optimized. Each optimization iteration comprises training the neural network with current parameters of the neural network to optimize a value of the weights, and training the neural network with current values of the weights to optimize the parameters of the neural network. Further, the method includes operations for selecting embedding sizes for the features based on the optimized values of the weights, and for training the neural network based on the selected embedding sizes for the features to obtain an estimator model. A prediction is generated utilizing the estimator model.Type: GrantFiled: October 19, 2021Date of Patent: March 17, 2026Assignee: Microsoft Technology Licensing, LLCInventors: Xiangyu Zhao, Sida Wang, Huiji Gao, Bo Long, Bee-Chung Chen, Weiwei Guo, Jun Shi
-
Patent number: 12572792Abstract: Performing a goal-seek analysis of spatial-temporal data by generating a hierarchical cluster according to spatial temporal data, determining a spatial-temporal location input for a target, determining spatial-temporal predictor values for the spatial-temporal location, and adjusting the hierarchical cluster according to and the spatial-temporal predictors.Type: GrantFiled: October 9, 2020Date of Patent: March 10, 2026Assignee: International Business Machines CorporationInventors: Rui Wang, Jing James Xu, Xiao Ming Ma, Si Er Han, Lei Gao
-
Patent number: 12505356Abstract: Aspects and examples disclosed herein are directed to data enrichment on insulated appliances. An appliance for performing knowledge mining in a disconnected state is operative to: import a plurality of containerized cognitive functions and a seed index from a service node, when the appliance is initially connected to a network; ingest data of a first type from a first data source coupled to the appliance; enrich at least a first portion of the ingested data, when in the disconnected state, with at least one of the cognitive functions of the plurality of containerized cognitive functions; identify at least a second portion of the ingested data for enrichment by a cognitive function that is not within the plurality of containerized cognitive functions; based at least on knowledge extracted from the enriched data, further enrich the enriched data; and grow the seed index into an enhanced index with the enriched data.Type: GrantFiled: May 8, 2019Date of Patent: December 23, 2025Assignee: Microsoft Technology Licensing, LLC.Inventors: Michael Mong-Kuan Tse, Kamran Rajabi Zargahi, Samuel Sau Man Chan, Richard Jason Ortega
-
Patent number: 12488224Abstract: Systems and methods for user-specific content generation can leverage parameter tuning based on user feedback data to tune a set of parameters for conditioning a machine-learned content generation model for the content generation. The set of parameters can be processed with the machine-learned content generation model to generate a model-generated content item that is associated with user tastes and interests. The parameter tuning can include processing user interactions associated with the model-generated content item to adjust the set of parameters.Type: GrantFiled: October 11, 2023Date of Patent: December 2, 2025Assignee: GOOGLE LLCInventor: Ibrahim Badr
-
Patent number: 12481870Abstract: A method for training a machine learning model for determining a quality grade of data sets from each of a plurality of sensors. The sensors are configured to generate surroundings representations. The method includes: providing data sets of each of the sensors from corresponding surroundings representations; providing attribute data of ground truth objects of the surroundings representations; determining a quality grade of the respective data set of each of the sensors using a metric, the metric comparing at least one variable, which is determined using the respective data set, with at least one attribute datum of at least one associated ground truth object of the surroundings representation; and training the machine learning model using the data sets of each of the sensors and the respectively assigned determined quality grades.Type: GrantFiled: October 5, 2020Date of Patent: November 25, 2025Assignee: ROBERT BOSCH GMBHInventors: Rainer Stal, Christian Haase-Schuetz, Heinz Hertlein
-
Patent number: 12456049Abstract: Systems, devices, and methods related to a Deep Learning Accelerator and memory are described. For example, an integrated circuit device may be configured to execute instructions with matrix operands and configured with random access memory (RAM). A compiler has an artificial neural network configured to identify an optimized compilation option for an artificial neural network to be compiled by the compiler and/or for a hardware platform of Deep Learning Accelerators. The artificial neural network of the compiler can be trained via machine learning to identify the optimized compilation option based on the features of the artificial neural network to be compiled and/or features of the hardware platform on which the compiler output will be executed.Type: GrantFiled: November 6, 2020Date of Patent: October 28, 2025Assignee: Micron Technology, Inc.Inventors: Andre Xian Ming Chang, Aliasger Tayeb Zaidy, Marko Vitez, Michael Cody Glapa, Abhishek Chaurasia, Eugenio Culurciello