Patents Examined by Paul J Breene
  • Patent number: 12664396
    Abstract: One example method includes performing the various operations concerning a model that is operable to predict resource usage and execution time of computing workloads. The operations include extracting a fingerprint associated with telemetry data, and the telemetry data was generated based on performance of one of the computing workloads, in a constrained infrastructure, checking a fingerprint catalog to determine if there is a same or similar fingerprint to the fingerprint, when the same or similar fingerprint is found in the fingerprint catalog, inferring that the model includes information about the computing workload and the model is able to predict telemetry data and execution time for the computing workload in a target infrastructure, and when the same or similar fingerprint is not found, inserting the extracted fingerprint into the fingerprint catalog, and generating a retrained model by retraining the model using the telemetry data associated with the extracted fingerprint.
    Type: Grant
    Filed: October 8, 2021
    Date of Patent: June 23, 2026
    Assignee: EMC IP Holding Company LLC
    Inventor: Eduardo Vera Sousa
  • Patent number: 12664430
    Abstract: A neural network processor is configured to execute instructions in parallel on different computing engines (CEs) to perform convolution operations on an input dataset. The input dataset is divided into overlapping chunks, including a first chunk and a second chunk. Each CE processes a last portion of a respective chunk to compute respective shared states and receives additional shared states for processing. The first chunk is the respective chunk for a first CE. The second chunk is the respective chunk for a second CE. The additional shared states received by the second CE are the respective shared states computed by the first CE. The second CE receives the respective shared states computed by the first CE as a substitute for intermediate states that would otherwise have been computed by the second CE using a first portion of the second chunk.
    Type: Grant
    Filed: April 30, 2024
    Date of Patent: June 23, 2026
    Assignee: Amazon Technologies, Inc.
    Inventors: Thiam Khean Hah, Randy Renfu Huang, Richard John Heaton, Ron Diamant, Vignesh Vivekraja
  • Patent number: 12585959
    Abstract: A method includes receiving a source data set and a target data set and identifying a loss function for a deep learning model based on the source data set and the target data set. The loss function includes encoder weights, source classifier layer weights, target classifier layer weights, coefficients, and a policy weight. During a first phase of each of a plurality of learning iterations for a learning to transfer learn (L2TL) architecture, the method also includes: applying gradient decent-based optimization to learn the encoder weights, the source classifier layer weights, and the target classifier weights that minimize the loss function; and determining the coefficients by sampling actions of a policy model. During a second phase of each of the plurality of learning iterations, determining the policy weight that maximizes an evaluation metric.
    Type: Grant
    Filed: August 24, 2023
    Date of Patent: March 24, 2026
    Assignee: Google LLC
    Inventors: Sercan Omer Arik, Tomas Jon Pfister, Linchao Zhu
  • Patent number: 12578718
    Abstract: A model construction support system supports searching for a feature used to construct a prediction model that outputs an objective variable related to a predicted event for a machine based on explanatory variables, and a division method for dividing the explanatory variables into groups to improve calculation accuracy of the objective variables based on the prediction model. The system divides the explanatory variables into a plurality of groups, calculates accuracy of the features set based on the explanatory variable in the groups, and calculates a score of the feature in the groups based on the accuracy and a support ratio of the explanatory variable to all of the explanatory variables before division. The system calculates accuracy of a group division feature used to divide the explanatory variables, and a score in the groups based on the score and the accuracy in the groups.
    Type: Grant
    Filed: February 28, 2022
    Date of Patent: March 17, 2026
    Assignee: Hitachi, Ltd.
    Inventor: Keiro Muro
  • Patent number: 12579427
    Abstract: Methods, systems, and computer programs are presented for determining parameters of neural networks and selecting embedding dimensions for the feature fields. One method includes an operation for initializing parameters of a neural network and weights for embedding sizes for each feature associated with the neural network. The parameters of the neural network and the weights are iteratively optimized. Each optimization iteration comprises training the neural network with current parameters of the neural network to optimize a value of the weights, and training the neural network with current values of the weights to optimize the parameters of the neural network. Further, the method includes operations for selecting embedding sizes for the features based on the optimized values of the weights, and for training the neural network based on the selected embedding sizes for the features to obtain an estimator model. A prediction is generated utilizing the estimator model.
    Type: Grant
    Filed: October 19, 2021
    Date of Patent: March 17, 2026
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Xiangyu Zhao, Sida Wang, Huiji Gao, Bo Long, Bee-Chung Chen, Weiwei Guo, Jun Shi
  • Patent number: 12572792
    Abstract: Performing a goal-seek analysis of spatial-temporal data by generating a hierarchical cluster according to spatial temporal data, determining a spatial-temporal location input for a target, determining spatial-temporal predictor values for the spatial-temporal location, and adjusting the hierarchical cluster according to and the spatial-temporal predictors.
    Type: Grant
    Filed: October 9, 2020
    Date of Patent: March 10, 2026
    Assignee: International Business Machines Corporation
    Inventors: Rui Wang, Jing James Xu, Xiao Ming Ma, Si Er Han, Lei Gao
  • Patent number: 12505356
    Abstract: Aspects and examples disclosed herein are directed to data enrichment on insulated appliances. An appliance for performing knowledge mining in a disconnected state is operative to: import a plurality of containerized cognitive functions and a seed index from a service node, when the appliance is initially connected to a network; ingest data of a first type from a first data source coupled to the appliance; enrich at least a first portion of the ingested data, when in the disconnected state, with at least one of the cognitive functions of the plurality of containerized cognitive functions; identify at least a second portion of the ingested data for enrichment by a cognitive function that is not within the plurality of containerized cognitive functions; based at least on knowledge extracted from the enriched data, further enrich the enriched data; and grow the seed index into an enhanced index with the enriched data.
    Type: Grant
    Filed: May 8, 2019
    Date of Patent: December 23, 2025
    Assignee: Microsoft Technology Licensing, LLC.
    Inventors: Michael Mong-Kuan Tse, Kamran Rajabi Zargahi, Samuel Sau Man Chan, Richard Jason Ortega
  • Patent number: 12488224
    Abstract: Systems and methods for user-specific content generation can leverage parameter tuning based on user feedback data to tune a set of parameters for conditioning a machine-learned content generation model for the content generation. The set of parameters can be processed with the machine-learned content generation model to generate a model-generated content item that is associated with user tastes and interests. The parameter tuning can include processing user interactions associated with the model-generated content item to adjust the set of parameters.
    Type: Grant
    Filed: October 11, 2023
    Date of Patent: December 2, 2025
    Assignee: GOOGLE LLC
    Inventor: Ibrahim Badr
  • Patent number: 12481870
    Abstract: A method for training a machine learning model for determining a quality grade of data sets from each of a plurality of sensors. The sensors are configured to generate surroundings representations. The method includes: providing data sets of each of the sensors from corresponding surroundings representations; providing attribute data of ground truth objects of the surroundings representations; determining a quality grade of the respective data set of each of the sensors using a metric, the metric comparing at least one variable, which is determined using the respective data set, with at least one attribute datum of at least one associated ground truth object of the surroundings representation; and training the machine learning model using the data sets of each of the sensors and the respectively assigned determined quality grades.
    Type: Grant
    Filed: October 5, 2020
    Date of Patent: November 25, 2025
    Assignee: ROBERT BOSCH GMBH
    Inventors: Rainer Stal, Christian Haase-Schuetz, Heinz Hertlein
  • Patent number: 12456049
    Abstract: Systems, devices, and methods related to a Deep Learning Accelerator and memory are described. For example, an integrated circuit device may be configured to execute instructions with matrix operands and configured with random access memory (RAM). A compiler has an artificial neural network configured to identify an optimized compilation option for an artificial neural network to be compiled by the compiler and/or for a hardware platform of Deep Learning Accelerators. The artificial neural network of the compiler can be trained via machine learning to identify the optimized compilation option based on the features of the artificial neural network to be compiled and/or features of the hardware platform on which the compiler output will be executed.
    Type: Grant
    Filed: November 6, 2020
    Date of Patent: October 28, 2025
    Assignee: Micron Technology, Inc.
    Inventors: Andre Xian Ming Chang, Aliasger Tayeb Zaidy, Marko Vitez, Michael Cody Glapa, Abhishek Chaurasia, Eugenio Culurciello
  • Patent number: 12444181
    Abstract: An electronic apparatus includes at least one memory configured to store at least one instruction and a first neural network model; a communicator comprising communication circuitry; and at least one processor configured to execute the at least one instruction to: receive, from an external electronic device, information on a second neural network model stored in the external electronic device through the communicator; compare the first neural network model with the second neural network model based on the information on the second neural network model; and control the communicator to transmit, to the external electronic device, information on a weight between nodes of the first neural network model based on comparison between the second neural network model and the first neural network model.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: October 14, 2025
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Juyong Song, Jaedeok Kim, Jungwook Kim
  • Patent number: 12423572
    Abstract: Embodiments provide a machine learning model to identify changes in setpoints of one or more environmental control modules that, while having a high critical error, provide greater reductions in a cost function associated with the one or more environmental modules provided in an environmentally controlled space. The high critical error associated with the identified changes may still be within an acceptable threshold range associated with the environmentally controlled space. Thus, contrary to rule-based methods, the artificial intelligence (AI) based model described herein may recommended optimal changes to the system that yield to greater savings in the cost function and may not focus on minimizing the critical control error. Rather, the AI-based technique may simply aim at keeping the critical control error within an acceptable threshold range.
    Type: Grant
    Filed: September 8, 2020
    Date of Patent: September 23, 2025
    Assignee: Vigilent Corporation
    Inventors: Clifford C. Federspiel, Peter C. Varadi
  • Patent number: 12417392
    Abstract: Provided is an apparatus for training a knowledge tracking model, which is an apparatus for predicting a correct answer probability of a user on the basis of data augmentation, the apparatus including: a problem-solving data storage unit configured to store problem-solving data in which a problem solved by a user and a response of the user to the problem are mapped; a data augmentation performing unit configured to receive the problem-solving data from the problem-solving storage unit and convert the problem-solving data to generate augmented data; a regularization performing unit configured to receive the augmented data from the data augmentation performing unit and perform a regularization operation using a regularization loss function determined on the basis of a data augmentation method that is performed; and a model training unit configured to input the augmented data to a knowledge tracking model, allow the knowledge tracking model to learn a weight representing a relationship between a problem-solving
    Type: Grant
    Filed: March 7, 2022
    Date of Patent: September 16, 2025
    Assignee: RIIID INC.
    Inventors: See Woo Lee, Young Duck Choi, Byung Soo Kim, June Young Park
  • Patent number: 12406203
    Abstract: Techniques are disclosed for providing a scalable multi-tenant serve pool for chatbot systems. A query serving system (QSS) receives a request to serve a query for a new skillbot. The QSS comprises a plurality of deployments, each of which is configured to host a plurality of machine-learning models, each machine-learning model being associated with a skillbot, each deployment including a serving container and a model manager container that hosts a model manager, the serving container including a plurality of sub-containers, each of which hosts one of the machine-learning models downloaded by the model manager. The QSS selects a first deployment to be assigned to the new skillbot based on a first criterion, and loads the machine-learning model associated with the new skillbot into the first deployment. The machine-learning model is trained to serve the query for the new skillbot. The query is served using the machine-learning model.
    Type: Grant
    Filed: April 13, 2021
    Date of Patent: September 2, 2025
    Assignee: ORACLE INTERNATIONAL CORPORATION
    Inventors: Vishal Vishnoi, Suman Mallapura Somasundar, Xin Xu, Stevan Malesevic
  • Patent number: 12399890
    Abstract: Systems and methods for natural language processing are described. Embodiments are configured to receive a structured representation of a search query, wherein the structured representation comprises a plurality of nodes and at least one edge connecting two of the nodes, receive a modification expression for the search query, wherein the modification expression comprises a natural language expression, generate a modified structured representation based on the structured representation and the modification expression using a neural network configured to combine structured representation features and natural language expression features, and perform a search based on the modified structured representation.
    Type: Grant
    Filed: November 3, 2020
    Date of Patent: August 26, 2025
    Assignee: ADOBE INC.
    Inventors: Quan Tran, Zhe Lin, Xuanli He, Walter Chang, Trung Bui, Franck Dernoncourt
  • Patent number: 12400128
    Abstract: Aspects and examples disclosed herein are directed to data enrichment on insulated appliances. An appliance for performing knowledge mining in a disconnected state is operative to: ingest data of a first type from a first data source coupled to the appliance; enrich at least a first portion of the ingested data, when in the disconnected state, with at least one of the cognitive functions of the plurality of containerized cognitive functions; identify at least a second portion of the ingested data for enrichment by a cognitive function that is not within the plurality of containerized cognitive functions; store the enriched data in an index; triage the ingested data and the enriched data in the index for uploading; upload the triaged data when reconnected to a network; and import an updated plurality of containerized cognitive functions when reconnected.
    Type: Grant
    Filed: May 8, 2019
    Date of Patent: August 26, 2025
    Assignee: Microsoft Technology Licensing, LLC.
    Inventors: Michael Mong-Kuan Tse, Kamran Rajabi Zargahi, Samuel Sau Man Chan, Richard Jason Ortega
  • Patent number: 12387113
    Abstract: Disclosed herein are embodiments of systems, methods, and products comprises a server for efficiently processing electronic requests. The server receives a plurality of predictive computer models and generates a specification file for each model by parsing the source code of each model. When the server receives an electronic request, the API layer of the server validates the request by verifying the inputs of the request satisfying validation codes in the specification file of the corresponding model. If the electronic request is invalid, the server imputes valid values for the request and sends the imputed values to the model execution layer. Within the model execution layer, the server utilizes an integrated development environment of a third-party server to call the function of the corresponding model. The model execution layer transmits the function's output results back to the API layer, which transmits the output results to the user device.
    Type: Grant
    Filed: August 27, 2020
    Date of Patent: August 12, 2025
    Assignee: Massachusetts Mutual Life Insurance Company
    Inventor: Peng Wang
  • Patent number: 12373706
    Abstract: Described is a system for continual adaptation of a machine learning model implemented in an autonomous platform. The system adapts knowledge previously learned by the machine learning model for performance in a new domain. The system receives a consecutive sequence of new domains comprising new task data. The new task data and past learned tasks are forced to share a data distribution in an embedding space, resulting in a shared generative data distribution. The shared generative data distribution is used to generate a set of pseudo-data points for the past learned tasks. Each new domain is learned using both the set of pseudo-data points and the new task data. The machine learning model is updated using both the set of pseudo-data points and the new task data.
    Type: Grant
    Filed: October 8, 2020
    Date of Patent: July 29, 2025
    Assignee: HRL LABORATORIES, LLC
    Inventors: Soheil Kolouri, Mohammad Rostami, Praveen K. Pilly
  • Patent number: 12353990
    Abstract: A computer-implemented method, a computer program product, and a computer system for using a time-window based attention long short-term memory (TW-LSTM) network to analyze sequential data with time irregularity. A computer splits elapsed time into a predetermined number of time windows. The computer calculates average values of previous cell states in respective ones of the time windows and sets the average values as aggregated cell states for the respective ones of the time windows. The computer generates attention weights for the respective ones of the time windows. The computer calculates a new previous cell state, based on the aggregated cell states and the attention weights for the respective ones of the time windows. The computer updates a current cell state, based on the new previous cell state.
    Type: Grant
    Filed: July 12, 2020
    Date of Patent: July 8, 2025
    Assignee: International Business Machines Corporation
    Inventors: Toshiya Iwamori, Akira Koseki, Hiroki Yanagisawa, Takayuki Katsuki
  • Patent number: 12346802
    Abstract: Next state prediction technology that performs the following computer based operations: receiving state information that includes information indicative of a current state of an environment; processing the state information to predict a future state of the environment, with the processing being performed by a hybrid computer system that includes both of the following: (i) neural network software module(s) that include machine learning functionality, and (ii) symbolic rule based software modules; and using the prediction of the next state of the environment as an input with respect to taking a further action (for example, activating a hardware device or effecting a communication to a human or another device).
    Type: Grant
    Filed: December 3, 2020
    Date of Patent: July 1, 2025
    Assignee: International Business Machines Corporation
    Inventors: Akifumi Wachi, Ryosuke Kohita, Daiki Kimura