Patents Examined by Brian M Smith
  • Patent number: 12333406
    Abstract: A method for providing an activation signal for activating an actuator. The activation signal is ascertained as a function of an output signal of a neural network. The neural network includes a scaling layer. The scaling layer maps an input signal present at the input of the scaling layer onto an output signal present at the output of the scaling layer in such a way that this mapping corresponds to a projection of the input signal onto a predefinable value range, parameters being predefinable, which characterize the mapping.
    Type: Grant
    Filed: November 28, 2019
    Date of Patent: June 17, 2025
    Assignee: ROBERT BOSCH GMBH
    Inventors: Frank Schmidt, Torsten Sachse
  • Patent number: 12321825
    Abstract: Embodiments of the present disclosure relate to a technique for training neural networks, such as a generative adversarial neural network (GAN), using a limited amount of data. Training GANs using too little example data typically leads to discriminator overfitting, causing training to diverge and produce poor results. An adaptive discriminator augmentation mechanism is used that significantly stabilizes training with limited data providing the ability to train high-quality GANs. An augmentation operator is applied to the distribution of inputs to a discriminator used to train a generator, representing a transformation that is invertible to ensure there is no leakage of the augmentations into the images generated by the generator. Reducing the amount of training data that is needed to achieve convergence has the potential to considerably help many applications and may the increase use of generative models in fields such as medicine.
    Type: Grant
    Filed: March 24, 2021
    Date of Patent: June 3, 2025
    Assignee: NVIDIA Corporation
    Inventors: Tero Tapani Karras, Miika Samuli Aittala, Janne Johannes Hellsten, Samuli Matias Laine, Jaakko T. Lehtinen, Timo Oskari Aila
  • Patent number: 12288138
    Abstract: A method, system, and computer program product for explaining predictions made by black box time series models. The method may include identifying a black box time series model. The method may also include predicting one or more time instances using the black box time series model. The method may also include selecting a predicted time instance from the predicted data. The method may also include receiving training data for the black box time series model. The method may also include generating a set of white box time series models similar to the black box time series model. The method may also include selecting a preferred white box time series model. The method may also include analyzing behavior of the preferred white box time series model. The method may also include generating an explanation illustrating why the black box time series model forecasted the predicted time instance.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: April 29, 2025
    Assignee: International Business Machines Corporation
    Inventors: Diptikalyan Saha, Philips George John, Vitobha Munigala
  • Patent number: 12205001
    Abstract: A method comprising: receiving a primary training set comprising annotated data samples associated with one or more classes and annotated with class labels; constructing an auxiliary training set comprising at least some of the data samples, wherein each of the data samples is assigned at random to one of a set of identification classes, and annotated with an identification label associated with the identification class; at a training stage, train a machine learning model comprising a primary and auxiliary prediction heads, by: (i) training the primary prediction head on the primary training set to predict the class, and (ii) training the auxiliary prediction head on the auxiliary training set to predict the identification class, wherein an output layer of the machine learning model is configured to output a joint prediction which predicts the class label and is invariant to the identification label.
    Type: Grant
    Filed: February 24, 2021
    Date of Patent: January 21, 2025
    Assignee: International Business Machines Corporation
    Inventors: Yonatan Keren, Yoel Shoshan, Vadim Ratner
  • Patent number: 12147886
    Abstract: Described are techniques for predictive microservice activation. The techniques include training a machine learning model using a plurality of sequences of coordinates, where the plurality of sequences of coordinates are respectively based upon a corresponding plurality of series of vectors generated from historical usage data for an application and its associated microservices. The techniques further include inputting a new sequence of coordinates representing a series of application operations to the machine learning model. The techniques further include identifying a predicted microservice for future utilization based on an output vector generated by the machine learning model. The techniques further include activating the predicted microservice prior to the predicted microservice being called by the application.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: November 19, 2024
    Assignee: International Business Machines Corporation
    Inventors: Meng Wan, Li Na Guo, Wang Liu, Xue Rui Hu, Mei Qin Si, Hong Yan Zhang
  • Patent number: 12136034
    Abstract: The disclosure herein describes training a global model based on a plurality of data sets. The global model is applied to each data set of the plurality of data sets and a plurality of gradients is generated based on that application. At least one gradient quality metric is determined for each gradient of the plurality of gradients. Based on the determined gradient quality metrics of the plurality of gradients, a plurality of weight factors is calculated. The plurality of gradients is transformed into a plurality of weighted gradients based on the calculated plurality of weight factors and a global gradient is generated based on the plurality of weighted gradients. The global model is updated based on the global gradient, wherein the updated global model, when applied to a data set, performs a task based on the data set and provides model output based on performing the task.
    Type: Grant
    Filed: July 31, 2020
    Date of Patent: November 5, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Dimitrios B. Dimitriadis, Kenichi Kumatani, Robert Peter Gmyr, Masaki Itagaki, Yashesh Gaur, Nanshan Zeng, Xuedong Huang
  • Patent number: 12131254
    Abstract: A processor-implemented neural network distributed processing method includes: obtaining a first operation cost of a neural network according to a distribution strategy based on a plurality of operation devices; generating an operation configuration corresponding to the neural network based on the obtained first operation cost; performing a reduction operation on the generated operation configuration; and processing an operation of the neural network based on a reduced operation configuration obtained by performing the reduction operation.
    Type: Grant
    Filed: July 2, 2020
    Date of Patent: October 29, 2024
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Jiseung Jang
  • Patent number: 12100488
    Abstract: The present invention provides a method and a device for estimating a value to be estimated associated with a specimen, by performing machine learning of a relationship between a value of an estimation object and an output corresponding thereto, based on an output from a chemical sensor with regard to a plurality of specimens for which specific values to be estimated are known, and using the result of the mechanical learning to estimate a specific value to be estimated on the basis of an output from the chemical sensor with regard to a given unknown specimen.
    Type: Grant
    Filed: November 21, 2017
    Date of Patent: September 24, 2024
    Assignee: National Institute for Materials Science
    Inventors: Kota Shiba, Ryo Tamura, Gaku Imamura, Genki Yoshikawa
  • Patent number: 12086718
    Abstract: Machine learning systems and methods for embedding attributed sequence data. The attributed sequence data includes an attribute data part having a fixed number of attribute data elements and a sequence data part having a variable number of sequence data elements. An attribute network module includes a feedforward neural network configured to convert the attribute data part to an encoded attribute vector having a first number of attribute features. A sequence network module includes a recurrent neural network configured to convert the sequence data part to an encoded sequence vector having a second number of sequence features. In use, the machine learning system learns and outputs a fixed-length feature representation of input attributed sequence data which encodes dependencies between different attribute data elements, dependencies between different sequence data elements, and dependencies between attribute data elements and sequence data elements within the attributed sequence data.
    Type: Grant
    Filed: August 7, 2018
    Date of Patent: September 10, 2024
    Assignee: Amadeus S.A.S.
    Inventors: Zhongfang Zhuang, Aditya Arora, Jihane Zouaoui, Xiangnan Kong, Elke Rundensteiner
  • Patent number: 12079717
    Abstract: There is provided with a data processing apparatus for detecting an object from an image using a hierarchical neural network. The data processing apparatus has parallel first and second neural networks. An obtaining unit obtains a table which defines different first and second portions. An operation unit performs calculation of the feature data of a third portion based on feature data of the first portion identified using the table and on a weighting parameter between first and second layers of the first neural network, and calculation of feature data of a fourth portion based on feature data of the second portion identified using the table and on a weighting parameter between the first and second layers of the second neural network.
    Type: Grant
    Filed: July 1, 2020
    Date of Patent: September 3, 2024
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Shunta Tate, Tsewei Chen
  • Patent number: 12061995
    Abstract: Methods for natural language semantic matching performed by training and using a Markov Network model are provided. The trained Markov Network model can be used to identify answers to questions. Training may be performed using question-answer pairs that include labels indicating a correct or incorrect answer to a question. The trained Markov Network model can be used to identify answers to questions from sources stored on a database. The Markov Network model provides superior performance over other semantic matching models, in particular, where the training data set includes a different information domain type relative to the input question or the output answer of the trained Markov Network model.
    Type: Grant
    Filed: March 9, 2020
    Date of Patent: August 13, 2024
    Assignee: Adobe Inc.
    Inventors: Trung Huu Bui, Tong Sun, Natwar Modani, Lidan Wang, Franck Dernoncourt
  • Patent number: 12061984
    Abstract: In one aspect, the invention comprises a system and method for control of a transaction state system utilizing a distributed ledger. First, the system and method includes an application plane layer adapted to receive instructions regarding operation of the transaction state system. Preferably, the application plane layer is coupled to the application plane layer interface. Second, a control plane layer is provided, the control plane layer including an adaptive control unit, such as a cognitive computing unit, artificial intelligence unit or machine-learning unit. Third, a data plane layer includes an input interface to receive data input from one or more data sources and to provide output coupled to a decentralized distributed ledger, the data plane layer is coupled to the control plane layer. Optionally, the system and method serve to implement a smart contract on a decentralized distributed ledger.
    Type: Grant
    Filed: December 15, 2023
    Date of Patent: August 13, 2024
    Assignee: MILESTONE ENTERTAINMENT, LLC
    Inventors: Randall M. Katz, Robert Tercek
  • Patent number: 12056579
    Abstract: Some embodiments herein disclose intelligent priority evaluators configured to perform a method that prioritizes tasks submitted by various users, even if the tasks are similarly classified. The scheduling system can collect, calculate, and use various criteria to determine a reward score in order to prioritize one task over another, such as for dynamic scheduling purposes. This can be performed in addition to or as a replacement for receiving user designations of priority.
    Type: Grant
    Filed: March 30, 2017
    Date of Patent: August 6, 2024
    Assignee: Electronic Arts Inc.
    Inventors: Mohamed Marwan Mattar, Reza Pourabolghasem, John Kolen, Navid Aghdaie, Kazi Atif-Uz Zaman
  • Patent number: 12045224
    Abstract: Various embodiments include methods and devices for transforming a data block into weights for a neural network. Some embodiments may include training a first neural network of a cybernetic engram to reproduce the data block, and replacing the data block in memory with weights used by the first neural network to reproduce the data block.
    Type: Grant
    Filed: January 20, 2020
    Date of Patent: July 23, 2024
    Assignee: s รข f.ai, Inc.
    Inventor: Ahmed Masud
  • Patent number: 12039414
    Abstract: A method and system assists train a classifier model with a machine learning process. The method and system trains the classifier with a labeled training set and with an unlabeled training set. The method and system trains the classifier model to correctly classify data items that fall within a distribution of the labeled training set. The method and system trains the classifier to indicate a lack of confidence in classification for data items that do not fall within the distribution of the labeled training set.
    Type: Grant
    Filed: June 11, 2019
    Date of Patent: July 16, 2024
    Assignee: Intuit Inc.
    Inventors: Ashok N. Srivastava, Kumar Sricharan, Kumar Kallurupalli
  • Patent number: 12014268
    Abstract: Disclosed is a batch normalization layer training method, which may be used in a neural network learning apparatus having limited operational processing capability and storage space. A batch normalization layer training method according to an embodiment of the present disclosure may perform batch normalization transform by setting the gradients of the standard deviation and the mean of the loss function to zero, and applying a normalized statistic value obtained from an initial neural network or a previous neural network to the gradient of the loss function. The neural network learning apparatus of the present disclosure may be connected or converged with an Artificial Intelligence module, an Unmanned Aerial Vehicle (UAV), a robot, an Augmented Reality (AR) apparatus, a Virtual Reality (VR), a 5G network service-related apparatus, etc.
    Type: Grant
    Filed: March 10, 2020
    Date of Patent: June 18, 2024
    Assignee: LG ELECTRONICS INC.
    Inventors: Seung-Kyun Oh, Jinseok Im, Sanghoon Kim
  • Patent number: 12014248
    Abstract: Reducing resource consumption of a database system and a machine learning (ML) system is described. Data is received from a ML application of a database system. The data includes a first inference call for a predicted response to the received data. The first inference call is a request to a ML model to generate one or more predictions for which a response is unknown. A ML model using the received data generates an output comprising the predicted response to the data. The output for future inference calls is cached in an inference cache so as to bypass the ML model. The generated output to the ML application is provided by the ML model. A second inference call is received which includes the data of the first inference call. The cached output is retrieved from the inference cache. The retrieving bypasses the ML model.
    Type: Grant
    Filed: July 2, 2019
    Date of Patent: June 18, 2024
    Assignee: SAP SE
    Inventor: Siar Sarferaz
  • Patent number: 12001509
    Abstract: Generally, the present disclosure is directed to systems and methods that perform adaptive optimization with improved convergence properties. The adaptive optimization techniques described herein are useful in various optimization scenarios, including, for example, training a machine-learned model such as, for example, a neural network. In particular, according to one aspect of the present disclosure, a system implementing the adaptive optimization technique can, over a plurality of iterations, employ an adaptive per coordinate clipping threshold to clip a current first moment of the coordinate to obtain a current update value that enables faster convergence for the machine-learned model when the noise in the stochastic gradients is heavy tailed.
    Type: Grant
    Filed: March 17, 2020
    Date of Patent: June 4, 2024
    Assignee: GOOGLE LLC
    Inventors: Seungyeon Kim, Jingzhao Zhang, Andreas Veit, Sanjiv Kumar, Sashank Reddi, Praneeth Karimireddy
  • Patent number: 11977995
    Abstract: An artificial intelligence system for communicating predicted hours of operation to a client device. The system may include a processor in communication with a client device and a database; and a storage medium storing instructions.
    Type: Grant
    Filed: February 2, 2022
    Date of Patent: May 7, 2024
    Assignee: Capital One Services, LLC
    Inventors: Ashish Bansal, Jonathan Stahlman
  • Patent number: 11971898
    Abstract: Disclosed is a system, method, and computer program product for implementing a log analytics method and system that can configure, collect, and analyze log records in an efficient manner. Machine learning-based classification can be performed to classify logs. This approach is used to group logs automatically using a machine learning infrastructure.
    Type: Grant
    Filed: December 2, 2021
    Date of Patent: April 30, 2024
    Assignee: Oracle International Corporation
    Inventors: Anindya Chandra Patthak, Gregory Michael Ferrar