Patents Examined by Li B. Zhen
  • Patent number: 11755953
    Abstract: A method, system and computer readable medium for generating a cognitive insight comprising: receiving data, the data comprising a plurality of examples, each of the plurality of examples comprising an input object and a desired output value, at least some of the plurality of examples being based upon feedback from a user; performing a machine learning operation on the data, the machine learning operation comprising performing an augmented gamma belief network operation, the augmented gamma belief network operation producing an inferred function based upon the data; and, generating a cognitive insight based upon the cognitive profile generated using the inferred function generated by the augmented gamma belief network operation.
    Type: Grant
    Filed: December 31, 2020
    Date of Patent: September 12, 2023
    Assignee: Tecnotree Technologies, Inc.
    Inventors: Ayan Acharya, Matthew Sanchez
  • Patent number: 11748641
    Abstract: A method, system and computer readable medium for generating a cognitive insight comprising: receiving information regarding a temporal sequence of events; performing a temporal topic machine learning operation on the temporal sequence of events; generating a cognitive profile based upon the information generated by performing the temporal topic machine learning operation; and, generating a cognitive insight based upon the cognitive profile generated using the temporal topic machine learning operation.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: September 5, 2023
    Assignee: Tecnotree Technologies, Inc.
    Inventors: Ayan Acharya, Matthew Sanchez, Omar Eid
  • Patent number: 11727252
    Abstract: The present disclosure relates to a neuromorphic neuron apparatus comprising an output generation block and at least one adaptation block. The apparatus has a current adaptation state variable corresponding to previously generated one or more signals. The output generation block is configured to use an activation function for generating a current output value based on the current adaptation state variable. The adaptation block is configured to repeatedly: compute an adaptation value of its current adaptation state variable using the current output value and a correction function; use the adaption value to update the current adaptation state variable to obtain an updated adaptation state variable, the updated adaptation state variable becoming the current adaptation state variable; receive a current signal; and cause the output generation block to generate a current output value based on the current adaptation state variable and input value that obtained from the received signal.
    Type: Grant
    Filed: August 30, 2019
    Date of Patent: August 15, 2023
    Assignee: International Business Machines Corporation
    Inventors: Stanislaw Andrzej Wozniak, Angeliki Pantazi
  • Patent number: 11727246
    Abstract: Embodiments provide systems and methods which facilitate optimization of a convolutional neural network (CNN). One embodiment provides for a non-transitory machine-readable medium storing instructions that cause one or more processors to perform operations comprising processing a trained convolutional neural network (CNN) to generate a processed CNN, the trained CNN having weights in a floating-point format. Processing the trained CNN includes quantizing the weights in the floating-point format to generate weights in an integer format. Quantizing the weights includes generating a quantization table to enable non-uniform quantization of the weights and quantizing the weights from the floating-point format to the integer format using the quantization table. The operations additionally comprise performing an inference operation utilizing the processed CNN with the integer format weights.
    Type: Grant
    Filed: February 22, 2019
    Date of Patent: August 15, 2023
    Assignee: Intel Corporation
    Inventors: Liwei Ma, Elmoustapha Ould-Ahmed-Vall, Barath Lakshmanan, Ben J. Ashbaugh, Jingyi Jin, Jeremy Bottleson, Mike B. Macpherson, Kevin Nealis, Dhawal Srivastava, Joydeep Ray, Ping T. Tang, Michael S. Strickland, Xiaoming Chen, Anbang Yao, Tatiana Shpeisman, Altug Koker, Abhishek R. Appu
  • Patent number: 11694072
    Abstract: A method and system are disclosed for training a model that implements a machine-learning algorithm. The technique utilizes latent descriptor vectors to change a multiple-valued output problem into a single-valued output problem and includes the steps of receiving a set of training data, processing, by a model, the set of training data to generate a set of output vectors, and adjusting a set of model parameters and component values for at least one latent descriptor vector in the plurality of latent descriptor vectors based on the set of output vectors. The set of training data includes a plurality of input vectors and a plurality of desired output vectors, and each input vector in the plurality of input vectors is associated with a particular latent descriptor vector in a plurality of latent descriptor vectors. Each latent descriptor vector comprises a plurality of scalar values that are initialized prior to training the model.
    Type: Grant
    Filed: November 29, 2017
    Date of Patent: July 4, 2023
    Assignee: NVIDIA Corporation
    Inventors: Tero Tapani Karras, Timo Oskari Aila, Samuli Matias Laine
  • Patent number: 11681942
    Abstract: One or more embodiments of a content naming system provide machine-learned name suggestions to a user for naming content items. Specifically, an online content management system can train a machine-learning model to identify a naming pattern from previously stored content items corresponding to a user account of the user. The online content management system uses the machine-learning model to determine a plurality of name suggestions for naming a content item associated with the user account. One or more embodiments provide graphical elements corresponding to the name suggestions within a graphical user interface. The user can select one or more graphical elements to add the corresponding name suggestion(s) to the name of the content item.
    Type: Grant
    Filed: October 27, 2016
    Date of Patent: June 20, 2023
    Assignee: Dropbox, Inc.
    Inventor: Neeraj Kumar
  • Patent number: 11669758
    Abstract: For machine learning data reduction and model optimization,a method randomly assigns each data feature of a training data set to a plurality of solution groups. Each solution group has no more than a solution group number k of data features and each data feature is assigned to a plurality of solution groups. The method identifies each solution group as a high-quality solution group or a low-quality solution group. The method further calculates data feature scores for each data feature comprising a high bin number and a low bin number. The method determines level data for each data feature from the data feature scores using a fuzzy inference system. The method identifies an optimized data feature set based on the level data. The method further trains a production model using only the optimized data feature set. The method predicts a result using the production model.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: June 6, 2023
    Assignee: Rockwell Automation Technologies, Inc.
    Inventors: Francisco Maturana, Phillip LaCasse
  • Patent number: 11663067
    Abstract: Embodiments of the invention include a computer-implemented method for detecting anomalies in non-stationary data in a network of computing entities. The method collects non-stationary data in the network and classifies the non-stationary data according to a non-Markovian, stateful classification, based on an inference model. Anomalies can then be detected, based on the classified data. The non-Markovian, stateful process allows anomaly detection even when no a priori knowledge of anomaly signatures or malicious entities exists. Anomalies can be detected in real time (e.g., at speeds of 10-100 Gbps) and the network data variability can be addressed by implementing a detection pipeline to adapt to changes in traffic behavior through online learning and retain memory of past behaviors. A two-stage scheme can be relied upon, which involves a supervised model coupled with an unsupervised model.
    Type: Grant
    Filed: December 15, 2017
    Date of Patent: May 30, 2023
    Assignee: International Business Machines Corporation
    Inventors: Andreea Anghel, Mitch Gusat, Georgios Kathareios
  • Patent number: 11660521
    Abstract: A method of generating an outcome for a sporting event is disclosed herein. A computing system retrieves tracking data from a data store. The computing system generates a predictive model using a deep neural network. The one or more neural networks of the deep neural network generates one or more embeddings comprising team-specific information and agent-specific information based on the tracking data. The computing system selects, from the tracking data, one or more features related to a current context of the sporting event. The computing system learns, by the deep neural network, one or more likely outcomes of one or more sporting events. The computing system receives a pre-match lineup for the sporting event. The computing system generates, via the predictive model, a likely outcome of the sporting event based on historical information of each agent for the home team, each agent for the away team, and team-specific features.
    Type: Grant
    Filed: January 22, 2019
    Date of Patent: May 30, 2023
    Assignee: STATS LLC
    Inventors: Hector Ruiz, Sujoy Ganguly, Nathan Frank, Patrick Lucey
  • Patent number: 11651218
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for adversarial training of a neural network. One of the methods includes obtaining a plurality of training inputs; and training the neural network on each of the training inputs, comprising, for each of the training inputs: processing the training input using the neural network to determine a neural network output for the training input; applying a perturbation to the training input to generate an adversarial perturbation of the training input; processing the adversarial perturbation of the training input using the neural network to determine a neural network output for the adversarial perturbation; and adjusting the current values of the parameters of the neural network by performing an iteration of a neural network training procedure to optimize an adversarial objective function.
    Type: Grant
    Filed: August 15, 2022
    Date of Patent: May 16, 2023
    Assignee: Google LLC
    Inventors: Christian Szegedy, Ian Goodfellow
  • Patent number: 11644856
    Abstract: A method, computer system, and a computer program product for assessing energy consumption is provided. The present invention may include determining a first set of critical energy consumption units (ECUs) involved in a target production process, the pool of the critical ECUs being obtained based on a plurality of reference production processes. The present invention may then include determining a second set of critical ECUs involved in the candidate production process. The present invention may also include determining a first set of non-critical ECUs involved in the target production process, the pool of the non-critical ECUs being obtained based on the plurality of reference production processes. The present invention may then include determining, a second set of non-critical ECUs involved in the candidate production process. The present invention may further include determining the process similarity.
    Type: Grant
    Filed: July 31, 2019
    Date of Patent: May 9, 2023
    Assignee: International Business Machines Corporation
    Inventors: Feng Jin, Bin Li, Xin Jie Lv, Qi Ming Tian, Lei Ye, Li Zhang, Gang Zhou
  • Patent number: 11645554
    Abstract: A method and apparatus for recognizing a low-quality article based on artificial intelligence, a device and a medium. The method comprises: obtaining a user feedback behavior feature of a to-be-recognized article in a news-recommending system; according to the user feedback behavior feature of the to-be-recognized article and a predetermined low-quality article recognition model, recognizing whether the to-be-recognized article is a low-quality article.
    Type: Grant
    Filed: June 20, 2018
    Date of Patent: May 9, 2023
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Chao Qiao, Bo Huang, Daren Li, Qiaoqiao She
  • Patent number: 11645541
    Abstract: A technique is disclosed for generating class level rules that globally explain the behavior of a machine learning model, such as a model that has been used to solve a classification problem. Each class level rule represents a logical conditional statement that, when the statement holds true for one or more instances of a particular class, predicts that the respective instances are members of the particular class. Collectively, these rules represent the pattern followed by the machine learning model. The techniques are model agnostic, and explain model behavior in a relatively easy to understand manner by outputting a set of logical rules that can be readily parsed. Although the techniques can be applied to any number of applications, in some embodiments, the techniques are suitable for interpreting models that perform the task of classification. Other machine learning model applications can equally benefit.
    Type: Grant
    Filed: November 17, 2017
    Date of Patent: May 9, 2023
    Assignee: Adobe Inc.
    Inventors: Piyush Gupta, Nikaash Puri, Balaji Krishnamurthy
  • Patent number: 11631026
    Abstract: Systems, methods, and non-transitory computer readable media are configured to train a machine learning model. The training can be based on a training set of embeddings of a first type and a training set of embeddings of a second type. The machine learning model can be trained to receive an embedding of a second type and to output a corresponding embedding of the first type. A given embedding of the second type can be provided as input to the machine learning model. An embedding of the first type can be obtained from the machine learning model. The embedding of the first type can correspond to the given embedding of the second type.
    Type: Grant
    Filed: July 13, 2017
    Date of Patent: April 18, 2023
    Assignee: Meta Platforms, Inc.
    Inventors: Martin Schatz, Bradley Ray Green
  • Patent number: 11631025
    Abstract: A learning apparatus includes: an update unit which updates a dictionary used by a classifier; a calculation unit which calculates, by using a dictionary updated and one or more samples with labeling being samples assigned with labels, a ratio to a number of the samples with labeling as a loss with respect to all the samples with labeling; and a determination unit which determines whether to update the dictionary, by using the loss, wherein, when the determination unit determines to update the dictionary, the update unit updates the dictionary by using the samples with labeling added with a new sample with labeling, and wherein the determination unit determines whether to update the dictionary, by using a loss calculated by using the updated dictionary and a loss calculated by using the dictionary before updating with respect to all the samples with labeling before adding the new sample with labeling.
    Type: Grant
    Filed: January 5, 2016
    Date of Patent: April 18, 2023
    Assignee: NEC CORPORATION
    Inventor: Atsushi Sato
  • Patent number: 11605304
    Abstract: A computer-implemented method for learning a policy for selection of an associative topic, which can be used in a dialog system, is described. The method includes obtaining a policy base that indicates a topic transition from a source topic to a destination topic and a short-term reward for the topic transition, by analyzing data from a corpus. The short-term reward may be defined as probability of associating a positive response. The method also includes calculating an expected long-term reward for the topic transition using the short-term reward for the topic transition with taking into account a discounted reward for a subsequent topic transition. The method further includes generating a policy using the policy base and the expected long-term reward for the topic transition. The policy indicates selection of the destination topic for the source topic as an associative topic for a current topic.
    Type: Grant
    Filed: March 6, 2017
    Date of Patent: March 14, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Hiroshi Kanayama, Akira Koseki, Toshiro Takase
  • Patent number: 11599787
    Abstract: A hardware-implemented multi-layer perceptron model calculation unit includes: a processor core to calculate output quantities of a neuron layer based on input quantities of an input vector; a memory that has, for each neuron layer, a respective configuration segment for storing configuration parameters and a respective data storage segment for storing the input quantities of the input vector and the one or more output quantities; and a DMA unit to successively instruct the processor core to: calculate respective neuron layers based on the configuration parameters of each configuration segment, calculate input quantities of the input vector defined thereby, and store respectively resulting output quantities in a data storage segment defined by the corresponding configuration parameters, the configuration parameters of configuration segments successively taken into account indicating a data storage region for the resulting output quantities corresponding to the data storage region for the input quantities for
    Type: Grant
    Filed: September 4, 2017
    Date of Patent: March 7, 2023
    Assignee: ROBERT BOSCH GMBH
    Inventors: Andre Guntoro, Heiner Markert
  • Patent number: 11599824
    Abstract: A learning device is configured to perform learning of a decision tree by gradient boosting. The learning device includes a plurality of learning units and a plurality of model memories. The plurality of learning units are configured to perform learning of the decision tree using learning data divided to be stored in a plurality of data memories. The plurality of model memories are each configured to store data of the decision tree learned by corresponding one of the plurality of learning units.
    Type: Grant
    Filed: November 1, 2019
    Date of Patent: March 7, 2023
    Assignee: RICOH COMPANY, LTD.
    Inventors: Takuya Tanaka, Ryosuke Kasahara
  • Patent number: 11580411
    Abstract: Systems are provided for implementing a hardware accelerator. The hardware accelerator emulate a stochastic neural network, and includes a first memristor crossbar array, and a second memristor crossbar array. The first memristor crossbar array can be programmed to calculate node values of the neural network. The nodes values can be calculated in accordance with rules to reduce an energy function associated with the neural network. The second memristor crossbar array is coupled to the first memristor crossbar array and programmed to introduce noise signals into the neural network. The noise signals can be introduced such that the energy function associated with the neural network converges towards a global minimum and modifies the calculated node values.
    Type: Grant
    Filed: December 18, 2018
    Date of Patent: February 14, 2023
    Assignee: Hewlett Packard Enterprise Development LP
    Inventors: Suhas Kumar, Thomas Van Vaerenbergh, John Paul Strachan
  • Patent number: 11580420
    Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for analyzing feature impact of a machine-learning model using prototypes across analytical spaces. For example, the disclosed system can identify features of data points used to generate outputs via a machine-learning model and then map the features to a feature space and the outputs to a label space. The disclosed system can then utilize an iterative process to determine prototypes from the data points based on distances between the data points in the feature space and the label space. Furthermore, the disclosed system can then use the prototypes to determine the impact of the features within the machine-learning model based on locally sensitive directions; region variability; or mean, range, and variance of features of the prototypes.
    Type: Grant
    Filed: January 22, 2019
    Date of Patent: February 14, 2023
    Assignee: Adobe Inc.
    Inventors: Deepak Pai, Joshua Sweetkind-Singer, Debraj Basu