Patents Examined by Li B. Zhen
-
Patent number: 11755953Abstract: A method, system and computer readable medium for generating a cognitive insight comprising: receiving data, the data comprising a plurality of examples, each of the plurality of examples comprising an input object and a desired output value, at least some of the plurality of examples being based upon feedback from a user; performing a machine learning operation on the data, the machine learning operation comprising performing an augmented gamma belief network operation, the augmented gamma belief network operation producing an inferred function based upon the data; and, generating a cognitive insight based upon the cognitive profile generated using the inferred function generated by the augmented gamma belief network operation.Type: GrantFiled: December 31, 2020Date of Patent: September 12, 2023Assignee: Tecnotree Technologies, Inc.Inventors: Ayan Acharya, Matthew Sanchez
-
Patent number: 11748641Abstract: A method, system and computer readable medium for generating a cognitive insight comprising: receiving information regarding a temporal sequence of events; performing a temporal topic machine learning operation on the temporal sequence of events; generating a cognitive profile based upon the information generated by performing the temporal topic machine learning operation; and, generating a cognitive insight based upon the cognitive profile generated using the temporal topic machine learning operation.Type: GrantFiled: May 25, 2021Date of Patent: September 5, 2023Assignee: Tecnotree Technologies, Inc.Inventors: Ayan Acharya, Matthew Sanchez, Omar Eid
-
Patent number: 11727252Abstract: The present disclosure relates to a neuromorphic neuron apparatus comprising an output generation block and at least one adaptation block. The apparatus has a current adaptation state variable corresponding to previously generated one or more signals. The output generation block is configured to use an activation function for generating a current output value based on the current adaptation state variable. The adaptation block is configured to repeatedly: compute an adaptation value of its current adaptation state variable using the current output value and a correction function; use the adaption value to update the current adaptation state variable to obtain an updated adaptation state variable, the updated adaptation state variable becoming the current adaptation state variable; receive a current signal; and cause the output generation block to generate a current output value based on the current adaptation state variable and input value that obtained from the received signal.Type: GrantFiled: August 30, 2019Date of Patent: August 15, 2023Assignee: International Business Machines CorporationInventors: Stanislaw Andrzej Wozniak, Angeliki Pantazi
-
Patent number: 11727246Abstract: Embodiments provide systems and methods which facilitate optimization of a convolutional neural network (CNN). One embodiment provides for a non-transitory machine-readable medium storing instructions that cause one or more processors to perform operations comprising processing a trained convolutional neural network (CNN) to generate a processed CNN, the trained CNN having weights in a floating-point format. Processing the trained CNN includes quantizing the weights in the floating-point format to generate weights in an integer format. Quantizing the weights includes generating a quantization table to enable non-uniform quantization of the weights and quantizing the weights from the floating-point format to the integer format using the quantization table. The operations additionally comprise performing an inference operation utilizing the processed CNN with the integer format weights.Type: GrantFiled: February 22, 2019Date of Patent: August 15, 2023Assignee: Intel CorporationInventors: Liwei Ma, Elmoustapha Ould-Ahmed-Vall, Barath Lakshmanan, Ben J. Ashbaugh, Jingyi Jin, Jeremy Bottleson, Mike B. Macpherson, Kevin Nealis, Dhawal Srivastava, Joydeep Ray, Ping T. Tang, Michael S. Strickland, Xiaoming Chen, Anbang Yao, Tatiana Shpeisman, Altug Koker, Abhishek R. Appu
-
Patent number: 11694072Abstract: A method and system are disclosed for training a model that implements a machine-learning algorithm. The technique utilizes latent descriptor vectors to change a multiple-valued output problem into a single-valued output problem and includes the steps of receiving a set of training data, processing, by a model, the set of training data to generate a set of output vectors, and adjusting a set of model parameters and component values for at least one latent descriptor vector in the plurality of latent descriptor vectors based on the set of output vectors. The set of training data includes a plurality of input vectors and a plurality of desired output vectors, and each input vector in the plurality of input vectors is associated with a particular latent descriptor vector in a plurality of latent descriptor vectors. Each latent descriptor vector comprises a plurality of scalar values that are initialized prior to training the model.Type: GrantFiled: November 29, 2017Date of Patent: July 4, 2023Assignee: NVIDIA CorporationInventors: Tero Tapani Karras, Timo Oskari Aila, Samuli Matias Laine
-
Patent number: 11681942Abstract: One or more embodiments of a content naming system provide machine-learned name suggestions to a user for naming content items. Specifically, an online content management system can train a machine-learning model to identify a naming pattern from previously stored content items corresponding to a user account of the user. The online content management system uses the machine-learning model to determine a plurality of name suggestions for naming a content item associated with the user account. One or more embodiments provide graphical elements corresponding to the name suggestions within a graphical user interface. The user can select one or more graphical elements to add the corresponding name suggestion(s) to the name of the content item.Type: GrantFiled: October 27, 2016Date of Patent: June 20, 2023Assignee: Dropbox, Inc.Inventor: Neeraj Kumar
-
Patent number: 11669758Abstract: For machine learning data reduction and model optimization,a method randomly assigns each data feature of a training data set to a plurality of solution groups. Each solution group has no more than a solution group number k of data features and each data feature is assigned to a plurality of solution groups. The method identifies each solution group as a high-quality solution group or a low-quality solution group. The method further calculates data feature scores for each data feature comprising a high bin number and a low bin number. The method determines level data for each data feature from the data feature scores using a fuzzy inference system. The method identifies an optimized data feature set based on the level data. The method further trains a production model using only the optimized data feature set. The method predicts a result using the production model.Type: GrantFiled: November 12, 2019Date of Patent: June 6, 2023Assignee: Rockwell Automation Technologies, Inc.Inventors: Francisco Maturana, Phillip LaCasse
-
Patent number: 11663067Abstract: Embodiments of the invention include a computer-implemented method for detecting anomalies in non-stationary data in a network of computing entities. The method collects non-stationary data in the network and classifies the non-stationary data according to a non-Markovian, stateful classification, based on an inference model. Anomalies can then be detected, based on the classified data. The non-Markovian, stateful process allows anomaly detection even when no a priori knowledge of anomaly signatures or malicious entities exists. Anomalies can be detected in real time (e.g., at speeds of 10-100 Gbps) and the network data variability can be addressed by implementing a detection pipeline to adapt to changes in traffic behavior through online learning and retain memory of past behaviors. A two-stage scheme can be relied upon, which involves a supervised model coupled with an unsupervised model.Type: GrantFiled: December 15, 2017Date of Patent: May 30, 2023Assignee: International Business Machines CorporationInventors: Andreea Anghel, Mitch Gusat, Georgios Kathareios
-
Patent number: 11660521Abstract: A method of generating an outcome for a sporting event is disclosed herein. A computing system retrieves tracking data from a data store. The computing system generates a predictive model using a deep neural network. The one or more neural networks of the deep neural network generates one or more embeddings comprising team-specific information and agent-specific information based on the tracking data. The computing system selects, from the tracking data, one or more features related to a current context of the sporting event. The computing system learns, by the deep neural network, one or more likely outcomes of one or more sporting events. The computing system receives a pre-match lineup for the sporting event. The computing system generates, via the predictive model, a likely outcome of the sporting event based on historical information of each agent for the home team, each agent for the away team, and team-specific features.Type: GrantFiled: January 22, 2019Date of Patent: May 30, 2023Assignee: STATS LLCInventors: Hector Ruiz, Sujoy Ganguly, Nathan Frank, Patrick Lucey
-
Patent number: 11651218Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for adversarial training of a neural network. One of the methods includes obtaining a plurality of training inputs; and training the neural network on each of the training inputs, comprising, for each of the training inputs: processing the training input using the neural network to determine a neural network output for the training input; applying a perturbation to the training input to generate an adversarial perturbation of the training input; processing the adversarial perturbation of the training input using the neural network to determine a neural network output for the adversarial perturbation; and adjusting the current values of the parameters of the neural network by performing an iteration of a neural network training procedure to optimize an adversarial objective function.Type: GrantFiled: August 15, 2022Date of Patent: May 16, 2023Assignee: Google LLCInventors: Christian Szegedy, Ian Goodfellow
-
Patent number: 11644856Abstract: A method, computer system, and a computer program product for assessing energy consumption is provided. The present invention may include determining a first set of critical energy consumption units (ECUs) involved in a target production process, the pool of the critical ECUs being obtained based on a plurality of reference production processes. The present invention may then include determining a second set of critical ECUs involved in the candidate production process. The present invention may also include determining a first set of non-critical ECUs involved in the target production process, the pool of the non-critical ECUs being obtained based on the plurality of reference production processes. The present invention may then include determining, a second set of non-critical ECUs involved in the candidate production process. The present invention may further include determining the process similarity.Type: GrantFiled: July 31, 2019Date of Patent: May 9, 2023Assignee: International Business Machines CorporationInventors: Feng Jin, Bin Li, Xin Jie Lv, Qi Ming Tian, Lei Ye, Li Zhang, Gang Zhou
-
Patent number: 11645554Abstract: A method and apparatus for recognizing a low-quality article based on artificial intelligence, a device and a medium. The method comprises: obtaining a user feedback behavior feature of a to-be-recognized article in a news-recommending system; according to the user feedback behavior feature of the to-be-recognized article and a predetermined low-quality article recognition model, recognizing whether the to-be-recognized article is a low-quality article.Type: GrantFiled: June 20, 2018Date of Patent: May 9, 2023Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.Inventors: Chao Qiao, Bo Huang, Daren Li, Qiaoqiao She
-
Patent number: 11645541Abstract: A technique is disclosed for generating class level rules that globally explain the behavior of a machine learning model, such as a model that has been used to solve a classification problem. Each class level rule represents a logical conditional statement that, when the statement holds true for one or more instances of a particular class, predicts that the respective instances are members of the particular class. Collectively, these rules represent the pattern followed by the machine learning model. The techniques are model agnostic, and explain model behavior in a relatively easy to understand manner by outputting a set of logical rules that can be readily parsed. Although the techniques can be applied to any number of applications, in some embodiments, the techniques are suitable for interpreting models that perform the task of classification. Other machine learning model applications can equally benefit.Type: GrantFiled: November 17, 2017Date of Patent: May 9, 2023Assignee: Adobe Inc.Inventors: Piyush Gupta, Nikaash Puri, Balaji Krishnamurthy
-
Patent number: 11631026Abstract: Systems, methods, and non-transitory computer readable media are configured to train a machine learning model. The training can be based on a training set of embeddings of a first type and a training set of embeddings of a second type. The machine learning model can be trained to receive an embedding of a second type and to output a corresponding embedding of the first type. A given embedding of the second type can be provided as input to the machine learning model. An embedding of the first type can be obtained from the machine learning model. The embedding of the first type can correspond to the given embedding of the second type.Type: GrantFiled: July 13, 2017Date of Patent: April 18, 2023Assignee: Meta Platforms, Inc.Inventors: Martin Schatz, Bradley Ray Green
-
Patent number: 11631025Abstract: A learning apparatus includes: an update unit which updates a dictionary used by a classifier; a calculation unit which calculates, by using a dictionary updated and one or more samples with labeling being samples assigned with labels, a ratio to a number of the samples with labeling as a loss with respect to all the samples with labeling; and a determination unit which determines whether to update the dictionary, by using the loss, wherein, when the determination unit determines to update the dictionary, the update unit updates the dictionary by using the samples with labeling added with a new sample with labeling, and wherein the determination unit determines whether to update the dictionary, by using a loss calculated by using the updated dictionary and a loss calculated by using the dictionary before updating with respect to all the samples with labeling before adding the new sample with labeling.Type: GrantFiled: January 5, 2016Date of Patent: April 18, 2023Assignee: NEC CORPORATIONInventor: Atsushi Sato
-
Patent number: 11605304Abstract: A computer-implemented method for learning a policy for selection of an associative topic, which can be used in a dialog system, is described. The method includes obtaining a policy base that indicates a topic transition from a source topic to a destination topic and a short-term reward for the topic transition, by analyzing data from a corpus. The short-term reward may be defined as probability of associating a positive response. The method also includes calculating an expected long-term reward for the topic transition using the short-term reward for the topic transition with taking into account a discounted reward for a subsequent topic transition. The method further includes generating a policy using the policy base and the expected long-term reward for the topic transition. The policy indicates selection of the destination topic for the source topic as an associative topic for a current topic.Type: GrantFiled: March 6, 2017Date of Patent: March 14, 2023Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Hiroshi Kanayama, Akira Koseki, Toshiro Takase
-
Patent number: 11599787Abstract: A hardware-implemented multi-layer perceptron model calculation unit includes: a processor core to calculate output quantities of a neuron layer based on input quantities of an input vector; a memory that has, for each neuron layer, a respective configuration segment for storing configuration parameters and a respective data storage segment for storing the input quantities of the input vector and the one or more output quantities; and a DMA unit to successively instruct the processor core to: calculate respective neuron layers based on the configuration parameters of each configuration segment, calculate input quantities of the input vector defined thereby, and store respectively resulting output quantities in a data storage segment defined by the corresponding configuration parameters, the configuration parameters of configuration segments successively taken into account indicating a data storage region for the resulting output quantities corresponding to the data storage region for the input quantities forType: GrantFiled: September 4, 2017Date of Patent: March 7, 2023Assignee: ROBERT BOSCH GMBHInventors: Andre Guntoro, Heiner Markert
-
Patent number: 11599824Abstract: A learning device is configured to perform learning of a decision tree by gradient boosting. The learning device includes a plurality of learning units and a plurality of model memories. The plurality of learning units are configured to perform learning of the decision tree using learning data divided to be stored in a plurality of data memories. The plurality of model memories are each configured to store data of the decision tree learned by corresponding one of the plurality of learning units.Type: GrantFiled: November 1, 2019Date of Patent: March 7, 2023Assignee: RICOH COMPANY, LTD.Inventors: Takuya Tanaka, Ryosuke Kasahara
-
Patent number: 11580411Abstract: Systems are provided for implementing a hardware accelerator. The hardware accelerator emulate a stochastic neural network, and includes a first memristor crossbar array, and a second memristor crossbar array. The first memristor crossbar array can be programmed to calculate node values of the neural network. The nodes values can be calculated in accordance with rules to reduce an energy function associated with the neural network. The second memristor crossbar array is coupled to the first memristor crossbar array and programmed to introduce noise signals into the neural network. The noise signals can be introduced such that the energy function associated with the neural network converges towards a global minimum and modifies the calculated node values.Type: GrantFiled: December 18, 2018Date of Patent: February 14, 2023Assignee: Hewlett Packard Enterprise Development LPInventors: Suhas Kumar, Thomas Van Vaerenbergh, John Paul Strachan
-
Patent number: 11580420Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for analyzing feature impact of a machine-learning model using prototypes across analytical spaces. For example, the disclosed system can identify features of data points used to generate outputs via a machine-learning model and then map the features to a feature space and the outputs to a label space. The disclosed system can then utilize an iterative process to determine prototypes from the data points based on distances between the data points in the feature space and the label space. Furthermore, the disclosed system can then use the prototypes to determine the impact of the features within the machine-learning model based on locally sensitive directions; region variability; or mean, range, and variance of features of the prototypes.Type: GrantFiled: January 22, 2019Date of Patent: February 14, 2023Assignee: Adobe Inc.Inventors: Deepak Pai, Joshua Sweetkind-Singer, Debraj Basu