Patents Examined by Sehwan Kim
  • Patent number: 11954577
    Abstract: A computer-implemented method and system having computer-executable instructions stored in a memory for processing user behavior features by neural networks to identify user segments. The method includes receiving user datasets from a database along with respective user identifiers, retention labels, static user features and interactive user features associated with an online product during a time period. A first neural network processes the interactive user features to generate a time distributed concatenation representation. A second neural network is configured to generate a vector by embedding the time distributed concatenation representation and the static user features through an embedding layer. The second neural network is configured to process the vector through a plurality of layers. A cluster model is used to determine user segments based on values extracted from nodes of a second to last layer of the second neural network.
    Type: Grant
    Filed: September 13, 2019
    Date of Patent: April 9, 2024
    Assignee: Intuit Inc.
    Inventor: Runhua Zhao
  • Patent number: 11954613
    Abstract: A method, apparatus and computer program product for establishing a logical connection between an indirect utterance and a transaction is described. An indirect utterance is received from a user as an input to a conversational system. The indirect utterance is parsed to a first logical form. A first set of predicates and terms is mapped from the first logical form to a first subgraph in a knowledge graph. A second set of predicates and terms is mapped from a second logical form belonging to a transaction to a second subgraph of the knowledge graph. A best path in the knowledge graph between the first subgraph and the second subgraph is searched for while transforming the first logical form using the node and edge labels along the best path to generate an intermediate logical form. A system action is performed for a transaction if a graph structure of the intermediate logical form matches the graph structure of the logical form of the transaction above a threshold.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: April 9, 2024
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Mustafa Canim, Robert G Farrell, Achille B Fokoue-Nkoutche, John A Gunnels, Ryan A Musa, Vijay A Saraswat
  • Patent number: 11948058
    Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods that utilize recurrent neural networks to determine the existence of one or more open intents in a text input, and then extract the one or more open intents from the text input. In particular, in one or more embodiments, the disclosed systems utilize a trained intent existence neural network to determine the existence of an actionable intent within a text input. In response to verifying the existence of an actionable intent, the disclosed systems can apply a trained intent extraction neural network to extract the actionable intent from the text input. Furthermore, in one or more embodiments, the disclosed systems can generate a digital response based on the intent identified from the text input.
    Type: Grant
    Filed: December 11, 2018
    Date of Patent: April 2, 2024
    Assignee: Adobe Inc.
    Inventors: Nedim Lipka, Nikhita Vedula
  • Patent number: 11928601
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for neural network compression. In one aspect, a method comprises receiving a neural network and identifying a particular set of multiple weights of the neural network. Multiple anchor points are determined based on current values of the particular set of weights of the neural network. The neural network is trained by, at each of multiple training iterations, performing operations comprising adjusting the values of the particular set of weights by backpropagating gradients of a loss function. The loss function comprises a first loss function term based on a prediction accuracy of the neural network and a second loss function term based on a similarity of the current values of the particular set of weights to the anchor points. After training, the values of the particular set of weights are quantized based on the anchor points.
    Type: Grant
    Filed: February 9, 2018
    Date of Patent: March 12, 2024
    Assignee: Google LLC
    Inventors: Yair Alon, Elad Eban
  • Patent number: 11900231
    Abstract: A method includes receiving a set of training data and selecting a first machine learning platform based on a first optimization function that metrics past machine learning platforms used for training on the set of training data. The method also includes selecting a first algorithm supported by the first machine learning platform based on a second optimization function that metrics past algorithms used for training on the set of training data. Further, the method includes determining one or more hyperparameters supported by the first algorithm based on a third optimization function that metrics past combinations of hyperparameters from the set of hyperparameters used for training on the set of training data. The method also includes training a machine learning model on the set of training data using the first machine learning platform, the first algorithm, and the one or more hyperparameters.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: February 13, 2024
    Assignee: PAYPAL, INC.
    Inventors: Lichao Liu, Xuyao Hao, Zhanghao Hu
  • Patent number: 11893499
    Abstract: Automated development and training of deep forest models for analyzing data by growing a random forest of decision trees using data, determining Out-of-bag (OOB) predictions for the forest, appending the OOB predictions to the data set, and growing an additional forest using the data set including the appended OOB predictions, and combining the output of the additional forest, then utilizing the model to classify data outside the training data set.
    Type: Grant
    Filed: March 12, 2019
    Date of Patent: February 6, 2024
    Assignee: International Business Machines Corporation
    Inventors: Jing Xu, Rui Wang, Xiao Ming Ma, Ji Hui Yang, Xue Ying Zhang, Jing James Xu, Si Er Han
  • Patent number: 11880741
    Abstract: Generate an automorphism of the problem graph, determine an embedding of the automorphism to the hardware graph and modify the embedding of the problem graph into the hardware graph to correspond to the embedding of the automorphism to the hardware graph. Determine an upper-bound on the required chain strength. Calibrate and record properties of the component of a quantum processor with a digital processor, query the digital processor for a range of properties. Generate a bit mask and change the sign of the bias of individual qubits according to the bit mask before submitting a problem to a quantum processor, apply the same bit mask to the bit result. Generate a second set of parameters of a quantum processor from a first set of parameters via a genetic algorithm.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: January 23, 2024
    Assignee: D-WAVE SYSTEMS INC.
    Inventors: Robert B. Israel, Trevor M. Lanting, Andrew D. King
  • Patent number: 11842251
    Abstract: A “Content Optimizer” applies a machine-learned relevancy model to predict levels of interest for segments of arbitrary content. Arbitrary content includes, but is not limited to, any combination of documents including text, charts, images, speech, etc. Various automated reports and suggestions for “reformatting” segments to modify the predicted levels of interest may then be presented. Similarly, the Content Optimizer applies a machine-learned comprehension model to predict what a human audience is likely to understand (e.g., a “comprehension prediction”) from the arbitrary content. Various automated reports and suggestions for “reformatting” segments to modify the comprehension prediction may then be presented.
    Type: Grant
    Filed: June 12, 2017
    Date of Patent: December 12, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Jacob M. Hofman
  • Patent number: 11822544
    Abstract: Aspects of the present disclosure provide techniques for FAQ retrieval. Embodiments include receiving, via a user interface of a computing application, a query related to a subject. Embodiments include generating a first multi-dimensional representation of the query. Embodiments include obtaining a plurality of question and answer pairs related to the subject and, for a given question and answer pair comprising a given question and a given answer, generating a second multi-dimensional representation of the given question and a third multi-dimensional representation of the given answer. Embodiments include providing input to a model based on the first multi-dimensional representation, the second multi-dimensional representation, and the third multi-dimensional representation and determining a match score for the query and the given question and answer pair based on an output of the model.
    Type: Grant
    Filed: July 30, 2019
    Date of Patent: November 21, 2023
    Assignee: INTUIT, INC.
    Inventors: Vitor R. Carvalho, Sparsh Gupta
  • Patent number: 11803746
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for neural programming. One of the methods includes processing a current neural network input using a core recurrent neural network to generate a neural network output; determining, from the neural network output, whether or not to end a currently invoked program and to return to a calling program from the set of programs; determining, from the neural network output, a next program to be called; determining, from the neural network output, contents of arguments to the next program to be called; receiving a representation of a current state of the environment; and generating a next neural network input from an embedding for the next program to be called and the representation of the current state of the environment.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: October 31, 2023
    Assignee: DeepMind Technologies Limited
    Inventors: Scott Ellison Reed, Joao Ferdinando Gomes de Freitas
  • Patent number: 11797826
    Abstract: A system is provided for classifying an instruction sequence with a machine learning model. The system may include at least one processor and at least one memory. The memory may include program code that provides operations when executed by the at least one processor. The operations may include: processing an instruction sequence with a trained machine learning model configured to detect one or more interdependencies amongst a plurality of tokens in the instruction sequence and determine a classification for the instruction sequence based on the one or more interdependencies amongst the plurality of tokens; and providing, as an output, the classification of the instruction sequence. Related methods and articles of manufacture, including computer program products, are also provided.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: October 24, 2023
    Assignee: Cylance Inc.
    Inventors: Xuan Zhao, Matthew Wolff, John Brock, Brian Wallace, Andy Wortman, Jian Luan, Mahdi Azarafrooz, Andrew Davis, Michael Wojnowicz, Derek Soeder, David Beveridge, Eric Petersen, Ming Jin, Ryan Permeh
  • Patent number: 11755959
    Abstract: The systems, methods, and computer program products for determining bins for a data model are provided. Variables in a training data set are binned into bins up to a configurable number of bins. Variables in the validation data set are also binned using the bins from the training data set. A first decision tree is generated using the bins and the binned variables from the training data set and is pruned. A second decision tree is generated using the structure of the first decision tree and the binned variables from the validation data set. The first and second decision tree are merged into a third decision tree. Leaf nodes of the third decision tree are sorted and merged until weights of evidence associated with the training data set and the validation data set are monotonic. The bins for the data model are determined from the merged leaf nodes.
    Type: Grant
    Filed: December 12, 2018
    Date of Patent: September 12, 2023
    Assignee: PayPal, Inc.
    Inventors: Fan Cai, Rongsheng Zhu, Yingying Yu
  • Patent number: 11681943
    Abstract: In some embodiments, user-selectable/connectable model representations may be provided via a user interface to facilitate artificial intelligence development. The model representations may comprises first and second machine learning model (ML) representations corresponding to first and second ML models, and non-ML model representations corresponding to non-ML models. Based on user input indicating selection of the first and second ML model representations and a non-ML model representation corresponding to a non-ML model, at least a portion of a software application may be generated such that the software application comprises (i) an instance of the first ML model, an instance of the second ML model, and an instance of the non-ML model and (ii) an input/output data path between the instance of the first ML model and at least one other instance, the at least one other instance comprising the instance of the second ML model or the instance of the non-ML model.
    Type: Grant
    Filed: September 26, 2017
    Date of Patent: June 20, 2023
    Assignee: CLARIFAI, INC.
    Inventors: Matthew Zeiler, Daniel Kantor, Marshall Jones, Christopher Fox
  • Patent number: 11620555
    Abstract: A method and system are herein disclosed. The method includes developing a joint latent variable model having a first variable, a second variable, and a joint latent variable representing common information between the first and second variables, generating a variational posterior of the joint latent variable model, training the variational posterior, and performing inference of the first variable from the second variable based on the variational posterior.
    Type: Grant
    Filed: April 3, 2019
    Date of Patent: April 4, 2023
    Inventors: Jongha Ryu, Yoo Jin Choi, Mostafa El-Khamy, Jungwon Lee
  • Patent number: 11610689
    Abstract: Provided are a method for adjusting a continuous variable, a method and an apparatus for analyzing a correlation using the same. A method for adjusting a continuous variable according to an exemplary embodiment of the present disclosure is a method for adjusting a continuous variable by an apparatus including: determining at least one confounder from analysis data; classifying the analysis data into a plurality of subgroups having the same combination of confounders; and generating a new continuous variable for each subgroup based on a representative value of a continuous variable distribution.
    Type: Grant
    Filed: February 7, 2019
    Date of Patent: March 21, 2023
    Assignee: AJOU UNIVERSITY INDUSTRY—ACADEMIC COOPERATION FOUNDATION
    Inventor: O Kyu Noh
  • Patent number: 11610136
    Abstract: A method, computer system, and a computer program product for estimating the probability of invoking information technology (IT) disaster recovery at a location based on an incident risk is provided. The present invention may include receiving a piece of data associated with an incident at the location. The present invention may also include estimating a similarity value associated with the incident based on a plurality of past incidents from a knowledge base. The present invention may then include receiving a plurality of mined data based on the location. The present invention may further include predicting the incident risk to the location based on the received plurality of mined data and the estimated similarity value to the plurality of past incidents.
    Type: Grant
    Filed: May 20, 2019
    Date of Patent: March 21, 2023
    Assignee: Kyndryl, Inc.
    Inventors: Pawel Jasionowski, George E. Stark, Daniel S. Riley, Michael H. Roehl
  • Patent number: 11593611
    Abstract: Cooperative neural networks may be implemented by providing an input to a first neural network including a plurality of first parameters, and updating at least one first parameter based on an output from a recurrent neural network provided with the input, the recurrent neural network including a plurality of second parameters.
    Type: Grant
    Filed: November 6, 2017
    Date of Patent: February 28, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventor: Sakyasingha Dasgupta
  • Patent number: 11580179
    Abstract: A method and system for recommending articles including: receiving a customer request from the customer during the session; generating case data for a case, by an article recommender app; configuring a training set based on the subject and description data of the customer request; identifying, by an artificial intelligence (AI) app, a first pool of articles from a knowledge database; identifying by at least one query, a second pool of articles from a case article database to into a merged pool of articles; assigning, by the AI app, an implicit label to one of the first pool and the second pool of the articles; applying a model derived by the AI app based on customer behavior and a set of features related to the case to classify each article of the merged pool of articles based at least in part on the predicted relevance of the article.
    Type: Grant
    Filed: September 24, 2018
    Date of Patent: February 14, 2023
    Assignee: salesforce.com, inc.
    Inventors: Pingping Xiu, Sitaram Asur, Anjan Goswami, Ziwei Chen, Na Cheng, Suhas Satish, Jacob Nathaniel Huffman, Peter Francis White, WeiPing Peng, Aditya Sakhuja, Jayesh Govindarajan, Edgar Gerardo Velasco
  • Patent number: 11580351
    Abstract: A technique is described herein for automatically logging journeys taken by a user, and then automatically classifying the purposes of the journeys. In one implementation, the technique obtains journey data from one or more movement-sensing devices as a user travels from a starting location to an ending location in a vehicle. The technique generates a set of features based on the journey data, and then uses a machine-trainable model (such as a neural network) to make its classification based on the features. The machine-trainable model accepts at least one feature that is based on statistical information regarding at least one aspect of prior journeys that the user has taken. Overall, the technique provides a resource-efficient solution that rapidly provides personalized results to individual respective users. In some implementations, the technique performs its personalization without sharing journey data with a remote server.
    Type: Grant
    Filed: November 22, 2018
    Date of Patent: February 14, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Justin James Wagle, Nathaniel Gunther Roth, Qian Liu, Pnina Eliyahu, Syed Farhan Raza, Timothy Edward Bellay, Rahul Anantha Padmanabha Udipi
  • Patent number: 11580396
    Abstract: Systems and methods for artificial intelligence discovered codes are described herein. A method includes obtaining received samples from a receive decoder, obtaining decoded bits from the receive decoder based on the receiver samples, training an encoder neural network of a transmit encoder, the encoder neural network receiving parameters that comprise the information bits, the received samples, and the decoded bits. The encoder neural network is optimized using a loss function applied to the decoded bits and the information bits to calculate a forward error correcting code.
    Type: Grant
    Filed: October 13, 2020
    Date of Patent: February 14, 2023
    Assignee: Aira Technologies, Inc.
    Inventors: RaviKiran Gopalan, Anand Chandrasekher, Yihan Jiang