Patents by Inventor Yanen Li

Yanen Li has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12118464
    Abstract: A neural network system can select content based on user and item content embeddings in an approach that can be updated in real time on the user device without server support. Requests for content sent to the server can include an anonymous user embedding that includes data describing the user's inputs. The content that is nearest to the user embedding in a joint embedding space can be returned as suggested content.
    Type: Grant
    Filed: August 18, 2022
    Date of Patent: October 15, 2024
    Assignee: Snap Inc.
    Inventors: Lawrence Jason Muhlstein, Leonardo Ribas Machado das Neves, Yanen Li, Ning Xu
  • Publication number: 20240127064
    Abstract: A computer-implement method comprises: training a classifier with labeled data from a dataset; classifying, by the trained classifier, unlabeled data from the dataset; providing, by the classifier to a policy gradient, a reward signal for each data/query pair; transferring, by the classifier to a ranker, learning; training, by the policy gradient, the ranker; ranking data from the dataset based on a query; and retrieving data from the ranked data in response to the query.
    Type: Application
    Filed: December 18, 2023
    Publication date: April 18, 2024
    Inventors: Shibi He, Yanen Li, Ning Xu
  • Publication number: 20240104506
    Abstract: Technologies for skill taxonomy management are described. Embodiments include extracting an input text from an online system and applying an unsupervised generative text machine learning model to the input text. The text generator generates a set of sentences based on a job title included in the input text. One or more skills are extracted from the set of sentences. The extracted one or more skills correspond to one or more skills in a skill taxonomy. A frequency distribution is generated over the extracted one or more skills. The one or more skills are ranked based on the frequency distribution. Based on the ranking, a subset of the extracted one or more skills is generated. The subset of the extracted one or more skills is provided to a downstream operation, process, or service of the online system.
    Type: Application
    Filed: September 23, 2022
    Publication date: March 28, 2024
    Inventors: Liwei WU, Lichao NI, Mikaela Makalinao GUERRERO, Yanen LI
  • Patent number: 11907312
    Abstract: Systems and methods are provided for generating a user click history table and a random bucket training table, generating training data for training a user-type-affinity machine learning model by combining the user click history table and the random bucket training table, and training the user-type-affinity machine learning model with the generated training data. The systems and methods further provide for generating a user click prediction table and generating user-type-affinity prediction values for each of the plurality of users by inputting the user click prediction table into the user-type-affinity machine learning model.
    Type: Grant
    Filed: January 4, 2018
    Date of Patent: February 20, 2024
    Assignee: Snap Inc.
    Inventors: Yanen Li, Fei Wu, Ning Xu
  • Patent number: 11893489
    Abstract: A computer-implement method comprises: training a classifier with labeled data from a dataset; classifying, by the trained classifier, unlabeled data from the dataset; providing, by the classifier to a policy gradient, a reward signal for each data/query pair; transferring, by the classifier to a ranker, learning; training, by the policy gradient, the ranker; ranking data from the dataset based on a query; and retrieving data from the ranked data in response to the query.
    Type: Grant
    Filed: October 24, 2022
    Date of Patent: February 6, 2024
    Assignee: SNAP INC.
    Inventors: Shibi He, Yanen Li, Ning Xu
  • Patent number: 11816636
    Abstract: Techniques for mining training data for use in training a dependency model are disclosed herein. In some embodiments, a computer-implemented method comprises: obtaining training data comprising a plurality of reference skill pairs, each reference skill pair comprising a corresponding first reference skill and a corresponding second reference skill, the plurality of reference skill pairs being included in the training data based on a co-occurrence of the corresponding first and second reference skills for each reference skill pair in the plurality of reference skill pairs, the co-occurrence comprising the corresponding first and second reference skills co-occurring for a same entity; and training a dependency model with a machine learning algorithm using the training data, the dependency model comprising a logistic regression model or a data gradient boosted decision tree (GBDT) model. The dependency model may then be used to identify corresponding dependency relations for a plurality of target skill pairs.
    Type: Grant
    Filed: August 26, 2021
    Date of Patent: November 14, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Liwei Wu, Wenjia Ma, Jaewon Yang, Yanen Li
  • Publication number: 20230334308
    Abstract: Techniques for using deep reinforcement learning for training a recommendation model for an online service are disclosed herein. In some embodiments, a computer-implemented method comprises training a recommendation model using deep reinforcement learning and a Markov decision process, where the Markov decision process has a state space including state embeddings of a plurality of reference users, an action space including action embeddings of the plurality of reference users, and a reward function. The reward function may be configured to issue a first reward based on current impression interaction data and a second reward based on a measurement of engagement of the reference user with the online service.
    Type: Application
    Filed: April 13, 2022
    Publication date: October 19, 2023
    Inventors: Chujie Zheng, Sufeng Niu, Xiao YAN, Qidu He, Jaewon YANG, Yanen LI, Yiming WANG
  • Publication number: 20230245258
    Abstract: Methods, systems, and computer programs are provided for presenting career information based on career transitions of members. One method comprises generating, using a machine-learning (ML) model, an embedding for a current job position of a member of an online service. The model is obtained by training a ML program with training data for job transitions of members. Further, the method includes generating, by the ML model, embeddings for career transitions, of members of the online service, that occurred within a predetermined time period. For each career transition, a similarity value is calculated between the embedding of the career transition and the embedding for the current job position. Further, the method includes operations for ranking the career transitions based on the similarity values, generating a career insight for the member based on the ranked career transitions, and causing presentation of the career insight on a user interface.
    Type: Application
    Filed: February 1, 2022
    Publication date: August 3, 2023
    Inventors: Wenjia Ma, Prakruthi Prabhakar, Yiping Yuan, Yanen LI, Tianqi Li, Arvind Murali Mohan
  • Publication number: 20230091110
    Abstract: A neural network system can select content based on user and item content embeddings in an approach that can be updated in real time on the user device without server support. Requests for content sent to the server can include an anonymous user embedding that includes data describing the user's inputs. The content that is nearest to the user embedding in a joint embedding space can be returned as suggested content.
    Type: Application
    Filed: August 18, 2022
    Publication date: March 23, 2023
    Inventors: Lawrence Jason Muhlstein, Leonardo Ribas Machado das Neves, Yanen Li, Ning Xu
  • Publication number: 20230086724
    Abstract: Techniques for mining training data for use in training a dependency model are disclosed herein. In some embodiments, a computer-implemented method comprises: obtaining training data comprising a plurality of reference skill pairs, each reference skill pair comprising a corresponding first reference skill and a corresponding second reference skill, the plurality of reference skill pairs being included in the training data based on a co-occurrence of the corresponding first and second reference skills for each reference skill pair in the plurality of reference skill pairs, the co-occurrence comprising the corresponding first and second reference skills co-occurring for a same entity; and training a dependency model with a machine learning algorithm using the training data, the dependency model comprising a logistic regression model or a data gradient boosted decision tree (GBDT) model. The dependency model may then be used to identify corresponding dependency relations for a plurality of target skill pairs.
    Type: Application
    Filed: August 26, 2021
    Publication date: March 23, 2023
    Inventors: Liwei Wu, Wenjia Ma, Jaewon Yang, Yanen Li
  • Publication number: 20230077840
    Abstract: Techniques for predicting specialty data for a knowledge base using a machine learning model are disclosed herein. In some embodiments, a computer-implemented method comprises: for each skill in a plurality of skills, computing a skill-to-specialty distribution for specialties using a first machine learning model; for each skill in the plurality of skills, computing a user-to-skill distribution for the plurality of skills based on feature data of a first user of an online service using a second machine learning model; computing a user-to-specialty distribution for the plurality of specialties based on the skill-to-specialty distribution and the user-to-skill distribution, the user-to-specialty distribution comprising a corresponding user-to-specialty probability value for each specialty in the plurality of specialties given the first user; and using the user-to-specialty distribution in an application of the online service.
    Type: Application
    Filed: September 16, 2021
    Publication date: March 16, 2023
    Inventors: Liwei WU, Sebastian Alexander Csar, Lin ZHU, Yanen LI
  • Publication number: 20230053009
    Abstract: A computer-implement method comprises: training a classifier with labeled data from a dataset; classifying, by the trained classifier, unlabeled data from the dataset; providing, by the classifier to a policy gradient, a reward signal for each data/query pair; transferring, by the classifier to a ranker, learning; training, by the policy gradient, the ranker; ranking data from the dataset based on a query; and retrieving data from the ranked data in response to the query.
    Type: Application
    Filed: October 24, 2022
    Publication date: February 16, 2023
    Inventors: Shibi He, Yanen Li, Ning Xu
  • Patent number: 11544553
    Abstract: A computer-implement method comprises: training a classifier with labeled data from a dataset; classifying, by the trained classifier, unlabeled data from the dataset; providing, by the classifier to a policy gradient, a reward signal for each data/query pair; transferring, by the classifier to a ranker, learning; training, by the policy gradient, the ranker; ranking data from the dataset based on a query; and retrieving data from the ranked data in response to the query.
    Type: Grant
    Filed: June 21, 2019
    Date of Patent: January 3, 2023
    Assignee: Snap Inc.
    Inventors: Shibi He, Yanen Li, Ning Xu
  • Patent number: 11461421
    Abstract: Techniques for ranking skills using an ensemble machine learning approach are described. The outputs of two heterogenous, machine-learned models are combined to rank a set of skills that may be possessed by an end-user of an online service. Some subset of the highest-ranking skills is then presented to the end-user with a recommendation that the skills be added to the end-user's profile. The ensemble learning technique involves a concept referred to as “boosting”, in which a weaker performing model is enhanced (e.g., “boosted”) by a stronger performing model, when ranking the set of skills. Accordingly, by using a combination of models, better results are achieved than might be with either one of the individual models alone. Furthermore, the approach is scalable in ways that cannot be achieved with heuristic-based approaches.
    Type: Grant
    Filed: December 29, 2020
    Date of Patent: October 4, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Yiming Wang, Xiao Yan, Lin Zhu, Jaewon Yang, Yanen Li, Jacob Bollinger
  • Patent number: 11422996
    Abstract: A neural network system can select content based on user and item content embeddings in an approach that can be updated in real time on the user device without server support. Requests for content sent to the server can include an anonymous user embedding that includes data describing the user's inputs. The content that is nearest to the user embedding in a joint embedding space can be returned as suggested content.
    Type: Grant
    Filed: April 26, 2019
    Date of Patent: August 23, 2022
    Assignee: Snap Inc.
    Inventors: Lawrence Jason Muhlstein, Leonardo Ribas Machado das Neves, Yanen Li, Ning Xu
  • Publication number: 20220207099
    Abstract: Techniques for ranking skills using an ensemble machine learning approach are described. The outputs of two heterogenous, machine-learned models are combined to rank a set of skills that may be possessed by an end-user of an online service. Some subset of the highest-ranking skills is then presented to the end-user with a recommendation that the skills be added to the end-user's profile. The ensemble learning technique involves a concept referred to as “boosting”, in which a weaker performing model is enhanced (e.g., “boosted”) by a stronger performing model, when ranking the set of skills. Accordingly, by using a combination of models, better results are achieved than might be with either one of the individual models alone. Furthermore, the approach is scalable in ways that cannot be achieved with heuristic-based approaches.
    Type: Application
    Filed: December 29, 2020
    Publication date: June 30, 2022
    Inventors: Yiming Wang, Xiao Yan, Lin Zhu, Jaewon Yang, Yanen Li, Jacob Bollinger
  • Patent number: 10552428
    Abstract: An on-line social network system is configured to generate a news feed for a member by processing updates originating from different sources using different first pass ranker models. The first pass ranker models generate respective sets of raw scores, which are calibrated based on a consistent scale of feed engagement metrics of interest, such as a click through rate. The calibrated scores are then used as training data to train a second pass ranker and/or as input into the second pass ranker at the time when the second pass ranker is to generate respective ranks for items in an inventory of updates identified as potentially of interest to a focus member and to select a subset of items from the inventory based on the generated respective ranks.
    Type: Grant
    Filed: June 3, 2016
    Date of Patent: February 4, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Pannagadatta K. Shivaswamy, Nikita Igorevych Lytkin, Yanen Li, Guy Lebanon
  • Publication number: 20190236450
    Abstract: Multimodal data sets of a given entity (e.g., a user) can be processed using a plurality of different machine learning schemes, such as a recurrent neural network and a fully connected neural network. Representations generated by the networks can be combined in an additive layer and further in a multiplicative layer that emphasizes informative modalities and tolerates less informative modalities.
    Type: Application
    Filed: December 21, 2018
    Publication date: August 1, 2019
    Inventors: Yanen Li, Kuan Liu, Ning Xu
  • Publication number: 20170351679
    Abstract: An on-line social network system is configured to generate a news feed for a member by processing updates originating from different sources using different first pass ranker models. The first pass ranker models generate respective sets of raw scores, which are calibrated based on a consistent scale of feed engagement metrics of interest, such as a click through rate. The calibrated scores are then used as training data to train a second pass ranker and/or as input into the second pass ranker at the time when the second pass ranker is to generate respective ranks for items in an inventory of updates identified as potentially of interest to a focus member and to select a subset of items from the inventory based on the generated respective ranks.
    Type: Application
    Filed: June 3, 2016
    Publication date: December 7, 2017
    Inventors: Pannagadatta K. Shivaswamy, Nikita Igorevych Lytkin, Yanen Li, Guy Lebanon
  • Patent number: 9787785
    Abstract: Systems and methods are disclosed that recommend one or more electronic presentations to a user based on one or more factors. These factors may include contextual information, behavioral information, profile information, or combinations of the foregoing. Contextual information may include content and/or features extracted from a given electronic presentation. Behavioral information may include user behavioral data, such as the number of times a user has viewed a presentation, the amount of the presentation viewed by the user, presentations previously viewed by the user, and other such behavioral data. Profile information may include user professional profile information, such as skills the user has identified as possessing, employment history information, and other such user professional profile information.
    Type: Grant
    Filed: August 29, 2014
    Date of Patent: October 10, 2017
    Assignee: LinkedIn Corporation
    Inventors: Haishan Liu, Lili Wu, Yanen Li, Liang Tang, Baoshi Yan, Anmol Bhasin