Patents by Inventor Alex Shelkovnykov

Alex Shelkovnykov has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11106982
    Abstract: In an example embodiment, a warm-start training solution is used to dramatically reduce the computational resources needed to train when retraining a generalized additive mixed-effect (GAME) model. The problem of retraining time is particularly applicable to GAME models, since these models take much longer to train as the data grows. In the past, the strategy to reduce computational resources during retraining was to use less training data, but this affects the model quality, especially for GAME models, which rely on fine-grained sub-models at, for example, member or item levels. The present solution addresses the computational resources issues without sacrificing GAME model accuracy.
    Type: Grant
    Filed: August 22, 2018
    Date of Patent: August 31, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Yiming Ma, Alex Shelkovnykov, Josh Fleming, Bee-Chung Chen, Bo Long
  • Publication number: 20200065678
    Abstract: In an example embodiment, a warm-start training solution is used to dramatically reduce the computational resources needed to train when retraining a generalized additive mixed-effect (GAME) model. The problem of retraining time is particularly applicable to GAME models, since these models take much longer to train as the data grows. In the past, the strategy to reduce computational resources during retraining was to use less training data, but this affects the model quality, especially for GAME models, which rely on fine-grained sub-models at, for example, member or item levels. The present solution addresses the computational resources issues without sacrificing GAME model accuracy.
    Type: Application
    Filed: August 22, 2018
    Publication date: February 27, 2020
    Inventors: Yiming Ma, Alex Shelkovnykov, Josh Fleming, Bee-Chung Chen, Bo Long
  • Publication number: 20190197422
    Abstract: In an example, predictions/recommendations using machine learned models are made even more accurate by using three models instead of a single Generalized Linear Mixed (GLMix) model. Specifically, rather than having a single GLMix model with different coefficients for users and items, three separate models are used and then combined. Each of these models has different granularities and dimensions. A global model models the similarity between user attributes (e.g., from the member profile or activity history) and item attributes. A per-user model models user attributes and activity history. A per-item model models item attributes and activity history. Such a model may be termed a Generalized Additive Mixed Effect (GAME) model.
    Type: Application
    Filed: January 24, 2018
    Publication date: June 27, 2019
    Inventors: Bee-Chung Chen, Deepak Agarwal, Alex Shelkovnykov, Josh Fleming, Yiming Ma
  • Publication number: 20190197013
    Abstract: Iterations of a machine learned model training process are performed until a convergence occurs. A fixed effects machine learned model is trained using a first machine learning algorithm. Residuals of the training of the fixed effects machine learned model are determined by comparing results of the trained fixed effects machine learned model to a first set of target results. A first random effects machine learned model is trained using a second machine learning algorithm and the residuals of the training of the fixed effects machine learned model. Residuals of the training of the first random effect machine learned model are determined by comparing results of the trained first random effects machine learned model to a second set of target result, in each subsequent iteration the training of the fixed effects machine learned model uses residuals of the training of a last machine learned model trained in a previous iteration.
    Type: Application
    Filed: January 24, 2018
    Publication date: June 27, 2019
    Inventors: Bee-Chung Chen, Deepak Agarwal, Alex Shelkovnykov, Josh Fleming, Yiming Ma