Patents by Inventor Jingbang Liu

Jingbang Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200104398
    Abstract: The disclosed embodiments provide a system for performing unified management of targeting attributes in A/B tests. During operation, the system obtains attribute configurations for attributes to be used in subsequent targeting of users by A/B tests. Next, the system configures, based on the attribute configurations, onboarding of the attributes from an offline environment, a near-real-time environment, and an online environment. During an A/B test, the system retrieves values of one or more of the attributes for a user from locations specified in the attribute configurations. Finally, the system outputs the values with targeting conditions for the A/B test for use in selecting a treatment assignment for the user in the A/B test.
    Type: Application
    Filed: September 28, 2018
    Publication date: April 2, 2020
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Alexander Ivaniuk, Jingbang Liu, Shaochen Huang, Jiahui Qi, Shaohua Xie
  • Publication number: 20200104383
    Abstract: The disclosed embodiments provide a system that uses A/B testing to safely terminate unused experiments. During operation, the system determines a first A/B test that matches one or more criteria for removal from an A/B testing platform. Next, the system initiates a first ramp-down of the first A/B test to observe an effect of a control variant on a performance metric for the first A/B test. When the effect includes a change in the performance metric, the system automatically removes code blocks that use the first A/B test on the A/B testing platform and terminates the first A/B test.
    Type: Application
    Filed: September 28, 2018
    Publication date: April 2, 2020
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Alexander Ivaniuk, Jingbang Liu, Ruirui Xiang
  • Publication number: 20200104160
    Abstract: The disclosed embodiments provide a system for evaluating targeting conditions for A/B tests. During operation, the system obtains a test configuration containing targeting conditions for an A/B test, wherein the targeting conditions include attributes of one or more segments of users and operators to be applied to the attributes. Next, the system identifies an operator between a first targeting condition that can be evaluated locally and a second targeting condition that requires a remote call to evaluate. The system then evaluates the first targeting condition without evaluating the second targeting condition to produce an output value of the first targeting condition. When application of the operator to the output value produces a Boolean value, the system returns the Boolean value as an evaluation result for a portion of the test configuration represented by the operator, the first targeting condition, and the second targeting condition.
    Type: Application
    Filed: September 28, 2018
    Publication date: April 2, 2020
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Alexander Ivaniuk, Jingbang Liu