Patents by Inventor Jinyun Yan
Jinyun Yan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230059115Abstract: Machine learning techniques to optimize user interface template selection are provided. In one technique, a first set of feature values pertaining to a first entity is identified. Multiple sets of feature values are also identified, each set of feature values pertaining to a different user interface (UI) template for rendering content items on a computer screen. For each set of feature values of the multiple sets, the set of feature values and the first set of feature values are inserted into a machine-learned model to generate a score, which is added to a set of scores, which set of scores is initially empty. Based on the set of scores, a particular UI template is selected for a content item. The content item is transmitted over a computer network to be presented on a screen of a computing device of the first entity according to the particular UI template.Type: ApplicationFiled: August 19, 2021Publication date: February 23, 2023Inventors: Jinyun YAN, Vinay Praneeth BODA, Mingyang HU, Randell C. COTTA, Scott SERRANO, Keren Kochava BARUCH, Tomas CHAVARRIA, Grant EMPEY, James HUNG
-
Patent number: 11514372Abstract: Techniques are provided for automatically tuning a parameter in a layered model framework. One or more machine learning techniques are used to train multiple versions of a first model that includes a first version and a second version. A second model is stored that includes a parameter and accepts, as input, output from the first model. Multiple parameter values of the parameter are tested when processing content requests using the first and second versions of the first model. A strict subset of the plurality of parameter values are selected for the parameter of the second model, such that processing a first subset of the content requests using the first version of the first model results in a first value of a particular metric that matches a second value of the particular metric resulting from processing a second subset of the content requests using the second version of the first model.Type: GrantFiled: August 30, 2019Date of Patent: November 29, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Zhiyuan Xu, Jinyun Yan, Kinjal Basu, Revant Kumar, Onkar A. Dalal
-
Publication number: 20220284320Abstract: Techniques for using machine-learned models to throttle content are provided. In one technique, based on multiple selection events, a distribution of relevance measures is computed, where the relevance measures are associated with the content item selection events. The relevance measures may be generated by one or more machine-learned models. Based on the computed distribution, a threshold relevance measure is computed. Thereafter, a request for content is received over a computer network. In response, a computer system performs, in real-time, multiple steps. For example, an identity of an entity that is associated with the request is identified and, based on that identity, multiple content delivery groups are identified. A relevance measure of one of the content delivery groups relative to the entity is determined and compared to the threshold relevance measure. The content delivery group is selected only after determining that the relevance measure is above the threshold relevance measure.Type: ApplicationFiled: March 3, 2021Publication date: September 8, 2022Inventors: Jinyun YAN, Shaunak CHATTERJEE, Runfang ZHOU
-
Patent number: 11321741Abstract: Techniques for using a machine-learned model to personalize content item density. In one technique, an entity that is associated with a content request is identified. Multiple sets of content items are identified that includes content items of different types. A first position of a first slot is determined in a content item feed that comprises multiple slots. A second position of a previous content item is determined, in the content item feed, that is of a first type. A difference between the first position and the second position is determined. Based on the difference, a gap sensitivity value that is associated with the entity and is different than the difference is determined. Based on the gap sensitivity value, a content item from the multiple sets of content items is selected and inserted into the first slot. The content item feed is transmitted to a computing device to be presented thereon.Type: GrantFiled: January 28, 2020Date of Patent: May 3, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Zhiyuan Xu, Jinyun Yan, Shaunak Chatterjee
-
Publication number: 20210342740Abstract: Techniques for selectively transmitting electronic notifications using machine learning techniques based on entity selection history are provided. In one technique, a candidate notification is identified for a target entity. An entity selection rate of the candidate notification by the target entity is determined. Based on the candidate notification, determining a probability of the target entity visiting a target online system. Based on online history of the target entity, a measure of downstream interaction by the target entity relative to one or more online systems is determined. Based on the entity selection rate, the probability, and the measure of downstream interaction by the target entity, a score for the candidate notification is generated. Based on the score, it is determined whether data about the candidate notification is to be transmitted over a computer network to a computing device of the target entity.Type: ApplicationFiled: May 4, 2020Publication date: November 4, 2021Inventors: Zhiyuan Xu, Jinyun Yan, Ajith Muralidharan, Wensheng Sun, Jiaqi Ge, Shaunak Chatterjee
-
Patent number: 11093861Abstract: Techniques for controlling item frequency using machine learning are provides. In one technique, two prediction models are trained: one based on interaction history of multiple content items by multiple entities and the other based on predicted interaction rates and an impression count for each of multiple content items. In response to a request, a particular entity associated with the request is identified and multiple candidate content items are identified. For each identified candidate content item, the first prediction model is used to determine a predicted interaction rate, an impression count of the candidate content item is determined with respect to the particular entity, the second prediction model is used to generate an adjustment based on the impression count, and an adjusted entity interaction rate is generated based on the predicted interaction rate and the adjustment. A particular candidate content item is selected based on the generated adjusted entity interaction rates.Type: GrantFiled: March 20, 2019Date of Patent: August 17, 2021Assignee: Microsoft Technology Licensing, LLCInventors: Jinyun Yan, Vinay Praneeth Boda, Yin Zhang, David Pardoe
-
Publication number: 20210233119Abstract: Techniques for using a machine-learned model to personalize content item density. In one technique, an entity that is associated with a content request is identified. Multiple sets of content items are identified that includes content items of different types. A first position of a first slot is determined in a content item feed that comprises multiple slots. A second position of a previous content item is determined, in the content item feed, that is of a first type. A difference between the first position and the second position is determined. Based on the difference, a gap sensitivity value that is associated with the entity and is different than the difference is determined. Based on the gap sensitivity value, a content item from the multiple sets of content items is selected and inserted into the first slot. The content item feed is transmitted to a computing device to be presented thereon.Type: ApplicationFiled: January 28, 2020Publication date: July 29, 2021Inventors: Zhiyuan Xu, Jinyun Yan, Shaunak Chatterjee
-
Patent number: 10951676Abstract: Techniques for varying content item density are provided. A first minimum gap value is stored that dictates how close two content items of a first type may appear in a content item feed that contains content items of multiple types that includes the first type and a second type. The first minimum gap value is used to place content items in a first set of content item feeds. For each content item feed of the first set of content item feeds, performance data that indicates how well content items of the first type perform in the content item feed is generated. Based on the performance data and the first minimum gap value, a second minimum gap value that is different than the first minimum gap value is generated. The second minimum gap value is used to place content items in a second plurality of content item feeds.Type: GrantFiled: September 25, 2018Date of Patent: March 16, 2021Assignee: Microsoft Technology Licensing, LLCInventors: Jinyun Yan, Yuan Gao, Shaunak Chatterjee, Gaurav Chandalia, Birjodh S. Tiwana
-
Publication number: 20210065064Abstract: Techniques are provided for automatically tuning a parameter in a layered model framework. One or more machine learning techniques are used to train multiple versions of a first model that includes a first version and a second version. A second model is stored that includes a parameter and accepts, as input, output from the first model. Multiple parameter values of the parameter are tested when processing content requests using the first and second versions of the first model. A strict subset of the plurality of parameter values are selected for the parameter of the second model, such that processing a first subset of the content requests using the first version of the first model results in a first value of a particular metric that matches a second value of the particular metric resulting from processing a second subset of the content requests using the second version of the first model.Type: ApplicationFiled: August 30, 2019Publication date: March 4, 2021Inventors: Zhiyuan Xu, Jinyun Yan, Kinjal Basu, Revant Kumar, Onkar A. Dalal
-
Patent number: 10853736Abstract: A method can include determining, based on learned parameter values, an intrinsic interest and an affinity for the user to be influenced to visit the website, determining, using the learned parameter values, intrinsic interest, and affinity for the user to be influenced to visit the website, a first probability indicating a likelihood that the user will, in response to viewing a badge notification, turn off notifications or delete an app and a second probability indicating a likelihood that the user will, in response to viewing the badge notification on the app, visit a website, in response to determining the second probability is greater than a threshold larger than the first probability, causing the app to include the badge notification when displayed on the user device.Type: GrantFiled: November 17, 2017Date of Patent: December 1, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Jinyun Yan, Peng Du, Shaunak Chatterjee, Shipeng Yu
-
Publication number: 20200311745Abstract: Technologies for optimizing content delivery to end-users are provided. Disclosed techniques include storing results of an online experiment with respect to a set of users and determining a plurality of distinct subsets of users based upon the results of the experiment. Users within each of the plurality of distinct subsets may be identified based on metric impacts of the online experiment. For each distinct subset and each associated model parameter, a utility value that represents effectiveness of the model parameter, with respect to an objective, may be determined. An objective optimization model may be used to automatically determine probabilities for each of the model parameters associated with each distinct subset. Users of a second set of users may be assigned to a distinct subset and associated model parameters may be applied to a content delivery strategies of the second set of users.Type: ApplicationFiled: March 29, 2019Publication date: October 1, 2020Inventors: Ye Tu, Kinjal Basu, Jinyun Yan, Shaunak Chatterjee, Birjodh S. Tiwana
-
Publication number: 20200302333Abstract: Techniques for controlling item frequency using machine learning are provides. In one technique, two prediction models are trained: one based on interaction history of multiple content items by multiple entities and the other based on predicted interaction rates and an impression count for each of multiple content items. In response to a request, a particular entity associated with the request is identified and multiple candidate content items are identified. For each identified candidate content item, the first prediction model is used to determine a predicted interaction rate, an impression count of the candidate content item is determined with respect to the particular entity, the second prediction model is used to generate an adjustment based on the impression count, and an adjusted entity interaction rate is generated based on the predicted interaction rate and the adjustment. A particular candidate content item is selected based on the generated adjusted entity interaction rates.Type: ApplicationFiled: March 20, 2019Publication date: September 24, 2020Inventors: Jinyun Yan, Vinay Praneeth Boda, Yin Zhang, David Pardoe
-
Patent number: 10743077Abstract: Techniques for accounting for position-specific differences in user interaction while conducting content item selection events are provided. In one technique, a position-specific factor is determined. The position-specific factor may be based on a ratio of an observed interaction and a predicted interaction. Different positions in a content item feed or on a web page may be associated with different position-specific factors. Eventually, multiple content items are identified for presentation on a screen of a computing device. The content items include a first content item for which a predicted interaction rate is calculated and a second content item for which no predicted interaction rate is calculated. An order of the content items is determined based on the position-specific factor. For example, the predicted interaction rate of the first content item is modified based on the position-specific factor. The content items are presented on the screen based on the order.Type: GrantFiled: December 19, 2018Date of Patent: August 11, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Lijun Peng, David Pardoe, Yuan Gao, Jinyun Yan
-
Publication number: 20200204868Abstract: Techniques for accounting for position-specific differences in user interaction while conducting content item selection events are provided. In one technique, a position-specific factor is determined. The position-specific factor may be based on a ratio of an observed interaction and a predicted interaction. Different positions in a content item feed or on a web page may be associated with different position-specific factors. Eventually, multiple content items are identified for presentation on a screen of a computing device. The content items include a first content item for which a predicted interaction rate is calculated and a second content item for which no predicted interaction rate is calculated. An order of the content items is determined based on the position-specific factor. For example, the predicted interaction rate of the first content item is modified based on the position-specific factor. The content items are presented on the screen based on the order.Type: ApplicationFiled: December 19, 2018Publication date: June 25, 2020Inventors: Lijun Peng, David Pardoe, Yuan Gao, Jinyun Yan
-
Patent number: 10671680Abstract: A system and method for content generation and targeting using machine learning are provided. In example embodiments, a probability that a user will visit a webpage based on historical data is calculated. A probability that the user will engage with a particular content category based on past user engagement is calculated. In response to the probability of the user engaging with the particular content category being equal to or greater than a first threshold, the content is generated. Further, in response to the probability of the user not visiting a webpage meeting or exceeding a second threshold, the generated content is sent to the user.Type: GrantFiled: August 25, 2016Date of Patent: June 2, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Jinyun Yan, Hsiao-Ping Tseng, Xiaoyu Chen, Rupesh Gupta, Romer E. Rosales
-
Publication number: 20200134663Abstract: Techniques are provided for automatically adjusting a resource reduction amount based on resource availability and other factors. The following are determined for a content delivery campaign: a winning distribution for a target audience of the content delivery campaign, a through rate distribution of the content delivery campaign, a resource allocation of the content delivery campaign, and an estimated number of content item selection events in which the content delivery campaign will participate in a future time period. Based on these values, a resource reduction amount is determined. An example of a resource reduction amount is an effective cost per impression. The resource reduction amount is used in one or more subsequent content item selection events in which the content delivery campaign participates.Type: ApplicationFiled: October 31, 2018Publication date: April 30, 2020Inventors: Yuan Gao, David Pardoe, Lijun Peng, Jinyun Yan
-
Patent number: 10628855Abstract: Techniques for automatically merging multiple content item queues are provided. In one technique, a first set of content items of a first type is identified. A second set of content items of a second type that is different than first type is identified. The first set of content items and the second set of content items are merged in a content item feed. Such merging involves, for a particular slot in the content item feed: determining a previous slot that contains a first content item from the first set; determining a number of slots between the previous slot and the particular slot; based on the number of slots, generating a score for a second content item from the second set; and based on the score, determining whether to insert, into the particular slot, the second content item or a third content item from the first set of content items.Type: GrantFiled: September 25, 2018Date of Patent: April 21, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Birjodh S. Tiwana, Jinyun Yan, Shaunak Chatterjee, Sarah Y. Xing, Gaurav Chandalia
-
Publication number: 20200099746Abstract: Techniques for automatically merging multiple content item queues are provided. In one technique, a first set of content items of a first type is identified. A second set of content items of a second type that is different than first type is identified. The the first set of content items and the second set of content items are merged in a content item feed. Such merging involves, for a particular slot in the content item feed: determining a previous slot that contains a first content item from the first set; determining a number of slots between the previous slot and the particular slot; based on the number of slots, generating a score for a second content item from the second set; and based on the score, determining whether to insert, into the particular slot, the second content item or a third content item from the first set of content items.Type: ApplicationFiled: September 25, 2018Publication date: March 26, 2020Inventors: Birjodh S. Tiwana, Jinyun Yan, Shaunak Chatterjee, Sarah Y. Xing, Gaurav Chandalia
-
Publication number: 20200099730Abstract: Techniques for varying content item density are provided. A first minimum gap value is stored that dictates how close two content items of a first type may appear in a content item feed that contains content items of multiple types that includes the first type and a second type. The first minimum gap value is used to place content items in a first set of content item feeds. For each content item feed of the first set of content item feeds, performance data that indicates how well content items of the first type perform in the content item feed is generated. Based on the performance data and the first minimum gap value, a second minimum gap value that is different than the first minimum gap value is generated. The second minimum gap value is used to place content items in a second plurality of content item feeds.Type: ApplicationFiled: September 25, 2018Publication date: March 26, 2020Inventors: Jinyun Yan, Yuan Gao, Shaunak Chatterjee, Gaurav Chandalia, Birjodh S. Tiwana
-
Patent number: 10516644Abstract: A notification platform for distribution of notification content in an on-line social network system addresses the technical problem of optimizing the volume of quality notifications that are being delivered to a given member. A notification delivery system is designed as a stream processing system that can fetch, store, and process data in a near-line fashion. It can perform feature generation, processing and scoring of notifications, as well as ranking of the notifications based on their respective relevance scores that are calculated using machine learning techniques. The notification delivery system is positioned centrally with respect to different producers of notifications, such that it can consume centrally-stored information about members' holistic notification experiences.Type: GrantFiled: April 30, 2018Date of Patent: December 24, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Changji Shi, Zhongen Tao, Jinyun Yan, Yan Gao, Shaunak Chatterjee, Sandor Nyako