Abstract: Methods, and systems, including computer programs encoded on computer-readable storage mediums, including a method for identifying keywords for a contextual advertisement campaign based on a remarketing list. The method including accessing a remarketing list identifying user identifiers; accessing user identifier history data specifying user events caused by users of the user devices; identifying keywords that caused the advertisements to be presented to the users; for each of the keywords: determining whether a first performance measure of advertisements that the keyword caused to be presented meets a first performance threshold; in response to determining that the first performance measure of advertisements that the keyword caused to be presented meets the first performance threshold, identifying the keyword as a target keyword; generating keyword suggestions from the target keywords; and providing the keyword suggestions to the advertiser.

Abstract: A system including a memory device storing instructions and servers that interact with the memory device and execute the instructions that cause the servers to perform operations including obtaining, using electronic cookies stored at client devices or pixel tags that are embedded in online resources, online activity performed at client devices; generating an online activity model using the online activity and the attributes of the users associated with the set of online activity, wherein the online activity model identifies different users as being likely to perform an activity in the online activity based on a similarity between the attributes of the users and attributes of the different users; determining, based on an application of the online activity model to the attributes, additional user identifiers of users that are likely to perform a same online activity by client devices as users corresponding to the user identifiers received from the third party.

Abstract: A computerized method, system for, and computer-readable medium operable to take a first set of network user identifiers and generate a set of recommended network user identifiers based on the first set and advertiser bid data. A processing circuit receives the first set and advertiser bid data for the first set and stores the first set and advertiser bid data for the first set in a memory. The advertiser bid data includes a price offered by the advertiser for the advertiser's content to be shown to a network user identifier in the first set. The processing circuit receives advertiser bid data for a second set. The processing circuit generates a user similarity parameter based on the advertiser bid data for the first set and the advertiser bid data for the second set. The processing circuit generates the set of recommended network user identifiers based on the user similarity parameter.

Abstract: A computerized method and system operable to build a device identifier similarity model with online event signals and determine similar network device identifiers. A processing circuit receives a first set of network device identifiers. The processing circuit represents each network device identifier of the first set by feature data associated with each network device identifier's network activity, where the feature data is associated with the content clicked-on or converted-on. The processing circuit applies abstractions on the feature data to form concepts. The processing circuit derives at least one hierarchy of feature data based on the keywords and concepts of the feature data. The processing circuit expands the feature data based on the derived at least one hierarchy of feature data and generates the device identifier similarity model based on the expanded feature data. The processing circuit is also capable of determining long-term and short-term history events.

Abstract: A computerized method for generating a representative model for a plurality of different models identified by similar feature data. A processing circuit receives a plurality of different models, each model configured for use in generating a second set of network user identifiers based on a first set of network user identifiers. The processing circuit receives feature data for each of the plurality of different models, each feature data having a corresponding feature weight data. The processing circuit identifies similar models within the plurality of different models based on a similarity of the feature data between models within the plurality of different models. The processing circuit generates the representative model to represent the similar models. The representative model may be used to generate the second set of network user identifiers based on the feature data and corresponding weight data of the representative model.

Abstract: A computerized method of creating a classifier model to determine whether a network user should be added to a list of similar network users. A first list of network users, a second list of network users who are not on the first list of network users and characteristic data associated with the network users' network activity are received. A time period is designated. A first category of network activities performed by a network user on the first list within the designated time period is identified. A second category of network activities performed at any time by network users on the second list is identified. A third category of network activities performed by network users on the first list at a time outside of the designated time period is identified. The classifier model is generated based on the first, second and third categories of network activities.

Abstract: A computerized method, system for, and computer-readable medium operable to select an algorithm for generating models configured to identify similar user identifiers. A first plurality of models generated by a first algorithm is received. A plurality of lists of similar user identifiers is generated. User queries associated with user identifiers on the plurality of lists of similar user identifiers are identified. Predicted click-through rates for the user queries is received. An average predicted click-through rate is computed for each model based on the predicted click-through rates. A weighted average predicted click-through rate associated with the first plurality of models is computed. The weighted average predicted click-through rate for the first plurality of models can be compared to a weighted average predicted click-through rate for a second plurality of models generated by a second algorithm. The algorithm for generating models is selected based on the comparison.

Abstract: A method of setting a threshold similarity score value for a first plurality of network user identifiers. The first plurality of network user identifiers, a second plurality of network user identifiers and characteristic data associated with the network user identifiers is received. A performance target and an experimental threshold similarity score value are designated. A similarity score between the first and second plurality of network user identifiers is calculated. Performance statistics data for each of the second plurality of network user identifiers having a similarity score greater than or equal to the experimental threshold similarity score value is collected and compared to the similarity score of the network user identifier. Based on the comparison, the experimental threshold similarity score value is adjusted to a similarity score value that achieves the performance target and the threshold similarity score value is set to the adjusted experimental threshold similarity score value.

Abstract: Systems and methods of selecting consumers to receive content on a computer network are provided. A user list identifying a first plurality of users having a group of features corresponding to internet activity of the first plurality of users can be obtained at a computing device. A subgroup of features can be selected from the group of features, and a cluster of users of the first plurality of users can be identified. The users of the cluster of users can each have at least one feature of the subgroup of features. A supplemental user having a supplemental feature can be identified. A correlation between the supplemental feature and at least one feature of the subgroup of features can be determined, and an expanded user list that includes at least one of the first plurality of users and the supplemental user can be generated.

Abstract: A computerized method for determining a model refresh rate for a model representing a list of network user identifiers includes receiving a first and a second model representing the list at a first and a second time, respectively. Similarity between the first and second model is calculated. If the similarity is less than a threshold value, the model refresh rate is a predetermined rate. If the similarity is equal to or exceeds the threshold value, the model refresh rate is decreased to a less frequent rate. A similarity between a reference model and a selected model in a same content category may be calculated. If the similarity is less than a threshold value, the model refresh rate for the selected model is a predetermined rate. If the similarity is equal to or exceeds the threshold value, the model refresh rate for the reference model is applied to the selected model.

Abstract: A computerized method, system for, and computer-readable medium operable to select a list of network user identifiers. A processing circuit receives a list of network user identifiers represented by long-term history data indicative of web pages visited prior to a first time and short-term history data indicative of web pages visited after the first time and prior to a second time. Long-term interest categories, corresponding weight values for each long-term interest category, short-term interest categories and corresponding weight values for each short-term interest category are identified. A model comprising the long-term and short-term interest categories is generated based on the weight values of the long-term and short-term interest categories using either arithmetic or harmonic progression. The processing circuit receives a list of candidate network user identifiers and generates a list of similar network user identifiers based on the model.