Abstract: Methods, systems, and apparatus, including computer program products, in which participation probabilities for content items in content item selection processes are adjusted based upon predicted performance measures. The predicted performance measures can be compared to one or more other predicted performance measures and/or threshold/scaling data to determine how to adjust the participation probability of the content item in the content item selection process.

Abstract: Experiment performance data associated with a first advertisement campaign is generated during a first advertisement campaign experiment. The experiment performance data includes a first set of experiment performance data and a second set of experiment performance data. A first set of simulated performance data for the first advertisement campaign using first set of auction instances with the advertisement campaign setting having second advertisement campaign value is generated. A second set of simulated performance data for the first advertisement campaign using the second set of auctions instances with the advertisement campaign setting having the first advertisement campaign value is generated. Accuracy of the first set of performance data and the second set of performance data is determined by comparing the first performance data to the second set of experiment performance data, and by comparing the second performance data to the first set of experiment performance data.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for providing guidance to price content items in publications. Features of a particular content item to be published in a particular publication are received from a requestor and compared with features of content items previously published in publications. Based on the comparing, a predicted price to publish the particular content item in the particular publication is determined based on actual prices of content items previously published in corresponding publications. Then, the predicted price is provided to the requestor.

Abstract: Content can be annotated with indications that contextually-related content associated with the annotation is available to a user in order to allow a user to more easily locate and access contextually-related content, particularly where hypertext links are unsuitable, such as for graphic and/or audio content. The location of the annotation within the content can indicate the portion of the content to which the contextually-related content pertains, and can be associated with a summary of the contextually-related content, such as a summary of the content, a brief explanation of the relatedness of the related content, and/or an indication of the source or the contextually-related content.

Abstract: Content can be annotated with indications that contextually-related content associated with the annotation is available to a user in order to allow a user to more easily locate and access contextually-related content, particularly where hypertext links are unsuitable, such as for graphic and/or audio content. The location of the annotation within the content can indicate the portion of the content to which the contextually-related content pertains, and can be associated with a summary of the contextually-related content, such as a summary of the content, a brief explanation of the relatedness of the related content, and/or an indication of the source or the contextually-related content.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for creating experiment content distribution campaigns (“experiment campaign”) and allocating content in accordance with the experiment campaign. In one aspect, a control campaign or an experiment campaign are selected as an available campaign for providing content in response to receiving a content request. The selection can be a probability constrained selection where the probability with which the experiment campaign is selected is specified as a portion of a total number of requests received during an experiment period for which the experiment campaign is available to provide content. Content is provided in response to the request, where the provided content being content corresponding to the selected campaign.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for creating experiment content distribution campaigns (“experiment campaign”) and allocating content in accordance with the experiment campaign. In one aspect, a control campaign or an experiment campaign are selected as an available campaign for providing content in response to receiving a content request. The selection can be a probability constrained selection where the probability with which the experiment campaign is selected is specified as a portion of a total number of requests received during an experiment period for which the experiment campaign is available to provide content. Content is provided in response to the request, where the provided content being content corresponding to the selected campaign.

Abstract: Content can be annotated with indications that contextually-related content associated with the annotation is available to a user in order to allow a user to more easily locate and access contextually-related content, particularly where hypertext links are unsuitable, such as for graphic and/or audio content. The location of the annotation within the content can indicate the portion of the content to which the contextually-related content pertains, and can be associated with a summary of the contextually-related content, such as a summary of the content, a brief explanation of the relatedness of the related content, and/or an indication of the source or the contextually-related content.

Abstract: A keyword, first online query volume information for the keyword in a first geographic region, and second online query volume information for the keyword in a second geographic region are received. A first parameter is calculated based on the first online query volume information and the second online query volume information, and the first parameter is determined to satisfy a threshold. In response to the determination that the first parameter satisfies the threshold, a first medium distributed in the first geographic region is identified and an item including the keyword is forwarded for placement in the first medium. Revenue generated by placement of the item in the first medium is determined.

Abstract: A term to be included in an item is identified. A value of a first parameter of online activity associated with the term is determined. A determination that the value of the first parameter satisfies a first threshold is made and an item that includes the term is generated. The item is forwarded for placement in a medium. After the item has been placed in the medium, one or more search queries including the term are received over a predetermined time period. A value for a second parameter of online activity associated with the one or more search queries is determined. Based on the determined value of the second parameter, a determination that the placement of the item in the medium was effective is made.