Abstract: An advertising (“ad”) system allows users to specify a budget for an advertisement (“ad”) campaign including ad requests (“ads”), and the ad system automatically determines bids on a per-impression basis to pace the ad spend according to the budget. The ad system computes a “regret” metric for the ad campaign, which is the total amount over the course of the ad campaign that the advertiser had to pay for presenting an ad above the ideal bid (e.g., the bid that would have captured at least a threshold number of the lowest priced impressions during the ad campaign's life while spending the budget). The ad system may use the regret metric to indicate the performance of the ad campaign, e.g., as feedback for the advertiser.

Abstract: An online system receives content items from publishing users for presentation to other users. When selecting content for presentation to users, the online system accounts for amounts of compensation from publishing users when presenting content items. To prevent publishing users from exploiting content selection by the online system to obtain disproportionate presentation of their content items relative to other publishing users, the online system generates an estimated amount of revenue from various publishing users from presenting their content items. The online system compares an amount of compensation received from a publishing user to the estimated amount of revenue from the publishing user, and generates clusters of content items from the publishing user for review if the amount of compensation is at least a threshold amount less than the estimated amount of revenue.

Abstract: An online system presents different content items to different sets of users to evaluate how changes to content or changes to the online system affect user interaction with the content items or presentation of the content items. However, if the online system receives compensation for presenting different content items, the online system may receive a disproportionate amount of compensation for presenting one of the content items that improves user interaction. To prevent such disproportionate allocation of compensation between presentation of different contents items, the online system allocates sets of users to whom different content items are eligible to be presented to maintain a specified budget for presenting the different content items. The online system also differently allocates users across sets to whom different content items are eligible for presentation to prevent biasing of users from presentation of other different content items to users done in parallel.

Abstract: An advertising (“ad”) system allows users to specify a budget for an advertisement (“ad”) campaign including ad requests (“ads”), and the ad system automatically determines bids on a per-impression basis to pace the ad spend according to the budget. The ad system computes a “regret” metric for the ad campaign, which is the total amount over the course of the ad campaign that the advertiser had to pay for presenting an ad above the ideal bid (e.g., the bid that would have captured at least a threshold number of the lowest priced impressions during the ad campaign's life while spending the budget). The ad system may use the regret metric to indicate the performance of the ad campaign, e.g., as feedback for the advertiser.

Abstract: Methods and systems are disclosed which allow shifting inventory to fulfill guaranteed delivery advertisement contracts. Inventory may be allocated from a supply of unallocated inventory to one or more advertisers in accordance with guaranteed delivery agreements. Inventory may be reserved for the one or more advertisers from the remaining supply of unallocated inventory. Inventory may then be allocated to an additional advertiser by using unallocated inventory or shifted inventory, or a combination of unallocated inventory and shifted inventory. The shifted inventory is shifted out of the allocation for the first advertiser and the shifted inventory is replaced by the reserve inventory for the respective advertiser.

Abstract: Methods and systems are disclosed which allow shifting inventory to fulfill guaranteed delivery advertisement contracts. Inventory may be allocated from a supply of unallocated inventory to one or more advertisers in accordance with guaranteed delivery agreements. Inventory may be reserved for the one or more advertisers from the remaining supply of unallocated inventory. Inventory may then be allocated to an additional advertiser by using unallocated inventory or shifted inventory, or a combination of unallocated inventory and shifted inventory. The shifted inventory is shifted out of the allocation for the first advertiser and the shifted inventory is replaced by the reserve inventory for the respective advertiser.

Abstract: Systems and methods for adjusting online ads delivery pace derive, in a computer system, a current impression delivery for an ads display contract. A plurality of estimation bands are delivered corresponding to over delivery and under delivery for the ads display contract. A relative distance is determined between the current impression delivery and the plurality of estimation bands. An adjustment factor is selected according to the relative distance. The adjustment factor is sent to a database.

Abstract: Methods and systems are disclosed which allow shifting inventory to fulfill guaranteed delivery advertisement contracts. Inventory may be allocated from a supply of unallocated inventory to one or more advertisers in accordance with guaranteed delivery agreements. Inventory may be reserved for the one or more advertisers from the remaining supply of unallocated inventory. Inventory may then be allocated to an additional advertiser by using unallocated inventory or shifted inventory, or a combination of unallocated inventory and shifted inventory. The shifted inventory is shifted out of the allocation for the first advertiser and the shifted inventory is replaced by the reserve inventory for the respective advertiser.

Abstract: The present application provides systems and corresponding methods for creating a delivery allocation plan in a network-based environment. The methods may include receiving and storing advertising contracts and data related to the advertising contracts; constructing a bipartite graph based on the received contract data; annotating each demand node; and receiving impression data and other eligible contract data. Thereafter, the method may include for each impression, calculating a first supply value and for each contract, calculating a first demand value. The first demand value may be used to calculate a second supply value and a delivery allocation may be calculated using the second supply value and the second demand value for each contract.