Abstract: Methods, systems, and media for managing online advertising campaigns based on causal conversion metrics are provided. In some embodiments, the method comprises: receiving conversion information corresponding to test group including consumers that were presented with an advertisement using an advertising channel; receiving advertisement viewability information indicative of a probability that each of the consumers viewed the advertisement; determining that a subset of the consumers did not view the advertisement based on the probability; placing the consumers into a control group and a test group based on the probability corresponding to each of the consumers; calculating a causal conversion metric based on a comparison of the conversion information corresponding to consumers of the control group and conversion information corresponding to consumers of the test group; and determining whether to place an advertisement using the advertising channel based on the causal conversion metric.

Abstract: Mechanisms for detecting fraudulent activity based on hardware events are provided. In accordance with some embodiments of the disclosed subject matter, the method comprises: receiving a request for advertising content to be placed on a website; receiving data describing physical activity at one or more user input hardware devices; receiving data describing interactions with the website; correlating the data describing interactions with the website with the data describing physical activity at one or more user input hardware devices; determining whether at least a portion of the interactions with the website are indicative of fraudulent behavior based on the correlation; and responding to the request for advertising content on the website by inhibiting the advertising content to be transmitted to the website in response to the determination that at least a portion of the interactions with the website indicates fraudulent behavior.

Abstract: Systems, methods, and media for detecting suspicious activity in connection with advertisement impressions are provided.

Abstract: Methods, systems, and media for identifying automatically refreshed advertisements are provided. In some embodiments, a method for modifying advertisement spending is provided, the method comprising: receiving advertisement delivery information associated with a plurality of advertisements displayed on a web page; generating a distribution of an amount of time that the plurality of advertisements were displayed on the web page using the advertisement delivery information; identifying a deviation in the generated distribution; determining whether the deviation correlates to an automatic refresh command performed by one or more browser applications; and providing an indication corresponding to the plurality of advertisements that were displayed on the web page in response to the automatic refresh command based on the determination.

Abstract: Systems, methods, and media for detecting advertisements with advertising cues are provided. In some embodiments, a method for detecting advertisements is provided, the method comprising: receiving an advertisement request from a web browser loading a web page; selecting an advertisement from a plurality of advertisements to be placed on the web page in response to receiving the advertisement request; loading an event listener associated with the advertisement that receives advertisement information associated with other advertisements on the web page; and transmitting advertisement information associated with the advertisement to frames on the web page, wherein the event listener receives responses to the advertisement information that includes the advertisement information associated with the other advertisements on the web page.

Abstract: Methods, systems, and media for enhancing a blind URL escrow with real-time bidding exchanges are provided. In some embodiments, the method comprises: receiving, using a hardware processor, a URL associated with an advertisement placement from a seller; generating a rating for the URL received from the seller; determining metadata based on the URL and a domain name associated with the seller; generating an anonymous label corresponding to the URL that includes the generated rating and the determined metadata; transmitting the anonymous label to a real-time bidding exchange; and causing a verification beacon to be inserted into an advertisement to be displayed in the advertisement placement in response to a buyer purchasing an opportunity to place an advertisement in the advertisement placement using the anonymous label through the real-time bidding exchange.

Abstract: Systems, methods, and media for correlating information corresponding to multiple related frames on a web page are provided. In some embodiments, a method for identifying corresponding iframes on a web page to a server is provided, the method comprising: loading a web page including a plurality of iframes; receiving the requested content and identifying information for a first iframe; loading an event listener; determining a location of the first iframe in the structure of the web page; transmitting a message to a second iframe including the first identifying information and location of the first iframe; receiving, using the event listener, a message from the second iframe including second identifying information and location of the second iframe; determining that the second iframe is nested within the first iframe; and transmitting a third message to a server including at least the second identifying information and location of the second iframe.

Abstract: Methods, systems, and media for generating a media quality score associated with the presentation of a content item are provided.

Abstract: Methods, systems, and media for estimating the causal effect of different content exposure levels are provided.

Abstract: In accordance with some embodiments of the disclosed subject matter, methods, systems, and media for generating predicted information related to advertisement viewability are provided.

Abstract: In accordance with some embodiments of the disclosed subject matter, methods, systems, and media for generating predicted information related to advertisement viewability are provided.

Abstract: Systems, methods, and media are disclosed for tracking viewability of content, such as Internet content, by associating a color-changing animated image file with the content and determining, based on whether color of an image is changing, whether the content is in a viewable region of a browser.

Abstract: Methods, systems, and media for dynamically detecting mobile environment information are provided.

Abstract: Methods, systems, and media for specifying different content management techniques across various publishing platforms are provided. In some embodiments, the method comprises: receiving information about content placements; generating a user interface that includes the information and selectable content management options; receiving a selection of a first content management option for a first content placement; configuring a tag for the first content placement, wherein the tag is associated with instructions for executing the first content management option; receiving, from a web browser that loaded a web page including the first content placement, a request for the instructions for executing the first content management option; and sending the instructions to the web browser to execute the instructions and send information about the web page to a location indicated by the instructions.

Abstract: Methods, systems, and media for managing online advertising campaigns based on causal conversion metrics are provided. In some embodiments, the method comprises: receiving conversion information corresponding to test group including consumers that were presented with an advertisement using an advertising channel; receiving advertisement viewability information indicative of a probability that each of the consumers viewed the advertisement; determining that a subset of the consumers did not view the advertisement based on the probability; placing the consumers into a control group and a test group based on the probability corresponding to each of the consumers; calculating a causal conversion metric based on a comparison of the conversion information corresponding to consumers of the control group and conversion information corresponding to consumers of the test group; and determining whether to place an advertisement using the advertising channel based on the causal conversion metric.

Abstract: Methods, systems, and media for identifying errors in predictive models using annotators are provided. In some embodiments, a method for evaluating predictive models in classification systems is provided, the method comprising: causing an input region to be presented to a user, where the input region receives an instance from the user that corresponds to a predictive model; retrieving a classification conducted by the predictive model for the received instance and a confidence value associated with the classification; determining whether the received instance has been incorrectly classified by the predictive model; determining a reward associated with the incorrect classification made by the predictive model in response to determining that the received instance has been incorrectly classified by the predictive model, where the reward is based on the confidence value associated with the classification of the received instance; and providing the reward to the user.

Abstract: Methods, systems, and media for identifying automatically refreshed advertisements are provided. In some embodiments, a method for modifying advertisement spending is provided, the method comprising: receiving advertisement delivery information associated with a plurality of advertisements displayed on a web page; generating a distribution of an amount of time that the plurality of advertisements were displayed on the web page using the advertisement delivery information; identifying a deviation in the generated distribution; determining whether the deviation correlates to an automatic refresh command performed by one or more browser applications; and providing an indication corresponding to the plurality of advertisements that were displayed on the web page in response to the automatic refresh command based on the determination.

Abstract: Systems, methods, and media for correlating information corresponding to multiple related frames on a web page are provided. In some embodiments, a method for identifying corresponding iframes on a web page to a server is provided, the method comprising: loading a web page including a plurality of iframes; receiving the requested content and identifying information for a first iframe; loading an event listener; determining a location of the first iframe in the structure of the web page; transmitting a message to a second iframe including the first identifying information and location of the first iframe; receiving, using the event listener, a message from the second iframe including second identifying information and location of the second iframe; determining that the second iframe is nested within the first iframe; and transmitting a third message to a server including at least the second identifying information and location of the second iframe.

Abstract: Mechanisms for detecting fraudulent activity based on hardware events are provided. In accordance with some embodiments of the disclosed subject matter, the method comprises: receiving a request for advertising content to be placed on a website; receiving data describing physical activity at one or more user input hardware devices; receiving data describing interactions with the website; correlating the data describing interactions with the website with the data describing physical activity at one or more user input hardware devices; determining whether at least a portion of the interactions with the website are indicative of fraudulent behavior based on the correlation; and responding to the request for advertising content on the website by inhibiting the advertising content to be transmitted to the website in response to the determination that at least a portion of the interactions with the website indicates fraudulent behavior.

Abstract: Methods, systems, and media for enhancing a blind URL escrow with real-time bidding exchanges are provided. In some embodiments, the method comprises: receiving, using a hardware processor, a URL associated with an advertisement placement from a seller; generating a rating for the URL received from the seller; determining metadata based on the URL and a domain name associated with the seller; generating an anonymous label corresponding to the URL that includes the generated rating and the determined metadata; transmitting the anonymous label to a real-time bidding exchange; and causing a verification beacon to be inserted into an advertisement to be displayed in the advertisement placement in response to a buyer purchasing an opportunity to place an advertisement in the advertisement placement using the anonymous label through the real-time bidding exchange.