Abstract: Methods, systems, and media for providing direct and hybrid data acquisition approaches are provided.

Abstract: Methods, systems, and media for providing direct and hybrid data acquisition approaches are provided.

Abstract: Methods, systems, and media for providing direct and hybrid data acquisition approaches are provided. In accordance with some embodiments of the disclosed subject matter, a method of data acquisition for construction of classification models that incorporates multiple human reviewing resources is provided, the method comprising: receiving a cost structure for constructing a classification model using a data set; instructing human reviewing resources to search through the data set and select instances of a class that satisfy a criterion, providing the human reviewing resources with a definition of the class; training the classification model with the instances from the human reviewing resources; determining when an expected gain for performing additional searches by the human reviewing resources as a function of the cost structure is lower than a given threshold; and, instructing the human reviewing resources searching through the set to label one or more examples from the data set.

Abstract: Methods, systems, and media for identifying errors in predictive models using annotators are provided. In some embodiments, a method for evaluating predictive models in classification systems is provided, the method comprising: causing an input region to be presented to a user, where the input region receives an instance from the user that corresponds to a predictive model; retrieving a classification conducted by the predictive model for the received instance and a confidence value associated with the classification; determining whether the received instance has been incorrectly classified by the predictive model; determining a reward associated with the incorrect classification made by the predictive model in response to determining that the received instance has been incorrectly classified by the predictive model, where the reward is based on the confidence value associated with the classification of the received instance; and providing the reward to the user.

Abstract: Privacy-sensitive methods, systems, and media for geo-social targeting are provided.

Abstract: Methods, systems, and media for identifying errors in predictive models using annotators are provided. In some embodiments, a method for evaluating predictive models in classification systems is provided, the method comprising: causing an input region to be presented to a user, where the input region receives an instance from the user that corresponds to a predictive model; retrieving a classification conducted by the predictive model for the received instance and a confidence value associated with the classification; determining whether the received instance has been incorrectly classified by the predictive model; determining a reward associated with the incorrect classification made by the predictive model in response to determining that the received instance has been incorrectly classified by the predictive model, where the reward is based on the confidence value associated with the classification of the received instance; and providing the reward to the user.

Abstract: Methods, systems, and media for determining location information from real-time bid requests are provided. In some implementations, a method for determining device locations is provided, the method comprising: receiving a real-time data stream that includes location proxies corresponding to devices; generating a movement graph of interconnected nodes and edges, wherein each node represents one of the location proxies and wherein each edge represents movement information between the location proxies; calculating, for a node in the movement graph, location information by applying a predictive model having weights based on the movement information; and assigning, for the node in the movement graph, a census-based identifier to the calculated location information. The census-based identifier can be used, for example, to supplement or enrich bid requests within the real-time data stream.

Abstract: Methods, systems, and media for determining location information from real-time bid requests are provided. In some implementations, a method for determining device locations is provided, the method comprising: receiving a real-time data stream that includes location proxies corresponding to devices; generating a movement graph of interconnected nodes and edges, wherein each node represents one of the location proxies and wherein each edge represents movement information between the location proxies; calculating, for a node in the movement graph, location information by applying a predictive model having weights based on the movement information; and assigning, for the node in the movement graph, a census-based identifier to the calculated location information. The census-based identifier can be used, for example, to supplement or enrich bid requests within the real-time data stream.

Abstract: Systems, methods, and media for rating websites for safe advertising are provided. In accordance with some embodiments of the disclosed subject matter, the method comprises: extracting one or more features from a piece of web content; applying a plurality of statistical models to the extracted features to generate a plurality of ordinomial estimates, wherein each ordinomial estimate represents a probability that the web content is a member of one of a plurality of severity groups; determining a posterior ordinomial estimate for the web content by combining the plurality of ordinomial estimates; generating a risk rating that encodes severity and confidence based on the determined posterior ordinomial estimate, wherein the risk rating identifies whether the web content is likely to contain objectionable content of a given category; and providing the risk rating for determining whether an advertisement should be associated with the web content.

Abstract: Systems, methods, and media for rating websites for safe advertising are provided. In accordance with some embodiments of the disclosed subject matter, the method comprises: extracting one or more features from a piece of web content; applying a plurality of statistical models to the extracted features to generate a plurality of ordinomial estimates, wherein each ordinomial estimate represents a probability that the web content is a member of one of a plurality of severity groups; determining a posterior ordinomial estimate for the web content by combining the plurality of ordinomial estimates; generating a risk rating that encodes severity and confidence based on the determined posterior ordinomial estimate, wherein the risk rating identifies whether the web content is likely to contain objectionable content of a given category; and providing the risk rating for determining whether an advertisement should be associated with the web content.

Abstract: Systems, methods, and media for rating websites for safe advertising are provided. In accordance with some embodiments of the disclosed subject matter, the method comprises: extracting one or more features from a piece of web content; applying a plurality of statistical models to the extracted features to generate a plurality of ordinomial estimates, wherein each ordinomial estimate represents a probability that the web content is a member of one of a plurality of severity groups; determining a posterior ordinomial estimate for the web content by combining the plurality of ordinomial estimates; generating a risk rating that encodes severity and confidence based on the determined posterior ordinomial estimate, wherein the risk rating identifies whether the web content is likely to contain objectionable content of a given category; and providing the risk rating for determining whether an advertisement should be associated with the web content.

Abstract: Methods, systems, and media for providing direct and hybrid data acquisition approaches are provided.

Abstract: Systems, methods, and media for rating websites for safe advertising are provided.