Abstract: In some embodiments, techniques for identifying email events generated by bot activity are provided. For example, a process may involve applying bot detection patterns to identify bot activity among email response events.

Abstract: One aspect of systems and methods for segment size estimation includes identifying a segment of users for a first time period based on time series data, wherein the time series data includes a series of interactions between users and a content channel and wherein the segment includes a portion of the users interacting with the content channel during the first time period; computing a segment return value for a second time period based on the time series data by computing a first subset and a second subset of the segment, wherein the first subset includes users that interact with the content channel greater than a threshold number of times during a range of the time series data and the second subset comprises a complement of the first subset with respect to the segment; and providing customized content to a user in the segment based on the segment return value.

Abstract: In implementations of systems for predicting a terminal event, a computing device implements a termination system to receive input data defining a period of time and a maximum event threshold. This system uses a classification model to generate event scores for a plurality of entity devices. Each of the event scores indicates a probability of an event occurrence for a corresponding entity device within a period of time. The plurality of entity devices are segmented into a first segment and a second segment based on an event score threshold. Entity devices included in the first segment have event scores greater than the event score threshold and entity devices included in the second segment have event scores below the event score threshold. The termination system generates an indication of a probability that a number of event occurrences for the entity devices included in the second segment exceeds the maximum even threshold within the period of time.

Abstract: A system debiases image translation models to produce generated images that contain minority attributes. A balanced batch for a minority attribute is created by over-sampling images having the minority attribute from an image dataset. An image translation model is trained using images from the balanced batch by applying supervised contrastive loss to output of an encoder of the image translation model and an auxiliary classifier loss based on predicted attributes in images generated by a decoder of the image translation model. Once trained, the image translation model is used to generate images with the minority image when given an input image having the minority attribute.

Abstract: This disclosure involves generating graph data structures that model inter-feature dependencies for use with machine-learning models to predict end-user behavior. For example, a processing device receives an input dataset and a request to modify a first input feature of the input dataset. The processing device uses a graph data structure that models the inter-feature dependencies to modify the input dataset by propagating the modification of the first input feature to a second input feature dependent on the first input feature. The modification to the second input feature is a function of at least (a) the value of the first input feature and (b) a weight assigned to an edge linking the first input feature to the second input feature within the directed graph. The processing device then applies a trained machine-learning model to the modified input dataset to generate a prediction of an outcome.

Abstract: Techniques for video manipulation detection are described to detect one or more manipulations present in digital content such as a digital video. A detection system, for instance, receives a frame of a digital video that depicts at least one entity. Coordinates of the frame that correspond to a gaze location of the entity are determined, and the detection system determines whether the coordinates correspond to a portion of an object depicted in the frame to calculate a gaze confidence score. A manipulation score is generated that indicates whether the digital video has been manipulated based on the gaze confidence score. In some examples, the manipulation score is based on at least one additional confidence score.

Abstract: A method, apparatus, and non-transitory computer readable medium for data analytics are described. Embodiments of the method, apparatus, and non-transitory computer readable medium include monitoring online activity corresponding to a plurality of users; receiving aggregate marketing data for a marketing activity; identifying online activity data for a time period corresponding to the marketing activity based on the monitoring; generating a regression model based on the aggregate marketing data and the online activity data using Bayesian regression, wherein the regression model represents a relationship between the marketing activity and the online activity, comprises a time effect coefficient, and is based on a prior distribution of the time effect coefficient that decays to zero as time increases; and estimating a treatment effect for the marketing activity on the online activity based on the regression model, wherein the treatment effect comprises a rate of effect decay.

Abstract: Determination of high value customer journey sequences is performed by determining customer interactions that are most frequent as length N=1 sub-sequences, recursively determining most frequent length N+1 sub-sequences that start with the length N sub-sequences, determining a first count indicating how often one of the sub-sequences appears in the sequences, determining a second count indicating how often the one sub-sequence resulted in the goal, and using the counts to determine the most or least effective sub-sequences for achieving the goal.

Abstract: Systems and methods for resource allocation are described. The systems and methods include receiving utilization data for computing resources shared by a plurality of users, updating a pricing agent using a reinforcement learning model based on the utilization data, identifying resource pricing information using the pricing agent, and allocating the computing resources to the plurality of users based on the resource pricing information.

Abstract: A system and method for content distribution without tracking is described. The system and method includes determining that device identifiers are not available for a first digital content channel; identifying a first cluster of users and a second cluster of users based on the determination that device identifiers are not available; providing first content and second content via the first digital content channel; monitoring user interactions on the first digital content channel to obtain a first conversion rate for users in the first cluster that receive the first content and a second conversion rate for users in the second cluster that receive the second content; computing a cross-cluster treatment effect based on the first conversion rate and the second conversion rate; computing a treatment effect for the first content based on the cross-cluster treatment effect; and providing the first content to a subsequent user based on the treatment effect.

Abstract: Systems and methods for diversity auditing are described. The systems and methods include identifying a plurality of images; detecting a face in each of the plurality of images using a face detection network; classifying the face in each of the plurality of images based on a sensitive attribute using an image classification network; generating a distribution of the sensitive attribute in the plurality of images based on the classification; and computing a diversity score for the plurality of images based on the distribution.

Abstract: An IDS generator determines multiple classes for electronic data items. The IDS generator determines, for each class, a class-specific candidate ruleset. The IDS generator performs a differential analysis of each class-specific candidate ruleset. The differential analysis is based on differences between result values of a scoring objective function. In some cases, the differential analysis determines at least one of the differences based on additional data structures, such as an augmented frequent-pattern tree. A probability function based on the differences is compared to a threshold probability At least one testing ruleset is modified based on the comparison. The IDS generator determines, for each class, a class-specific optimized ruleset based on the differential analysis of each class-specific candidate ruleset. The IDS generator creates an optimized interpretable decision set based on combined class-specific optimized rulesets for the multiple classes.

Abstract: Various disclosed embodiments are directed to using one or more algorithms or models to select a suitable or optimal variation, among multiple variations, of a given content item based on feedback. Such feedback guides the algorithm or model to arrive at suitable variation result such that the variation result is produced as the output for consumption by users. Further, various embodiments resolve tedious manual user input requirements and reduce computing resource consumption, among other things, as described in more detail below.

Abstract: Methods and systems disclosed herein relate generally to systems and methods for generating simulated images for enhancing socio-demographic diversity. An image-generating application receives a request that includes a set of target socio-demographic attributes. The set of target socio-demographic attributes can define a gender, age, and/or race of a subject that are non-stereotypical for a particular occupation. The image-generating application applies the a machine-learning model to the set of target socio-demographic attributes. The machine-learning model generates a simulated image depicts a subject having visual characteristics that are defined by the set of target socio-demographic attributes.

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating automatic suggestions to effectively modify the organization of an ingested data collection without destruction of the underlying raw data. In particular, in one or more embodiments, the disclosed systems utilize multiple machine learning models in sequence to determine likelihoods that the organizational structure of an ingested data collection should be modified in various ways. In response to generating these likelihoods, the disclosed systems generate corresponding automatic suggestions to modify the organization of the ingested data collection. In response to a detected selection of one or more of the automatic suggestions, the disclosed systems read data out of the ingested data collection in accordance with the selected automatic suggestions to effectively modify the organization of the ingested data collection.

Abstract: A computer-implemented method includes instantiating a framework configured to optimize a metric of interest for a website based on interactions by participants with instances of a website in a controlled experiment. The instances of the website include one of two variants of digital content. Test data including an estimate of an effect on the metric of interest is generated based on the interactions. A sequence of confidence intervals is dynamically generated while the controlled experiment is ongoing. The true effect and the estimate effect on the metric of interest are both bounded by the sequence of confidence intervals throughout the controlled experiment. As such, an anytime analysis with anytime-valid test data is enabled while the controlled experiment is ongoing.

Abstract: Determination of high value customer journey sequences is performed by determining customer interactions that are most frequent as length N=1 sub-sequences, recursively determining most frequent length N+1 sub-sequences that start with the length N sub-sequences, determining a first count indicating how often one of the sub-sequences appears in the sequences, determining a second count indicating how often the one sub-sequence resulted in the goal, and using the counts to determine the most or least effective sub-sequences for achieving the goal.

Abstract: A method, apparatus, and non-transitory computer readable medium for data analytics are described. Embodiments of the method, apparatus, and non-transitory computer readable medium include monitoring online activity corresponding to a plurality of users; receiving aggregate marketing data for a marketing activity; identifying online activity data for a time period corresponding to the marketing activity based on the monitoring; generating a regression model based on the aggregate marketing data and the online activity data using Bayesian regression, wherein the regression model represents a relationship between the marketing activity and the online activity, comprises a time effect coefficient, and is based on a prior distribution of the time effect coefficient that decays to zero as time increases; and estimating a treatment effect for the marketing activity on the online activity based on the regression model, wherein the treatment effect comprises a rate of effect decay.

Abstract: A content saliency network is a machine-learned neural network that predicts the saliency of elements of a content item. The content saliency network may be used in a method that includes determining a set of elements in draft content and computing a first pixel-level vector for the content. The method may also include, for each element in the set of elements, computing a vector of simple features for the element, the simple features being computed from attributes of the element, computing a second pixel-level vector for the element, computing a third pixel-level vector for an intermediate context of the element, and providing the vectors to the content saliency network. The content saliency network provides a saliency score for the element. The method further includes generating an element-level saliency map of the content using the respective saliency scores for the set of elements and providing the saliency map to a requestor.

Abstract: Various embodiments describe user segmentation. In an example, potential rules are generated by applying a frequency-based analysis to user interaction data points. Each of the potential rules includes a set of attributes of the user interaction data points and indicates that these data points belong to a segment of interest. An objective function is used to select an optimal set of rules from the potential rules for the segment of interest. The potential rules are used as variable inputs to the objective function and this function is optimized based on interpretability and accuracy parameters. Each rule from the optimal set is associated with a group of the segment of interest. The user interaction data points are segments into the groups by matching attributes of these data points with the rules.