Abstract: In some embodiments, an intervention evaluation system estimates counterfactual metric for a focal online platform based on an assessment model built using performance data of the focal online platform and control online platforms. The intervention evaluation system accesses performance data of the focal online platform that has been subject to a temporary intervention and performance data of control online platforms that are not subject to the temporary intervention. The intervention evaluation system determines estimation weights for these control online platforms based on the performance data in a pre-intervention period. Based on the estimation weights, the intervention evaluation system computes a counterfactual metric indicating the performance of the focal online platform in a post-intervention period in the absence of the temporary intervention.

Abstract: The technology described herein can identify phishing URLs using transformers. The technology tokenizes useful features from the subject URL. The useful features can include the text of the URL and other data associated with the URL, such as certificate data for the subject URL, a referrer URL, an IP address, etc. The technology may build a joint Byte Pair Encoding for the features. The token encoding may be processed through a transformer, resulting in a transformer output. The transformer output, which may be described as a token embedding, may be input to a classifier to determine whether the URL is a phishing URL. Additional or improved URL training data may be generated by permuting token order, by simulating a homoglyph attack, and by simulating an a compound word attack.

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media directed to facilitating predicting style breaches within content. In one embodiment, target content for which style breach prediction is desired is obtained. Style features associated with the target content are identified. Such style features and a style breach prediction model are used to predict a style breach within the target content, the style breach indicating a change of style used within the target content (e.g., a single document).

Abstract: Various embodiments describe user segmentation. In an example, potential rules are generated by applying a frequency-based analysis to user interaction data points. Each of the potential rules includes a set of attributes of the user interaction data points and indicates that these data points belong to a segment of interest. An objective function is used to select an optimal set of rules from the potential rules for the segment of interest. The potential rules are used as variable inputs to the objective function and this function is optimized based on interpretability and accuracy parameters. Each rule from the optimal set is associated with a group of the segment of interest. The user interaction data points are segments into the groups by matching attributes of these data points with the rules.

Abstract: Various embodiments describe user segmentation. In an example, potential rules are generated by applying a frequency-based analysis to user interaction data points. Each of the potential rules includes a set of attributes of the user interaction data points and indicates that these data points belong to a segment of interest. An objective function is used to select an optimal set of rules from the potential rules for the segment of interest. The potential rules are used as variable inputs to the objective function and this function is optimized based on interpretability and accuracy parameters. Each rule from the optimal set is associated with a group of the segment of interest. The user interaction data points are segments into the groups by matching attributes of these data points with the rules.

Abstract: A fact replacement and style consistency tool is described. Rather than rely heavily on human involvement to replace facts and maintain consistent styles across multiple digital documents, the described change management system identifies factual and stylistic inconsistencies between these documents, in part, using natural language processing techniques. Once these inconsistencies are identified, the change management system generates a user interface that includes indications of the inconsistencies and information describing them, e.g., an indication noting not only a type of inconsistency but also presenting a first portion and at least a second portion of the multiple documents that are factually inconsistent.

Abstract: In some embodiments, an intervention evaluation system estimates counterfactual metric for a focal online platform based on an assessment model built using performance data of the focal online platform and control online platforms. The intervention evaluation system accesses performance data of the focal online platform that has been subject to a temporary intervention and performance data of control online platforms that are not subject to the temporary intervention. The intervention evaluation system determines estimation weights for these control online platforms based on the performance data in a pre-intervention period. Based on the estimation weights, the intervention evaluation system computes a counterfactual metric indicating the performance of the focal online platform in a post-intervention period in the absence of the temporary intervention.

Abstract: Modifications to the DiD technique are disclosed which provide an estimate of the effectiveness of a site-wide action where no control group exists within the data subsequent to implementation of the site-wide action. In some examples, a method may include identifying a treatment group based on a modified treatment period, selecting a control group from a control period prior to the modified treatment period, and performing a modified difference-in-differences (DiD) estimation for a metric based on the modified treatment period, the treatment group, the control period, and the control group. The modified treatment period may encompass an intervention of a site-wide action, and include a pre-intervention time period and a post-intervention time period.

Abstract: In some embodiments, an intervention evaluation system estimates counterfactual metric for a focal online platform based on an assessment model built using performance data of the focal online platform and control online platforms. The intervention evaluation system accesses performance data of the focal online platform that has been subject to a temporary intervention and performance data of control online platforms that are not subject to the temporary intervention. The intervention evaluation system determines estimation weights for these control online platforms based on the performance data in a pre-intervention period. Based on the estimation weights, the intervention evaluation system computes a counterfactual metric indicating the performance of the focal online platform in a post-intervention period in the absence of the temporary intervention.

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media directed to facilitating corpus-based content generation, in particular, using graph-based multi-sentence compression to generate a final content output. In one embodiment, pre-existing source content is identified and retrieved from a corpus. The source content is then parsed into sentence tokens, mapped and weighted. The sentence tokens are further parsed into word tokens and weighted. The mapped word tokens are then compressed into candidate sentences to be used in a final content. The final content is assembled using ranked candidate sentences, such that the final content is organized to reduce information redundancy and optimize content cohesion.

Abstract: Systems and techniques for identifying segments in categorical data include receiving multiple transaction ID (TID) lists with univariate values that satisfy a thresholding metric with each TID list representing an occurrence of a single attribute in a set of transactions. The TID lists are stored with the univariate values that satisfy the thresholding metric in a data structure. In a loop, candidate itemsets to form from combinations of TID lists are determined using only the combinations of TID lists that satisfy categorical constraints. In the loop, for the candidate itemsets that satisfy categorical constraints, both the thresholding metric and a similarity metric are applied to the candidate itemsets. Final itemsets are formed from only the candidate itemsets that satisfy both the thresholding metric and the similarity metric.

Abstract: Embodiments are disclosed for bundling and arranging online content fragments for presentation based on content-specific metrics and inter-content constraints. For example, a content management application accesses candidate content fragments, a content-specific metric, and an inter-content constraint. The content management application computes minimum and maximum contribution values for the candidate content fragments. The content management application selects, based on the computed minimum and maximum contribution values, a subset of the candidate content fragments. The content management application applies, subject to the inter-content constraint, a bundle-selection function to the selected candidate content fragments and thereby identifies a bundle of online content fragments. The content management application outputs the identified bundle of online content fragments for presentation via an online service.

Abstract: A method includes extracting a set of segments located in a reference single page graphic image. A first segment overlaps with a second segment of the set of segments. The method includes identifying a plurality of bounding areas within the reference single page graphic image. Each segment of the set of segments is associated with a bounding area of the plurality of bounding areas. The plurality of bounding areas includes a first bounding area and a second bounding area, the first bounding area overlapping with the second bounding area. The method includes generating an editable template including a set of editable fields. The set of editable fields is determined based upon the plurality of bounding areas in the reference single page graphic image. A position of an editable field in the editable template is based upon a position in the reference single page graphic image of a corresponding bounding area.

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media directed to facilitating predicting style breaches within content. In one embodiment, target content for which style breach prediction is desired is obtained. Style features associated with the target content are identified. Such style features and a style breach prediction model are used to predict a style breach within the target content, the style breach indicating a change of style used within the target content (e.g., a single document).

Abstract: In some embodiments, an intervention evaluation system estimates counterfactual metric for a focal online platform based on an assessment model built using performance data of the focal online platform and control online platforms. The intervention evaluation system accesses performance data of the focal online platform that has been subject to a temporary intervention and performance data of control online platforms that are not subject to the temporary intervention. The intervention evaluation system determines estimation weights for these control online platforms based on the performance data in a pre-intervention period. Based on the estimation weights, the intervention evaluation system computes a counterfactual metric indicating the performance of the focal online platform in a post-intervention period in the absence of the temporary intervention.

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media directed to facilitating predicting style breaches within content. In one embodiment, target content for which style breach prediction is desired is obtained. Style features associated with the target content are identified. Such style features and a style breach prediction model are used to predict a style breach within the target content, the style breach indicating a change of style used within the target content (e.g., a single document).

Abstract: A fact replacement and style consistency tool is described. Rather than rely heavily on human involvement to replace facts and maintain consistent styles across multiple digital documents, the described change management system identifies factual and stylistic inconsistencies between these documents, in part, using natural language processing techniques. Once these inconsistencies are identified, the change management system generates a user interface that includes indications of the inconsistencies and information describing them, e.g., an indication noting not only a type of inconsistency but also presenting a first portion and at least a second portion of the multiple documents that are factually inconsistent.

Abstract: Systems and techniques for identifying segments in categorical data include receiving multiple transaction ID (TID) lists with univariate values that satisfy a thresholding metric with each TID list representing an occurrence of a single attribute in a set of transactions. The TID lists are stored with the univariate values that satisfy the thresholding metric in a data structure. In a loop, candidate itemsets to form from combinations of TID lists are determined using only the combinations of TID lists that satisfy categorical constraints. In the loop, for the candidate itemsets that satisfy categorical constraints, both the thresholding metric and a similarity metric are applied to the candidate itemsets. Final itemsets are formed from only the candidate itemsets that satisfy both the thresholding metric and the similarity metric.

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media directed to facilitating corpus-based content generation, in particular, using graph-based multi-sentence compression to generate a final content output. In one embodiment, pre-existing source content is identified and retrieved from a corpus. The source content is then parsed into sentence tokens, mapped and weighted. The sentence tokens are further parsed into word tokens and weighted. The mapped word tokens are then compressed into candidate sentences to be used in a final content. The final content is assembled using ranked candidate sentences, such that the final content is organized to reduce information redundancy and optimize content cohesion.

Abstract: Various embodiments describe user segmentation. In an example, potential rules are generated by applying a frequency-based analysis to user interaction data points. Each of the potential rules includes a set of attributes of the user interaction data points and indicates that these data points belong to a segment of interest. An objective function is used to select an optimal set of rules from the potential rules for the segment of interest. The potential rules are used as variable inputs to the objective function and this function is optimized based on interpretability and accuracy parameters. Each rule from the optimal set is associated with a group of the segment of interest. The user interaction data points are segments into the groups by matching attributes of these data points with the rules.