Abstract: Modifications to the DiD technique are disclosed which provide an estimate of the effectiveness of a site-wide action where no control group exists within the data subsequent to implementation of the site-wide action. In some examples, a method may include identifying a treatment group based on a modified treatment period, selecting a control group from a control period prior to the modified treatment period, and performing a modified difference-in-differences (DiD) estimation for a metric based on the modified treatment period, the treatment group, the control period, and the control group. The modified treatment period may encompass an intervention of a site-wide action, and include a pre-intervention time period and a post-intervention time period.

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media directed to facilitating predicting style breaches within content. In one embodiment, target content for which style breach prediction is desired is obtained. Style features associated with the target content are identified. Such style features and a style breach prediction model are used to predict a style breach within the target content, the style breach indicating a change of style used within the target content (e.g., a single document).

Abstract: Embodiments are disclosed for bundling and arranging online content fragments for presentation based on content-specific metrics and inter-content constraints. For example, a content management application accesses candidate content fragments, a content-specific metric, and an inter-content constraint. The content management application computes minimum and maximum contribution values for the candidate content fragments. The content management application selects, based on the computed minimum and maximum contribution values, a subset of the candidate content fragments. The content management application applies, subject to the inter-content constraint, a bundle-selection function to the selected candidate content fragments and thereby identifies a bundle of online content fragments. The content management application outputs the identified bundle of online content fragments for presentation via an online service.

Abstract: A quality metric of a multimedia summary of a multimedia content item is determined based, in part, on semantic similarities of the summary and content item, rather than just on word frequencies. This is accomplished in some embodiments by identifying a semantic meaning of the summary and multimedia content item using vector analysis. The vectors of the summary and the vectors of the multimedia content item are compared to determine semantic similarity. In other examples, the quality metric of the multimedia summary is determined based on, in part, a coherence between an image portion of a summary and a text portion of the summary for determining a quality metric of a multimedia summary.