Abstract: In accordance with the described techniques, a processing device receives a document that includes a table, and uses a machine learning model to detect cells in the table and probabilities assigned to the cells indicating whether respective cells correspond to a row header or a column header of the table. Further, the processing device aligns borders of the cells along horizontal axes of corresponding rows of the table and along vertical axes of corresponding columns of the table. In addition, the processing device generates a table structure based on the aligned cells and the probabilities such that the table structure includes the aligned cells arranged in the rows and columns.

Abstract: A method comprises obtaining an unstructured document and font information for the document, wherein the unstructured document includes a table; generating location information for an element of the table based on the font information; and generating a structured representation of the table based on the location information.

Abstract: A method, apparatus, non-transitory computer readable medium, and system for generating images includes obtaining an image generation prompt and a reference prompt. The image generation prompt includes a first element and a second element and the reference prompt includes the second element. Embodiments then generate, using an image generation model, an intermediate image based on the reference prompt. Subsequently, embodiments generate, using the image generation model, a synthetic image including the first element and the second element based on the intermediate image and the image generation prompt.

Abstract: Embodiments are disclosed for reflowing an infographic image for display in a mobile device using machine learning models. In particular, in one or more embodiments, the method may include receiving a document for display in a user device, the document including an infographic image. The method may further include identifying, using a convolutional neural network, visual components of the infographic image. The method may further include determining, using an encoder-decoder network, an ordered sequence of the identified visual components. A generative adversarial network then generates a modified visual representation of the infographic image based on the identified visual components and the determined ordered sequence of the identified visual components. The modified visual of representation of the infographic image is then presented for display in a viewing pane of a user device in place of the infographic image.

Abstract: Systems and methods for machine learning are described. The systems and methods include receiving target training data including a training image and ground truth label data for the training image, generating source network features for the training image using a source network trained on source training data, generating target network features for the training image using a target network, generating at least one attention map for training the target network based on the source network features and the target network features using a guided attention transfer network, and updating parameters of the target network based on the attention map and the ground truth label data.

Abstract: Embodiments are disclosed for a digital design system trained to segment unstructured text into topically coherent segments. The method may include receiving unstructured text, the unstructured text including a sequence of sentences. The disclosed systems and methods further comprise generating, by a neural network, a hierarchically segmented tree structure representing the unstructured text. The tree structure comprises a plurality of tree structure nodes, where a node of the tree structure nodes represents a sentence from the sequence of sentences. The segments and sub-segments of the unstructured text can then be determined based on node data for nodes of the hierarchically segmented tree structure. Using the determined segments and sub-segments of the unstructured text, a modified representation of the unstructured text can be displayed.

Abstract: Embodiments are disclosed for a digital design system trained to segment unstructured text into topically coherent segments. The method may include receiving unstructured text, the unstructured text including a sequence of sentences. The disclosed systems and methods further comprise generating, by a neural network, a hierarchically segmented tree structure representing the unstructured text. The tree structure comprises a plurality of tree structure nodes, where a node of the tree structure nodes represents a sentence from the sequence of sentences. The segments and sub-segments of the unstructured text can then be determined based on node data for nodes of the hierarchically segmented tree structure. Using the determined segments and sub-segments of the unstructured text, a modified representation of the unstructured text can be displayed.

Abstract: Embodiments are disclosed for reflowing an infographic image for display in a mobile device using machine learning models. In particular, in one or more embodiments, the method may include receiving a document for display in a user device, the document including an infographic image. The method may further include identifying, using a convolutional neural network, visual components of the infographic image. The method may further include determining, using an encoder-decoder network, an ordered sequence of the identified visual components. A generative adversarial network then generates a modified visual representation of the infographic image based on the identified visual components and the determined ordered sequence of the identified visual components. The modified visual of representation of the infographic image is then presented for display in a viewing pane of a user device in place of the infographic image.

Abstract: Systems and methods for training an object detection network are described. Embodiments train an object detection network using a labeled training set, wherein each element of the labeled training set includes an image and ground truth labels for object instances in the image, predict annotation data for a candidate set of unlabeled data using the object detection network, select a sample image from the candidate set using a policy network, generate a labeled sample based on the selected sample image and the annotation data, wherein the labeled sample includes labels for a plurality of object instances in the sample image, and perform additional training on the object detection network based at least in part on the labeled sample.

Abstract: Embodiments of the technology described herein are directed to a persona-specific navigation interface for a document. Initially, a user may select a persona associated with a document through a document navigation interface. A machine-learning model may identify an interest within a portion of the document. The interest may be mapped to the persona. A navigation interface that includes a navigable link to the portion of the document is generated and output for display. A user interaction with the navigable link is received. In response to the interaction, the portion of the document corresponding to the navigable link is output for display.

Abstract: Embodiments provide systems, methods, and computer storage media for extracting semantic labels for field widgets of form fields in unfilled forms. In some embodiments, a processing device accesses a representation of a fillable widget of a form field of an unfilled form. The processing device generates an encoded input representing text and layout of a sequence of tokens in a neighborhood of the fillable widget. The processing device uses a machine learning model to extract a semantic label representing a field type of the fillable widget in view of the encoded input. The processing device causes execution of an action using the semantic label.

Abstract: Methods, computer systems, computer-storage media, and graphical user interfaces are provided for facilitating data visualization generation. In one implementation, dataset intent data, visual design intent data, and insight intent data determined from a user input natural language query are obtained. A set of candidate intent recommendations is generated using various combinations of the dataset intent data, visual design intent data, and insight intent data. Each of the candidate intent recommendations is incorporated into a set of visualization templates to determine eligibility of the candidate intent recommendations. For eligible candidate intent recommendations, a score associated with a corresponding visualization template is determined. Based on the scores, a candidate intent recommendation and corresponding visualizations template is selected to use as a visual recommendation for presenting a data visualization.

Abstract: Embodiments of the technology described herein are directed to a persona-specific navigation interface for a document. Initially, a user may select a persona associated with a document through a document navigation interface. A machine-learning model may identify an interest within a portion of the document. The interest may be mapped to the persona. A navigation interface that includes a navigable link to the portion of the document is generated and output for display. A user interaction with the navigable link is received. In response to the interaction, the portion of the document corresponding to the navigable link is output for display.

Abstract: Various embodiments are directed to assigning offers to marketing deliveries utilizing new features to describe offers in the marketing deliveries. Marketing deliveries can be described at a finer level to thus enhance the effectiveness of building and conducting marketing campaigns. The approaches facilitate matching content to recipients, predicting content performance, and measuring content performance after dispatching a marketing delivery.

Abstract: In some embodiments, a data visualization system detects insights from a dataset and computes insight scores for respective insights. The data visualization system further computes insight type scores, from the insight scores, for insight types in the detected insights. The data visualization system determines a selected insight type for the dataset having a higher insight type score than unselected insight types and determines, for the selected insight type, a set of selected insights that have higher insight scores than unselected insights. The data visualization system determines insight visualizations for the set of selected insights and generates, for inclusion in a user interface of the data visualization system, selectable interface elements configured for invoking an editing tool for updating the determined insight visualizations from the dataset. The selectable interface elements are arranged in the user interface according to the insight scores of the set of selected insights.

Abstract: This disclosure describes methods, systems, and non-transitory computer readable media for automatically parsing infographics into segments corresponding to structured groups or lists and displaying the identified segments or reflowing the segments into various computing tasks. For example, the disclosed systems may utilize a novel infographic grouping taxonomy and annotation system to group elements within infographics. The disclosed systems can train and apply a machine-learning-detection model to generate infographic segments according to the infographic grouping taxonomy. By generating infographic segments, the disclosed systems can facilitate computing tasks, such as converting infographics into digital presentation graphics (e.g., slide carousels), reflow the infographic into query-and-response models, perform search functions, or other computational tasks.

Abstract: Systems and methods for machine learning are described. The systems and methods include receiving target training data including a training image and ground truth label data for the training image, generating source network features for the training image using a source network trained on source training data, generating target network features for the training image using a target network, generating at least one attention map for training the target network based on the source network features and the target network features using a guided attention transfer network, and updating parameters of the target network based on the attention map and the ground truth label data.

Abstract: Certain embodiments involve a template-based redesign of documents based on the contents of documents. For instance, a computing system selects a template for modifying an input document. To do so, the computing system uses a generative adversarial network to generate an interpolated layout image from an input layout image, which represents the input document, and a template layout image, which represents the selected template. The computing system matches the input element to an interpolated element from the interpolated layout image. The computing system generates an output document by, for example, modifying a layout of the input document to match the interpolated layout image, such as by fitting the input element into a shape of the interpolated element.

Abstract: Methods, computer systems, computer-storage media, and graphical user interfaces are provided for facilitating data visualization generation. In one implementation, dataset intent data, visual design intent data, and insight intent data determined from a user input natural language query are obtained. A set of candidate intent recommendations is generated using various combinations of the dataset intent data, visual design intent data, and insight intent data. Each of the candidate intent recommendations is incorporated into a set of visualization templates to determine eligibility of the candidate intent recommendations. For eligible candidate intent recommendations, a score associated with a corresponding visualization template is determined. Based on the scores, a candidate intent recommendation and corresponding visualizations template is selected to use as a visual recommendation for presenting a data visualization.

Abstract: Techniques and systems for determining paywall metrics are described. In an implementation, a candidate paywall metric is created that corresponds to an increased propensity of users to engage in a paid transaction when exposed to a paywall. In this way, providers of digital content may increase the proportion of users that perform a transaction when exposed to the paywall.