Abstract: Techniques are described for object insertion via scene graph. In implementations, given an input image and a region of the image where a new object is to be inserted, the input image is converted to an intermediate scene graph space. In the intermediate scene graph space, graph convolutional networks are leveraged to expand the scene graph by predicting the identity and relationships of a new object to be inserted, taking into account existing objects in the input image. The expanded scene graph and the input image are then processed by an image generator to insert a predicted visual object into the input image to produce an output image.

Abstract: Digital image text editing techniques as implemented by an image processing system are described that support increased user interaction in the creation and editing of digital images through understanding a content creator's intent as expressed using text. In one example, a text user input is received by a text input module. The text user input describes a visual object and a visual attribute, in which the visual object specifies a visual context of the visual attribute. A feature representation generated by a text-to-feature system using a machine-learning module based on the text user input. The feature representation is passed to an image editing system to edit a digital object in a digital image, e.g., by applying a texture to an outline of the digital object within the digital image.

Abstract: Systems and methods for color representation are described. Embodiments of the inventive concept are configured to receive an attribute-object pair including a first term comprising an attribute label and a second term comprising an object label, encode the attribute-object pair to produce encoded features using a neural network that orders the first term and the second term based on the attribute label and the object label, and generate a color profile for the attribute-object pair based on the encoded features, wherein the color profile is based on a compositional relationship between the first term and the second term.

Abstract: Digital image text editing techniques as implemented by an image processing system are described that support increased user interaction in the creation and editing of digital images through understanding a content creator's intent as expressed using text. In one example, a text user input is received by a text input module. The text user input describes a visual object and a visual attribute, in which the visual object specifies a visual context of the visual attribute. A feature representation generated by a text-to-feature system using a machine-learning module based on the text user input. The feature representation is passed to an image editing system to edit a digital object in a digital image, e.g., by applying a texture to an outline of the digital object within the digital image.

Abstract: Embodiments are disclosed for multichannel content recommendation. The method may include receiving an input collection comprising a plurality of images. The method may include extracting a set of feature channels from each of the images. The method may include generating, by a trained machine learning model, an intent channel of the input collection from the set of feature channels. The method may include retrieving, from a content library, a plurality of search result images that include a channel that matches the intent channel. The method may include generating a recommended set of images based on the intent channel and the set of feature channels.

Abstract: Systems and methods for image processing are described. One or more embodiments of the present disclosure identify an image including a plurality of objects, generate a scene graph of the image including a node representing an object and an edge representing a relationship between two of the objects, generate a node vector for the node, wherein the node vector represents semantic information of the object, generate an edge vector for the edge, wherein the edge vector represents semantic information of the relationship, generate a scene graph embedding based on the node vector and the edge vector using a graph convolutional network (GCN), and assign metadata to the image based on the scene graph embedding.

Abstract: A method for predicting user purchase by a user of a first site includes: selecting a distribution representing a probability distribution (PD) of inter-purchase-times (IPTs) across the first site and a second other site for each user, assigning each purchase of each user to one of the first site and the second site according to a Stochastic model, combining the selected PD with the Stochastic model to generate a PD of IPTs for only the first online site, estimating parameters of the probability distribution of IPTs for the first site by applying a Statistical modeling approach to features of each user, applying a sequence of observed IPTs of a given user for the first site and the parameters of the given user to the selected distribution to generate a probability, and determining whether the next purchase occurs on the second site based on the probability.

Abstract: A method for predicting user purchase by a user of a first site includes: selecting a distribution representing a probability distribution (PD) of inter-purchase-times (IPTs) across the first site and a second other site for each user, assigning each purchase of each user to one of the first site and the second site according to a Stochastic model, combining the selected PD with the Stochastic model to generate a PD of IPTs for only the first online site, estimating parameters of the probability distribution of IPTs for the first site by applying a Statistical modeling approach to features of each user, applying a sequence of observed IPTs of a given user for the first site and the parameters of the given user to the selected distribution to generate a probability, and determining whether the next purchase occurs on the second site based on the probability.

Abstract: Certain embodiments involve a template-based redesign of documents based on the contents of documents. For instance, a computing system selects a template for modifying an input document. To do so, the computing system uses a generative adversarial network to generate an interpolated layout image from an input layout image, which represents the input document, and a template layout image, which represents the selected template. The computing system matches the input element to an interpolated element from the interpolated layout image. The computing system generates an output document by, for example, modifying a layout of the input document to match the interpolated layout image, such as by fitting the input element into a shape of the interpolated element.

Abstract: Systems and methods for image processing are described. One or more embodiments of the present disclosure identify an image including a plurality of objects, generate a scene graph of the image including a node representing an object and an edge representing a relationship between two of the objects, generate a node vector for the node, wherein the node vector represents semantic information of the object, generate an edge vector for the edge, wherein the edge vector represents semantic information of the relationship, generate a scene graph embedding based on the node vector and the edge vector using a graph convolutional network (GCN), and assign metadata to the image based on the scene graph embedding.

Abstract: Certain embodiments involve a template-based redesign of documents based on the contents of documents. For instance, a computing system selects a template for modifying an input document. To do so, the computing system uses a generative adversarial network to generate an interpolated layout image from an input layout image, which represents the input document, and a template layout image, which represents the selected template. The computing system matches the input element to an interpolated element from the interpolated layout image. The computing system generates an output document by, for example, modifying a layout of the input document to match the interpolated layout image, such as by fitting the input element into a shape of the interpolated element.

Abstract: Techniques are described for intelligently identifying concept labels for a set of multiple documents where the identified concept labels are representative of and semantically relevant to the information contained by the set of documents. The technique includes extracting semantic units (e.g., paragraphs) from the set of documents and determining concept labels applicable to the semantic units based on relevance scores computed for the concept labels. The technique includes determining an initial set of concept labels for the set of documents based on the applicable concept labels. The technique further includes obtaining a reference hierarchy associated with the reference set of concept labels and determining a final set of concept labels for the set of documents using a reference hierarchy, the initial set of concept labels, and the relevance scores. The technique includes outputting information identifying the final set of concept labels for the set of documents.

Abstract: The disclosed techniques include at least one computer-implemented method performed by a system. The system can receive a textual query and process query features of the textual query to identify a color profile indicative of a color intent of the query. The system can identify candidate images that at least partially match the desired content and color intent of the query. The system can further order candidate images based in part on a similarity of a candidate color profile for each candidate image with the identified color profile of the query, and output image data indicative of the ordered set of candidate images.

Abstract: Systems and methods for color representation are described. Embodiments of the inventive concept are configured to receive an attribute-object pair including a first term comprising an attribute label and a second term comprising an object label, encode the attribute-object pair to produce encoded features using a neural network that orders the first term and the second term based on the attribute label and the object label, and generate a color profile for the attribute-object pair based on the encoded features, wherein the color profile is based on a compositional relationship between the first term and the second term.

Abstract: A technique for intelligently identifying concept labels for a text fragment where the identified concept labels are representative of and semantically relevant to the information contained by the text fragment is provided. The technique includes determining, using a knowledge base storing information for a reference set of concept labels, a first subset of concept labels that are relevant to the information contained by the text fragment. The technique includes ordering the first subset of concept labels according to their relevance scores and performing dependency analysis on the ordered list of concept labels. Based on the dependency analysis, the technique includes identifying concept labels for a text fragment that are more independent (e.g., more distinct and non-overlapping) of each other, representative of and semantically relevant to the information represented by the text fragment.

Abstract: Digital image text editing techniques as implemented by an image processing system are described that support increased user interaction in the creation and editing of digital images through understanding a content creator's intent as expressed using text. In one example, a text user input is received by a text input module. The text user input describes a visual object and a visual attribute, in which the visual object specifies a visual context of the visual attribute. A feature representation generated by a text-to-feature system using a machine-learning module based on the text user input. The feature representation is passed to an image editing system to edit the digital object in the digital image, e.g., by applying a texture to an outline of the digital object within the digital image.

Abstract: The disclosed techniques include at least one computer-implemented method performed by a system. The system can receive a textual query and process query features of the textual query to identify a color profile indicative of a color intent of the query. The system can identify candidate images that at least partially match the desired content and color intent of the query. The system can further order candidate images based in part on a similarity of a candidate color profile for each candidate image with the identified color profile of the query, and output image data indicative of the ordered set of candidate images.

Abstract: A technique for intelligently identifying concept labels for a text fragment where the identified concept labels are representative of and semantically relevant to the information contained by the text fragment is provided. The technique includes determining, using a knowledge base storing information for a reference set of concept labels, a first subset of concept labels that are relevant to the information contained by the text fragment. The technique includes ordering the first subset of concept labels according to their relevance scores and performing dependency analysis on the ordered list of concept labels. Based on the dependency analysis, the technique includes identifying concept labels for a text fragment that are more independent (e.g., more distinct and non-overlapping) of each other, representative of and semantically relevant to the information represented by the text fragment.

Abstract: Techniques are described for intelligently identifying concept labels for a set of multiple documents where the identified concept labels are representative of and semantically relevant to the information contained by the set of documents. The technique includes extracting semantic units (e.g., paragraphs) from the set of documents and determining concept labels applicable to the semantic units based on relevance scores computed for the concept labels. The technique includes determining an initial set of concept labels for the set of documents based on the applicable concept labels. The technique further includes obtaining a reference hierarchy associated with the reference set of concept labels and determining a final set of concept labels for the set of documents using a reference hierarchy, the initial set of concept labels, and the relevance scores. The technique includes outputting information identifying the final set of concept labels for the set of documents.

Abstract: Systems, methods, and non-transitory computer-readable media are disclosed for easily, accurately, and efficiently determining a personalized market share of a user with a company versus that of its competitors using only focal company's own clickstream data. For instance, the disclosed systems can infer a mapping of purchases to product categories from clickstream data of a company and use the mappings to generate a dataset of observable conversions (with interconversion times) for one or more product categories. Then, the disclosed systems can utilize models for a category level interconversion time and for transition probabilities of a user to determine a personalized market share and an interconversion time for an individual user (between the company and competitors of the company).