Abstract: One or more implementations include systems, non-transitory computer-readable media, and methods that utilize a segmentation approach that distinguishes between smooth-shaded regions from high-frequency regions in an image within a vectorization pipeline to generate a vector image. For instance, the disclosed systems utilize a smoothing function to identify non-overlapping sets of pixels that include locally smooth pixels and pixels with high frequency details for an image. Furthermore, in some instances, the disclosed systems generate separate sets of fill functions (representing color-based regions) using color-based pixel clustering for the non-overlapping sets of pixels. Moreover, in one or more instances, the disclosed systems merge neighboring color-based regions in the sets of fill functions (using color similarity) to generate a set of segmented regions for an image.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generates a vectorized digital image of a raster image according to at least one gradient fill function. In particular, the disclosed systems generate a segmentation map of a raster digital image by using a segmentation model to cluster pixel values while minimizing a number of boundaries. Moreover, the disclosed systems generate one or more closed connected partitions that include locally smooth pixel values within the raster digital image according to the boundaries of the segmentation map. Further, the disclosed systems fit one or more fill function to the closed connected partition(s), where the one or more fill function includes at least one gradient fill function for a closed connected partition. The disclosed systems generate the vectorized digital image according to the at least one gradient fill function for the closed connected partition.

Abstract: The systems, methods, and non-transitory computer-readable media include recoloring a digital design according to colors of a digital image and further generating an enhanced recolored digital design. In particular, in some embodiments, the disclosed systems identify a digital image for recoloring a digital design and recolors the digital design utilizing a color affine transformation algorithm to generate a recolored digital design. Further, in some embodiments, the disclosed systems generate the enhanced recolored digital design by transforming one or more colors of the recolored digital design to be within a range of the colors of the digital image utilizing a convex hull projection method. Moreover, in some embodiments, the disclosed systems further enhance the recolored digital design utilizing a contrast enhancement algorithm to modify luminescence values.

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating a digital vector image including strokes based on a digital raster image. In particular, in one or more embodiments, the disclosed systems generate a digital vector image that includes editable, single-lined digital strokes based on strokes from a digital raster image. More specifically, the disclosed systems utilize a stroke identification machine learning model to generate a stroke segmentation map including boundary pixels. Additionally, the disclosed systems generate a digital vector image based on the stroke segmentation map. Accordingly, the disclosed systems generate editable, single-lined digital strokes for the boundary regions of digital objects in the digital raster image.

Abstract: Systems and methods for generating tile-able patterns from text include obtaining a text prompt and generating, by a generation prior model, a latent vector based on the text prompt, where the generation prior model is trained to output vectors within a distribution of tile-able patterns. An image generation model then generates an output image based on the latent vector. The output image comprises a tile-able pattern including an element from the text prompt.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generates a vectorized digital image of a raster image according to at least one gradient fill function. In particular, the disclosed systems generate a segmentation map of a raster digital image by using a segmentation model to cluster pixel values while minimizing a number of boundaries. Moreover, the disclosed systems generate one or more closed connected partitions that include locally smooth pixel values within the raster digital image according to the boundaries of the segmentation map. Further, the disclosed systems fit one or more fill function to the closed connected partition(s), where the one or more fill function includes at least one gradient fill function for a closed connected partition. The disclosed systems generate the vectorized digital image according to the at least one gradient fill function for the closed connected partition.

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for vectorizing raster images using path simplification via corner detection and a directed graph. The disclosed system determines a plurality of line segments from one or more paths along boundaries of segmented regions of a raster image. The disclosed system determines cornerness scores corresponding to portions of the one or more paths at a set of vertices by comparing the portions at the set of vertices to different shapes including at least a corner shape. The disclosed system also fits a plurality of candidate vector paths to input paths corresponding to pairs of the set of vertices. Additionally, the disclosed system generates a vector image comprising a set of vector paths fitted to the boundaries of the segmented regions that minimize costs according to the cornerness scores.

Abstract: The present disclosure is directed toward systems, methods, and non-transitory computer readable media that provide that provide processes and a graphical user interface tailored to organize vector geometry within a vector image into a hierarchical structure based on layered semantic groups. In particular, in one or more embodiments, the disclosed systems determine, using an object segmentation model, a set of masks corresponding to objects depicted within a raster image. The disclosed systems determine an intersection between a first mask and a second mask from among the set of masks. The disclosed systems generate a hierarchical semantic structure comprising a set of nodes corresponding to the set of masks by generating a first node for the first mask and a second node for the second mask arranged according to the intersection. The disclosed systems generate a vector image from the raster image according to the hierarchical semantic structure.

Abstract: A method, apparatus, non-transitory computer readable medium, apparatus, and system for generating pattern data include obtaining an input image including a pattern element. Then, embodiments generate a pattern image including the pattern element based on the input image. The pattern image includes a plurality of versions of the pattern element. Subsequently, embodiments generate a pattern caption based on the pattern image. Embodiments then utilize the pattern image and the pattern caption for training an image generation model to generate pattern images based on a text prompt.

Abstract: A stroke-guided vectorization system is described that generates, from an input sketch and guide image depicting an approximate vector representation of the sketch, an aligned guide image depicting an improved vector representation of the sketch. To do so, the stroke-guided vectorization system determines black levels representing a vector stroke in the input sketch and white levels representing a background in the input sketch. The stroke-guided vectorization system determines a black threshold value and a white threshold value for discrete portions of the aligned guide image using subsets of the black levels and subsets of the white levels determined using the input sketch. Each discrete portion of the aligned guide image is then mapped to a vector stroke or a background based on the black threshold value and the white threshold value of the portion.

Abstract: Certain aspects and features of the present disclosure relate to receiving an input corresponding to a fill for a vector graphical representation including an overlapping area. Aspects and features further involve converting the vector graphical representation to a simple graph, and aligning contours within the simple graph to provide a unified winding number for the overlapping area. Aspects and features also involve rendering the vector graphical representation with the fill using the simple graph to include the overlapping area within the rendered representation as filled.

Abstract: Recoloring a target graphic using color palettes generated using a stochastic color mapping process. One method of recoloring a target graphic using the stochastic color mapping process includes obtaining a target graphic to be recolored and a source color palette defining source colors for recoloring the target graphic. A target color set of target colors is extracted from the target graphic. The method includes computing a mapping to map source colors of a source color palette to target colors extracted from a target color set of the target graphic based on a transition probability. A destination color palette of destination colors is determined based on the mapping. The target graphic is modified by recoloring at least one object in the target graphic with a destination color from the destination color palette.

Abstract: Embodiments are disclosed for reconstructing linear gradients from an input image that can be applied to another image. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a raster image, the raster image including a representation of a linear color gradient. The disclosed systems and methods further comprise determining a vector representing a direction of the linear color gradient. The disclosed systems and methods further comprise analyzing pixel points along the direction of the linear color gradient to compute color stops of the linear color gradient. The disclosed systems and methods further comprise generating an output color gradient vector with the computed color stops of the linear color gradient, the output color gradient vector to be applied to a vector graphic.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that selectively utilizes an image super-resolution model to upscale image patches corresponding to high frequency portions. In particular, the disclosed systems select a set of image patches corresponding to high frequency portions of a digital image at a first resolution. Furthermore, the disclosed systems utilize an image super-resolution model to generate upscaled image patches for the set of image patches of the high-frequency portions to a second resolution higher than the first resolution according to an upscaling factor of at least two. The disclosed systems generate a segmentation map of the digital image based on the upscaled image patches and an upscaled segmentation corresponding to low-frequency portions of the digital image. Further, the disclosed systems generate a vectorized digital image for the digital image according to the segmentation map.

Abstract: Certain aspects and features of this disclosure relate to providing a vector graphics entity component system that supports collaborative editing in real time or near real time. Graphical constructs are efficiently described by integer-based identifiers, and graphical constructs of the same type are stored in a definitional component. Each client maintains both a pending state representation and a synchronized state representation of the graphical design to independently track the state of the representation at a live editing server. The use of integer-based identifiers for graphical constructs provides an efficient change representation that can be communicated with minimal network traffic. All copies of the graphical design represented among clients reach a consistent state quickly even when multiple users are making changes to the same vector path, eliminating the need to track changes manually or to move large files.

Abstract: This disclosure describes one or more implementations of systems, non-transitory computer-readable media, and methods that utilizes a segmentation approach that distinguishes between smooth-shaded regions from high-frequency regions in an image within a vectorization pipeline to generate a vector image. For instance, the disclosed systems utilize a smoothing function to identify non-overlapping sets of pixels that include locally smooth pixels and pixels with high frequency details for an image. Furthermore, in some instances, the disclosed systems generate separate sets of fill functions (representing color-based regions) using color-based pixel clustering for the non-overlapping sets of pixels. Moreover, in one or more instances, the disclosed systems merge neighboring color-based regions in the sets of fill functions (using color similarity) to generate a set of segmented regions for an image.

Abstract: Graphical constructs are efficiently described by integer-based identifiers, and graphical constructs of the same type are stored in a definitional component. Each client maintains both a pending state representation and a synchronized state representation of the graphical design to independently track the state of the representation at a live editing server. The use of integer-based identifiers for graphical constructs provides an efficient change representation that can be communicated with minimal network traffic. All copies of the graphical design represented among clients reach a consistent state quickly even when multiple users are making changes to the same vector path, eliminating the need to track changes manually or to move large files.

Abstract: Systems and methods for image processing are described. Embodiments of the present disclosure receive a raster image depicting a radial color gradient; compute an origin point of the radial color gradient based on an orthogonality measure between a color gradient vector at a point in the raster image and a relative position vector between the point and the origin point; construct a vector graphics representation of the radial color gradient based on the origin point; and generate a vector graphics image depicting the radial color gradient based on the vector graphics representation.

Abstract: Generating a vector representation of a hand-drawn sketch is described. To do so, the sketch is segmented into different superpixel regions. Superpixels are grown by distributing superpixel seeds throughout an image of the sketch and assigning unassigned pixels to a neighboring superpixel based on pixel value differences. The border between each pair of adjacent superpixels is then classified as either an active or an inactive boundary, with active boundaries indicating that the border corresponds to a salient sketch stroke. Vector paths are generated by traversing edges between pixel vertices along the active boundaries. To minimize vector paths included in the vector representation, vector paths are greedily generated first for longer curves along active boundaries until each edge is assigned to a vector path. Regions encompassed by vector paths corresponding to a foreground superpixel are filled to produce a high-fidelity vector representation of the sketch.

Abstract: A method, apparatus, non-transitory computer readable medium, apparatus, and system for image generation include obtaining a sketch input depicting an object, processing the sketch input to obtain sketch guidance, and generating a synthesized image based on the sketch guidance using an image generation model, where the synthesized image depicts the object from the sketch input.