Abstract: A visual lens system is described that identifies, automatically and without user intervention, digital tool parameters for achieving a visual appearance of an image region in raster image data. To do so, the visual lens system processes raster image data using a tool region detection network trained to output a mask indicating whether the digital tool is useable to achieve a visual appearance of each pixel in the raster image data. The mask is then processed by a tool parameter estimation network trained to generate a probability distribution indicating an estimation of discrete parameter configurations applicable to the digital tool to achieve the visual appearance. The visual lens system generates an image tool description for the parameter configuration and incorporates the image tool description into an interactive image for the raster image data. The image tool description enables transfer of the digital tool parameter configuration to different image data.

Abstract: Embodiments are disclosed for reconstructing linear gradients from an input image that can be applied to another image. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a raster image, the raster image including a representation of a linear color gradient. The disclosed systems and methods further comprise determining a vector representing a direction of the linear color gradient. The disclosed systems and methods further comprise analyzing pixel points along the direction of the linear color gradient to compute color stops of the linear color gradient. The disclosed systems and methods further comprise generating an output color gradient vector with the computed color stops of the linear color gradient, the output color gradient vector to be applied to a vector graphic.

Abstract: Systems and methods for image processing are described. Embodiments of the present disclosure receive a raster image depicting a radial color gradient; compute an origin point of the radial color gradient based on an orthogonality measure between a color gradient vector at a point in the raster image and a relative position vector between the point and the origin point; construct a vector graphics representation of the radial color gradient based on the origin point; and generate a vector graphics image depicting the radial color gradient based on the vector graphics representation.

Abstract: Embodiments are disclosed for performing 3-D vectorization. The method includes obtaining a three-dimensional rendered image and a camera position. The method further includes obtaining a triangle mesh representing the three-dimensional rendered image. The method further involves creating a reduced triangle mesh by removing one or more triangles from the triangle mesh. The method further involves subdividing each triangle of the reduced triangle mesh into one or more subdivided triangles. The method further involves performing a mapping of each pixel of the three-dimensional rendered image to the reduced triangle mesh. The method further involves assigning a color value to each vertex of the reduced triangle mesh. The method further involves sorting each triangle of the reduced triangle mesh using a depth value of each triangle. The method further involves generating a two-dimensional triangle mesh using the sorted triangles of the reduced triangle mesh.

Abstract: A visual lens system is described that identifies, automatically and without user intervention, digital tool parameters for achieving a visual appearance of an image region in raster image data. To do so, the visual lens system processes raster image data using a tool region detection network trained to output a mask indicating whether the digital tool is useable to achieve a visual appearance of each pixel in the raster image data. The mask is then processed by a tool parameter estimation network trained to generate a probability distribution indicating an estimation of discrete parameter configurations applicable to the digital tool to achieve the visual appearance. The visual lens system generates an image tool description for the parameter configuration and incorporates the image tool description into an interactive image for the raster image data. The image tool description enables transfer of the digital tool parameter configuration to different image data.

Abstract: This disclosure covers methods, non-transitory computer readable media, and systems analyze a digital design document having an initial layout of digital objects and automatically generate candidate layouts by concurrently performing operations on the digital objects within the initial layout. By iteratively performing concurrent operations, in some implementations, the methods, non-transitory computer readable media, and systems produce multiple candidate layouts that the systems evaluate by generating design scores. Based on a comparison of such design scores, the methods, non-transitory computer readable media, and systems generate one or more modified layouts (from among the candidate layouts) for presentation to a user.

Abstract: In implementations of systems for generating stroked paths, a computing device implements a stroked path system to receive input data describing a vector object having a filled path. The stroked path system generates a medial axis for the filled path by performing a medial axis transform on a boundary of the filled path. A stroke width is estimated based on distances between the medial axis and the boundary of the filled path that are normal to the medial axis. The stroked path system generates a stroked path for display in a user interface that is visually similar to the filled path based on the medial axis and the stroke width.

Abstract: Embodiments are disclosed for reconstructing freeform gradients from an input image. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving an input image, computing an outline of the input image, identifying a set of candidate color handles for the input image, each candidate color handle of the set of candidate color handles representing an extremum point for a color in the input image, generating a reconstructed image using a subset of the set of candidate color handles, determining a reconstruction error by computing a difference between the input image and the reconstructed image, and providing the reconstructed image when the reconstruction error is below a threshold value.

Abstract: Systems and methods provide for efficiently and accurately determining a simplified path that conforms to the geometry of an original path by simultaneously minimizing the deviation from the original path and reducing the number of anchor points in the simplified path. A simplified path may be iteratively generated by updating parametric values and anchor points for candidate simplified paths at epochs. A deviation in distance between points on the original path and corresponding points on candidate paths may be iteratively decreased to ensure that the resulting simplified path follows the geometry of the original path to a predetermined threshold. Continuity constrains can also be applied to ensure smoothness of the simplified path.

Abstract: In implementations of segmenting objects in vector graphics images, an object segmentation system can obtain points that identify an object in a vector graphics image, and determine a region of interest in the image that includes the object based on the points that identify the object. The object segmentation system can generate a heat map from the points that identify the object in the image, and a rasterized region from rasterizing the region of interest. The object segmentation system can generate a mask from the rasterized region and the heat map, the mask identifying pixels of the object in the rasterized region, and determine, from the mask, paths of the vector graphics corresponding to the object.

Abstract: Boundary correspondence determination techniques are described for digital objects as implemented by a boundary correspondence system. In an implementation, the boundary correspondence system partitions outer boundaries of first and second digital objects into a first plurality of cuts and a second plurality of cuts, respectively. A set of corresponding cut pairs are then determined based on a comparison of the first plurality of cuts with the second plurality of cuts. Further, corresponding anchor point pairs are determined based on a comparison of anchor points of the set of corresponding cut pairs. The boundary correspondence system then generates and outputs a mapping of the first digital object to the second digital object based on the determined correspondence of anchor point pairs.

Abstract: A computer-implemented method including receiving an input image at a first image stage and receiving a request to generate a plurality of variations of the input image at a second image stage. The method including generating, using an auto-regressive generative deep learning model, the plurality of variations of the input image at the second image stage and outputting the plurality of variations of the input image at the second image stage.

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing ray-tracing and mesh generation to illuminate two-dimensional digital vector images. In response to inserting a light source into a two-dimensional digital vector image including one or more vector elements, the disclosed system embeds the vector element(s) into a polygonal mesh generated for a region of the digital vector image. The disclosed system samples a plurality of rays at a plurality of points within the region and detect intersections of the rays with the vector element(s) or a bounding shape surrounding the region. Additionally, the disclosed system determines color values for mesh points in the polygonal mesh based on the intersections of the rays by interpolating color values associated with the intersected points. Furthermore, in some embodiments, the disclosed system subdivides the polygonal mesh according to a priority queue based on error scores associated with the determined color values.

Abstract: Directional pattern generation techniques are described for digital images as implemented by a directional pattern system. In an implementation, a user input is received to specify a direction with respect to the object. A directional pattern system then fills the object using a directional pattern based on the contours of the object as well as the user-specified direction. To do so, the directional pattern system generates a directional vector field that specifies directions with respect to corresponding locations within the field defined by a mesh. Uniform field embedding is employed to transfer the directional vector field to a grid by superimposing the grid onto the mesh of the directional vector field. The directional pattern system then generates the directional pattern within the object by filling the grid with one or more pattern cells.

Abstract: Boundary correspondence determination techniques are described for digital objects as implemented by a boundary correspondence system. In an implementation, the boundary correspondence system partitions outer boundaries of first and second digital objects into a first plurality of cuts and a second plurality of cuts, respectively. A set of corresponding cut pairs are then determined based on a comparison of the first plurality of cuts with the second plurality of cuts. Further, corresponding anchor point pairs are determined based on a comparison of anchor points of the set of corresponding cut pairs. The boundary correspondence system then generates and outputs a mapping of the first digital object to the second digital object based on the determined correspondence of anchor point pairs.

Abstract: Embodiments are disclosed for reconstructing freeform gradients from an input image. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving an input image, computing an outline of the input image, identifying a set of candidate color handles for the input image, each candidate color handle of the set of candidate color handles representing an extremum point for a color in the input image, generating a reconstructed image using a subset of the set of candidate color handles, determining a reconstruction error by computing a difference between the input image and the reconstructed image, and providing the reconstructed image when the reconstruction error is below a threshold value.

Abstract: Generating a vector representation of a hand-drawn sketch is described. To do so, the sketch is segmented into different superpixel regions. Superpixels are grown by distributing superpixel seeds throughout an image of the sketch and assigning unassigned pixels to a neighboring superpixel based on pixel value differences. The border between each pair of adjacent superpixels is then classified as either an active or an inactive boundary, with active boundaries indicating that the border corresponds to a salient sketch stroke. Vector paths are generated by traversing edges between pixel vertices along the active boundaries. To minimize vector paths included in the vector representation, vector paths are greedily generated first for longer curves along active boundaries until each edge is assigned to a vector path. Regions encompassed by vector paths corresponding to a foreground superpixel are filled to produce a high-fidelity vector representation of the sketch.

Abstract: A computer-implemented method including receiving an input image at a first image stage and receiving a request to generate a plurality of variations of the input image at a second image stage. The method including generating, using an auto-regressive generative deep learning model, the plurality of variations of the input image at the second image stage and outputting the plurality of variations of the input image at the second image stage.

Abstract: In implementations of systems for generating stroked paths, a computing device implements a stroked path system to receive input data describing a vector object having a filled path. The stroked path system generates a medial axis for the filled path by performing a medial axis transform on a boundary of the filled path. A stroke width is estimated based on distances between the medial axis and the boundary of the filled path that are normal to the medial axis. The stroked path system generates a stroked path for display in a user interface that is visually similar to the filled path based on the medial axis and the stroke width.

Abstract: Digital object surface inflation techniques are described as implemented by an image processing system to generate an inflated digital object, automatically and without user intervention, from a two-dimensional digital object in a digital image. In one example, the geometry inflation system generates the inflated digital object based on an outer boundary and in this way overcomes challenges of conventional skeleton based techniques. In another example, rules are configured to guide a geometry inflation system to generate the inflated digital object.