Abstract: Digital object surface inflation techniques are described as implemented by an image processing system to generate an inflated digital object, automatically and without user intervention, from a two-dimensional digital object in a digital image. In one example, the geometry inflation system generates the inflated digital object based on an outer boundary and in this way overcomes challenges of conventional skeleton based techniques. In another example, rules are configured to guide a geometry inflation system to generate the inflated digital object.

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing ray-tracing and mesh generation to illuminate two-dimensional digital vector images. In response to inserting a light source into a two-dimensional digital vector image including one or more vector elements, the disclosed system embeds the vector element(s) into a polygonal mesh generated for a region of the digital vector image. The disclosed system samples a plurality of rays at a plurality of points within the region and detect intersections of the rays with the vector element(s) or a bounding shape surrounding the region. Additionally, the disclosed system determines color values for mesh points in the polygonal mesh based on the intersections of the rays by interpolating color values associated with the intersected points. Furthermore, in some embodiments, the disclosed system subdivides the polygonal mesh according to a priority queue based on error scores associated with the determined color values.

Abstract: Directional pattern generation techniques are described for digital images as implemented by a directional pattern system. In an implementation, a user input is received to specify a direction with respect to the object. A directional pattern system then fills the object using a directional pattern based on the contours of the object as well as the user-specified direction. To do so, the directional pattern system generates a directional vector field that specifies directions with respect to corresponding locations within the field defined by a mesh. Uniform field embedding is employed to transfer the directional vector field to a grid by superimposing the grid onto the mesh of the directional vector field. The directional pattern system then generates the directional pattern within the object by filling the grid with one or more pattern cells.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for removing an anchor point from a Bezier spline while preserving the shape of the Bezier spline. For example, the disclosed systems can replace adjacent input segments of an initial Bezier spline that are connected at an anchor point with a new contiguous segment that does not include an anchor point and that spans the portion of the spline covered by the adjacent segments. The disclosed systems can utilize an objective function to determine tangent vectors that indicate locations of control points for generating the new segment to replace the adjacent segments. In addition, the disclosed systems can generate a modified Bezier spline that includes the new segment in place of the adjacent segments of the initial Bezier spline.

Abstract: A fill pattern alignment system fills a geometric shape with a graphical cell in accordance with a pattern and aligned with the contours of the geometric shape. The intrinsic shape of the geometric shape being filled is determined and an orientation for the graphical cell at each location in the pattern is determined based on the intrinsic shape of the geometric shape. Accordingly, the orientation for each graphical cell being used to fill the geometric shape is variable based on the location of the graphical cell and the intrinsic shape of the geometric shape.

Abstract: A fill pattern alignment system fills a geometric shape with a graphical cell in accordance with a pattern and aligned with the contours of the geometric shape. The intrinsic shape of the geometric shape being filled is determined and an orientation for the graphical cell at each location in the pattern is determined based on the intrinsic shape of the geometric shape. Accordingly, the orientation for each graphical cell being used to fill the geometric shape is variable based on the location of the graphical cell and the intrinsic shape of the geometric shape.

Abstract: Certain embodiments involve flow-based color transfers from a source graphic to target graphic. For instance, a palette flow is computed that maps colors of a target color palette to colors of the source color palette (e.g., by minimizing an earth-mover distance with respect to the source and target color palettes). In some embodiments, such color palettes are extracted from vector graphics using path and shape data. To modify the target graphic, the target color from the target graphic is mapped, via the palette flow, to a modified target color using color information of the source color palette. A modification to the target graphic is performed (e.g., responsive to a preview function or recoloring command) by recoloring an object in the target color with the modified target color.

Abstract: Embodiments are disclosed for generating multiple color theme variations from an input image using learned color distributions. A method of generating multiple color theme variations from an input image using learned color distributions includes obtaining, by a user interface manager, an input image, determining, by a color extraction manager, one or more color priors based on the input image, generating, by a color distribution modeling network, a plurality of color theme variations based on the one or more color priors, ranking, by a color theme evaluation network, the plurality of color theme variations, and generating, by a recolor manager, a plurality of recolored output images using the plurality of color theme variations.

Abstract: Techniques are disclosed for generating a vector image from a raster image, where the raster image is, for instance, a photographed or scanned version of a hand-drawn sketch. While drawing a sketch, an artist may perform multiple strokes to draw a line, and the resultant raster image may have adjacent or partially overlapping salient and non-salient lines, where the salient lines are representative of the artist's intent, and the non-salient (or auxiliary) lines are formed due to the redundant strokes or otherwise as artefacts of the creation process. The raster image may also include other auxiliary features, such as blemishes, non-white background (e.g., reflecting the canvas on which the hand-sketch was made), and/or uneven lighting. In an example, the vector image is generated to include the salient lines, but not the non-salient lines or other auxiliary features. Thus, the generated vector image is a cleaner version of the raster image.

Abstract: Embodiments are disclosed for constrained modification of vector geometry. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a selection of a first segment of a vector graphic to be edited, identifying an active region associated with the first segment, wherein the active region includes the first segment and at least one second segment which comprise a geometric primitive, identifying the region of influence including at least one third segment connected to the active region, identifying at least one constraint associated with the active region or the region of influence based at least on the geometric primitive, receiving an edit to the active region, and generating an update for the vector graphic based on the edit and the at least one constraint.

Abstract: Digital object surface inflation techniques are described as implemented by an image processing system to generate an inflated digital object, automatically and without user intervention, from a two-dimensional digital object in a digital image. In one example, the geometry inflation system generates the inflated digital object based on an outer boundary and in this way overcomes challenges of conventional skeleton based techniques. In another example, rules are configured to guide a geometry inflation system to generate the inflated digital object.

Abstract: Embodiments are disclosed for constrained modification of vector geometry. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a selection of a first segment of a vector graphic to be edited, identifying an active region associated with the first segment, wherein the active region includes the first segment and at least one second segment which comprise a geometric primitive, identifying the region of influence including at least one third segment connected to the active region, identifying at least one constraint associated with the active region or the region of influence based at least on the geometric primitive, receiving an edit to the active region, and generating an update for the vector graphic based on the edit and the at least one constraint.

Abstract: In implementations of segmenting objects in vector graphics images, an object segmentation system can obtain points that identify an object in a vector graphics image, and determine a region of interest in the image that includes the object based on the points that identify the object. The object segmentation system can generate a heat map from the points that identify the object in the image, and a rasterized region from rasterizing the region of interest. The object segmentation system can generate a mask from the rasterized region and the heat map, the mask identifying pixels of the object in the rasterized region, and determine, from the mask, paths of the vector graphics corresponding to the object.

Abstract: A visual lens system is described that identifies, automatically and without user intervention, digital tool parameters for achieving a visual appearance of an image region in raster image data. To do so, the visual lens system processes raster image data using a tool region detection network trained to output a mask indicating whether the digital tool is useable to achieve a visual appearance of each pixel in the raster image data. The mask is then processed by a tool parameter estimation network trained to generate a probability distribution indicating an estimation of discrete parameter configurations applicable to the digital tool to achieve the visual appearance. The visual lens system generates an image tool description for the parameter configuration and incorporates the image tool description into an interactive image for the raster image data. The image tool description enables transfer of the digital tool parameter configuration to different image data.

Abstract: Embodiments are disclosed for synchronously editing locally repeating vector geometry. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a selection of a first plurality of segments of a vector-based object to be edited, generating a stencil mask of the first plurality of segments, the stencil mask representing segment placement and primitive types for each of the first plurality of segments, identifying a second plurality of segments of the vector-based object using the stencil mask and a stencil predicate, determining a transform between the first plurality of segments and the second plurality of segments, receiving an edit to the first plurality of segments, and applying the edit to the second plurality of segments using the transform.

Abstract: Dynamic spread anti-aliasing is described. In some embodiments, a filled object is segmented into control tiles. Along the object border, multiple exterior control tiles respectively correspond to multiple curves forming the border. For each curve, one side is filled and the other is anti-aliased to smooth the appearance of the filled object. Each exterior control tile is expanded to create an expanded control tile having a spread zone that includes additional pixels. For example, a control triangle is transformed into a control rectangle, and the control rectangle is enlarged to create an expanded control rectangle by extending an edge outward and away from the curve on the side to be anti-aliased. The additional pixels of the spread zone are subjected to anti-aliasing, such as by applying alpha modulation to the pixels based on respective distances between the pixels and the curve. For subpixel zoom levels, pixel color can be adjusted.

Abstract: In implementations of segmenting objects in vector graphics images, an object segmentation system can obtain points that identify an object in a vector graphics image, and determine a region of interest in the image that includes the object based on the points that identify the object. The object segmentation system can generate a heat map from the points that identify the object in the image, and a rasterized region from rasterizing the region of interest. The object segmentation system can generate a mask from the rasterized region and the heat map, the mask identifying pixels of the object in the rasterized region, and determine, from the mask, paths of the vector graphics corresponding to the object.

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing enhanced curve primitives to modify color gradients in vector-based graphics. To illustrate, the disclosed system can receive an input of a curve to insert into a portion of a vector-based graphic including a mesh for a color gradient. The disclosed system can then insert a discontinuity into the mesh by adding a plurality of vertices to the mesh defining two unconnected edges at the position of the curve within the portion of the vector-based graphic. After inserting the discontinuity into the mesh, the disclosed system can determine colors for the edges of the discontinuity based on one or more user-selected colors and/or one or more colors associated with the color gradient. The disclosed system can then update the color gradient in response to determining the colors for the edges of the discontinuity.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for efficiently and flexibly extracting reusable geometric assets from an arbitrary arrangement of vector geometry within a digital image. For example, the disclosed systems can organize vector geometry of a digital image by structuring geometric objects into groups (e.g., clusters). The disclosed systems can assign mnemonics to these groups and transform the digital image into a mnemonic sequence. Moreover, the disclosed systems can utilize various computer-implemented algorithms to identify and filter patterns within the mnemonic sequence. The disclosed systems can then generate pattern scores for these patterns and identify which patterns of geometric objects to include within a set of reusable geometric assets.

Abstract: A multi-layer light source includes an emissive layer and a textured lighting gel layer, the lighting gel layer being situated between the emissive layer and a 2D canvas or a 3D object. User inputs controlling the multi-layer light source are received, these user inputs being provided with the user interacting with the 2D canvas without switching to editing in 3D space. The multi-layer light source is configured based on the user inputs and, based on the configuration, emission of light rays from the multi-layer light source is determined. Areas of shadows cast by 3D objects are also determined. An image generation system determines, a color of a location (e.g., a pixel) on the 2D canvas or the 3D object that a light ray intersects based on the color that is in the lighting gel layer that the light ray passes through.