Abstract: In some embodiments, a computing system generates a color gradient for data visualizations by displaying a color selection design interface. The computing system receives a user input identifying a start point of a color map path and an end point of a color map path. The computing system draws a color map path within the color space element between the start point and the end point constrained to traverse colors having uniform transitions between one or more of lightness, chroma, and hue. The computing system selects a color gradient having a first color corresponding to the start point of the color map path and a second color corresponding to the end point of the color map path, and additional colors corresponding to additional points along the color map path. The computing system generates a color map for visually representing a range of data values.

Abstract: Methods and systems for reconstructing surfaces of an object using regional level sets (RLS) are disclosed. A scanning system scans an object and generates a point cloud. An RLS is iteratively determined as solution to a differential equation constrained by the point cloud. The RLS is a 2-tuple, where the first component corresponds to a region identification and the second component corresponds to the solution of the differential equation. The space around the point cloud is iteratively segmented into a plurality of regions. A single solution to the differential equation is applied, encompassing all the regions. The solution in regions of the space corresponding to the finer structures within the point cloud are modeled similar to the coarser regions. The solution in a particular region is iteratively based on the solution in the neighboring regions. An RLS is enabled to reconstruct thinner or smaller structures or surfaces of the object.

Abstract: In some embodiments, a computing system computes a palette-based color harmony and applies palette-based image recoloration by determining a color palette for the electronic image that includes a first image color at a first position on a color space and a second image color at a second position on a color space. The computing system applies a harmonic template using a combination of a global rotation angle and a secondary rotation angle, such that, the harmonic template, as applied, minimizes an aggregate of hue distances. The computing system modifies the color palette by moving at least one of (i) the first image color from the first position toward a position along a first axis of the harmonic template or (ii) the second image color from the second position toward a modified position along a second axis of the harmonic template. The computing system updates an editing interface.

Abstract: Generation of parameterized avatars is described. An avatar generation system uses a trained machine-learning model to generate a parameterized avatar, from which digital visual content (e.g., images, videos, augmented and/or virtual reality (AR/VR) content) can be generated. The machine-learning model is trained to identify cartoon features of a particular style—from a library of these cartoon features—that correspond to features of a person depicted in a digital photograph. The parameterized avatar is data (e.g., a feature vector) that indicates the cartoon features identified from the library by the trained machine-learning model for the depicted person. This parameterization enables the avatar to be animated. The parameterization also enables the avatar generation system to generate avatars in non-photorealistic (relatively cartoony) styles such that, despite the style, the avatars preserve identities and expressions of persons depicted in input digital photographs.

Abstract: Caricature generation techniques and systems are described that are configured to preserve an individuality identity of a subject of the caricature and thus overcome inaccuracies and failures of conventional techniques. In one example, a caricature generation system is employed by a computing device to determine deviations of facial features of a subject captured by a digital image from reference values. Caricature-specific blend shapes are then employed by the caricature generation system to generate a digital image caricature from a digital image based on these deviations. In one example, blend shapes include interaction rules that define an interplay of distortions that are jointly applied to at least two of the facial features of a subject in the digital image.

Abstract: An augmented reality (AR) mirror system is described. In an example, the AR mirror system includes a sensor, a display device, a semi-reflecting surface, a processing system, and computer-readable storage media having instructions stored thereon. The instructions are executable by the processing system to cause display of augmented reality (AR) digital content by the display device to be simultaneously viewable with a reflection of a physical object.

Abstract: Certain embodiments involve synthesizing image content depicting facial hair or other hair features based on orientation data obtained using guidance inputs or other user-provided guidance data. For instance, a graphic manipulation application accesses guidance data identifying a desired hair feature and an appearance exemplar having image data with color information for the desired hair feature. The graphic manipulation application transforms the guidance data into an input orientation map. The graphic manipulation application matches the input orientation map to an exemplar orientation map having a higher resolution than the input orientation map. The graphic manipulation application generates the desired hair feature by applying the color information from the appearance exemplar to the exemplar orientation map. The graphic manipulation application outputs the desired hair feature at a presentation device.

Abstract: Generation of parameterized avatars is described. An avatar generation system uses a trained machine-learning model to generate a parameterized avatar, from which digital visual content (e.g., images, videos, augmented and/or virtual reality (AR/VR) content) can be generated. The machine-learning model is trained to identify cartoon features of a particular style—from a library of these cartoon features—that correspond to features of a person depicted in a digital photograph. The parameterized avatar is data (e.g., a feature vector) that indicates the cartoon features identified from the library by the trained machine-learning model for the depicted person. This parameterization enables the avatar to be animated. The parameterization also enables the avatar generation system to generate avatars in non-photorealistic (relatively cartoony) styles such that, despite the style, the avatars preserve identities and expressions of persons depicted in input digital photographs.

Abstract: Embodiments involve reducing collision-based defects in motion-stylizations. For example, a device obtains facial landmark data from video data. The facial landmark data includes a first trajectory traveled by a first point tracking one or more facial features, and a second trajectory traveled by a second point tracking one or more facial features. The device applies a motion-stylization to the facial landmark data that causes a first change to one or more of the first trajectory and the second trajectory. The device also identifies a new collision between the first and second points that is introduced by the first change. The device applies a modified stylization to the facial landmark data that causes a second change to one or more of the first trajectory and the second trajectory. If the new collision is removed by the second change, the device outputs the facial landmark data with the modified stylization applied.

Abstract: Certain embodiments involve synthesizing image content depicting facial hair or other hair features based on orientation data obtained using guidance inputs or other user-provided guidance data. For instance, a graphic manipulation application accesses guidance data identifying a desired hair feature and an appearance exemplar having image data with color information for the desired hair feature. The graphic manipulation application transforms the guidance data into an input orientation map. The graphic manipulation application matches the input orientation map to an exemplar orientation map having a higher resolution than the input orientation map. The graphic manipulation application generates the desired hair feature by applying the color information from the appearance exemplar to the exemplar orientation map. The graphic manipulation application outputs the desired hair feature at a presentation device.

Abstract: Caricature generation techniques and systems are described that are configured to preserve an individuality identity of a subject of the caricature and thus overcome inaccuracies and failures of conventional techniques. In one example, a caricature generation system is employed by a computing device to determine deviations of facial features of a subject captured by a digital image from reference values. Caricature-specific blend shapes are then employed by the caricature generation system to generate a digital image caricature from a digital image based on these deviations. In one example, blend shapes include interaction rules that define an interplay of distortions that are jointly applied to at least two of the facial features of a subject in the digital image.

Abstract: Embodiments involve reducing collision-based defects in motion-stylizations. For example, a device obtains facial landmark data from video data. The facial landmark data includes a first trajectory traveled by a first point tracking one or more facial features, and a second trajectory traveled by a second point tracking one or more facial features. The device applies a motion-stylization to the facial landmark data that causes a first change to one or more of the first trajectory and the second trajectory. The device also identifies a new collision between the first and second points that is introduced by the first change. The device applies a modified stylization to the facial landmark data that causes a second change to one or more of the first trajectory and the second trajectory. If the new collision is removed by the second change, the device outputs the facial landmark data with the modified stylization applied.

Abstract: An augmented reality (AR) mirror system is described. In an example, the AR mirror system includes a sensor, a display device, a semi-reflecting surface, a processing system, and computer-readable storage media having instructions stored thereon. The instructions are executable by the processing system to cause display of augmented reality (AR) digital content by the display device to be simultaneously viewable with a reflection of a physical object.

Abstract: Methods and systems for reconstructing surfaces of an object using regional level sets (RLS) are disclosed. A scanning system scans an object and generates a point cloud. An RLS is iteratively determined as solution to a differential equation constrained by the point cloud. The RLS is a 2-tuple, where the first component corresponds to a region identification and the second component corresponds to the solution of the differential equation. The space around the point cloud is iteratively segmented into a plurality of regions. A single solution to the differential equation is applied, encompassing all the regions. The solution in regions of the space corresponding to the finer structures within the point cloud are modeled similar to the coarser regions. The solution in a particular region is iteratively based on the solution in the neighboring regions. An RLS is enabled to reconstruct thinner or smaller structures or surfaces of the object.

Abstract: Methods and systems for reconstructing surfaces of an object using regional level sets (RLS) are disclosed. A scanning system scans an object and generates a point cloud. An RLS is iteratively determined as solution to a differential equation constrained by the point cloud. The RLS is a 2-tuple, where the first component corresponds to a region identification and the second component corresponds to the solution of the differential equation. The space around the point cloud is iteratively segmented into a plurality of regions. A single solution to the differential equation is applied, encompassing all the regions. The solution in regions of the space corresponding to the finer structures within the point cloud are modeled similar to the coarser regions. The solution in a particular region is iteratively based on the solution in the neighboring regions. An RLS is enabled to reconstruct thinner or smaller structures or surfaces of the object.

Abstract: Methods and systems for reconstructing surfaces of an object using regional level sets (RLS) are disclosed. A scanning system scans an object and generates a point cloud. An RLS is iteratively determined as solution to a differential equation constrained by the point cloud. The RLS is a 2-tuple, where the first component corresponds to a region identification and the second component corresponds to the solution of the differential equation. The space around the point cloud is iteratively segmented into a plurality of regions. A single solution to the differential equation is applied, encompassing all the regions. The solution in regions of the space corresponding to the finer structures within the point cloud are modeled similar to the coarser regions. The solution in a particular region is iteratively based on the solution in the neighboring regions. An RLS is enabled to reconstruct thinner or smaller structures or surfaces of the object.

Abstract: Systems and methods for simulating liquid-on-lens effects may provide an interface through which users can add and/or manipulate fluids on a virtual camera lens. A physically based fluid simulation may simulate the behavior of the fluid as it is deposited on and/or manipulated on the virtual lens, and determine the distribution of the fluid across the lens. A ray tracing technique may be employed to determine how light is refracted through the virtual lens and the fluid, and to render a distorted output image as seen through the lens and the fluid. As the fluid is manipulated, corresponding changes in the image may be displayed in real time. The input image may be an existing single image or a direct camera feed (e.g., of a tablet type device). The user may select a fluid type and/or various fluid properties for the image editing operation.

Abstract: Systems and methods for simulating liquid-on-lens effects may provide an interface through which users can add and/or manipulate fluids on a virtual camera lens. A physically based fluid simulation may simulate the behavior of the fluid as it is deposited on and/or manipulated on the virtual lens, and determine the distribution of the fluid across the lens. A ray tracing technique may be employed to determine how light is refracted through the virtual lens and the fluid, and to render a distorted output image as seen through the lens and the fluid. As the fluid is manipulated, corresponding changes in the image may be displayed in real time. The input image may be an existing single image or a direct camera feed (e.g., of a tablet type device). The user may select a fluid type and/or various fluid properties for the image editing operation.