Abstract: Systems and methods for texture hallucination with a large upscaling factor are described. Embodiments of the systems and methods may receive an input image and a reference image, extract an upscaled feature map from the input image, match the input image to a portion of the reference image, wherein a resolution of the reference image is higher than a resolution of the input image, concatenate the upscaled feature map with a reference feature map corresponding to the portion of the reference image to produce a concatenated feature map, and generate a reconstructed image based on the concatenated feature map using a machine learning model trained with a texture loss and a degradation loss, wherein the texture loss is based on a high frequency band filter, and the degradation loss is based on a downscaled version of the reconstructed image.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for utilizing a visual-feature-classification model to generate font maps that efficiently and accurately organize fonts based on visual similarities. For example, the disclosed systems can extract features from fonts of varying styles and utilize a self-organizing map (or other visual-feature-classification model) to map extracted font features to positions within font maps. Further, the disclosed systems can also magnify areas of font maps by mapping some fonts within a bounded area to positions within a higher-resolution font map. Additionally, the disclosed systems can navigate the font map to identify visually similar fonts (e.g., fonts within a threshold similarity).

Abstract: A method for generating a color gradient includes receiving an input indicating a smoothness of the color gradient and detecting a gradient path defined from an image. The method also includes identifying a set of colors from the gradient path. The method includes detecting a set of color pivots associated with the set of colors. A number of the color pivots in the set of color pivots is based on the input indicating the smoothness of the color gradient. The method includes generating a set of individual color gradients along the gradient path including a color gradient between a first pair of colors located at a first pair of the color pivots and a different color gradient between a second pair of colors located at a second pair of the color pivots. Additionally, the method includes generating the color gradient of the image from the set of individual color gradients.

Abstract: In implementations of multi-resolution color-based image search, an image search system determines a color vector for a query image based on a color histogram of the query image by concatenating two color histograms having different resolutions. The image search system can compute distance measures between the color vector of the query image and color vectors of candidate images. The image search system can select one or more of the candidate images to return based on the distance measures utilizing the distance measures as indication of color similarity of the candidate images to the query image.

Abstract: A method for generating a color gradient includes receiving an input indicating a smoothness of the color gradient and detecting a gradient path defined from an image. The method also includes identifying a set of colors from the gradient path. The method includes detecting a set of color pivots associated with the set of colors. A number of the color pivots in the set of color pivots is based on the input indicating the smoothness of the color gradient. The method includes generating a set of individual color gradients along the gradient path including a color gradient between a first pair of colors located at a first pair of the color pivots and a different color gradient between a second pair of colors located at a second pair of the color pivots. Additionally, the method includes generating the color gradient of the image from the set of individual color gradients.

Abstract: Systems and methods for texture hallucination with a large upscaling factor are described. Embodiments of the systems and methods may receive an input image and a reference image, extract an upscaled feature map from the input image, match the input image to a portion of the reference image, wherein a resolution of the reference image is higher than a resolution of the input image, concatenate the upscaled feature map with a reference feature map corresponding to the portion of the reference image to produce a concatenated feature map, and generate a reconstructed image based on the concatenated feature map using a machine learning model trained with a texture loss and a degradation loss, wherein the texture loss is based on a high frequency band filter, and the degradation loss is based on a downscaled version of the reconstructed image.

Abstract: Various methods and systems are provided for image-management operations that includes generating adaptive image armatures based on an alignment between composition lines of a reference armature and a position of an object in an image. In operation, a reference armature for an image is accessed. The reference armature includes a plurality of composition lines that define a frame of reference for image composition. An alignment map is determined using the reference armature. The alignment map includes alignment information that indicates alignment between the composition lines of the reference armature and the position of the object in the image. Based on the alignment map, an adaptive image armature is determined. The adaptive image armature includes a subset of the composition lines of the reference armature. The adaptive image armature is displayed.

Abstract: Disclosed herein are embodiments of systems and computer-implemented methods for extracting a set of discrete colors from an input image. A playful palette may be automatically generated from the set of discrete colors, where the playful palette contains a gamut limited to a blend of the set of discrete colors. A representation of the playful palette may be displayed on a graphical user interface of an electronic device. In a first method, an optimization may be performed using a bidirectional objective function comparing the color gamut of the input image and rendering of a candidate playful palette. Initial blobs may be generated by clustering. In a second method, color subsampling may be performed from the image, and a self-organizing map (SOM) may be generated. Clustering the SOM colors may be performed, and each pixel of the SOM may be replaced with an average color value to generate a cluster map.

Abstract: In some embodiments, a computing system computes a palette-based color harmony and applies palette-based image recoloration by determining a color palette for the electronic image that includes a first image color at a first position on a color space and a second image color at a second position on a color space. The computing system applies a harmonic template using a combination of a global rotation angle and a secondary rotation angle, such that, the harmonic template, as applied, minimizes an aggregate of hue distances. The computing system modifies the color palette by moving at least one of (i) the first image color from the first position toward a position along a first axis of the harmonic template or (ii) the second image color from the second position toward a modified position along a second axis of the harmonic template. The computing system updates an editing interface.

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for generating an animation of a talking head from an input audio signal of speech and a representation (such as a static image) of a head to animate. Generally, a neural network can learn to predict a set of 3D facial landmarks that can be used to drive the animation. In some embodiments, the neural network can learn to detect different speaking styles in the input speech and account for the different speaking styles when predicting the 3D facial landmarks. Generally, template 3D facial landmarks can be identified or extracted from the input image or other representation of the head, and the template 3D facial landmarks can be used with successive windows of audio from the input speech to predict 3D facial landmarks and generate a corresponding animation with plausible 3D effects.

Abstract: A method includes accessing a digital image in a raster representation and identifying edges in the digital image. A set of curves are generated by fitting each of the edges with a corresponding curve. A curvilinear triangulation is generated to include the set of curves. The method further includes generating a gradient mesh based on the curvilinear triangulation, where the gradient mesh includes polygons of the curvilinear triangulation along with control points based on the curvilinear triangulation. A respective color is determined for each control point of the gradient mesh, based on pixel colors of pixels of the raster representation corresponding to the control points in the gradient mesh. The method further includes generating a vector representation of the digital image, where the vector representation includes the gradient mesh with colors of the control points.

Abstract: Certain embodiments involve applying a palette-based color harmony and palette-based image recoloration to an electronic image. For instance, an electronic image processing application accesses a color palette that includes colors at a different positions in a color space. The electronic image processing application selects a harmonic template that, when applied to the color palette, minimizes an aggregate of hue distances between the positions in the color space and axes of the harmonic template. The electronic image processing application modifies the color palette based on the selected harmonic template.

Abstract: A method for generating a color gradient includes receiving an input indicating a smoothness of the color gradient and detecting a gradient path defined from an image. The method also includes identifying a set of colors from the gradient path. The method includes detecting a set of color pivots associated with the set of colors. A number of the color pivots in the set of color pivots is based on the input indicating the smoothness of the color gradient. The method includes generating a set of individual color gradients along the gradient path including a color gradient between a first pair of colors located at a first pair of the color pivots and a different color gradient between a second pair of colors located at a second pair of the color pivots. Additionally, the method includes generating the color gradient of the image from the set of individual color gradients.

Abstract: Embodiments of the present disclosure relate to computer storage, methods, and systems for the automatic optimization of accessible color themes. Systems and methods are disclosed that leverage the use of confusion lines to identify and highlight relationships between colors that may be inaccessible (e.g., indistinguishable) for a person with a vision impairment, such as a color vision deficiency. In some embodiments, a set of input colors can be automatically optimized for color accessibility using confusion lines. The set of input colors can be optimized utilizing an objective function, including at least one of a CVD alignment term, out-of-gamut term, distinguishability term, and faithfulness term.

Abstract: Embodiments of the present disclosure relate to computer storage, methods, and systems for the optimization of accessible color themes. Systems and methods are disclosed that leverage the use of confusion lines to identify and highlight relationships between colors that may be inaccessible (e.g., indistinguishable) for a person with a vision impairment, such as a color vision deficiency. In some embodiments, a graphical user interface is provided that, based on a selection of colors in a color wheel, visually indicates curves of confusion for each color in the selection of colors. Each curve of confusion visually indicates a confusion of colors for a type of vision impairment, such as a CVD.

Abstract: In some embodiments, a computing system generates a color gradient for data visualizations by displaying a color selection design interface. The computing system receives a user input identifying a start point of a color map path and an end point of a color map path. The computing system computes a color map path between the start point and the end point constrained to traverse colors having uniform transitions between one or more of lightness, chroma, and hue. The computing system selects a color gradient having a first color corresponding to the start point of the color map path and a second color corresponding to the end point of the color map path, and additional colors corresponding to additional points along the color map path. The computing system generates a color map for visually representing a range of data values.

Abstract: In implementations of multi-resolution color-based image search, an image search system determines a color vector for a query image based on a color histogram of the query image by concatenating two color histograms having different resolutions. The image search system can compute distance measures between the color vector of the query image and color vectors of candidate images. The image search system can select one or more of the candidate images to return based on the distance measures utilizing the distance measures as indication of color similarity of the candidate images to the query image.

Abstract: In some embodiments, a computing system generates a color gradient for data visualizations by displaying a color selection design interface. The computing system receives a user input identifying a start point of a color map path and an end point of a color map path. The computing system draws a color map path within the color space element between the start point and the end point constrained to traverse colors having uniform transitions between one or more of lightness, chroma, and hue. The computing system selects a color gradient having a first color corresponding to the start point of the color map path and a second color corresponding to the end point of the color map path, and additional colors corresponding to additional points along the color map path. The computing system generates a color map for visually representing a range of data values.

Abstract: Techniques are disclosed for parametric color mixing in a digital painting application. A methodology implementing the techniques according to an embodiment includes generating a Bezier curve extending from a first point to a second point in a 3-Dimensional space. The first and second points are specified by coordinates based on red-green-blue (RGB) values of first and second mixing colors, respectively. The Bezier curve is defined by a selected curvature parameter which can be related to the paint medium, such as oil colors, water colors, pastels, etc., and which further specifies additive or subtractive mixing. The method also includes locating a point on the Bezier curve, the point determined by a selected mixing ratio parameter specifying a ratio of the first mixing color to the second mixing color. The method further includes generating a color mix based on RGB values specified by coordinates of the located point on the Bezier curve.

Abstract: Various methods and systems are provided for image-management operations that includes generating adaptive image armatures based on an alignment between composition lines of a reference armature and a position of an object in an image. In operation, a reference armature for an image is accessed. The reference armature includes a plurality of composition lines that define a frame of reference for image composition. An alignment map is determined using the reference armature. The alignment map includes alignment information that indicates alignment between the composition lines of the reference armature and the position of the object in the image. Based on the alignment map, an adaptive image armature is determined. The adaptive image armature includes a subset of the composition lines of the reference armature. The adaptive image armature is displayed.