Abstract: Techniques are disclosed for providing guidance information for guiding a user to capture an image according to a predefined composition. A first user may provide information identifying a reference frame that defines a composition desired by the first user. The reference frame depicts a particular view of the real-world environment that the first user desires as the composition of the photo-to-be-taken by a second user. Based upon the reference frame and using augmented reality techniques, AR content is presented to a second user that guides the second user in positioning and orienting the image capture device such that the live view captured by the image capture device matches the particular view. When the live view aligns with the particular view, the second user may take a photo. The composition of such a photo matches the composition desired by the first user and represented by the reference frame.

Abstract: Techniques are disclosed for providing guidance information for guiding a user to capture an image according to a predefined composition. A first user may provide information identifying a reference frame that defines a composition desired by the first user. The reference frame depicts a particular view of the real-world environment that the first user desires as the composition of the photo-to-be-taken by a second user. Based upon the reference frame and using augmented reality techniques, AR content is presented to a second user that guides the second user in positioning and orienting the image capture device such that the live view captured by the image capture device matches the particular view. When the live view aligns with the particular view, the second user may take a photo. The composition of such a photo matches the composition desired by the first user and represented by the reference frame.

Abstract: Methods and apparatus for manipulating digital images. A warping module is described that enables the manipulation of a surface by selectively deforming portions of the surface while maintaining local rigidity. The user may position multiple control points on a surface to constrain deformation. The user may specify multiple properties (e.g., translation, rotation, depth, and scale) at each control point. A mesh may be overlaid on the surface. The warping module may perform an initialization in which the properties are propagated other vertices in the mesh to generate an initial deformed mesh. The warping module may then perform an iterative optimization operation on the deformed mesh to improve the deformation while retaining local rigidity. Thus, instead of moving every pixel in the surface, the warping module moves or adjusts coordinates of the vertices of the mesh. The surface is then deformed according to the deformed mesh.

Abstract: Methods and apparatus for manipulating digital images. A warping module is described that enables the manipulation of a surface by selectively deforming portions of the surface while maintaining local rigidity. The user may position multiple control points on a surface to constrain deformation. The user may specify multiple properties (e.g., translation, rotation, depth, and scale) at each control point. A mesh may be overlaid on the surface. The warping module may perform an initialization in which the properties are propagated other vertices in the mesh to generate an initial deformed mesh. The warping module may then perform an iterative optimization operation on the deformed mesh to improve the deformation while retaining local rigidity. Thus, instead of moving every pixel in the surface, the warping module moves or adjusts coordinates of the vertices of the mesh. The surface is then deformed according to the deformed mesh.

Abstract: Systems and methods are provided that allow a user to specify one or more areas of, e.g., a digital image, upon which perspective manipulation is to be applied. Once the one or more areas of the digital image have been specified, the user may specify one or more portions within the one or more areas, such as points, lines, etc., as being constrained in some manner. Thereafter, the user is able to manipulate perspective within the one or more specified areas in an intuitive and efficient manner.

Abstract: Methods and apparatus for manipulating digital images. A warping module is described that enables the manipulation of a surface by selectively deforming portions of the surface while maintaining local rigidity. The user may position multiple control points on a surface to constrain deformation. The user may specify multiple properties (e.g., translation, rotation, depth, and scale) at each control point. A mesh may be overlaid on the surface. The warping module may perform an initialization in which the properties are propagated other vertices in the mesh to generate an initial deformed mesh. The warping module may then perform an iterative optimization operation on the deformed mesh to improve the deformation while retaining local rigidity. Thus, instead of moving every pixel in the surface, the warping module moves or adjusts coordinates of the vertices of the mesh. The surface is then deformed according to the deformed mesh.

Abstract: Methods and apparatus for specifying complex continuous gradients. A field blur tool may provide a user interface through which users may apply instances of a field blur pattern. The field blur tool allows the user to place one, two, or more pins over the image and to specify the blur amount (blur radius) at each field blur pin. A blur algorithm distributes the blur values for the one or more instances of the field blur pattern over the entire image, applying the blur according to the locations of the pin(s) and blur parameters at the pin(s). If the input indicates the location and the value for the blur radius of each of two or more instances of the field blur pattern, the two or more instances of the field blur pattern are combined in a blur mask by multiplying normalized radius fields of each of the instances.

Abstract: Methods and apparatus for providing simultaneous, non-destructive blur patterns in an interactive environment. A blur module may render physically-realistic, spatially-varying blurs in digital images while at the same time giving users the flexibility to produce creative blur effects. The blur module may provide different types of blur patterns, including field blur, iris blur, and tilt-shift blur, all of which are available in a given session. Each different blur pattern can be combined with one or more of the other blur patterns non-destructively. Each blur pattern has a corresponding on-canvas user interface element or elements that can be manipulated for a live preview. A bokeh technique may be provided to create bokeh effects in digital images by simulating bokeh in the resultant blurred image. A selection bleed technique may be provided that allows the user to control bleeding at the edges of selections for any of the blur patterns.

Abstract: Methods and apparatus for creating bokeh effects in digital images. A bokeh technique is described that may provide double threshold image bokeh boosting. The bokeh effect may be controlled by a boost amount, an upper threshold value, and a lower threshold value. Colorfulness may be added to the bokeh effect applied to specular highlights according to a variable colorfulness value. A soft threshold may be implemented that results in most but not all energy of the boosting of the intensity falling between the upper and lower threshold values. The bokeh technique may achieve creative bokeh effects in digital images by simulating bokeh in the resultant blurred image. The bokeh technique may, for example, be used in combination with any of various blur patterns, and also may be used with combinations of two or more blur patterns.

Abstract: Methods and apparatus for controlling bleeding at the edges of a blur region or selection. A technique for aesthetically controlling the bleeding of blur introduced by blurring selections, referred to herein as a selection bleed technique, may enable continuous adjustment of the amount of bleeding of image blurs between a selected image region and its complement (the unselected region, e.g. the background). The selection bleed technique may allow selections to go from no-bleed to full-bleed and in between via a percentage indicated by one or more user interface elements, for example a slider.

Abstract: Systems, methods, and computer-readable storage media for editing the frequency content of an image may provide an intuitive interface for examining and/or modifying the frequency content. The methods may include accessing image data, performing a wavelet transform of the image data (or another MRA technique) to produce a time-frequency representation (TFR) of the image representing frequency content in multiple frequency bands, and displaying an indication of the frequency content of the image by displaying a sub-image of the TFR or numerical data representing the frequency content at selected pixels. In response to receiving input specifying a desired frequency content modification, the methods may include performing a Fourier transform of the image data to produce frequency content data, modifying the frequency content data, and performing an inverse transformation of the modified data to produce modified image data. The modification may be applied globally or to a selected portion of the image.

Abstract: Systems and methods are provided that allow a user to specify one or more areas of, e.g., a digital image, upon which perspective manipulation is to be applied. Once the one or more areas of the digital image have been specified, the user may specify one or more portions within the one or more areas, such as points, lines, etc., as being constrained in some manner. Thereafter, the user is able to manipulate perspective within the one or more specified areas in an intuitive and efficient manner.

Abstract: Systems, methods, and computer-readable storage media for resizing images using seam carving techniques are disclosed. The methods may facilitate efficient re-computation of the energy of an image between seam carving iterations in a resizing operation by re-computing only the energy of pixels and/or seams in the neighborhood of removed and/or replicated seams. The neighborhood and pixels for which energy values are updated may be dependent on the energy function employed by the seam carving techniques. The efficient re-computation of image energy may facilitate the use of seam carving techniques in user-interactive environments. The methods may also be used to pre-compute a retargeting matrix, usable in performing retargeting operations on an input image without re-computing the energy and/or the lowest cost seam(s) of the image between iterations.

Abstract: Various methods and apparatus for removing artifacts in frequency domain processing of light-field images are described. Methods for the reduction or removal of the artifacts are described that include methods that may be applied during frequency domain processing and a method that may be applied during post-processing of resultant angular views. The methods may be implemented in software as or in a light-field frequency domain processing module. The described methods include an oversampling method to determine the correct centers of slices, a phase multiplication method to determine the correct centers of slices, a method to exclude low-energy slices, and a cosmetic correction method.

Abstract: Systems, methods, and computer-readable storage media for resizing images using seam carving techniques may include generation of a partial solution matrix by at least partially isolating dependencies between sub-problems of a dynamic programming problem corresponding to its solution within different regions of an input image. The number and/or shape of the isolated (or partially isolated) sub-problems may be dependent on the access pattern used by a dynamic programming operation to identify seams in the input image. Multiple sub-problems may be processed independently and in parallel on respective processor core(s) or threads thereof to generate the partial solution matrix. The partial solution matrix may then be processed to identify one or more low-cost seams of the input image. The methods may be implemented as stand-alone applications or as program instructions implementing components of a graphics application, executable by a CPU and/or GPU configured for parallel processing.

Abstract: Method and apparatus for radiance processing by demultiplexing in the frequency domain. A frequency domain demultiplexing module obtains a radiance image captured with a lens-based radiance camera. The image includes optically mixed spatial and angular frequency components of light from a scene. The module performs frequency domain demultiplexing on the radiance image to generate multiple parallax views of the scene. The method may extract multiple slices at different angular frequencies from a Fourier transform of the radiance image, apply a Fourier transform to each of the multiple slices to generate intermediate images, stack the intermediate images to form a 3- or 4-dimensional image, apply an inverse Fourier transform along angular dimension(s) of the 3- or 4-dimensional image, and unstack the transformed 3- or 4-dimensional image to obtain the multiple parallax views. During the method, phase correction may be performed to determine the centers of the intermediate images.

Abstract: Methods and apparatus for specifying complex continuous gradients. A field blur tool may provide a user interface through which users may apply instances of a field blur pattern. The field blur tool allows the user to place one, two, or more pins over the image and to specify the blur amount (blur radius) at each field blur pin. A blur algorithm distributes the blur values for the one or more instances of the field blur pattern over the entire image, applying the blur according to the locations of the pin(s) and blur parameters at the pin(s). If the input indicates the location and the value for the blur radius of each of two or more instances of the field blur pattern, the two or more instances of the field blur pattern are combined in a blur mask by multiplying normalized radius fields of each of the instances.

Abstract: Methods and apparatus for creating bokeh effects in digital images. A bokeh technique is described that may provide double threshold image bokeh boosting. The bokeh effect may be controlled by a boost amount, an upper threshold value, and a lower threshold value. Colorfulness may be added to the bokeh effect applied to specular highlights according to a variable colorfulness value. A soft threshold may be implemented that results in most but not all energy of the boosting of the intensity falling between the upper and lower threshold values. The bokeh technique may achieve creative bokeh effects in digital images by simulating bokeh in the resultant blurred image. The bokeh technique may, for example, be used in combination with any of various blur patterns, and also may be used with combinations of two or more blur patterns.

Abstract: Methods and apparatus for providing simultaneous, non-destructive blur patterns in an interactive environment. A blur module may render physically-realistic, spatially-varying blurs in digital images while at the same time giving users the flexibility to produce creative blur effects. The blur module may provide different types of blur patterns, including field blur, iris blur, and tilt-shift blur, all of which are available in a given session. Each different blur pattern can be combined with one or more of the other blur patterns non-destructively. Each blur pattern has a corresponding on-canvas user interface element or elements that can be manipulated for a live preview. A bokeh technique may be provided to create bokeh effects in digital images by simulating bokeh in the resultant blurred image. A selection bleed technique may be provided that allows the user to control bleeding at the edges of selections for any of the blur patterns.

Abstract: Methods and apparatus for controlling bleeding at the edges of a blur region or selection. A technique for aesthetically controlling the bleeding of blur introduced by blurring selections, referred to herein as a selection bleed technique, may enable continuous adjustment of the amount of bleeding of image blurs between a selected image region and its complement (the unselected region, e.g. the background). The selection bleed technique may allow selections to go from no-bleed to full-bleed and in between via a percentage indicated by one or more user interface elements, for example a slider.