Patents by Inventor Kevin Wampler
Kevin Wampler has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11915133Abstract: Systems and methods seamlessly blend edited and unedited regions of an image. A computing system crops an input image around a region to be edited. The system applies an affine transformation to rotate the cropped input image. The system provides the rotated cropped input image as input to a machine learning model to generate a latent space representation of the rotated cropped input image. The system edits the latent space representation and provides the edited latent space representation to a generator neural network to generate a generated edited image. The system applies an inverse affine transformation to rotate the generated edited image and aligns an identified segment of the rotated generated edited image with an identified corresponding segment of the input image to produce an aligned rotated generated edited image. The system blends the aligned rotated generated edited image with the input image to generate an edited output image.Type: GrantFiled: September 7, 2021Date of Patent: February 27, 2024Assignee: Adobe Inc.Inventors: Ratheesh Kalarot, Kevin Wampler, Jingwan Lu, Jakub Fiser, Elya Shechtman, Aliakbar Darabi, Alexandru Vasile Costin
-
Patent number: 11907839Abstract: Systems and methods combine an input image with an edited image generated using a generator neural network to preserve detail from the original image. A computing system provides an input image to a machine learning model to generate a latent space representation of the input image. The system provides the latent space representation to a generator neural network to generate a generated image. The system generates multiple scale representations of the input image, as well as multiple scale representations of the generated image. The system generates a first combined image based on first scale representations of the images and a first value. The system generates a second combined image based on second scale representations of the images and a second value. The system blends the first combined image with the second combined image to generate an output image.Type: GrantFiled: September 7, 2021Date of Patent: February 20, 2024Assignee: Adobe Inc.Inventors: Ratheesh Kalarot, Kevin Wampler, Jingwan Lu, Jakub Fiser, Elya Shechtman, Aliakbar Darabi, Alexandru Vasile Costin
-
Patent number: 11756264Abstract: Embodiments are disclosed for receiving a target shape. The method may further include initializing a gradient mesh to a vector graphic having at least one node. The method may further include performing a constrained optimization of the vector graphic based on the target shape. The method may further include generating a stress metric based on a comparison of the constrained optimization and the target shape. The method may further include determining one or more unconstrained candidate vector graphics based on the stress metric. The method may further include selecting an improved vector graphic from the one or more unconstrained candidate vector graphics. The method may further include mapping the vector graphic to the improved vector graphic. The method may further include optimizing the improved vector graphic based on the target shape.Type: GrantFiled: November 23, 2021Date of Patent: September 12, 2023Assignee: Adobe Inc.Inventors: Chi Cheng Hsu, Michal Lukác, Michael Gharbi, Kevin Wampler
-
Patent number: 11694416Abstract: Embodiments of the present invention are directed towards intuitive editing of three-dimensional models. In embodiments, salient geometric features associated with a three-dimensional model defining an object are identified. Thereafter, feature attributes associated with the salient geometric features are identified. A feature set including a plurality of salient geometric features related to one another is generated based on the determined feature attributes (e.g., properties, relationships, distances). An editing handle can then be generated and displayed for the feature set enabling each of the salient geometric features within the feature set to be edited in accordance with a manipulation of the editing handle. The editing handle can be displayed in association with one of the salient geometric features of the feature set.Type: GrantFiled: March 22, 2021Date of Patent: July 4, 2023Assignee: Adobe, Inc.Inventors: Duygu Ceylan Aksit, Vladimir Kim, Siddhartha Chaudhuri, Radomir Mech, Noam Aigerman, Kevin Wampler, Jonathan Eisenmann, Giorgio Gori, Emiliano Gambaretto
-
Patent number: 11481619Abstract: Techniques for incorporating a black-box function into a neural network are described. For example, an image editing function may be the black-box function and may be wrapped into a layer of the neural network. A set of parameters and a source image are provided to the black-box function, and the output image that represents the source image with the set of parameters applied to the source image is output from the black-box function. To address the issue that the black-box function may not be differentiable, a loss optimization may calculate the gradients of the function using, for example, a finite differences calculation, and the gradients are used to train the neural network to ensure the output image is representative of an expected ground truth image.Type: GrantFiled: July 10, 2019Date of Patent: October 25, 2022Assignee: ADOBE INC.Inventors: Oliver Wang, Kevin Wampler, Kalyan Krishna Sunkavalli, Elya Shechtman, Siddhant Jain
-
Patent number: 11461947Abstract: Embodiments are disclosed for constrained modification of vector geometry. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a selection of a first segment of a vector graphic to be edited, identifying an active region associated with the first segment, wherein the active region includes the first segment and at least one second segment which comprise a geometric primitive, identifying the region of influence including at least one third segment connected to the active region, identifying at least one constraint associated with the active region or the region of influence based at least on the geometric primitive, receiving an edit to the active region, and generating an update for the vector graphic based on the edit and the at least one constraint.Type: GrantFiled: February 26, 2021Date of Patent: October 4, 2022Assignee: Adobe Inc.Inventors: Ashwani Chandil, Wilmot Li, Vineet Batra, Matthew David Fisher, Kevin Wampler, Daniel Kaufman, Ankit Phogat
-
Publication number: 20220277501Abstract: Embodiments are disclosed for constrained modification of vector geometry. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a selection of a first segment of a vector graphic to be edited, identifying an active region associated with the first segment, wherein the active region includes the first segment and at least one second segment which comprise a geometric primitive, identifying the region of influence including at least one third segment connected to the active region, identifying at least one constraint associated with the active region or the region of influence based at least on the geometric primitive, receiving an edit to the active region, and generating an update for the vector graphic based on the edit and the at least one constraint.Type: ApplicationFiled: February 26, 2021Publication date: September 1, 2022Inventors: Ashwani CHANDIL, Wilmot LI, Vineet BATRA, Matthew David FISHER, Kevin WAMPLER, Daniel KAUFMAN, Ankit PHOGAT
-
Publication number: 20220122307Abstract: Systems and methods combine an input image with an edited image generated using a generator neural network to preserve detail from the original image. A computing system provides an input image to a machine learning model to generate a latent space representation of the input image. The system provides the latent space representation to a generator neural network to generate a generated image. The system generates multiple scale representations of the input image, as well as multiple scale representations of the generated image. The system generates a first combined image based on first scale representations of the images and a first value. The system generates a second combined image based on second scale representations of the images and a second value. The system blends the first combined image with the second combined image to generate an output image.Type: ApplicationFiled: September 7, 2021Publication date: April 21, 2022Inventors: Ratheesh Kalarot, Kevin Wampler, Jingwan Lu, Jakub Fiser, Elya Shechtman, Aliakbar Darabi, Alexandru Vasile Costin
-
Publication number: 20220122308Abstract: Systems and methods seamlessly blend edited and unedited regions of an image. A computing system crops an input image around a region to be edited. The system applies an affine transformation to rotate the cropped input image. The system provides the rotated cropped input image as input to a machine learning model to generate a latent space representation of the rotated cropped input image. The system edits the latent space representation and provides the edited latent space representation to a generator neural network to generate a generated edited image. The system applies an inverse affine transformation to rotate the generated edited image and aligns an identified segment of the rotated generated edited image with an identified corresponding segment of the input image to produce an aligned rotated generated edited image. The system blends the aligned rotated generated edited image with the input image to generate an edited output image.Type: ApplicationFiled: September 7, 2021Publication date: April 21, 2022Inventors: Ratheesh Kalarot, Kevin Wampler, Jingwan Lu, Jakub Fiser, Elya Shechtman, Aliakbar Darabi, Alexandru Vasile Costin
-
Patent number: 11164355Abstract: Systems and methods for editing an image based on multiple constraints are described. Embodiments of the systems and methods may identify a change to a vector graphics data structure, generate an update for the vector graphics data structure based on strictly enforcing a handle constraint, a binding constraint, and a continuity constraint, adjust the vector graphics data structure sequentially for each of a plurality of sculpting constraints according to a priority ordering of the sculpting constraints, generate an additional update for the vector graphics data structure based on strictly enforcing the binding constraint and the continuity constraint and approximately enforcing the handle constraint and the sculpting constraints, adjust the vector graphics data structure sequentially for each of a plurality of sculpting constraints, and display the vector graphic based on the adjusted vector graphics data structure.Type: GrantFiled: April 23, 2020Date of Patent: November 2, 2021Assignee: ADOBE INC.Inventors: Ankit Phogat, Kevin Wampler, Wilmot Li, Matthew David Fisher, Vineet Batra, Daniel Kaufman
-
Publication number: 20210335026Abstract: Systems and methods for editing an image based on multiple constraints are described. Embodiments of the systems and methods may identify a change to a vector graphics data structure, generate an update for the vector graphics data structure based on strictly enforcing a handle constraint, a binding constraint, and a continuity constraint, adjust the vector graphics data structure sequentially for each of a plurality of sculpting constraints according to a priority ordering of the sculpting constraints, generate an additional update for the vector graphics data structure based on strictly enforcing the binding constraint and the continuity constraint and approximately enforcing the handle constraint and the sculpting constraints, adjust the vector graphics data structure sequentially for each of a plurality of sculpting constraints, and display the vector graphic based on the adjusted vector graphics data structure.Type: ApplicationFiled: April 23, 2020Publication date: October 28, 2021Inventors: ANKIT PHOGAT, KEVIN WAMPLER, WILMOT LI, MATTHEW DAVID FISHER, VINEET BATRA, DANIEL KAUFMAN
-
Publication number: 20210256775Abstract: Embodiments of the present invention are directed towards intuitive editing of three-dimensional models. In embodiments, salient geometric features associated with a three-dimensional model defining an object are identified. Thereafter, feature attributes associated with the salient geometric features are identified. A feature set including a plurality of salient geometric features related to one another is generated based on the determined feature attributes (e.g., properties, relationships, distances). An editing handle can then be generated and displayed for the feature set enabling each of the salient geometric features within the feature set to be edited in accordance with a manipulation of the editing handle. The editing handle can be displayed in association with one of the salient geometric features of the feature set.Type: ApplicationFiled: March 22, 2021Publication date: August 19, 2021Inventors: Duygu Ceylan Aksit, Vladimir Kim, Siddhartha Chaudhuri, Radomir Mech, Noam Aigerman, Kevin Wampler, Jonathan Eisenmann, Giorgio Gori, Emiliano Gambaretto
-
Patent number: 10957117Abstract: Embodiments of the present invention are directed towards intuitive editing of three-dimensional models. In embodiments, salient geometric features associated with a three-dimensional model defining an object are identified. Thereafter, feature attributes associated with the salient geometric features are identified. A feature set including a plurality of salient geometric features related to one another is generated based on the determined feature attributes (e.g., properties, relationships, distances). An editing handle can then be generated and displayed for the feature set enabling each of the salient geometric features within the feature set to be edited in accordance with a manipulation of the editing handle. The editing handle can be displayed in association with one of the salient geometric features of the feature set.Type: GrantFiled: November 29, 2018Date of Patent: March 23, 2021Assignee: Adobe Inc.Inventors: Duygu Ceylan Aksit, Vladimir Kim, Siddhartha Chaudhuri, Radomir Mech, Noam Aigerman, Kevin Wampler, Jonathan Eisenmann, Giorgio Gori, Emiliano Gambaretto
-
Publication number: 20210012189Abstract: Techniques for incorporating a black-box function into a neural network are described. For example, an image editing function may be the black-box function and may be wrapped into a layer of the neural network. A set of parameters and a source image are provided to the black-box function, and the output image that represents the source image with the set of parameters applied to the source image is output from the black-box function. To address the issue that the black-box function may not be differentiable, a loss optimization may calculate the gradients of the function using, for example, a finite differences calculation, and the gradients are used to train the neural network to ensure the output image is representative of an expected ground truth image.Type: ApplicationFiled: July 10, 2019Publication date: January 14, 2021Inventors: Oliver Wang, Kevin Wampler, Kalyan Krishna Sunkavalli, Elya Shechtman, Siddhant Jain
-
Publication number: 20200118347Abstract: Embodiments of the present invention are directed towards intuitive editing of three-dimensional models. In embodiments, salient geometric features associated with a three-dimensional model defining an object are identified. Thereafter, feature attributes associated with the salient geometric features are identified. A feature set including a plurality of salient geometric features related to one another is generated based on the determined feature attributes (e.g., properties, relationships, distances). An editing handle can then be generated and displayed for the feature set enabling each of the salient geometric features within the feature set to be edited in accordance with a manipulation of the editing handle. The editing handle can be displayed in association with one of the salient geometric features of the feature set.Type: ApplicationFiled: November 29, 2018Publication date: April 16, 2020Inventors: Duygu Ceylan Aksit, Vladimir Kim, Siddhartha Chaudhuri, Radomir Mech, Noam Aigerman, Kevin Wampler, Jonathan Eisenmann, Giorgio Gori, Emiliano Gambaretto
-
Patent number: 10600243Abstract: The present disclosure includes methods and systems for manipulating digital models based on user input. In particular, disclosed systems and methods can generate modified meshes in real time based on a plurality of input meshes and user manipulation of one or more control points. For example, one or more embodiments of the disclosed systems and methods generate modified meshes from a plurality of input meshes based on a combined shape-space, deformation interpolation measure. Moreover, in one or more embodiments, the disclosed systems and methods utilize an as-rigid-as-possible-deformation measure to combine input meshes into a modified mesh. Further, the disclosed systems and methods can variably combine input shapes over different portions of a modified mesh, providing increased expressiveness while reducing artifacts and increasing computing efficiency.Type: GrantFiled: October 3, 2018Date of Patent: March 24, 2020Assignee: ADOBE INC.Inventor: Kevin Wampler
-
Patent number: 10586311Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for improved patch validity testing for patch-based synthesis applications using similarity transforms. The improved patch validity tests are used to validate (or invalidate) candidate patches as valid patches falling within a sampling region of a source image. The improved patch validity tests include a hole dilation test for patch validity, a no-dilation test for patch invalidity, and a comprehensive pixel test for patch invalidity. A fringe test for range invalidity can be used to identify pixels with an invalid range and invalidate corresponding candidate patches. The fringe test for range invalidity can be performed as a precursor to any or all of the improved patch validity tests. In this manner, validated candidate patches are used to automatically reconstruct a target image.Type: GrantFiled: March 14, 2018Date of Patent: March 10, 2020Assignee: Adobe Inc.Inventors: Sohrab Amirghodsi, Kevin Wampler, Elya Shechtman, Aliakbar Darabi
-
Publication number: 20190287225Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for improved patch validity testing for patch-based synthesis applications using similarity transforms. The improved patch validity tests are used to validate (or invalidate) candidate patches as valid patches falling within a sampling region of a source image. The improved patch validity tests include a hole dilation test for patch validity, a no-dilation test for patch invalidity, and a comprehensive pixel test for patch invalidity. A fringe test for range invalidity can be used to identify pixels with an invalid range and invalidate corresponding candidate patches. The fringe test for range invalidity can be performed as a precursor to any or all of the improved patch validity tests. In this manner, validated candidate patches are used to automatically reconstruct a target image.Type: ApplicationFiled: March 14, 2018Publication date: September 19, 2019Inventors: Sohrab Amirghodsi, Kevin Wampler, Elya Shechtman, Aliakbar Darabi
-
Patent number: 10217262Abstract: Systems and methods disclosed herein improve the quality and speed of computing deformations used to animate artwork. One aspect provides adaptive meshing that creates a mesh adapted to handle locations and weights associating the handles with the mesh vertices. Portions of the mesh requiring smaller triangles with more densely positioned vertices are identified based on the handle locations and associated weights and resolution is added only to those portions of the mesh in which finer resolution is required. A second aspect involves creating a mesh using a coarse-to-fine iterative approach. This involves generating a mesh and the weights associating each handle to each vertex in the mesh and iteratively refining the mesh to add resolution until a refinement criteria is satisfied.Type: GrantFiled: November 27, 2017Date of Patent: February 26, 2019Assignee: Adobe Systems IncorporatedInventor: Kevin Wampler
-
Publication number: 20190035151Abstract: The present disclosure includes methods and systems for manipulating digital models based on user input. In particular, disclosed systems and methods can generate modified meshes in real time based on a plurality of input meshes and user manipulation of one or more control points. For example, one or more embodiments of the disclosed systems and methods generate modified meshes from a plurality of input meshes based on a combined shape-space, deformation interpolation measure. Moreover, in one or more embodiments, the disclosed systems and methods utilize an as-rigid-as-possible-deformation measure to combine input meshes into a modified mesh. Further, the disclosed systems and methods can variably combine input shapes over different portions of a modified mesh, providing increased expressiveness while reducing artifacts and increasing computing efficiency.Type: ApplicationFiled: October 3, 2018Publication date: January 31, 2019Inventor: Kevin Wampler