Patents by Inventor Jakub Fiser
Jakub Fiser has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11915133Abstract: Systems and methods seamlessly blend edited and unedited regions of an image. A computing system crops an input image around a region to be edited. The system applies an affine transformation to rotate the cropped input image. The system provides the rotated cropped input image as input to a machine learning model to generate a latent space representation of the rotated cropped input image. The system edits the latent space representation and provides the edited latent space representation to a generator neural network to generate a generated edited image. The system applies an inverse affine transformation to rotate the generated edited image and aligns an identified segment of the rotated generated edited image with an identified corresponding segment of the input image to produce an aligned rotated generated edited image. The system blends the aligned rotated generated edited image with the input image to generate an edited output image.Type: GrantFiled: September 7, 2021Date of Patent: February 27, 2024Assignee: Adobe Inc.Inventors: Ratheesh Kalarot, Kevin Wampler, Jingwan Lu, Jakub Fiser, Elya Shechtman, Aliakbar Darabi, Alexandru Vasile Costin
-
Patent number: 11907839Abstract: Systems and methods combine an input image with an edited image generated using a generator neural network to preserve detail from the original image. A computing system provides an input image to a machine learning model to generate a latent space representation of the input image. The system provides the latent space representation to a generator neural network to generate a generated image. The system generates multiple scale representations of the input image, as well as multiple scale representations of the generated image. The system generates a first combined image based on first scale representations of the images and a first value. The system generates a second combined image based on second scale representations of the images and a second value. The system blends the first combined image with the second combined image to generate an output image.Type: GrantFiled: September 7, 2021Date of Patent: February 20, 2024Assignee: Adobe Inc.Inventors: Ratheesh Kalarot, Kevin Wampler, Jingwan Lu, Jakub Fiser, Elya Shechtman, Aliakbar Darabi, Alexandru Vasile Costin
-
Publication number: 20230360299Abstract: Face anonymization techniques are described that overcome conventional challenges to generate an anonymized face. In one example, a digital object editing system is configured to generate an anonymized face based on a target face and a reference face. As part of this, the digital object editing system employs an encoder as part of machine learning to extract a target encoding of the target face image and a reference encoding of the reference face. The digital object editing system then generates a mixed encoding from the target and reference encodings. The mixed encoding is employed by a machine-learning model of the digital object editing system to generate a mixed face. An object replacement module is used by the digital object editing system to replace the target face in the target digital image with the mixed face.Type: ApplicationFiled: July 21, 2023Publication date: November 9, 2023Applicant: Adobe Inc.Inventors: Yang Yang, Zhixin Shu, Shabnam Ghadar, Jingwan Lu, Jakub Fiser, Elya Schechtman, Cameron Y. Smith, Baldo Antonio Faieta, Alex Charles Filipkowski
-
Patent number: 11748928Abstract: Face anonymization techniques are described that overcome conventional challenges to generate an anonymized face. In one example, a digital object editing system is configured to generate an anonymized face based on a target face and a reference face. As part of this, the digital object editing system employs an encoder as part of machine learning to extract a target encoding of the target face image and a reference encoding of the reference face. The digital object editing system then generates a mixed encoding from the target and reference encodings. The mixed encoding is employed by a machine-learning model of the digital object editing system to generate a mixed face. An object replacement module is used by the digital object editing system to replace the target face in the target digital image with the mixed face.Type: GrantFiled: November 10, 2020Date of Patent: September 5, 2023Assignee: Adobe Inc.Inventors: Yang Yang, Zhixin Shu, Shabnam Ghadar, Jingwan Lu, Jakub Fiser, Elya Schechtman, Cameron Y. Smith, Baldo Antonio Faieta, Alex Charles Filipkowski
-
Patent number: 11657552Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing ray-tracing and mesh generation to illuminate two-dimensional digital vector images. In response to inserting a light source into a two-dimensional digital vector image including one or more vector elements, the disclosed system embeds the vector element(s) into a polygonal mesh generated for a region of the digital vector image. The disclosed system samples a plurality of rays at a plurality of points within the region and detect intersections of the rays with the vector element(s) or a bounding shape surrounding the region. Additionally, the disclosed system determines color values for mesh points in the polygonal mesh based on the intersections of the rays by interpolating color values associated with the intersected points. Furthermore, in some embodiments, the disclosed system subdivides the polygonal mesh according to a priority queue based on error scores associated with the determined color values.Type: GrantFiled: October 7, 2021Date of Patent: May 23, 2023Assignee: Adobe Inc.Inventors: Jakub Fiser, Ankit Phogat, Vineet Batra
-
Publication number: 20230110680Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing ray-tracing and mesh generation to illuminate two-dimensional digital vector images. In response to inserting a light source into a two-dimensional digital vector image including one or more vector elements, the disclosed system embeds the vector element(s) into a polygonal mesh generated for a region of the digital vector image. The disclosed system samples a plurality of rays at a plurality of points within the region and detect intersections of the rays with the vector element(s) or a bounding shape surrounding the region. Additionally, the disclosed system determines color values for mesh points in the polygonal mesh based on the intersections of the rays by interpolating color values associated with the intersected points. Furthermore, in some embodiments, the disclosed system subdivides the polygonal mesh according to a priority queue based on error scores associated with the determined color values.Type: ApplicationFiled: October 7, 2021Publication date: April 13, 2023Inventors: Jakub Fiser, Ankit Phogat, Vineet Batra
-
Publication number: 20220148243Abstract: Face anonymization techniques are described that overcome conventional challenges to generate an anonymized face. In one example, a digital object editing system is configured to generate an anonymized face based on a target face and a reference face. As part of this, the digital object editing system employs an encoder as part of machine learning to extract a target encoding of the target face image and a reference encoding of the reference face. The digital object editing system then generates a mixed encoding from the target and reference encodings. The mixed encoding is employed by a machine-learning model of the digital object editing system to generate a mixed face. An object replacement module is used by the digital object editing system to replace the target face in the target digital image with the mixed face.Type: ApplicationFiled: November 10, 2020Publication date: May 12, 2022Applicant: Adobe Inc.Inventors: Yang Yang, Zhixin Shu, Shabnam Ghadar, Jingwan Lu, Jakub Fiser, Elya Schechtman, Cameron Y. Smith, Baldo Antonio Faieta, Alex Charles Filipkowski
-
Publication number: 20220122308Abstract: Systems and methods seamlessly blend edited and unedited regions of an image. A computing system crops an input image around a region to be edited. The system applies an affine transformation to rotate the cropped input image. The system provides the rotated cropped input image as input to a machine learning model to generate a latent space representation of the rotated cropped input image. The system edits the latent space representation and provides the edited latent space representation to a generator neural network to generate a generated edited image. The system applies an inverse affine transformation to rotate the generated edited image and aligns an identified segment of the rotated generated edited image with an identified corresponding segment of the input image to produce an aligned rotated generated edited image. The system blends the aligned rotated generated edited image with the input image to generate an edited output image.Type: ApplicationFiled: September 7, 2021Publication date: April 21, 2022Inventors: Ratheesh Kalarot, Kevin Wampler, Jingwan Lu, Jakub Fiser, Elya Shechtman, Aliakbar Darabi, Alexandru Vasile Costin
-
Publication number: 20220122307Abstract: Systems and methods combine an input image with an edited image generated using a generator neural network to preserve detail from the original image. A computing system provides an input image to a machine learning model to generate a latent space representation of the input image. The system provides the latent space representation to a generator neural network to generate a generated image. The system generates multiple scale representations of the input image, as well as multiple scale representations of the generated image. The system generates a first combined image based on first scale representations of the images and a first value. The system generates a second combined image based on second scale representations of the images and a second value. The system blends the first combined image with the second combined image to generate an output image.Type: ApplicationFiled: September 7, 2021Publication date: April 21, 2022Inventors: Ratheesh Kalarot, Kevin Wampler, Jingwan Lu, Jakub Fiser, Elya Shechtman, Aliakbar Darabi, Alexandru Vasile Costin
-
Patent number: 10997754Abstract: Freeform drawing beautification techniques are described. An input is received by a computing device describing a freeform path drawn by a user as part of a drawing, the freeform path not formed solely as a circular arc or a circle (e.g., a fixed distance from a point) and including one or more curved elements. The drawing is examined by the computing device to locate another curved element in the drawing. One or more suggestions are constructed to adjust the freeform path by the computing device based on the located curved element in the drawing. The constructed one or more suggestions are output to adjust the freeform path by the computing device.Type: GrantFiled: May 27, 2015Date of Patent: May 4, 2021Assignee: Adobe Inc.Inventors: Paul J. Asente, Jakub Fiser
-
Patent number: 10825224Abstract: Certain embodiments involve automatically detecting video frames that depict visemes and that are usable for generating an animatable puppet. For example, a computing device accesses video frames depicting a person performing gestures usable for generating a layered puppet, including a viseme gesture corresponding to a target sound or phoneme. The computing device determines that audio data including the target sound or phoneme aligns with a particular video frame from the video frames that depicts the person performing the viseme gesture. The computing device creates, from the video frames, a puppet animation of the gestures, including an animation of the viseme corresponding to the target sound or phoneme that is generated from the particular video frame. The computing device outputs the puppet animation to a presentation device.Type: GrantFiled: November 20, 2018Date of Patent: November 3, 2020Assignee: Adobe Inc.Inventors: Geoffrey Heller, Jakub Fiser, David P. Simons
-
Patent number: 10783691Abstract: Certain embodiments involve generating one or more of appearance guide and a positional guide and using one or more of the guides to synthesize a stylized image or animation. For example, a system obtains data indicating a target image and a style exemplar image. The system generates an appearance guide, a positional guide, or both from the target image and the style exemplar image. The system uses one or more of the guides to transfer a texture or style from the style exemplar image to the target image.Type: GrantFiled: November 12, 2019Date of Patent: September 22, 2020Assignees: ADOBE INC., CZECH TECHNICAL UNIVERSITY IN PRAGUEInventors: David Simons, Michal Lukac, Daniel Sykora, Elya Shechtman, Paul Asente, Jingwan Lu, Jakub Fiser, Ondrej Jamriska
-
Patent number: 10762674Abstract: Embodiments of the present invention are directed to beautifying freeform input paths in accordance with paths existing in the drawing (i.e., resolved paths). In some embodiments of the present invention, freeform input paths of a curved format can be modified or replaced to more precisely illustrate a path desired by a user. As such, a user can provide a freeform input path that resembles a path of interest by the user, but is not as precise as desired. Based on existing paths in the electronic drawing, a path suggestion(s) can be generated to rectify, modify, or replace the input path with a more precise path. In some cases, a user can then select a desired path suggestion, and the selected path then replaces the initially provided freeform input path.Type: GrantFiled: January 27, 2020Date of Patent: September 1, 2020Assignee: Adobe Inc.Inventors: Paul John Asente, Stephen Schiller, Jakub Fiser
-
Publication number: 20200160581Abstract: Certain embodiments involve automatically detecting video frames that depict visemes and that are usable for generating an animatable puppet. For example, a computing device accesses video frames depicting a person performing gestures usable for generating a layered puppet, including a viseme gesture corresponding to a target sound or phoneme. The computing device determines that audio data including the target sound or phoneme aligns with a particular video frame from the video frames that depicts the person performing the viseme gesture. The computing device creates, from the video frames, a puppet animation of the gestures, including an animation of the viseme corresponding to the target sound or phoneme that is generated from the particular video frame. The computing device outputs the puppet animation to a presentation device.Type: ApplicationFiled: November 20, 2018Publication date: May 21, 2020Inventors: Geoffrey Heller, Jakub Fiser, David P. Simons
-
Publication number: 20200160570Abstract: Embodiments of the present invention are directed to beautifying freeform input paths in accordance with paths existing in the drawing (i.e., resolved paths). In some embodiments of the present invention, freeform input paths of a curved format can be modified or replaced to more precisely illustrate a path desired by a user. As such, a user can provide a freeform input path that resembles a path of interest by the user, but is not as precise as desired. Based on existing paths in the electronic drawing, a path suggestion(s) can be generated to rectify, modify, or replace the input path with a more precise path. In some cases, a user can then select a desired path suggestion, and the selected path then replaces the initially provided freeform input path.Type: ApplicationFiled: January 27, 2020Publication date: May 21, 2020Inventors: Paul John Asente, Stephen Schiller, Jakub Fiser
-
Patent number: 10621759Abstract: Embodiments of the present invention are directed to beautifying freeform input paths in accordance with paths existing in the drawing (i.e., resolved paths). In some embodiments of the present invention, freeform input paths of a curved format can be modified or replaced to more precisely illustrate a path desired by a user. As such, a user can provide a freeform input path that resembles a path of interest by the user, but is not as precise as desired. Based on existing paths in the electronic drawing, a path suggestion(s) can be generated to rectify, modify, or replace the input path with a more precise path. In some cases, a user can then select a desired path suggestion, and the selected path then replaces the initially provided freeform input path.Type: GrantFiled: April 25, 2018Date of Patent: April 14, 2020Assignee: Adobe Inc.Inventors: Paul John Asente, Stephen Schiller, Jakub Fiser
-
Publication number: 20200082591Abstract: Certain embodiments involve generating one or more of appearance guide and a positional guide and using one or more of the guides to synthesize a stylized image or animation. For example, a system obtains data indicating a target image and a style exemplar image. The system generates an appearance guide, a positional guide, or both from the target image and the style exemplar image. The system uses one or more of the guides to transfer a texture or style from the style exemplar image to the target image.Type: ApplicationFiled: November 12, 2019Publication date: March 12, 2020Inventors: David Simons, Michal Lukac, Daniel Sykora, Elya Shechtman, Paul Asente, Jingwan Lu, Jakub Fiser, Ondrej Jamriska
-
Patent number: 10586356Abstract: Embodiments of the present invention are directed to beautifying freeform input paths in accordance with paths existing in the drawing (i.e., resolved paths). In some embodiments of the present invention, freeform input paths of a curved format can be modified or replaced to more precisely illustrate a path desired by a user. As such, a user can provide a freeform input path that resembles a path of interest by the user, but is not as precise as desired. Based on existing paths in the electronic drawing, a path suggestion(s) can be generated to rectify, modify, or replace the input path with a more precise path. In some cases, a user can then select a desired path suggestion, and the selected path then replaces the initially provided freeform input path.Type: GrantFiled: April 25, 2018Date of Patent: March 10, 2020Assignee: Adobe Inc.Inventors: Paul John Asente, Stephen Schiller, Jakub Fiser
-
Patent number: 10504267Abstract: Certain embodiments involve generating an appearance guide, a segmentation guide, and a positional guide and using one or more of the guides to synthesize a stylized image or animation. For example, a system obtains data indicating a target and a style exemplar image and generates a segmentation guide for segmenting the target image and the style exemplar image and identifying a feature of the target image and a corresponding feature of the style exemplar image. The system generates a positional guide for determining positions of the target feature and style feature relative to a common grid system. The system generates an appearance guide for modifying intensity levels and contrast values in the target image based on the style exemplar image. The system uses one or more of the guides to transfer a texture of the style feature to the corresponding target feature.Type: GrantFiled: October 16, 2017Date of Patent: December 10, 2019Assignee: Adobe Inc.Inventors: David Simons, Michal Lukac, Daniel Sykora, Elya Shechtman, Paul Asente, Jingwan Lu, Jakub Fiser, Ondrej Jamriska
-
Patent number: 10489959Abstract: Certain embodiments involve automatically generating a layered animatable puppet using a content stream. For example, a system identifies various frames of a content stream that includes a character performing various gestures usable for generating a layered puppet. The system separates the various frames of the content stream into various individual layers. The system extracts a face of the character from the various individual layers and creates the layered puppet by combining the individual layers and using the face of the character. The system can output the layered puppet for animation to perform a gesture of the various gestures.Type: GrantFiled: October 17, 2017Date of Patent: November 26, 2019Assignee: Adobe Inc.Inventors: David Simons, Jakub Fiser