Patents by Inventor Hyunghwan Byun
Hyunghwan Byun has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11776184Abstract: The present disclosure provides systems and methods for image editing. Embodiments of the present disclosure provide an image editing system for perform image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. The original image and the replacement image (e.g., the image including a desirable object or region) include layers of masks. A sky from the replacement image may replace the sky of the image to produce an aesthetically pleasing composite image.Type: GrantFiled: March 17, 2021Date of Patent: October 3, 2023Assignee: ADOBE, INC.Inventors: Jianming Zhang, Alan Erickson, I-Ming Pao, Guotong Feng, Kalyan Sunkavalli, Frederick Mandia, Hyunghwan Byun, Betty Leong, Meredith Payne Stotzner, Yukie Takahashi, Quynn Megan Le, Sarah Kong
-
Patent number: 11645788Abstract: Systems and methods for image editing are described. Embodiments of the present disclosure provide an image editing system for performing image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. According to some embodiments described herein, thumbnails, region location information, and image metadata from multiple preset images can be stored together and loaded for presentation and selection of a preset image for replacing a region of an image. Once a preset image (e.g., an image with a replacement sky) is selected, a high-resolution version of the image can be loaded and used to generate a composite image.Type: GrantFiled: April 19, 2021Date of Patent: May 9, 2023Assignee: ADOBE INC.Inventors: Guotong Feng, Alan Erickson, I-Ming Pao, Betty Leong, Hyunghwan Byun
-
Publication number: 20230129341Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generate preliminary object masks for objects in an image, surface the preliminary object masks as object mask previews, and on-demand converts preliminary object masks into refined object masks. Indeed, in one or more implementations, an object mask preview and on-demand generation system automatically detects objects in an image. For the detected objects, the object mask preview and on-demand generation system generates preliminary object masks for the detected objects of a first lower resolution. The object mask preview and on-demand generation system surfaces a given preliminary object mask in response to detecting a first input. The object mask preview and on-demand generation system also generates a refined object mask of a second higher resolution in response to detecting a second input.Type: ApplicationFiled: January 25, 2022Publication date: April 27, 2023Inventors: Betty Leong, Hyunghwan Byun, Alan L Erickson, Chih-Yao Hsieh, Sarah Kong, Seyed Morteza Safdarnejad, Salil Tambe, Yilin Wang, Zijun Wei, Zhengyun Zhang
-
Publication number: 20230037276Abstract: Systems and methods for image editing are described. Embodiments of the present disclosure provide an image editing system for performing image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. According to some embodiments described herein, thumbnails, region location information, and image metadata from multiple preset images can be stored together and loaded for presentation and selection of a preset image for replacing a region of an image. Once a preset image (e.g., an image with a replacement sky) is selected, a high-resolution version of the image can be loaded and used to generate a composite image.Type: ApplicationFiled: April 19, 2021Publication date: February 2, 2023Inventors: Guotong Feng, Alan Erickson, I-Ming Pao, Betty Leong, Hyunghwan Byun
-
Publication number: 20230005197Abstract: The present disclosure provides systems and methods for image editing. Embodiments of the present disclosure provide an image editing system for perform image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. The original image and the replacement image (e.g., the image including a desirable object or region) include layers of masks. A sky from the replacement image may replace the sky of the image to produce an aesthetically pleasing composite image.Type: ApplicationFiled: March 17, 2021Publication date: January 5, 2023Inventors: JIANMING ZHANG, Alan Erickson, I-Ming Pao, Guotong Feng, Kalyan Sunkavalli, Frederick Mandia, Hyunghwan Byun, Betty Leong, Meredith Payne Stotzner, Yukie Takahashi, Quynn Megan Le, Sarah Kong
-
Publication number: 20220335659Abstract: Systems and methods for image editing are described. Embodiments of the present disclosure provide an image editing system for performing image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. According to some embodiments described herein, thumbnails, region location information, and image metadata from multiple preset images can be stored together and loaded for presentation and selection of a preset image for replacing a region of an image. Once a preset image (e.g., an image with a replacement sky) is selected, a high-resolution version of the image can be loaded and used to generate a composite image.Type: ApplicationFiled: April 19, 2021Publication date: October 20, 2022Inventors: Guotong Feng, Alan Erickson, I-Ming Pao, Betty Leong, Hyunghwan Byun
-
Patent number: 11468614Abstract: Methods and systems are provided for presenting and using multiple masks based on a segmented image in editing the image. In particular, multiple masks can be presented to a user using a graphical user interface for easy selection and utilization in the editing of an image. The graphical user interface can include a display configured to display an image, a mask zone configured to display segmentations of the image using masks, and an edit zone configured to display edits to the image. Upon receiving segmentation for the image, the masks can be displayed in the mask zone where the masks are based on a selected segmentation detail level.Type: GrantFiled: March 28, 2021Date of Patent: October 11, 2022Assignee: Adobe Inc.Inventors: Sarah Aye Kong, I-Ming Pao, Hyunghwan Byun
-
Publication number: 20220301243Abstract: The present disclosure provides systems and methods for image editing. Embodiments of the present disclosure provide an image editing system for perform image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. The original image and the replacement image (e.g., the image including a desirable object or region) include layers of masks. A sky from the replacement image may replace the sky of the image to produce an aesthetically pleasing composite image.Type: ApplicationFiled: March 17, 2021Publication date: September 22, 2022Inventors: JIANMING ZHANG, Alan Erickson, I-Ming Pao, Guotong Feng, Kalyan Sunkavalli, Frederick Mandia, Hyunghwan Byun, Betty Leong, Meredith Payne Stotzner, Yukie Takahashi, Quynn Megan Le, Sarah Kong
-
Patent number: 11257491Abstract: This application relates generally to modifying visual data based on audio commands and more specifically, to performing complex operations that modify visual data based on one or more audio commands. In some embodiments, a computer system may receive an audio input and identify an audio command based on the audio input. The audio command may be mapped to one or more operations capable of being performed by a multimedia editing application. The computer system may perform the one or more operations to edit to received multimedia data.Type: GrantFiled: November 29, 2018Date of Patent: February 22, 2022Assignee: ADOBE INC.Inventors: Sarah Kong, Yinglan Ma, Hyunghwan Byun, Chih-Yao Hsieh
-
Publication number: 20210217216Abstract: Methods and systems are provided for presenting and using multiple masks based on a segmented image in editing the image. In particular, multiple masks can be presented to a user using a graphical user interface for easy selection and utilization in the editing of an image. The graphical user interface can include a display configured to display an image, a mask zone configured to display segmentations of the image using masks, and an edit zone configured to display edits to the image. Upon receiving segmentation for the image, the masks can be displayed in the mask zone where the masks are based on a selected segmentation detail level.Type: ApplicationFiled: March 28, 2021Publication date: July 15, 2021Applicant: Adobe Inc.Inventors: Sarah Aye Kong, I-Ming Pao, Hyunghwan Byun
-
Patent number: 11042990Abstract: Systems and techniques for automatic object replacement in an image include receiving an original image and a preferred image. The original image is automatically segmented into an original image foreground region and an original image object region. The preferred image is automatically segmented into a preferred image foreground region and a preferred image object region. A composite image is automatically composed by replacing the original image object region with the preferred image object region such that the composite image includes the original image foreground region and the preferred image object region. An attribute of the composite image is automatically adjusted.Type: GrantFiled: October 31, 2018Date of Patent: June 22, 2021Assignee: ADOBE INC.Inventors: I-Ming Pao, Sarah Aye Kong, Alan Lee Erickson, Kalyan Sunkavalli, Hyunghwan Byun
-
Patent number: 10977844Abstract: Methods and systems are provided for presenting and using multiple masks based on a segmented image in editing the image. In particular, multiple masks can be presented to a user using a graphical user interface for easy selection and utilization in the editing of an image. The graphical user interface can include a display configured to display an image, a mask zone configured to display segmentations of the image using masks, and an edit zone configured to display edits to the image. Upon receiving segmentation for the image, the masks can be displayed in the mask zone where the masks are based on a selected segmentation detail level.Type: GrantFiled: November 29, 2017Date of Patent: April 13, 2021Assignee: Adobe Inc.Inventors: Sarah Aye Kong, I-Ming Pao, Hyunghwan Byun
-
Patent number: 10878641Abstract: Techniques are disclosed for deforming an image using Bezier transformation. The image is divided in a plurality of sections. Each section represents a corresponding Bezier patch. Each section comprises a multiple control points for Bezier transformation, with corner control points of the sections forming anchor points. The deformation of the image is performed by selecting multiple anchor points, and interacting with the selected anchor points. A bounding box that includes the selected anchor points is displayed. Translating, rotating, and/or scaling the selected anchor points based on user input relative to the bounding box results in corresponding Bezier transformation of portion of the image within the bounding box. Thus, instead of having to interact with one control point at a time to deform the image, the desired deformation is achieved by selecting multiple anchor points, and applying the Bezier deformation to the whole bounding box defined by the selected anchor points.Type: GrantFiled: June 7, 2019Date of Patent: December 29, 2020Assignee: Adobe Inc.Inventors: John W. Peterson, Hyunghwan Byun
-
Publication number: 20200388082Abstract: Techniques are disclosed for deforming an image using Bezier transformation. The image is divided in a plurality of sections. Each section represents a corresponding Bezier patch. Each section comprises a multiple control points for Bezier transformation, with corner control points of the sections forming anchor points. The deformation of the image is performed by selecting multiple anchor points, and interacting with the selected anchor points. A bounding box that includes the selected anchor points is displayed. Translating, rotating, and/or scaling the selected anchor points based on user input relative to the bounding box results in corresponding Bezier transformation of portion of the image within the bounding box. Thus, instead of having to interact with one control point at a time to deform the image, the desired deformation is achieved by selecting multiple anchor points, and applying the Bezier deformation to the whole bounding box defined by the selected anchor points.Type: ApplicationFiled: June 7, 2019Publication date: December 10, 2020Applicant: Adobe Inc.Inventors: John W. Peterson, Hyunghwan Byun
-
Patent number: 10706500Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for applying piecewise deformations to digital content using a plurality of parametric patches. For example, the disclosed system generates a plurality of parametric patches (e.g., Bezier patches) within a parametric quilt for digital content (e.g., a digital image or digital text). The disclosed system also provides interface controls for user-defined split/patch locations for the parametric quilt. In one or more embodiments, the disclosed system divides digital content into a plurality of portions. The disclosed system modifies one or more parametric patches and deforms a corresponding portion(s) of the digital content based on the modified parametric patch(es). The disclosed system then recombines the portions of the digital content to generate modified digital content that includes any deformations based on the modified parametric patch(es).Type: GrantFiled: September 25, 2018Date of Patent: July 7, 2020Assignee: ADOBE INC.Inventors: John Peterson, Hyunghwan Byun
-
Publication number: 20200175975Abstract: This application relates generally to modifying visual data based on audio commands and more specifically, to performing complex operations that modify visual data based on one or more audio commands. In some embodiments, a computer system may receive an audio input and identify an audio command based on the audio input. The audio command may be mapped to one or more operations capable of being performed by a multimedia editing application. The computer system may perform the one or more operations to edit to received multimedia data.Type: ApplicationFiled: November 29, 2018Publication date: June 4, 2020Inventors: Sarah Kong, Yinglan Ma, Hyunghwan Byun, Chih-Yao Hsieh
-
Publication number: 20200134834Abstract: Systems and techniques for automatic object replacement in an image include receiving an original image and a preferred image. The original image is automatically segmented into an original image foreground region and an original image object region. The preferred image is automatically segmented into a preferred image foreground region and a preferred image object region. A composite image is automatically composed by replacing the original image object region with the preferred image object region such that the composite image includes the original image foreground region and the preferred image object region. An attribute of the composite image is automatically adjusted.Type: ApplicationFiled: October 31, 2018Publication date: April 30, 2020Inventors: I-Ming Pao, Sarah Aye Kong, Alan Lee Erickson, Kalyan Sunkavalli, Hyunghwan Byun
-
Publication number: 20200098087Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for applying piecewise deformations to digital content using a plurality of parametric patches. For example, the disclosed system generates a plurality of parametric patches (e.g., Bezier patches) within a parametric quilt for digital content (e.g., a digital image or digital text). The disclosed system also provides interface controls for user-defined split/patch locations for the parametric quilt. In one or more embodiments, the disclosed system divides digital content into a plurality of portions. The disclosed system modifies one or more parametric patches and deforms a corresponding portion(s) of the digital content based on the modified parametric patch(es). The disclosed system then recombines the portions of the digital content to generate modified digital content that includes any deformations based on the modified parametric patch(es).Type: ApplicationFiled: September 25, 2018Publication date: March 26, 2020Inventors: John Peterson, Hyunghwan Byun
-
Publication number: 20190164322Abstract: Methods and systems are provided for presenting and using multiple masks based on a segmented image in editing the image. In particular, multiple masks can be presented to a user using a graphical user interface for easy selection and utilization in the editing of an image. The graphical user interface can include a display configured to display an image, a mask zone configured to display segmentations of the image using masks, and an edit zone configured to display edits to the image. Upon receiving segmentation for the image, the masks can be displayed in the mask zone where the masks are based on a selected segmentation detail level.Type: ApplicationFiled: November 29, 2017Publication date: May 30, 2019Inventors: Sarah Aye Kong, I-Ming Pao, Hyunghwan Byun