Patents by Inventor Chih-Yao Hsieh

Chih-Yao Hsieh has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200106945
    Abstract: This disclosure relates to methods, non-transitory computer readable media, and systems that generate a virtual long exposure image from a sequence of short exposure images portraying a moving object. In various embodiments, the image transformation system aligns two digital images in the sequence of short exposure images. The image transformation system can determine a motion vector path for the moving object between the first digital image and the second digital image. The image transformation system can also blend pixels along the motion vector path to generate a blended image representative of the motion of the moving object between the first digital image and the second digital image. The image transformation system can generate additional blended images based on consecutive pairs of images in the sequence of digital images and generates a virtual long exposure image by combining the first blended image with the additional blended images.
    Type: Application
    Filed: October 2, 2018
    Publication date: April 2, 2020
    Inventors: Chih-Yao Hsieh, Sylvain Paris, Seyed Morteza Safdarnejad, Gregg Wilensky
  • Publication number: 20200090351
    Abstract: This disclosure relates to methods, non-transitory computer readable media, and systems that analyze feature points of digital images to selectively apply a pixel-adjusted-gyroscope-alignment model and a feature-based-alignment model to align the digital images. For instance, the disclosed systems can select an appropriate alignment model based on feature-point-deficiency metrics specific to an input image and reference-input image. Moreover, in certain implementations, the pixel-adjusted-gyroscope-alignment model utilizes parameters from pixel-based alignment and gyroscope-based alignment to align such digital images. Together with the feature-based-alignment model, the disclosed methods, non-transitory computer readable media, and systems can use a selective image-alignment algorithm that improves computational efficiency, accuracy, and flexibility in generating enhanced digital images from a set of input images.
    Type: Application
    Filed: September 17, 2018
    Publication date: March 19, 2020
    Inventors: Seyed Morteza Safdarnejad, Chih-Yao Hsieh
  • Patent number: 10573052
    Abstract: Embodiments of the present invention are directed to facilitate creating cinemagraphs from virtual long-exposure images. In accordance with some embodiments of the present invention, virtual long-exposure image comprising a plurality of aligned frames is provided and a selection of a region of pixels in the virtual long-exposure image is received. Based on the selected region of pixels, a set of frames for animation is identified from the plurality of frames. The set of frames may be identified by automatically detecting a sequence of frames or by receiving a user selection of frames. The virtual LE image is combined with the set of frames to create a cinemagraph having a visible non-animated portion formed by the virtual LE image and a visible animated portion formed by the set of frames.
    Type: Grant
    Filed: February 13, 2018
    Date of Patent: February 25, 2020
    Assignee: ADOBE INC.
    Inventors: Seyed Morteza Safdarnejad, Sarah Aye Kong, Chih-Yao Hsieh
  • Publication number: 20190333198
    Abstract: The present disclosure relates to training and utilizing an image exposure transformation network to generate a long-exposure image from a single short-exposure image (e.g., still image). In various embodiments, the image exposure transformation network is trained using adversarial learning, long-exposure ground truth images, and a multi-term loss function. In some embodiments, the image exposure transformation network includes an optical flow prediction network and/or an appearance guided attention network. Trained embodiments of the image exposure transformation network generate realistic long-exposure images from single short-exposure images without additional information.
    Type: Application
    Filed: April 25, 2018
    Publication date: October 31, 2019
    Inventors: Yilin Wang, Zhe Lin, Zhaowen Wang, Xin Lu, Xiaohui Shen, Chih-Yao Hsieh
  • Publication number: 20190251729
    Abstract: Embodiments of the present invention are directed to facilitate creating cinemagraphs from virtual long-exposure images. In accordance with some embodiments of the present invention, virtual long-exposure image comprising a plurality of aligned frames is provided and a selection of a region of pixels in the virtual long-exposure image is received. Based on the selected region of pixels, a set of frames for animation is identified from the plurality of frames. The set of frames may be identified by automatically detecting a sequence of frames or by receiving a user selection of frames. The virtual LE image is combined with the set of frames to create a cinemagraph having a visible non-animated portion formed by the virtual LE image and a visible animated portion formed by the set of frames.
    Type: Application
    Filed: February 13, 2018
    Publication date: August 15, 2019
    Inventors: SEYED MORTEZA SAFDARNEJAD, SARAH AYE KONG, CHIH-YAO HSIEH
  • Publication number: 20190251683
    Abstract: Embodiments of the present invention are directed to facilitating images with selective application of the long-exposure effect. In accordance with some embodiments of the present invention, virtual long-exposure image comprising a plurality of aligned frames is provided and a selection of a region of pixels in the virtual long-exposure image is received. The virtual long-exposure image is combined with one of the frames forming the virtual long-exposure image to create a selective virtual long-exposure image. The selective virtual long-exposure image comprises a visible portion of the original virtual long-exposure image and a visible portion of the individual frame that corresponds to the selected region of pixels. Additional frames may be combined with the virtual long-exposure image to create a plurality of selective virtual long-exposure image options, and the user may select one for continued use or for saving.
    Type: Application
    Filed: February 13, 2018
    Publication date: August 15, 2019
    Inventors: SEYED MORTEZA SAFDARNEJAD, SARAH AYE KONG, GREGG DARRYL WILENSKY, CHIH-YAO HSIEH
  • Publication number: 20190095326
    Abstract: Constraining memory use for overlapping virtual memory operations is described. The memory use is constrained to prevent memory from exceeding an operational threshold, e.g., in relation to operations for modifying content. These operations are implemented according to algorithms having a plurality of instructions. Before the instructions are performed in relation to the content, virtual memory is allocated to the content data, which is then loaded into the virtual memory and is also partitioned into data portions. In the context of the described techniques, at least one of the instructions affects multiple portions of the content data loaded in virtual memory. When this occurs, the instruction is carried out, in part, by transferring the multiple portions of content data between the virtual memory and a memory such that a number of portions of the content data in the memory is constrained to the memory that is reserved for the operation.
    Type: Application
    Filed: September 26, 2017
    Publication date: March 28, 2019
    Applicant: Adobe Systems Incorporated
    Inventors: Chih-Yao Hsieh, Zhaowen Wang
  • Patent number: 10200560
    Abstract: Automated sharing of digital images is described. In example implementations, a computing device, such as a smart phone, captures a digital image depicting multiple faces of multiple persons included in the digital image. The computing device is capable of automatically distributing a copy of the digital image to the subjects of the digital image. To do so, a digital image sharing module determines a person identifier using facial detection and recognition. The person identifier, which can be derived from facial characteristics, is used to search a contact information database and find a matching entry. The matching entry includes contact information associated with the person in the digital image. The sharing module transmits a copy of the digital image to the person using the contact information. The digital image sharing module can also display a sharing status indicator indicative of whether the digital image can be, or has been, transmitted automatically.
    Type: Grant
    Filed: January 13, 2017
    Date of Patent: February 5, 2019
    Assignee: Adobe Inc.
    Inventors: Sarah A. Kong, Chih-Yao Hsieh
  • Publication number: 20180260941
    Abstract: Methods and systems are provided for adjusting the brightness of images. In some implementations, an exposure bracketed set of input images produced by a camera is received. A brightness adjustment is determined for at least one input image from the set of input images. The determined brightness adjustment is applied to the input image. An output image is produced by exposure fusion from the set of input images, using the input image having the determined brightness adjustment. The output image is transmitted where, the transmitting causes display of the output image on a user device.
    Type: Application
    Filed: March 7, 2017
    Publication date: September 13, 2018
    Inventors: YINGLAN MA, Sylvain Philippe PARIS, Chih-Yao HSIEH
  • Publication number: 20180205848
    Abstract: Automated sharing of digital images is described. In example implementations, a computing device, such as a smart phone, captures a digital image depicting multiple faces of multiple persons included in the digital image. The computing device is capable of automatically distributing a copy of the digital image to the subjects of the digital image. To do so, a digital image sharing module determines a person identifier using facial detection and recognition. The person identifier, which can be derived from facial characteristics, is used to search a contact information database and find a matching entry. The matching entry includes contact information associated with the person in the digital image. The sharing module transmits a copy of the digital image to the person using the contact information. The digital image sharing module can also display a sharing status indicator indicative of whether the digital image can be, or has been, transmitted automatically.
    Type: Application
    Filed: January 13, 2017
    Publication date: July 19, 2018
    Applicant: Adobe Systems Incorporated
    Inventors: Sarah A. Kong, Chih-Yao Hsieh
  • Patent number: 9613405
    Abstract: Techniques for enhancing an image using pixel-specific processing are disclosed. An image can be enhanced by updating certain pixels through patch aggregation. Neighboring pixels of a selected pixel are identified. Respective patch values for patches containing the selected pixel are determined. Patch values provide update information for updating the respective pixels in the patch. Relevant patch values for the selected pixel are identified by identifying associated patches of the pixel. Information from the relevant patch values of the selected pixel may be obtained. Using this information, pixel-specific processing may be performed to determine an updated pixel value for the selected pixel or for neighboring pixels of the selected pixel. Pixel-specific processes may be executed for each of the selected or neighboring pixels. These pixel-specific processes can be executed in parallel.
    Type: Grant
    Filed: June 21, 2016
    Date of Patent: April 4, 2017
    Assignee: Adobe Systems Incorporated
    Inventors: Chih-Yao Hsieh, Zhe Lin
  • Patent number: 9569822
    Abstract: In embodiments of removing noise from an image via efficient patch distance computations, weights are computed for patches of pixels in a digital image, and the computed weights are multiplied by respective offset values of offset images that are pixelwise shifted images of the entire digital image. The weights can be applied to the pixels in the digital image on a patch-by-patch basis to restore values of the pixels. Additionally, the digital image can be pixelwise shifted to generate the offset images of the digital image, and the digital image is compared to the offset images. Lookup tables of pixel values can be generated based on the comparisons of the digital image to the offset images, and integral images generated from the lookup tables. Distances to the patches of pixels in the digital image are computed from the integral images, and the computed weights are based on the computed distances.
    Type: Grant
    Filed: January 7, 2016
    Date of Patent: February 14, 2017
    Assignee: Adobe Systems Incorporated
    Inventors: Chih-Yao Hsieh, Yuyan Song, Zhe Lin
  • Publication number: 20160300331
    Abstract: Techniques for enhancing an image using pixel-specific processing are disclosed. An image can be enhanced by updating certain pixels through patch aggregation. Neighboring pixels of a selected pixel are identified. Respective patch values for patches containing the selected pixel are determined. Patch values provide update information for updating the respective pixels in the patch. Relevant patch values for the selected pixel are identified by identifying associated patches of the pixel. Information from the relevant patch values of the selected pixel may be obtained. Using this information, pixel-specific processing may be performed to determine an updated pixel value for the selected pixel or for neighboring pixels of the selected pixel. Pixel-specific processes may be executed for each of the selected or neighboring pixels. These pixel-specific processes can be executed in parallel.
    Type: Application
    Filed: June 21, 2016
    Publication date: October 13, 2016
    Inventors: Chih-Yao Hsieh, Zhe Lin
  • Patent number: 9396522
    Abstract: Techniques for enhancing an image using pixel-specific processing. An image can be enhanced by updating selected pixels through patch aggregation. Respective patch values for patches of any size of the image are determined. Patch values provide update information for updating the respective pixels in the patch. Relevant patch values for the selected pixel are identified by identifying associated patches of the pixel. Information from the relevant patch values of the selected pixel may be obtained by averaging the relevant patch values or determining the maximum or minimum patch value. Using this information, pixel-specific processing may be performed to determine an updated pixel value for the selected pixel. Pixel-specific processes may be executed for each of the selected pixels. These pixel-specific processes can be executed in parallel. Therefore, through the execution of pixel-specific processes, which may be performed concurrently, an enhanced image may be determined.
    Type: Grant
    Filed: July 24, 2014
    Date of Patent: July 19, 2016
    Assignee: Adobe Systems Incorporated
    Inventors: Chih-Yao Hsieh, Zhe Lin
  • Publication number: 20160117805
    Abstract: In embodiments of removing noise from an image via efficient patch distance computations, weights are computed for patches of pixels in a digital image, and the computed weights are multiplied by respective offset values of offset images that are pixelwise shifted images of the entire digital image. The weights can be applied to the pixels in the digital image on a patch-by-patch basis to restore values of the pixels. Additionally, the digital image can be pixelwise shifted to generate the offset images of the digital image, and the digital image is compared to the offset images. Lookup tables of pixel values can be generated based on the comparisons of the digital image to the offset images, and integral images generated from the lookup tables. Distances to the patches of pixels in the digital image are computed from the integral images, and the computed weights are based on the computed distances.
    Type: Application
    Filed: January 7, 2016
    Publication date: April 28, 2016
    Inventors: Chih-Yao Hsieh, Yuyan Song, Zhe Lin
  • Patent number: 9251569
    Abstract: Systems and methods herein provide for reduced computations in image processing and a more efficient way of computing distances between patches in patch-based image denoising. One method is operable within a processing system to remove noise from a digital image by generating a plurality of lookup tables of pixel values based on a plurality of comparisons of the digital image to offsets of the digital image, generating integral images from the lookup tables, and computing distances between patches of pixels in the digital image from the integral images. The method also includes computing weights for the patches of pixels in the digital image based on the computed distances and applying the weights to pixels in the digital image on a patch-by-patch basis to restore values of the pixels.
    Type: Grant
    Filed: September 10, 2013
    Date of Patent: February 2, 2016
    Assignee: Adobe Systems Incorporated
    Inventors: Chih-Yao Hsieh, Yuyan Song, Zhe Lin
  • Publication number: 20160027152
    Abstract: Techniques for enhancing an image using pixel-specific processing. An image can be enhanced by updating selected pixels through patch aggregation. Respective patch values for patches of any size of the image are determined. Patch values provide update information for updating the respective pixels in the patch. Relevant patch values for the selected pixel are identified by identifying associated patches of the pixel. Information from the relevant patch values of the selected pixel may be obtained by averaging the relevant patch values or determining the maximum or minimum patch value. Using this information, pixel-specific processing may be performed to determine an updated pixel value for the selected pixel. Pixel-specific processes may be executed for each of the selected pixels. These pixel-specific processes can be executed in parallel. Therefore, through the execution of pixel-specific processes, which may be performed concurrently, an enhanced image may be determined.
    Type: Application
    Filed: July 24, 2014
    Publication date: January 28, 2016
    Inventors: Chih-Yao Hsieh, Zhe Lin
  • Publication number: 20150071561
    Abstract: Systems and methods herein provide for reduced computations in image processing and a more efficient way of computing distances between patches in patch-based image denoising. One method is operable within a processing system to remove noise from a digital image by generating a plurality of lookup tables of pixel values based on a plurality of comparisons of the digital image to offsets of the digital image, generating integral images from the lookup tables, and computing distances between patches of pixels in the digital image from the integral images. The method also includes computing weights for the patches of pixels in the digital image based on the computed distances and applying the weights to pixels in the digital image on a patch-by-patch basis to restore values of the pixels.
    Type: Application
    Filed: September 10, 2013
    Publication date: March 12, 2015
    Applicant: Adobe Systems Incorporated
    Inventors: Chih-Yao Hsieh, Yuyan Song, Zhe Lin