Patents by Inventor Chongyang Ma

Chongyang Ma has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210097741
    Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.
    Type: Application
    Filed: December 10, 2020
    Publication date: April 1, 2021
    Inventors: Nan Hu, Xing Mei, Chongyang Ma, Kun Duan
  • Publication number: 20210037179
    Abstract: A dolly zoom effect can be applied to one or more images captured via a resource-constrained device (e.g., a mobile smartphone) by manipulating the size of a target feature while the background in the one or more images changes due to physical movement of the resource-constrained device. The target feature can be detected using facial recognition or shape detection techniques. The target feature can be resized before the size is manipulated as the background changes (e.g., changes perspective).
    Type: Application
    Filed: July 20, 2020
    Publication date: February 4, 2021
    Inventors: Linjie Luo, Chongyang Ma, Zehao Xue
  • Patent number: 10891768
    Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.
    Type: Grant
    Filed: April 22, 2020
    Date of Patent: January 12, 2021
    Assignee: Snap Inc.
    Inventors: Nan Hu, Xing Mei, Chongyang Ma, Kun Duan
  • Publication number: 20200394826
    Abstract: Disclosed are systems, methods, and computer-readable storage media to modify image content. One aspect includes identifying, by one or more electronic hardware processors, an image and content within the image, determining, by the one or more electronic hardware processors, a sky region of the image, determining, by the one or more electronic hardware processors, whether the content within the image is located within the sky region of the image, and in response to the content being within the sky region of the image, modifying, by the one or more electronic hardware processors, the content based on fractal Brownian motion.
    Type: Application
    Filed: August 27, 2020
    Publication date: December 17, 2020
    Inventors: Chongyang Ma, Xing Mei, Nan Hu, Kirk Ouimet
  • Publication number: 20200336678
    Abstract: Disclosed are systems, methods, and computer-readable storage media to enhance an image on a mobile computing device. In some aspects, a user interface on the mobile computing device provides a plurality of image filters, each of the image filters associated with a different replacement sky type. Upon application of one of the plurality of image filters to an image, the mobile computing device is configured to identify a sky portion of the image, modify a color mapping of a non-sky portion of the image, and replace the sky portion of the image with replacement sky data corresponding to the applied image filter.
    Type: Application
    Filed: July 6, 2020
    Publication date: October 22, 2020
    Inventors: Chongyang Ma, Kun Duan, Xing Mei, Nan Hu
  • Publication number: 20200320726
    Abstract: The present disclosure provides a method, device and non-transitory computer storage medium for processing an image. The method includes: obtaining an image by a monocular camera; extracting image features with different levels based on the image; determining a fused feature by fusing the image features with different levels; and determining a depth distribution feature map of the image based on the fused feature, where a pixel value of each pixel point in the depth distribution feature map is a depth value.
    Type: Application
    Filed: June 19, 2020
    Publication date: October 8, 2020
    Inventors: Shijie AN, Yuan ZHANG, Chongyang MA
  • Patent number: 10789736
    Abstract: Disclosed are systems, methods, and computer-readable storage media to modify image content. One aspect includes identifying, by one or more electronic hardware processors, an image and content within the image, determining, by the one or more electronic hardware processors, a sky region of the image, determining, by the one or more electronic hardware processors, whether the content within the image is located within the sky region of the image, and in response to the content being within the sky region of the image, modifying, by the one or more electronic hardware processors, the content based on fractal Brownian motion.
    Type: Grant
    Filed: January 9, 2020
    Date of Patent: September 29, 2020
    Assignee: Snap Inc.
    Inventors: Chongyang Ma, Xing Mei, Nan Hu, Kirk Ouimet
  • Patent number: 10757319
    Abstract: A dolly zoom effect can be applied to one or more images captured via a resource-constrained device (e.g., a mobile smartphone) by manipulating the size of a target feature while the background in the one or more images changes due to physical movement of the resource-constrained device. The target feature can be detected using facial recognition or shape detection techniques. The target feature can be resized before the size is manipulated as the background changes (e.g., changes perspective).
    Type: Grant
    Filed: June 15, 2017
    Date of Patent: August 25, 2020
    Assignee: Snap Inc.
    Inventors: Linjie Luo, Chongyang Ma, Zehao Xue
  • Publication number: 20200258248
    Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.
    Type: Application
    Filed: April 27, 2020
    Publication date: August 13, 2020
    Inventors: Kun Duan, Daniel Ron, Chongyang Ma, Ning Xu, Shenlong Wang, Sumant Milind Hanumante, Dhritiman Sagar
  • Patent number: 10742899
    Abstract: Disclosed are systems, methods, and computer-readable storage media to enhance an image on a mobile computing device. In some aspects, a user interface on the mobile computing device provides a plurality of image filters, each of the image filters associated with a different replacement sky type. Upon application of one of the plurality of image filters to an image, the mobile computing device is configured to identify a sky portion of the image, modify a color mapping of a non-sky portion of the image, and replace the sky portion of the image with replacement sky data corresponding to the applied image filter.
    Type: Grant
    Filed: August 30, 2017
    Date of Patent: August 11, 2020
    Assignee: Snap Inc.
    Inventors: Chongyang Ma, Kun Duan, Xing Mei, Nan Hu
  • Publication number: 20200250869
    Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.
    Type: Application
    Filed: April 22, 2020
    Publication date: August 6, 2020
    Inventors: Nan Hu, Xing Mei, Chongyang Ma, Kun Duan
  • Patent number: 10672168
    Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.
    Type: Grant
    Filed: August 1, 2019
    Date of Patent: June 2, 2020
    Assignee: Snap Inc.
    Inventors: Nan Hu, Xing Mei, Chongyang Ma, Kun Duan
  • Patent number: 10672136
    Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.
    Type: Grant
    Filed: August 31, 2018
    Date of Patent: June 2, 2020
    Assignee: Snap Inc.
    Inventors: Kun Duan, Daniel Ron, Chongyang Ma, Ning Xu, Shenlong Wang, Sumant Milind Hanumante, Dhritiman Sagar
  • Publication number: 20200074653
    Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.
    Type: Application
    Filed: August 31, 2018
    Publication date: March 5, 2020
    Inventors: Kun Duan, Daniel Ron, Chongyang Ma, Ning Xu, Shenlong Wang, Sumant Milind Hanumante, Dhritiman Sagar
  • Patent number: 10565743
    Abstract: Disclosed are systems, methods, and computer-readable storage media to modify image content. One aspect includes identifying, by one or more electronic hardware processors, an image and content within the image, determining, by the one or more electronic hardware processors, a sky region of the image, determining, by the one or more electronic hardware processors, whether the content within the image is located within the sky region of the image, and in response to the content being within the sky region of the image, modifying, by the one or more electronic hardware processors, the content based on fractal Brownian motion.
    Type: Grant
    Filed: November 21, 2017
    Date of Patent: February 18, 2020
    Assignee: Snap Inc.
    Inventors: Chongyang Ma, Xing Mei, Nan Hu, Kirk Ouimet
  • Patent number: 10430987
    Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.
    Type: Grant
    Filed: December 21, 2017
    Date of Patent: October 1, 2019
    Assignee: Snap Inc.
    Inventors: Nan Hu, Xing Mei, Chongyang Ma, Kun Duan
  • Publication number: 20180033190
    Abstract: The present specification describes systems and methods for automatically animating personalized blendshapes from three dimensional stereo reconstruction data. The disclosed inventions facilitate the animation of blendshapes using an optimization process that applies to a frame a fitting process to yield a set of weighted blendshapes and applies to that frame a temporal smoothing process to yield a another set of weighted blendshapes and repeats that optimization process for a predetermined number of iterations to yield a final set of weighted blendshapes.
    Type: Application
    Filed: October 21, 2016
    Publication date: February 1, 2018
    Inventors: Wan-Chun Ma, Chongyang Ma
  • Publication number: 20180033189
    Abstract: The present specification describes systems and methodsfor automatically generating personalized blendshapes from actor performance measurements, while preserving the semantics of a template facial animation rig. The disclosed inventions facilitate the creation of an ensemble of realistic digital double face rigs for each individual with consistent behaviour across the set with sophisticated iterative optimization techniques.
    Type: Application
    Filed: October 21, 2016
    Publication date: February 1, 2018
    Inventors: Wan-Chun Ma, Chongyang Ma
  • Patent number: 8698829
    Abstract: Output textures may be generated by synthesizing an input texture comprising discrete elements with a set of boundary conditions. Elements of the input texture are copied from the input texture to an output texture that is defined by a set of boundary conditions and are then refined. The elements of the output texture are refined by assigning domain and/or attribute information to the elements of the output texture element by minimizing an energy function measuring a similarity between output neighborhoods of the output texture and a corresponding best matching input neighborhood of the input texture.
    Type: Grant
    Filed: May 28, 2010
    Date of Patent: April 15, 2014
    Assignee: Microsoft Corporation
    Inventors: Li-Yi Wei, Chongyang Ma, Xin Tong
  • Publication number: 20110292064
    Abstract: Output textures may be generated by synthesizing an input texture comprising discrete elements with a set of boundary conditions. Elements of the input texture are copied from the input texture to an output texture that is defined by a set of boundary conditions and are then refined. The elements of the output texture are refined by assigning domain and/or attribute information to the elements of the output texture element by minimizing an energy function measuring a similarity between output neighborhoods of the output texture and a corresponding best matching input neighborhood of the input texture.
    Type: Application
    Filed: May 28, 2010
    Publication date: December 1, 2011
    Applicant: Microsoft Corporation
    Inventors: Li-Yi Wei, Chongyang Ma, Xin Tong