Patents by Inventor Chongyang Ma

Chongyang Ma has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20260162319
    Abstract: Embodiments of the disclosure relate method, apparatus, device and storage medium for processing a media content. The method includes: obtaining a first media content; and generating a second media content by applying an effect to the first media content with a model, wherein the model is trained based on the following process: determining a plurality of sub-effects corresponding to the effect; determining a plurality of effect models corresponding to the plurality of sub-effects from a set of pre-trained effect model; generating a plurality of corresponding output images by processing a plurality of sample images with the plurality of effect models according to a preset order; and training the model with the plurality of sample images and the plurality of corresponding output images. According to embodiments of the present disclosure, the generation efficiency of the model can be improved.
    Type: Application
    Filed: December 11, 2025
    Publication date: June 11, 2026
    Inventors: Yiding YANG, Bo LIU, Haibin HUANG, Chongyang MA, Yunzhu LI, Youran WU, Chenliang ZHANG
  • Publication number: 20260164093
    Abstract: Embodiments of the disclosure relate to a method, a device, an electronic device and a storage medium for processing media content. The method includes: obtaining first media content; applying a first effect to the first media content by a first model to generate second media content; and providing the second media content, wherein the first model is trained by: training a pre-trained model associated with the first effect with a first sample set to determine a reference model; constructing a second sample set based on processing results for a plurality of sample images from the reference model; and training the first model with the second sample set.
    Type: Application
    Filed: December 8, 2025
    Publication date: June 11, 2026
    Inventors: Bo LIU, Chongyang MA, Haibin HUANG, Yiding YANG, Yunzhu LI
  • Publication number: 20260120365
    Abstract: The embodiment of the disclosure relates to a method, apparatus, device and storage medium for generating decoration element. The method includes: obtaining input information indicating an element category and an element style; providing a target decoration element generated based on the input information, wherein the target decoration element is generated by: determining mask information corresponding to the element category, the mask information indicating a target area for generating a decoration element; providing a reference image, the mask information, and a first prompt corresponding to the input information to a first target model to indicate the first target model to fill the target area in the reference image; and generating the target decoration element based on a filling result of the target area. According to the embodiment of the disclosure, the quality of the generated decoration element can be improved.
    Type: Application
    Filed: October 29, 2025
    Publication date: April 30, 2026
    Inventors: Angtian Wang, Haibin Huang, Chongyang Ma, Peilin Li, Jie Meng
  • Publication number: 20260024255
    Abstract: The present disclosure relates to an effect processing method, an electronic device and a non-transitory storage medium. The effect processing method includes: in response to an effect processing request input on a mobile terminal, acquiring an image to be processed; and performing effect processing on the image to be processed by a first generation model deployed on the mobile terminal to obtain a target effect image, and displaying the target effect image; the first generation model is obtained by training a first generative adversarial network, at least part of training data of the first generative adversarial network is generated by a second generation model deployed on a server, and the second generation model is obtained by training a second generative adversarial network.
    Type: Application
    Filed: July 16, 2025
    Publication date: January 22, 2026
    Inventors: Haibin HUANG, Chongyang MA, Yunzhu LI, Lezhou FENG, Chenliang ZHANG
  • Publication number: 20260010832
    Abstract: The embodiment of the disclosure relates to a method, apparatus, device and a computer readable storage medium of processing information. The method proposed herein includes: obtaining target content to be processed; determining a target encoding representation of the target content with an encoding model; and determining a target generation manner of the target content based on a comparison between the target encoding representation and a plurality of predetermined encoding representations, the plurality of predetermined encoding representations corresponding to a plurality of predetermined generation manners, the plurality of predetermined generation manners including a plurality of model generation manners, the plurality of predetermined encoding representations being determined by processing a plurality of groups of sample contents with the encoding model, each group of sample contents corresponding to a respective predetermined generation manner.
    Type: Application
    Filed: July 2, 2025
    Publication date: January 8, 2026
    Inventors: Xun Guo, Haibin Huang, Chongyang Ma
  • Publication number: 20250168488
    Abstract: A dolly zoom effect can be applied to one or more images captured via a resource-constrained device (e.g., a mobile smartphone) by manipulating the size of a target feature while the background in the one or more images changes due to physical movement of the resource-constrained device. The target feature can be detected using facial recognition or shape detection techniques. The target feature can be resized before the size is manipulated as the background changes (e.g., changes perspective).
    Type: Application
    Filed: January 17, 2025
    Publication date: May 22, 2025
    Inventors: Linjie Luo, Chongyang Ma, Zehao Xue
  • Patent number: 12238404
    Abstract: A dolly zoom effect can be applied to one or more images captured via a resource-constrained device (e.g., a mobile smartphone) by manipulating the size of a target feature while the background in the one or more images changes due to physical movement of the resource-constrained device. The target feature can be detected using facial recognition or shape detection techniques. The target feature can be resized before the size is manipulated as the background changes (e.g., changes perspective).
    Type: Grant
    Filed: July 29, 2022
    Date of Patent: February 25, 2025
    Assignee: Snap Inc.
    Inventors: Linjie Luo, Chongyang Ma, Zehao Xue
  • Patent number: 11758079
    Abstract: Disclosed are systems, methods, and computer-readable storage media to enhance an image on a mobile computing device. In some aspects, a user interface on the mobile computing device provides a plurality of image filters, each of the image filters associated with a different replacement sky type. Upon application of one of the plurality of image filters to an image, the mobile computing device is configured to identify a sky portion of the image, modify a color mapping of a non-sky portion of the image, and replace the sky portion of the image with replacement sky data corresponding to the applied image filter.
    Type: Grant
    Filed: March 31, 2022
    Date of Patent: September 12, 2023
    Assignee: Snap Inc.
    Inventors: Chongyang Ma, Kun Duan, Xing Mei, Nan Hu
  • Patent number: 11715223
    Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.
    Type: Grant
    Filed: January 31, 2022
    Date of Patent: August 1, 2023
    Assignee: Snap Inc.
    Inventors: Kun Duan, Daniel Ron, Chongyang Ma, Ning Xu, Shenlong Wang, Sumant Milind Hanumante, Dhritiman Sagar
  • Patent number: 11715242
    Abstract: Disclosed are systems, methods, and computer-readable storage media to modify image content. One aspect includes identifying, by one or more electronic hardware processors, an image and content within the image, determining, by the one or more electronic hardware processors, a sky region of the image, determining, by the one or more electronic hardware processors, whether the content within the image is located within the sky region of the image, and in response to the content being within the sky region of the image, modifying, by the one or more electronic hardware processors, the content based on fractal Brownian motion.
    Type: Grant
    Filed: September 20, 2021
    Date of Patent: August 1, 2023
    Assignee: Snap Inc.
    Inventors: Chongyang Ma, Xing Mei, Nan Hu, Kirk Ouimet
  • Publication number: 20230087476
    Abstract: A neural network training method, an image processing method, and apparatuses thereof are provided. The neural network training method includes obtaining a first domain image and a second domain image, where the first domain image and the second domain image are unpaired images in different domains; obtaining a scaled first domain image by scaling, at an iteration, the first domain image; obtaining a training patch by cropping the scaled first domain image, where each training patch has a same number of pixels with different contents; inputting the training patch into the neural network at the iteration, and outputting an output patch; calculating a contrastive loss based on a query sub-patch and negative sub-patches selected from the training patch and a corresponding positive sub-patch selected from the output patch; and updating model parameters of the neural network based on the contrastive loss and a generative adversarial network loss.
    Type: Application
    Filed: September 17, 2021
    Publication date: March 23, 2023
    Applicant: KWAI INC.
    Inventors: Oliver Dayun LIU, Mengtian LI, Yi ZHENG, Haibin HUANG, Chongyang MA
  • Publication number: 20230065433
    Abstract: A method for processing an image, an electronic device and a storage medium are provided. The method includes: obtaining an original image including a target object; obtaining an auxiliary line by extracting semantic information from the original image, the auxiliary line including at least one of: an area boundary line of the target object and a part contour line of the target object; obtaining a prediction result for a semantic line by inputting an image stitched from the auxiliary line and the original image to a predictive neural network, the auxiliary line guiding the predictive neural network to obtain the prediction result, the prediction result indicating a probability that a pixel in the original image is a pixel in the semantic line, the semantic line being used for rendering the target object; and obtaining the semantic line based on the prediction result for the semantic line.
    Type: Application
    Filed: October 24, 2022
    Publication date: March 2, 2023
    Inventors: Xiao LI, Yibing MA, Chongyang MA
  • Publication number: 20220414963
    Abstract: A hair rendering method includes acquiring a target video containing hair information, and selecting a target image frame from image frames of the target video, acquiring a texture image of the target image frame, wherein the texture image is an image in a texture format which records motion states and state change information of one or more pixel points in the target image frame. The method further includes acquiring a first target motion state and target state change information of a first target particle region from the texture image; determining a second target motion state of the first target particle region in a next image frame according to the first target motion state and the target state change information, and rendering the hair region by updating a motion state in the texture image according to the second target motion state.
    Type: Application
    Filed: August 29, 2022
    Publication date: December 29, 2022
    Inventors: Peihong HOU, Chongyang MA
  • Publication number: 20220368824
    Abstract: A dolly zoom effect can be applied to one or more images captured via a resource-constrained device (e.g., a mobile smartphone) by manipulating the size of a target feature while the background in the one or more images changes due to physical movement of the resource-constrained device. The target feature can be detected using facial recognition or shape detection techniques. The target feature can be resized before the size is manipulated as the background changes (e.g., changes perspective).
    Type: Application
    Filed: July 29, 2022
    Publication date: November 17, 2022
    Inventors: Linjie Luo, Chongyang Ma, Zehao Xue
  • Patent number: 11468613
    Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: October 11, 2022
    Assignee: Snap Inc.
    Inventors: Nan Hu, Xing Mei, Chongyang Ma, Kun Duan
  • Patent number: 11418704
    Abstract: A dolly zoom effect can be applied to one or more images captured via a resource-constrained device (e.g., a mobile smartphone) by manipulating the size of a target feature while the background in the one or more images changes due to physical movement of the resource-constrained device. The target feature can be detected using facial recognition or shape detection techniques. The target feature can be resized before the size is manipulated as the background changes (e.g., changes perspective).
    Type: Grant
    Filed: July 20, 2020
    Date of Patent: August 16, 2022
    Assignee: Snap Inc.
    Inventors: Linjie Luo, Chongyang Ma, Zehao Xue
  • Patent number: 11403789
    Abstract: A method for processing images includes recognizing a hair region in a target image; acquiring a hairline direction of each pixel point in the hair region; acquiring an intermediate image by smoothing the hair region based on the hairline direction; and acquiring a virtual hairline along the hairline direction, and acquiring a first image by superimposing the virtual hairline to the hair region in the intermediate image.
    Type: Grant
    Filed: February 10, 2021
    Date of Patent: August 2, 2022
    Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
    Inventors: Chongyang Ma, Zhenyang Liu
  • Publication number: 20220224842
    Abstract: Disclosed are systems, methods, and computer-readable storage media to enhance an image on a mobile computing device. In some aspects, a user interface on the mobile computing device provides a plurality of image filters, each of the image filters associated with a different replacement sky type. Upon application of one of the plurality of image filters to an image, the mobile computing device is configured to identify a sky portion of the image, modify a color mapping of a non-sky portion of the image, and replace the sky portion of the image with replacement sky data corresponding to the applied image filter.
    Type: Application
    Filed: March 31, 2022
    Publication date: July 14, 2022
    Inventors: Chongyang Ma, Kun Duan, Xing Mei, Nan Hu
  • Patent number: 11361459
    Abstract: The present disclosure provides a method, device and non-transitory computer storage medium for processing an image. The method includes: obtaining an image by a monocular camera; extracting image features with different levels based on the image; determining a fused feature by fusing the image features with different levels; and determining a depth distribution feature map of the image based on the fused feature, where a pixel value of each pixel point in the depth distribution feature map is a depth value.
    Type: Grant
    Filed: June 19, 2020
    Date of Patent: June 14, 2022
    Assignee: Beijing Dajia Internet Information Technology Co., Ltd.
    Inventors: Shijie An, Yuan Zhang, Chongyang Ma
  • Publication number: 20220156956
    Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.
    Type: Application
    Filed: January 31, 2022
    Publication date: May 19, 2022
    Inventors: Kun Duan, Daniel Ron, Chongyang Ma, Ning Xu, Shenlong Wang, Sumant Milind Hanumante, Dhritiman Sagar