Patents by Inventor Xing Mei

Xing Mei has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10839007
    Abstract: Systems and methods provide for analyzing at least one feature of each segment of a plurality of segments of the audio stream to generate for each segment a prediction value indicating whether there is music in the segment, generating a probability value that there is music in the audio stream based on aggregating the prediction values of the plurality of segments, and causing the audio stream to be identified based on determining that the probability value that there is music in the audio stream meets a predetermined threshold.
    Type: Grant
    Filed: January 28, 2020
    Date of Patent: November 17, 2020
    Assignee: Snap Inc.
    Inventors: Xin Chen, Jaewook Chung, Yu Hu, Jinhua Jiang, Xing Mei, Kirk Ouimet, Ning Xu
  • Publication number: 20200336678
    Abstract: Disclosed are systems, methods, and computer-readable storage media to enhance an image on a mobile computing device. In some aspects, a user interface on the mobile computing device provides a plurality of image filters, each of the image filters associated with a different replacement sky type. Upon application of one of the plurality of image filters to an image, the mobile computing device is configured to identify a sky portion of the image, modify a color mapping of a non-sky portion of the image, and replace the sky portion of the image with replacement sky data corresponding to the applied image filter.
    Type: Application
    Filed: July 6, 2020
    Publication date: October 22, 2020
    Inventors: Chongyang Ma, Kun Duan, Xing Mei, Nan Hu
  • Publication number: 20200311426
    Abstract: Method for receiving an input onto a graphical user interface at a client device, capturing an image frame at the client device, the image frame comprising a depiction of an object, identifying the object within the image frame, accessing media content associated with the object within a media repository in response to identifying the object, and causing presentation of the media content within the image frame at the client device.
    Type: Application
    Filed: March 10, 2020
    Publication date: October 1, 2020
    Inventors: Ebony James Charlton, Hao Hu, Yanjia Li, Xing Mei, Kevin Dechau Tang
  • Patent number: 10789736
    Abstract: Disclosed are systems, methods, and computer-readable storage media to modify image content. One aspect includes identifying, by one or more electronic hardware processors, an image and content within the image, determining, by the one or more electronic hardware processors, a sky region of the image, determining, by the one or more electronic hardware processors, whether the content within the image is located within the sky region of the image, and in response to the content being within the sky region of the image, modifying, by the one or more electronic hardware processors, the content based on fractal Brownian motion.
    Type: Grant
    Filed: January 9, 2020
    Date of Patent: September 29, 2020
    Assignee: Snap Inc.
    Inventors: Chongyang Ma, Xing Mei, Nan Hu, Kirk Ouimet
  • Patent number: 10742899
    Abstract: Disclosed are systems, methods, and computer-readable storage media to enhance an image on a mobile computing device. In some aspects, a user interface on the mobile computing device provides a plurality of image filters, each of the image filters associated with a different replacement sky type. Upon application of one of the plurality of image filters to an image, the mobile computing device is configured to identify a sky portion of the image, modify a color mapping of a non-sky portion of the image, and replace the sky portion of the image with replacement sky data corresponding to the applied image filter.
    Type: Grant
    Filed: August 30, 2017
    Date of Patent: August 11, 2020
    Assignee: Snap Inc.
    Inventors: Chongyang Ma, Kun Duan, Xing Mei, Nan Hu
  • Publication number: 20200250869
    Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.
    Type: Application
    Filed: April 22, 2020
    Publication date: August 6, 2020
    Inventors: Nan Hu, Xing Mei, Chongyang Ma, Kun Duan
  • Patent number: 10672168
    Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.
    Type: Grant
    Filed: August 1, 2019
    Date of Patent: June 2, 2020
    Assignee: Snap Inc.
    Inventors: Nan Hu, Xing Mei, Chongyang Ma, Kun Duan
  • Patent number: 10621230
    Abstract: Systems and Methods describe capturing a plurality of segments of an audio stream, analyzing at least one feature of each segment of the plurality of segments of the audio stream to generate for each segment a prediction value indicating whether there is music in the segment, generating a probability value that there is music in the audio stream based on aggregating the prediction values of the plurality of segments, determining that the probability value that there is music in the audio stream meets a predetermined threshold, and causing the audio stream to be identified based on determining that the probability value that there is music in the audio stream meets a predetermined threshold.
    Type: Grant
    Filed: April 3, 2019
    Date of Patent: April 14, 2020
    Assignee: Snap Inc.
    Inventors: Xin Chen, Jaewook Chung, Yu Hu, Jinhua Jiang, Xing Mei, Kirk Ouimet, Ning Xu
  • Patent number: 10571994
    Abstract: Systems and methods for detecting touch events with an accelerometer are disclosed. In one aspect, a method includes measuring first accelerometer data at a first rate, detecting a first touch event based on the first accelerometer data, in response to detecting the first touch event, measuring second accelerometer data at a second rate, determining whether a second touch event is detected based on the second accelerometer data, measuring third accelerometer data at the first rate in response to an absence of the second touch event being detecting in the second accelerometer data over a predetermined threshold period of time.
    Type: Grant
    Filed: October 30, 2017
    Date of Patent: February 25, 2020
    Assignee: Snap Inc.
    Inventors: Yu Jiang Tham, Xing Mei
  • Patent number: 10565743
    Abstract: Disclosed are systems, methods, and computer-readable storage media to modify image content. One aspect includes identifying, by one or more electronic hardware processors, an image and content within the image, determining, by the one or more electronic hardware processors, a sky region of the image, determining, by the one or more electronic hardware processors, whether the content within the image is located within the sky region of the image, and in response to the content being within the sky region of the image, modifying, by the one or more electronic hardware processors, the content based on fractal Brownian motion.
    Type: Grant
    Filed: November 21, 2017
    Date of Patent: February 18, 2020
    Assignee: Snap Inc.
    Inventors: Chongyang Ma, Xing Mei, Nan Hu, Kirk Ouimet
  • Patent number: 10430987
    Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.
    Type: Grant
    Filed: December 21, 2017
    Date of Patent: October 1, 2019
    Assignee: Snap Inc.
    Inventors: Nan Hu, Xing Mei, Chongyang Ma, Kun Duan
  • Patent number: 10296638
    Abstract: Systems and methods provide for capturing a plurality of segments of an audio stream and, for each segment of the plurality of segments of the audio stream: performing feature extraction on an audio signal of the segment using a feature extraction machine learning model that analyzes the audio signal to generate a feature vector for the segment and generating a prediction value for the segment for whether there is music in the segment using the extracted feature vector and a music detector machine learning model. The systems and methods further provide for generating a probability value that there is music in the audio stream based on the prediction value for each of the plurality of segments and causing the audio stream to be identified based on determining that the probability value that there is music in the audio stream meets a predetermined threshold.
    Type: Grant
    Filed: December 12, 2017
    Date of Patent: May 21, 2019
    Assignee: Snap Inc.
    Inventors: Xin Chen, Jaewook Chung, Yu Hu, Jinhua Jiang, Xing Mei, Kirk Ouimet, Ning Xu
  • Patent number: 9148652
    Abstract: A video processing method for a three-dimensional (3D) display is based on a multi-cue process. The method may include acquiring a cut boundary of a shot by performing a shot boundary detection with respect to each frame of an input video, computing a texture saliency with respect to each pixel of the input video, computing a motion saliency with respect to each pixel of the input video, computing an object saliency with respect to each pixel of the input video based on the acquired cut boundary of the shot, acquiring a universal saliency with respect to each pixel of the input video by combining the texture saliency, the motion saliency, and the object saliency, and smoothening the universal saliency of each pixel using a space-time technology.
    Type: Grant
    Filed: June 2, 2011
    Date of Patent: September 29, 2015
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ji Won Kim, Gengyu Ma, Haitao Wang, Xing Mei, Ji Yeun Kim, Yong Ju Jung
  • Publication number: 20120007960
    Abstract: A video processing method for a three-dimensional (3D) display is based on a multi-cue process. The method may include acquiring a cut boundary of a shot by performing a shot boundary detection with respect to each frame of an input video, computing a texture saliency with respect to each pixel of the input video, computing a motion saliency with respect to each pixel of the input video, computing an object saliency with respect to each pixel of the input video based on the acquired cut boundary of the shot, acquiring a universal saliency with respect to each pixel of the input video by combining the texture saliency, the motion saliency, and the object saliency, and smoothening the universal saliency of each pixel using a space-time technology.
    Type: Application
    Filed: June 2, 2011
    Publication date: January 12, 2012
    Applicant: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Ji Won Kim, Gengyu Ma, Haitao Wang, Xing Mei, Ji Yeun Kim, Yong Ju Jung
  • Publication number: 20110298898
    Abstract: Provided is a three-dimensional (3D) image generating system and method accommodating multi-view imaging. The 3D image generating system and method may generate corrected depth maps respectively corresponding to color images by merging disparity information associated with a disparity between color images and depth maps generated respectively from depth images.
    Type: Application
    Filed: May 4, 2011
    Publication date: December 8, 2011
    Applicant: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Yong Ju Jung, Haitao Wang, Ji Won Kim, Gengyu Ma, Xing Mei, Du Sik Park