Patents by Inventor Xing Mei
Xing Mei has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10839007Abstract: Systems and methods provide for analyzing at least one feature of each segment of a plurality of segments of the audio stream to generate for each segment a prediction value indicating whether there is music in the segment, generating a probability value that there is music in the audio stream based on aggregating the prediction values of the plurality of segments, and causing the audio stream to be identified based on determining that the probability value that there is music in the audio stream meets a predetermined threshold.Type: GrantFiled: January 28, 2020Date of Patent: November 17, 2020Assignee: Snap Inc.Inventors: Xin Chen, Jaewook Chung, Yu Hu, Jinhua Jiang, Xing Mei, Kirk Ouimet, Ning Xu
-
Publication number: 20200336678Abstract: Disclosed are systems, methods, and computer-readable storage media to enhance an image on a mobile computing device. In some aspects, a user interface on the mobile computing device provides a plurality of image filters, each of the image filters associated with a different replacement sky type. Upon application of one of the plurality of image filters to an image, the mobile computing device is configured to identify a sky portion of the image, modify a color mapping of a non-sky portion of the image, and replace the sky portion of the image with replacement sky data corresponding to the applied image filter.Type: ApplicationFiled: July 6, 2020Publication date: October 22, 2020Inventors: Chongyang Ma, Kun Duan, Xing Mei, Nan Hu
-
Publication number: 20200311426Abstract: Method for receiving an input onto a graphical user interface at a client device, capturing an image frame at the client device, the image frame comprising a depiction of an object, identifying the object within the image frame, accessing media content associated with the object within a media repository in response to identifying the object, and causing presentation of the media content within the image frame at the client device.Type: ApplicationFiled: March 10, 2020Publication date: October 1, 2020Inventors: Ebony James Charlton, Hao Hu, Yanjia Li, Xing Mei, Kevin Dechau Tang
-
Patent number: 10789736Abstract: Disclosed are systems, methods, and computer-readable storage media to modify image content. One aspect includes identifying, by one or more electronic hardware processors, an image and content within the image, determining, by the one or more electronic hardware processors, a sky region of the image, determining, by the one or more electronic hardware processors, whether the content within the image is located within the sky region of the image, and in response to the content being within the sky region of the image, modifying, by the one or more electronic hardware processors, the content based on fractal Brownian motion.Type: GrantFiled: January 9, 2020Date of Patent: September 29, 2020Assignee: Snap Inc.Inventors: Chongyang Ma, Xing Mei, Nan Hu, Kirk Ouimet
-
Patent number: 10742899Abstract: Disclosed are systems, methods, and computer-readable storage media to enhance an image on a mobile computing device. In some aspects, a user interface on the mobile computing device provides a plurality of image filters, each of the image filters associated with a different replacement sky type. Upon application of one of the plurality of image filters to an image, the mobile computing device is configured to identify a sky portion of the image, modify a color mapping of a non-sky portion of the image, and replace the sky portion of the image with replacement sky data corresponding to the applied image filter.Type: GrantFiled: August 30, 2017Date of Patent: August 11, 2020Assignee: Snap Inc.Inventors: Chongyang Ma, Kun Duan, Xing Mei, Nan Hu
-
Publication number: 20200250869Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.Type: ApplicationFiled: April 22, 2020Publication date: August 6, 2020Inventors: Nan Hu, Xing Mei, Chongyang Ma, Kun Duan
-
Patent number: 10672168Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.Type: GrantFiled: August 1, 2019Date of Patent: June 2, 2020Assignee: Snap Inc.Inventors: Nan Hu, Xing Mei, Chongyang Ma, Kun Duan
-
Patent number: 10621230Abstract: Systems and Methods describe capturing a plurality of segments of an audio stream, analyzing at least one feature of each segment of the plurality of segments of the audio stream to generate for each segment a prediction value indicating whether there is music in the segment, generating a probability value that there is music in the audio stream based on aggregating the prediction values of the plurality of segments, determining that the probability value that there is music in the audio stream meets a predetermined threshold, and causing the audio stream to be identified based on determining that the probability value that there is music in the audio stream meets a predetermined threshold.Type: GrantFiled: April 3, 2019Date of Patent: April 14, 2020Assignee: Snap Inc.Inventors: Xin Chen, Jaewook Chung, Yu Hu, Jinhua Jiang, Xing Mei, Kirk Ouimet, Ning Xu
-
Patent number: 10571994Abstract: Systems and methods for detecting touch events with an accelerometer are disclosed. In one aspect, a method includes measuring first accelerometer data at a first rate, detecting a first touch event based on the first accelerometer data, in response to detecting the first touch event, measuring second accelerometer data at a second rate, determining whether a second touch event is detected based on the second accelerometer data, measuring third accelerometer data at the first rate in response to an absence of the second touch event being detecting in the second accelerometer data over a predetermined threshold period of time.Type: GrantFiled: October 30, 2017Date of Patent: February 25, 2020Assignee: Snap Inc.Inventors: Yu Jiang Tham, Xing Mei
-
Patent number: 10565743Abstract: Disclosed are systems, methods, and computer-readable storage media to modify image content. One aspect includes identifying, by one or more electronic hardware processors, an image and content within the image, determining, by the one or more electronic hardware processors, a sky region of the image, determining, by the one or more electronic hardware processors, whether the content within the image is located within the sky region of the image, and in response to the content being within the sky region of the image, modifying, by the one or more electronic hardware processors, the content based on fractal Brownian motion.Type: GrantFiled: November 21, 2017Date of Patent: February 18, 2020Assignee: Snap Inc.Inventors: Chongyang Ma, Xing Mei, Nan Hu, Kirk Ouimet
-
Patent number: 10430987Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.Type: GrantFiled: December 21, 2017Date of Patent: October 1, 2019Assignee: Snap Inc.Inventors: Nan Hu, Xing Mei, Chongyang Ma, Kun Duan
-
Patent number: 10296638Abstract: Systems and methods provide for capturing a plurality of segments of an audio stream and, for each segment of the plurality of segments of the audio stream: performing feature extraction on an audio signal of the segment using a feature extraction machine learning model that analyzes the audio signal to generate a feature vector for the segment and generating a prediction value for the segment for whether there is music in the segment using the extracted feature vector and a music detector machine learning model. The systems and methods further provide for generating a probability value that there is music in the audio stream based on the prediction value for each of the plurality of segments and causing the audio stream to be identified based on determining that the probability value that there is music in the audio stream meets a predetermined threshold.Type: GrantFiled: December 12, 2017Date of Patent: May 21, 2019Assignee: Snap Inc.Inventors: Xin Chen, Jaewook Chung, Yu Hu, Jinhua Jiang, Xing Mei, Kirk Ouimet, Ning Xu
-
Patent number: 9148652Abstract: A video processing method for a three-dimensional (3D) display is based on a multi-cue process. The method may include acquiring a cut boundary of a shot by performing a shot boundary detection with respect to each frame of an input video, computing a texture saliency with respect to each pixel of the input video, computing a motion saliency with respect to each pixel of the input video, computing an object saliency with respect to each pixel of the input video based on the acquired cut boundary of the shot, acquiring a universal saliency with respect to each pixel of the input video by combining the texture saliency, the motion saliency, and the object saliency, and smoothening the universal saliency of each pixel using a space-time technology.Type: GrantFiled: June 2, 2011Date of Patent: September 29, 2015Assignee: Samsung Electronics Co., Ltd.Inventors: Ji Won Kim, Gengyu Ma, Haitao Wang, Xing Mei, Ji Yeun Kim, Yong Ju Jung
-
Publication number: 20120007960Abstract: A video processing method for a three-dimensional (3D) display is based on a multi-cue process. The method may include acquiring a cut boundary of a shot by performing a shot boundary detection with respect to each frame of an input video, computing a texture saliency with respect to each pixel of the input video, computing a motion saliency with respect to each pixel of the input video, computing an object saliency with respect to each pixel of the input video based on the acquired cut boundary of the shot, acquiring a universal saliency with respect to each pixel of the input video by combining the texture saliency, the motion saliency, and the object saliency, and smoothening the universal saliency of each pixel using a space-time technology.Type: ApplicationFiled: June 2, 2011Publication date: January 12, 2012Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Ji Won Kim, Gengyu Ma, Haitao Wang, Xing Mei, Ji Yeun Kim, Yong Ju Jung
-
Publication number: 20110298898Abstract: Provided is a three-dimensional (3D) image generating system and method accommodating multi-view imaging. The 3D image generating system and method may generate corrected depth maps respectively corresponding to color images by merging disparity information associated with a disparity between color images and depth maps generated respectively from depth images.Type: ApplicationFiled: May 4, 2011Publication date: December 8, 2011Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Yong Ju Jung, Haitao Wang, Ji Won Kim, Gengyu Ma, Xing Mei, Du Sik Park