Patents by Inventor Jianchao Yang

Jianchao Yang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12248506
    Abstract: Systems and methods are provided for receiving, at a server computer, a plurality of content messages from a plurality of content sources, each content message comprising media content and associated with a predetermined media collection, for each of the plurality of content messages received, analyzing each of the plurality of content messages to determine a quality score for each of the plurality of content messages, and storing each of the plurality of content messages in a database along with the quality score for each of the plurality of content messages.
    Type: Grant
    Filed: March 3, 2021
    Date of Patent: March 11, 2025
    Assignee: Snap Inc.
    Inventors: Nicholas Richard Allen, Sheldon Chang, Maria Pavlovskaia, Amer Shahnawaz, Jianchao Yang
  • Patent number: 12159215
    Abstract: A modulated segmentation system can use a modulator network to emphasize spatial prior data of an object to track the object across multiple images. The modulated segmentation system can use a segmentation network that receives spatial prior data as intermediate data that improves segmentation accuracy. The segmentation network can further receive visual guide information from a visual guide network to increase tracking accuracy via segmentation.
    Type: Grant
    Filed: October 18, 2023
    Date of Patent: December 3, 2024
    Assignee: Snap Inc.
    Inventors: Linjie Yang, Jianchao Yang, Xuehan Xiong, Yanran Wang
  • Publication number: 20240372963
    Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.
    Type: Application
    Filed: July 15, 2024
    Publication date: November 7, 2024
    Inventors: Lidiia Bogdanovych, William Brendel, Samuel Edward Hare, Fedir Paliakov, Guohui Wang, Xuehan Xiong, Jianchao Yang, Linjie Yang
  • Patent number: 12136026
    Abstract: A compact neural network system can generate multiple individual filters from a compound filter. Each convolutional layer of a convolutional neural network can include a compound filters used to generate individual filters for that layer. The individual filters overlap in the compound filter and can be extracted using a sampling operation. The extracted individual filters can share weights with nearby filters thereby reducing the overall size of the convolutional neural network.
    Type: Grant
    Filed: July 17, 2023
    Date of Patent: November 5, 2024
    Assignee: SNAP INC.
    Inventors: Yingzhen Yang, Jianchao Yang, Ning Xu
  • Publication number: 20240331245
    Abstract: The present disclosure provides a video processing method, a video processing apparatus, and a storage medium. A picture of the video includes a landmark building and a moving subject. The video processing method includes: identifying and tracking the landmark building in the video; extracting and tracking a key point of the moving subject in the video, and determining a posture of the moving subject based on information of the extracted key point of the moving subject; and making the key point of the moving subject correspond to the landmark building, and driving the landmark building to perform a corresponding action based on an action of the key point of the moving subject, so as to make a posture of the landmark building in the picture of the video correspond to the posture of the moving subject. The video processing method may enhance interactions between the user and the shot landmark.
    Type: Application
    Filed: August 4, 2021
    Publication date: October 3, 2024
    Inventors: Zhili CHEN, Linjie LUO, Jianchao YANG, Guohui WANG
  • Patent number: 12075190
    Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.
    Type: Grant
    Filed: July 13, 2023
    Date of Patent: August 27, 2024
    Assignee: Snap Inc.
    Inventors: Lidiia Bogdanovych, William Brendel, Samuel Edward Hare, Fedir Poliakov, Guohui Wang, Xuehan Xiong, Jianchao Yang, Linjie Yang
  • Publication number: 20240249522
    Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
    Type: Application
    Filed: April 2, 2024
    Publication date: July 25, 2024
    Inventors: Samuel Edward Hare, Fedir Poliakov, Guohui Wang, Xuehan Xiong, Jianchao Yang, Linjie Yang, Shah Tanmay Anilkumar
  • Patent number: 11989938
    Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
    Type: Grant
    Filed: May 4, 2023
    Date of Patent: May 21, 2024
    Assignee: Snap Inc.
    Inventors: Samuel Edward Hare, Fedir Poliakov, Guohui Wang, Xuehan Xiong, Jianchao Yang, Linjie Yang, Shah Tanmay Anilkumar
  • Publication number: 20240104810
    Abstract: Embodiments of the disclosure provide a method and a device for processing a portrait image, the method includes: acquiring a to-be-processed portrait image; inputting the to-be-processed portrait image into an image processing model, and acquiring a head smear image output by the image processing model, where the image processing model is configured to smear a hair area of a portrait located above a preset boundary in the portrait image, and the image processing model is generated by training a sample data set of a sample portrait image and a sample head smear image corresponding to the sample portrait image; rendering the head smear image with a head effect material to obtain a portrait image added with an effect; and displaying the portrait image added with the effect.
    Type: Application
    Filed: November 22, 2021
    Publication date: March 28, 2024
    Inventors: Xiao YANG, Jianwei LI, Ding LIU, Yangyue WAN, Xiaohui SHEN, Jianchao YANG
  • Publication number: 20240046072
    Abstract: A modulated segmentation system can use a modulator network to emphasize spatial prior data of an object to track the object across multiple images. The modulated segmentation system can use a segmentation network that receives spatial prior data as intermediate data that improves segmentation accuracy. The segmentation network can further receive visual guide information from a visual guide network to increase tracking accuracy via segmentation.
    Type: Application
    Filed: October 18, 2023
    Publication date: February 8, 2024
    Inventors: Linjie Yang, Jianchao Yang, Xuehan Xiong, Yanran Wang
  • Patent number: 11895068
    Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a plurality of content communications from a plurality of client devices, each content communication comprising an associated piece of content and a corresponding metadata. Each content communication is processed to determine associated context values for each piece of content, each associated context value comprising at least one content value generated by machine vision processing of the associated piece of content. A first content collection is automatically generated based on context values, and a set of user accounts are associated with the collection. An identifier associated with the first content collection is published to user devices associated with user accounts. In various additional embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.
    Type: Grant
    Filed: July 12, 2021
    Date of Patent: February 6, 2024
    Assignee: Snap Inc.
    Inventors: Jianchao Yang, Yuke Zhu, Ning Xu, Kevin Dechau Tang, Jia Li
  • Patent number: 11887357
    Abstract: Disclosed herein are arrangements that facilitate the transfer of knowledge from models for a source data-processing domain to models for a target data-processing domain. A convolutional neural network space for a source domain is factored into a first classification space and a first reconstruction space. The first classification space stores class information and the first reconstruction space stores domain-specific information. A convolutional neural network space for a target domain is factored into a second classification space and a second reconstruction space. The second classification space stores class information and the second reconstruction space stores domain-specific information. Distribution of the first classification space and the second classification space is aligned.
    Type: Grant
    Filed: December 10, 2021
    Date of Patent: January 30, 2024
    Assignee: Snap Inc.
    Inventors: Jianchao Yang, Ning Xu, Jian Ren
  • Patent number: 11889381
    Abstract: Systems and methods are provided for receiving input increasing a default predetermined window of time that the new media collection is accessible and activating the new media collection for the increased predetermined window of time and a geographic boundary size for where media content originates. The systems and methods further cause a plurality of content messages comprising media content originating in the geographical boundary size to be included in the new media collection and displayed in response to a request from a computing device to view the new media collection based on determining the request occurs within the increased predetermined window of time that the new media collection is accessible.
    Type: Grant
    Filed: December 29, 2022
    Date of Patent: January 30, 2024
    Assignee: Snap Inc.
    Inventors: Nicholas Richard Allen, Sheldon Chang, Maria Pavlovskaia, Amer Shahnawaz, Jianchao Yang
  • Patent number: 11847528
    Abstract: A modulated segmentation system can use a modulator network to emphasize spatial prior data of an object to track the object across multiple images. The modulated segmentation system can use a segmentation network that receives spatial prior data as intermediate data that improves segmentation accuracy. The segmentation network can further receive visual guide information from a visual guide network to increase tracking accuracy via segmentation.
    Type: Grant
    Filed: December 29, 2022
    Date of Patent: December 19, 2023
    Assignee: Snap Inc.
    Inventors: Linjie Yang, Jianchao Yang, Xuehan Xiong, Yanran Wang
  • Publication number: 20230401791
    Abstract: A landmark data collection method includes: determining (S100) a first basic collection point (A), a second basic collection point (B), and a third basic collection point (C) sequentially in an observation area of a landmark building; and collecting (S200) photos of the landmark building based on each of the first basic collection point (A), the second basic collection point (B), and the third basic collection point (C) to obtain landmark data of the landmark building. A photo of the landmark building is taken by a camera at the i-th basic collection point; and a collection point is determined at every predetermined distance interval as the camera is moved in a counterclockwise direction and/or a clockwise direction, and the photo of the landmark building is taken by the camera at the collection point, until the camera is moved out of the observation area, where i=1, 2, 3.
    Type: Application
    Filed: August 4, 2021
    Publication date: December 14, 2023
    Inventors: Zhili CHEN, Linjie LUO, Xiao YANG, Jianchao YANG, Jing LIU, Guohui WANG
  • Patent number: 11830209
    Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.
    Type: Grant
    Filed: February 17, 2022
    Date of Patent: November 28, 2023
    Assignee: SNAP INC.
    Inventors: Travis Chen, Samuel Edward Hare, Yuncheng Li, Tony Mathew, Jonathan Solichin, Jianchao Yang, Ning Zhang
  • Publication number: 20230359859
    Abstract: A compact neural network system can generate multiple individual filters from a compound filter. Each convolutional layer of a convolutional neural network can include a compound filters used to generate individual filters for that layer. The individual filters overlap in the compound filter and can be extracted using a sampling operation. The extracted individual filters can share weights with nearby filters thereby reducing the overall size of the convolutional neural network.
    Type: Application
    Filed: July 17, 2023
    Publication date: November 9, 2023
    Inventors: Yingzhen Yang, Jianchao Yang, Ning Xu
  • Publication number: 20230362331
    Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.
    Type: Application
    Filed: July 13, 2023
    Publication date: November 9, 2023
    Inventors: Lidiia Bogdanovych, William Brendel, Samuel Edward Hare, Fedir Poliakov, Guohui Wang, Xuehan Xiong, Jianchao Yang, Linjie Yang
  • Publication number: 20230328197
    Abstract: Embodiments of the present disclosure provide a display method and apparatus based on augmented reality, a device, and a storage medium, the method includes receiving a first video; acquiring a video material by segmenting a target object from the first video; acquiring and displaying a real scene image, where the real scene image is acquired by an image collection apparatus; and displaying the video material at a target position of the real scene image in an augmented manner and playing the video material. Since the video material is acquired by receiving the first video and segmenting the target object from the first video, the video material may be set according to the needs of the user.
    Type: Application
    Filed: June 9, 2023
    Publication date: October 12, 2023
    Inventors: Yaxi GAO, Chenyu SUN, Xiao YANG, Zhili CHEN, Linjie LUO, Jing LIU, Hengkai GUO, Huaxia LI, Hwankyoo Shawn KIM, Jianchao YANG
  • Publication number: 20230306694
    Abstract: A list information display method and apparatus, an electronic device, and a storage medium are provided, the method includes: displaying list information in response to an information display operation triggered by a user; obtaining a real scene shooting image; and loading a plurality of types of information related to the list information into the real scene shooting image and display the real scene shooting image. Due to the use of virtual enhanced display technology, while the list information is displayed in the real scene shooting image, the plurality of types of information related to the list information are also displayed. On one hand, the user can obtain more information related to the list information while obtaining the list information, which improves the efficiency of information acquisition; and on the other hand, the user can obtain information in the real scene shooting image, which improves the visual effect and interactive experience.
    Type: Application
    Filed: August 26, 2021
    Publication date: September 28, 2023
    Inventors: Jingcong ZHANG, Weikai LI, Zihao CHEN, Guohui WANG, Xiao YANG, Haiying CHENG, Anda LI, Ray MCCLURE, Zhili CHEN, Yiheng ZHU, Shihkuang CHU, Liyou XU, Yunzhu LI, Jianchao YANG