Patents by Inventor Jianchao Yang

Jianchao Yang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230306694
    Abstract: A list information display method and apparatus, an electronic device, and a storage medium are provided, the method includes: displaying list information in response to an information display operation triggered by a user; obtaining a real scene shooting image; and loading a plurality of types of information related to the list information into the real scene shooting image and display the real scene shooting image. Due to the use of virtual enhanced display technology, while the list information is displayed in the real scene shooting image, the plurality of types of information related to the list information are also displayed. On one hand, the user can obtain more information related to the list information while obtaining the list information, which improves the efficiency of information acquisition; and on the other hand, the user can obtain information in the real scene shooting image, which improves the visual effect and interactive experience.
    Type: Application
    Filed: August 26, 2021
    Publication date: September 28, 2023
    Inventors: Jingcong ZHANG, Weikai LI, Zihao CHEN, Guohui WANG, Xiao YANG, Haiying CHENG, Anda LI, Ray MCCLURE, Zhili CHEN, Yiheng ZHU, Shihkuang CHU, Liyou XU, Yunzhu LI, Jianchao YANG
  • Patent number: 11763130
    Abstract: A compact neural network system can generate multiple individual filters from a compound filter. Each convolutional layer of a convolutional neural network can include a compound filters used to generate individual filters for that layer. The individual filters overlap in the compound filter and can be extracted using a sampling operation. The extracted individual filters can share weights with nearby filters thereby reducing the overall size of the convolutional neural network.
    Type: Grant
    Filed: November 23, 2020
    Date of Patent: September 19, 2023
    Assignee: SNAP INC.
    Inventors: Yingzhen Yang, Jianchao Yang, Ning Xu
  • Publication number: 20230290094
    Abstract: A positioning model optimization method, a positioning method, and a positioning device are provided. The positioning model optimization method includes: inputting a positioning model for a scene, the positioning model including a three-dimensional (3D) point cloud and a plurality of descriptors corresponding to each 3D point in the 3D point cloud; calculating a significance of each 3D point in the 3D point cloud, and if the significance is greater than a predetermined threshold, outputting the 3D point and the plurality of descriptors corresponding to the 3D point to an optimized positioning model for the scene; and outputting the optimized positioning model for the scene.
    Type: Application
    Filed: July 22, 2021
    Publication date: September 14, 2023
    Inventors: Linjie LUO, Jing LIU, Zhili CHEN, Guohui WANG, Xiao YANG., Jianchao YANG, Xiaochen LIAN
  • Patent number: 11756276
    Abstract: An image processing method and apparatus for augmented reality, an electronic device and a storage medium, including: acquiring a target image in response to an image acquiring instruction triggered by a user, where the target image includes a target object; acquiring an augmented reality model of the target object, and outputting the augmented reality model in combination with the target object; acquiring target audio data selected by the user, and determining an audio feature with temporal regularity according to the target audio data; and driving the augmented reality model according to the audio feature and a playing progress of the target audio data when outputting the target audio data.
    Type: Grant
    Filed: November 8, 2022
    Date of Patent: September 12, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Yunzhu Li, Jingcong Zhang, Xuchen Song, Jianchao Yang, Guohui Wang, Zhili Chen, Linjie Luo, Xiao Yang, Haoze Li, Jing Liu
  • Publication number: 20230274543
    Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
    Type: Application
    Filed: May 4, 2023
    Publication date: August 31, 2023
    Inventors: Samuel Edward Hare, Fedir Poliakov, Guohui Wang, Xuehan Xiong, Jianchao Yang, Linjie Yang, Shah Tanmay Anilkumar
  • Patent number: 11743426
    Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can he assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented. using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.
    Type: Grant
    Filed: August 13, 2020
    Date of Patent: August 29, 2023
    Assignee: Snap Inc.
    Inventors: Lidiia Bogdanovych, William Brendel, Samuel Edward Hare, Fedir Poliakov, Guohui Wang, Xuehan Xiong, Jianchao Yang, Linjie Yang
  • Publication number: 20230267664
    Abstract: An animation processing method and apparatus, an electronic device and a storage medium, applied to a shader, the method including: acquiring an animation sample of a model unit; acquiring an external interaction parameter of an augmented reality model, where the augmented reality model includes a plurality of model units; and outputting the augmented reality model, and driving the animation sample of the model unit in the output augmented reality model according to the external interaction parameter. The animation sample of the model unit can be driven according to the external interaction parameter, so that animation of the model can be adjusted according to user operation, thereby improving usability.
    Type: Application
    Filed: July 1, 2021
    Publication date: August 24, 2023
    Inventors: Jingcong ZHANG, Beixin HU, Yuanlong CHEN, Zhili CHEN, Linjie LUO, Jing LIU, Xiao YANG, Guohui WANG, Jianchao YANG
  • Patent number: 11727660
    Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: August 15, 2023
    Assignee: Snap Inc.
    Inventors: Jia Li, Linjie Luo, Rahul Bhupendra Sheth, Ning Xu, Jianchao Yang
  • Publication number: 20230245398
    Abstract: The embodiments of the present disclosure disclose an image effect implementing method and apparatus, an electronic device, a storage medium, a computer program product and a computer program. The method includes: acquiring a first image, recognizing a set object in the first image, and acquiring an augmented reality model corresponding to the set object; superimposing, according to coordinate information of pixels of the set object, the augmented reality model onto the first image to obtain a second image; and upon detection of a preset deformation event, controlling, according to a set deformation policy, at least one sub-model of the augmented reality model in the second image to deform, and displaying the deformed second image.
    Type: Application
    Filed: June 22, 2021
    Publication date: August 3, 2023
    Inventors: Jingcong ZHANG, Yunzhu LI, Haoze LI, Zhili CHEN, Linjie LUO, Jing LIU, Xiao YANG, Guohui WANG, Jianchao YANG, Xuchen SONG
  • Publication number: 20230222749
    Abstract: A positioning model optimization method, an image-based positioning method and positioning device, and a computer-readable storage medium are provided. The positioning model optimization method includes: inputting a positioning model for a scene, the positioning model including a three-dimensional (3D) point cloud and a plurality of descriptors corresponding to each 3D point in the 3D point cloud; determining, for each 3D point in the 3D point cloud, a plurality of neighboring points of the 3D point, and if a distance relationship between each of the plurality of neighboring points and the 3D point is smaller than a predetermined threshold, outputting the 3D point and the plurality of descriptors corresponding to the 3D point to an optimized positioning model for the scene; and outputting the optimized positioning model for the scene.
    Type: Application
    Filed: July 22, 2021
    Publication date: July 13, 2023
    Inventors: Linjie LUO, Jing LIU, Zhili CHEN, Guohui WANG, Xiao YANG, Jianchao YANG, Xiaochen LIAN
  • Patent number: 11676381
    Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
    Type: Grant
    Filed: January 22, 2021
    Date of Patent: June 13, 2023
    Assignee: Snap Inc.
    Inventors: Samuel Edward Hare, Fedir Poliakov, Guohui Wang, Xuehan Xiong, Jianchao Yang, Linjie Yang, Shah Tanmay Anilkumar
  • Patent number: 11645843
    Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
    Type: Grant
    Filed: January 22, 2021
    Date of Patent: May 9, 2023
    Assignee: Snap Inc.
    Inventors: Samuel Edward Hare, Fedir Poliakov, Guohui Wang, Xuehan Xiong, Jianchao Yang, Linjie Yang, Shah Tanmay Anilkumar
  • Patent number: 11645834
    Abstract: Systems, devices, media, and methods are presented for identifying and categorically labeling objects within a set of images. The systems and methods receive an image depicting an object of interest, detect at least a portion of the object of interest within the image using a multilayer object model, determine context information, and identify the object of interest included in two or more bounding boxes.
    Type: Grant
    Filed: November 17, 2020
    Date of Patent: May 9, 2023
    Assignee: Snap Inc.
    Inventors: Wei Han, Jianchao Yang, Ning Zhang, Jia Li
  • Publication number: 20230135137
    Abstract: A modulated segmentation system can use a modulator network to emphasize spatial prior data of an object to track the object across multiple images. The modulated segmentation system can use a segmentation network that receives spatial prior data as intermediate data that improves segmentation accuracy. The segmentation network can further receive visual guide information from a visual guide network to increase tracking accuracy via segmentation.
    Type: Application
    Filed: December 29, 2022
    Publication date: May 4, 2023
    Inventors: Linjie Yang, Jianchao Yang, Xuehan Xiong, Yanran Wang
  • Publication number: 20230135808
    Abstract: Systems and methods are provided for receiving input increasing a default predetermined window of time that the new media collection is accessible and activating the new media collection for the increased predetermined window of time and a geographic boundary size for where media content originates. The systems and methods further cause a plurality of content messages comprising media content originating in the geographical boundary size to be included in the new media collection and displayed in response to a request from a computing device to view the new media collection based on determining the request occurs within the increased predetermined window of time that the new media collection is accessible.
    Type: Application
    Filed: December 29, 2022
    Publication date: May 4, 2023
    Inventors: Nicholas Richard Allen, Sheldon Chang, Maria Pavlovskaia, Amer Shahnawaz, Jianchao Yang
  • Patent number: 11637797
    Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a content message from a first content source, and analyzes the content message to determine one or more quality scores and one or more content values associated with the content message. The server computer system analyzes the content message with a plurality of content collections of the database to identify a match between at least one of the one or more content values and a topic associated with at least a first content collection of the one or more content collections and automatically adds the content message to the first content collection based at least in part on the match. In various embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.
    Type: Grant
    Filed: August 9, 2021
    Date of Patent: April 25, 2023
    Assignee: Snap Inc.
    Inventors: Jianchao Yang, Yuke Zhu, Ning Xu, Kevin Dechau Tang, Jia Li
  • Patent number: 11611846
    Abstract: Systems and methods are provided for receiving input increasing a default predetermined window of time that a new media collection is accessible, sending a request to a server computer for activation of the new media collection including the input, and receiving confirmation that the new media collection was activated for the increased predetermined window of time and a geographic boundary size for where media content originates. The systems and methods further provide for causing a plurality of content messages comprising media content originating in the geographical boundary size to be included in the new media collection and displayed in response to a request from a computing device to view the new media collection based on determining the request occurs within the increased predetermined window of time that the new media collection is accessible.
    Type: Grant
    Filed: November 3, 2021
    Date of Patent: March 21, 2023
    Assignee: Snap Inc.
    Inventors: Nicholas Richard Allen, Sheldon Chang, Maria Pavlovskaia, Amer Shahnawaz, Jianchao Yang
  • Publication number: 20230063920
    Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system communicates at least a portion of a first content collection to a first client device, and receives a first selection communication in response, the first selection communication identifying a first piece of content of the first plurality of pieces of content. The server analyzes analyzing the first piece of content to identify a set of context values for the first piece of content, and accesses accessing a second content collection comprising pieces of content sharing at least a portion of the set of context values of the first piece of content. In various embodiments, different content values, image processing operations, and content selection operations are used to curate the content collections.
    Type: Application
    Filed: October 24, 2022
    Publication date: March 2, 2023
    Inventors: Jianchao Yang, Yuke Zhu, Ning Xu, Kevin Dechau Tang, Jia Li
  • Publication number: 20230061012
    Abstract: An image processing method and apparatus for augmented reality, an electronic device and a storage medium, including: acquiring a target image in response to an image acquiring instruction triggered by a user, where the target image includes a target object; acquiring an augmented reality model of the target object, and outputting the augmented reality model in combination with the target object; acquiring target audio data selected by the user, and determining an audio feature with temporal regularity according to the target audio data; and driving the augmented reality model according to the audio feature and a playing progress of the target audio data when outputting the target audio data.
    Type: Application
    Filed: November 8, 2022
    Publication date: March 2, 2023
    Inventors: Yunzhu LI, Jingcong ZHANG, Xuchen SONG, Jianchao YANG, Guohui WANG, Zhili CHEN, Linjie LUO, Xiao YANG, Haoze LI, Jing LIU
  • Patent number: 11557324
    Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.
    Type: Grant
    Filed: June 8, 2021
    Date of Patent: January 17, 2023
    Assignee: Snap Inc.
    Inventors: Jia Li, Nathan Litke, Jose Jesus (Joseph) Paredes, Rahul Bhupendra Sheth, Daniel Szeto, Ning Xu, Jianchao Yang