Patents by Inventor Jianchao Yang
Jianchao Yang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240104810Abstract: Embodiments of the disclosure provide a method and a device for processing a portrait image, the method includes: acquiring a to-be-processed portrait image; inputting the to-be-processed portrait image into an image processing model, and acquiring a head smear image output by the image processing model, where the image processing model is configured to smear a hair area of a portrait located above a preset boundary in the portrait image, and the image processing model is generated by training a sample data set of a sample portrait image and a sample head smear image corresponding to the sample portrait image; rendering the head smear image with a head effect material to obtain a portrait image added with an effect; and displaying the portrait image added with the effect.Type: ApplicationFiled: November 22, 2021Publication date: March 28, 2024Inventors: Xiao YANG, Jianwei LI, Ding LIU, Yangyue WAN, Xiaohui SHEN, Jianchao YANG
-
Publication number: 20240046072Abstract: A modulated segmentation system can use a modulator network to emphasize spatial prior data of an object to track the object across multiple images. The modulated segmentation system can use a segmentation network that receives spatial prior data as intermediate data that improves segmentation accuracy. The segmentation network can further receive visual guide information from a visual guide network to increase tracking accuracy via segmentation.Type: ApplicationFiled: October 18, 2023Publication date: February 8, 2024Inventors: Linjie Yang, Jianchao Yang, Xuehan Xiong, Yanran Wang
-
Patent number: 11895068Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a plurality of content communications from a plurality of client devices, each content communication comprising an associated piece of content and a corresponding metadata. Each content communication is processed to determine associated context values for each piece of content, each associated context value comprising at least one content value generated by machine vision processing of the associated piece of content. A first content collection is automatically generated based on context values, and a set of user accounts are associated with the collection. An identifier associated with the first content collection is published to user devices associated with user accounts. In various additional embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.Type: GrantFiled: July 12, 2021Date of Patent: February 6, 2024Assignee: Snap Inc.Inventors: Jianchao Yang, Yuke Zhu, Ning Xu, Kevin Dechau Tang, Jia Li
-
Patent number: 11889381Abstract: Systems and methods are provided for receiving input increasing a default predetermined window of time that the new media collection is accessible and activating the new media collection for the increased predetermined window of time and a geographic boundary size for where media content originates. The systems and methods further cause a plurality of content messages comprising media content originating in the geographical boundary size to be included in the new media collection and displayed in response to a request from a computing device to view the new media collection based on determining the request occurs within the increased predetermined window of time that the new media collection is accessible.Type: GrantFiled: December 29, 2022Date of Patent: January 30, 2024Assignee: Snap Inc.Inventors: Nicholas Richard Allen, Sheldon Chang, Maria Pavlovskaia, Amer Shahnawaz, Jianchao Yang
-
Patent number: 11887357Abstract: Disclosed herein are arrangements that facilitate the transfer of knowledge from models for a source data-processing domain to models for a target data-processing domain. A convolutional neural network space for a source domain is factored into a first classification space and a first reconstruction space. The first classification space stores class information and the first reconstruction space stores domain-specific information. A convolutional neural network space for a target domain is factored into a second classification space and a second reconstruction space. The second classification space stores class information and the second reconstruction space stores domain-specific information. Distribution of the first classification space and the second classification space is aligned.Type: GrantFiled: December 10, 2021Date of Patent: January 30, 2024Assignee: Snap Inc.Inventors: Jianchao Yang, Ning Xu, Jian Ren
-
Patent number: 11847528Abstract: A modulated segmentation system can use a modulator network to emphasize spatial prior data of an object to track the object across multiple images. The modulated segmentation system can use a segmentation network that receives spatial prior data as intermediate data that improves segmentation accuracy. The segmentation network can further receive visual guide information from a visual guide network to increase tracking accuracy via segmentation.Type: GrantFiled: December 29, 2022Date of Patent: December 19, 2023Assignee: Snap Inc.Inventors: Linjie Yang, Jianchao Yang, Xuehan Xiong, Yanran Wang
-
Publication number: 20230401791Abstract: A landmark data collection method includes: determining (S100) a first basic collection point (A), a second basic collection point (B), and a third basic collection point (C) sequentially in an observation area of a landmark building; and collecting (S200) photos of the landmark building based on each of the first basic collection point (A), the second basic collection point (B), and the third basic collection point (C) to obtain landmark data of the landmark building. A photo of the landmark building is taken by a camera at the i-th basic collection point; and a collection point is determined at every predetermined distance interval as the camera is moved in a counterclockwise direction and/or a clockwise direction, and the photo of the landmark building is taken by the camera at the collection point, until the camera is moved out of the observation area, where i=1, 2, 3.Type: ApplicationFiled: August 4, 2021Publication date: December 14, 2023Inventors: Zhili CHEN, Linjie LUO, Xiao YANG, Jianchao YANG, Jing LIU, Guohui WANG
-
Patent number: 11830209Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.Type: GrantFiled: February 17, 2022Date of Patent: November 28, 2023Assignee: SNAP INC.Inventors: Travis Chen, Samuel Edward Hare, Yuncheng Li, Tony Mathew, Jonathan Solichin, Jianchao Yang, Ning Zhang
-
Publication number: 20230359859Abstract: A compact neural network system can generate multiple individual filters from a compound filter. Each convolutional layer of a convolutional neural network can include a compound filters used to generate individual filters for that layer. The individual filters overlap in the compound filter and can be extracted using a sampling operation. The extracted individual filters can share weights with nearby filters thereby reducing the overall size of the convolutional neural network.Type: ApplicationFiled: July 17, 2023Publication date: November 9, 2023Inventors: Yingzhen Yang, Jianchao Yang, Ning Xu
-
Publication number: 20230362331Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.Type: ApplicationFiled: July 13, 2023Publication date: November 9, 2023Inventors: Lidiia Bogdanovych, William Brendel, Samuel Edward Hare, Fedir Poliakov, Guohui Wang, Xuehan Xiong, Jianchao Yang, Linjie Yang
-
Publication number: 20230328197Abstract: Embodiments of the present disclosure provide a display method and apparatus based on augmented reality, a device, and a storage medium, the method includes receiving a first video; acquiring a video material by segmenting a target object from the first video; acquiring and displaying a real scene image, where the real scene image is acquired by an image collection apparatus; and displaying the video material at a target position of the real scene image in an augmented manner and playing the video material. Since the video material is acquired by receiving the first video and segmenting the target object from the first video, the video material may be set according to the needs of the user.Type: ApplicationFiled: June 9, 2023Publication date: October 12, 2023Inventors: Yaxi GAO, Chenyu SUN, Xiao YANG, Zhili CHEN, Linjie LUO, Jing LIU, Hengkai GUO, Huaxia LI, Hwankyoo Shawn KIM, Jianchao YANG
-
Publication number: 20230306694Abstract: A list information display method and apparatus, an electronic device, and a storage medium are provided, the method includes: displaying list information in response to an information display operation triggered by a user; obtaining a real scene shooting image; and loading a plurality of types of information related to the list information into the real scene shooting image and display the real scene shooting image. Due to the use of virtual enhanced display technology, while the list information is displayed in the real scene shooting image, the plurality of types of information related to the list information are also displayed. On one hand, the user can obtain more information related to the list information while obtaining the list information, which improves the efficiency of information acquisition; and on the other hand, the user can obtain information in the real scene shooting image, which improves the visual effect and interactive experience.Type: ApplicationFiled: August 26, 2021Publication date: September 28, 2023Inventors: Jingcong ZHANG, Weikai LI, Zihao CHEN, Guohui WANG, Xiao YANG, Haiying CHENG, Anda LI, Ray MCCLURE, Zhili CHEN, Yiheng ZHU, Shihkuang CHU, Liyou XU, Yunzhu LI, Jianchao YANG
-
Patent number: 11763130Abstract: A compact neural network system can generate multiple individual filters from a compound filter. Each convolutional layer of a convolutional neural network can include a compound filters used to generate individual filters for that layer. The individual filters overlap in the compound filter and can be extracted using a sampling operation. The extracted individual filters can share weights with nearby filters thereby reducing the overall size of the convolutional neural network.Type: GrantFiled: November 23, 2020Date of Patent: September 19, 2023Assignee: SNAP INC.Inventors: Yingzhen Yang, Jianchao Yang, Ning Xu
-
Publication number: 20230290094Abstract: A positioning model optimization method, a positioning method, and a positioning device are provided. The positioning model optimization method includes: inputting a positioning model for a scene, the positioning model including a three-dimensional (3D) point cloud and a plurality of descriptors corresponding to each 3D point in the 3D point cloud; calculating a significance of each 3D point in the 3D point cloud, and if the significance is greater than a predetermined threshold, outputting the 3D point and the plurality of descriptors corresponding to the 3D point to an optimized positioning model for the scene; and outputting the optimized positioning model for the scene.Type: ApplicationFiled: July 22, 2021Publication date: September 14, 2023Inventors: Linjie LUO, Jing LIU, Zhili CHEN, Guohui WANG, Xiao YANG., Jianchao YANG, Xiaochen LIAN
-
Patent number: 11756276Abstract: An image processing method and apparatus for augmented reality, an electronic device and a storage medium, including: acquiring a target image in response to an image acquiring instruction triggered by a user, where the target image includes a target object; acquiring an augmented reality model of the target object, and outputting the augmented reality model in combination with the target object; acquiring target audio data selected by the user, and determining an audio feature with temporal regularity according to the target audio data; and driving the augmented reality model according to the audio feature and a playing progress of the target audio data when outputting the target audio data.Type: GrantFiled: November 8, 2022Date of Patent: September 12, 2023Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.Inventors: Yunzhu Li, Jingcong Zhang, Xuchen Song, Jianchao Yang, Guohui Wang, Zhili Chen, Linjie Luo, Xiao Yang, Haoze Li, Jing Liu
-
Publication number: 20230274543Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.Type: ApplicationFiled: May 4, 2023Publication date: August 31, 2023Inventors: Samuel Edward Hare, Fedir Poliakov, Guohui Wang, Xuehan Xiong, Jianchao Yang, Linjie Yang, Shah Tanmay Anilkumar
-
Patent number: 11743426Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can he assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented. using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.Type: GrantFiled: August 13, 2020Date of Patent: August 29, 2023Assignee: Snap Inc.Inventors: Lidiia Bogdanovych, William Brendel, Samuel Edward Hare, Fedir Poliakov, Guohui Wang, Xuehan Xiong, Jianchao Yang, Linjie Yang
-
Publication number: 20230267664Abstract: An animation processing method and apparatus, an electronic device and a storage medium, applied to a shader, the method including: acquiring an animation sample of a model unit; acquiring an external interaction parameter of an augmented reality model, where the augmented reality model includes a plurality of model units; and outputting the augmented reality model, and driving the animation sample of the model unit in the output augmented reality model according to the external interaction parameter. The animation sample of the model unit can be driven according to the external interaction parameter, so that animation of the model can be adjusted according to user operation, thereby improving usability.Type: ApplicationFiled: July 1, 2021Publication date: August 24, 2023Inventors: Jingcong ZHANG, Beixin HU, Yuanlong CHEN, Zhili CHEN, Linjie LUO, Jing LIU, Xiao YANG, Guohui WANG, Jianchao YANG
-
Patent number: 11727660Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.Type: GrantFiled: April 18, 2022Date of Patent: August 15, 2023Assignee: Snap Inc.Inventors: Jia Li, Linjie Luo, Rahul Bhupendra Sheth, Ning Xu, Jianchao Yang
-
Publication number: 20230245398Abstract: The embodiments of the present disclosure disclose an image effect implementing method and apparatus, an electronic device, a storage medium, a computer program product and a computer program. The method includes: acquiring a first image, recognizing a set object in the first image, and acquiring an augmented reality model corresponding to the set object; superimposing, according to coordinate information of pixels of the set object, the augmented reality model onto the first image to obtain a second image; and upon detection of a preset deformation event, controlling, according to a set deformation policy, at least one sub-model of the augmented reality model in the second image to deform, and displaying the deformed second image.Type: ApplicationFiled: June 22, 2021Publication date: August 3, 2023Inventors: Jingcong ZHANG, Yunzhu LI, Haoze LI, Zhili CHEN, Linjie LUO, Jing LIU, Xiao YANG, Guohui WANG, Jianchao YANG, Xuchen SONG