Patents by Inventor Ning Xu

Ning Xu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220156956
    Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.
    Type: Application
    Filed: January 31, 2022
    Publication date: May 19, 2022
    Inventors: Kun Duan, Daniel Ron, Chongyang Ma, Ning Xu, Shenlong Wang, Sumant Milind Hanumante, Dhritiman Sagar
  • Publication number: 20220148325
    Abstract: The present disclosure relates to a tag-based font recognition system that utilizes a multi-learning framework to develop and improve tag-based font recognition using deep learning neural networks. In particular, the tag-based font recognition system jointly trains a font tag recognition neural network with an implicit font classification attention model to generate font tag probability vectors that are enhanced by implicit font classification information. Indeed, the font recognition system weights the hidden layers of the font tag recognition neural network with implicit font information to improve the accuracy and predictability of the font tag recognition neural network, which results in improved retrieval of fonts in response to a font tag query. Accordingly, using the enhanced tag probability vectors, the tag-based font recognition system can accurately identify and recommend one or more fonts in response to a font tag query.
    Type: Application
    Filed: January 26, 2022
    Publication date: May 12, 2022
    Inventors: Zhaowen Wang, Tianlang Chen, Ning Xu, Hailin Jin
  • Publication number: 20220148183
    Abstract: Introduced here are computer programs and associated computer-implemented techniques for training and then applying computer-implemented models designed for segmentation of an object in the frames of video. By training and then applying the segmentation model in a cyclical manner, the errors encountered when performing segmentation can be eliminated rather than propagated. In particular, the approach to segmentation described herein allows the relationship between a reference mask and each target frame for which a mask is to be produced to be explicitly bridged or established. Such an approach ensures that masks are accurate, which in turn means that the segmentation model is less prone to distractions.
    Type: Application
    Filed: January 26, 2022
    Publication date: May 12, 2022
    Inventor: Ning Xu
  • Publication number: 20220136733
    Abstract: The present invention discloses a film type liquid heater and a uniform heating method thereof. End fixation plates are arranged at two ends of a barrel. A heating pipe is arranged in the barrel. Pipe ports run through the two end fixation plates, respectively. Connecting pipes are arranged in the pipe ports. Sealing connection components are arranged at inner ends of the two connecting pipes. A heating film layer is coated outside the heating pipe. Electrode layers are connected left and right sides of the heating film layer, and the electrode layers are connected to an external power supply. An insulating layer is coated outside the heating film layer. A flow splitting column is fixedly connected in the heating pipe. A heating chamber is formed between an inner side of the heating pipe and the flow splitting column. Flow splitting grooves are formed at left and right ends and on the inner side of the flow splitting column.
    Type: Application
    Filed: December 31, 2020
    Publication date: May 5, 2022
    Inventors: XIN FU, ZHENG LUO, YIWEN ZHAO, SEN DU, NING XU
  • Patent number: 11314982
    Abstract: Systems and methods are disclosed for selecting target objects within digital images. In particular, in one or more embodiments, the disclosed systems and methods generate a trained neural network based on training digital images and training indicators. Moreover, one or more embodiments of the disclosed systems and methods utilize a trained neural network and iterative user indicators to select targeted objects in digital images. Specifically, the disclosed systems and methods can transform user indicators into distance maps that can be utilized in conjunction with color channels and a trained neural network to identify pixels that reflect the target object.
    Type: Grant
    Filed: December 11, 2018
    Date of Patent: April 26, 2022
    Assignee: Adobe Inc.
    Inventors: Brian Price, Scott Cohen, Ning Xu
  • Patent number: 11315219
    Abstract: Remote distribution of multiple neural network models to various client devices over a network can be implemented by identifying a native neural network and remotely converting the native neural network to a target neural network based on a given client device operating environment. The native neural network can be configured for execution using efficient parameters, and the target neural network can use less efficient but more precise parameters.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: April 26, 2022
    Assignee: Snap Inc.
    Inventors: Guohui Wang, Sumant Milind Hanumante, Ning Xu, Yuncheng Li
  • Publication number: 20220122357
    Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media for generating a response to a question received from a user during display or playback of a video segment by utilizing a query-response-neural network. The disclosed systems can extract a query vector from a question corresponding to the video segment using the query-response-neural network. The disclosed systems further generate context vectors representing both visual cues and transcript cues corresponding to the video segment using context encoders or other layers from the query-response-neural network. By utilizing additional layers from the query-response-neural network, the disclosed systems generate (i) a query-context vector based on the query vector and the context vectors, and (ii) candidate-response vectors representing candidate responses to the question from a domain-knowledge base or other source.
    Type: Application
    Filed: December 28, 2021
    Publication date: April 21, 2022
    Inventors: Wentian Zhao, Seokhwan Kim, Ning Xu, Hailin Jin
  • Patent number: 11308706
    Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.
    Type: Grant
    Filed: July 13, 2020
    Date of Patent: April 19, 2022
    Assignee: Snap Inc.
    Inventors: Jia Li, Linjie Luo, Rahul Bhupendra Sheth, Ning Xu, Jianchao Yang
  • Patent number: 11308628
    Abstract: Methods and systems are provided for generating mattes for input images. A neural network system is trained to generate a matte for an input image utilizing contextual information within the image. Patches from the image and a corresponding trimap are extracted, and alpha values for each individual image patch are predicted based on correlations of features in different regions within the image patch. Predicting alpha values for an image patch may also be based on contextual information from other patches extracted from the same image. This contextual information may be determined by determining correlations between features in the query patch and context patches. The predicted alpha values for an image patch form a matte patch, and all matte patches generated for the patches are stitched together to form an overall matte for the input image.
    Type: Grant
    Filed: April 14, 2020
    Date of Patent: April 19, 2022
    Assignee: ADOBE INC.
    Inventor: Ning Xu
  • Patent number: 11301725
    Abstract: The present invention discloses a visual relationship detection method based on a region-aware learning mechanism, comprising: acquiring a triplet graph structure and combining features after its aggregation with neighboring nodes, using the features as nodes in a second graph structure, and connecting in accordance with equiprobable edges to form the second graph structure; combining node features of the second graph structure with features of corresponding entity object nodes in the triplet, using the combined features as a visual attention mechanism and merging internal region visual features extracted by two entity objects, and using the merged region visual features as visual features to be used in the next message propagation by corresponding entity object nodes in the triplet; and after a certain number of times of message propagations, combining the output triplet node features and the node features of the second graph structure to infer predicates between object sets.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: April 12, 2022
    Assignee: TIANJIN UNIVERSITY
    Inventors: Anan Liu, Hongshuo Tian, Ning Xu, Weizhi Nie, Dan Song
  • Patent number: 11276190
    Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: March 15, 2022
    Assignee: Snap Inc.
    Inventors: Kun Duan, Daniel Ron, Chongyang Ma, Ning Xu, Shenlong Wang, Sumant Milind Hanumante, Dhritiman Sagar
  • Publication number: 20220067992
    Abstract: This disclosure involves executing artificial intelligence models that infer image editing operations from natural language requests spoken by a user. Further, this disclosure performs the inferred image editing operations using inferred parameters for the image editing operations. Systems and methods may be provided that infer one or more image editing operations from a natural language request associated with a source image, locate areas of the source that are relevant to the one or more image editing operations to generate image masks, and performing the one or more image editing operations to generate a modified source image.
    Type: Application
    Filed: August 31, 2020
    Publication date: March 3, 2022
    Inventors: Ning XU, Trung Bui, Jing Shi, Franck Dernoncourt
  • Patent number: 11263750
    Abstract: Introduced here are computer programs and associated computer-implemented techniques for training and then applying computer-implemented models designed for segmentation of an object in the frames of video. By training and then applying the segmentation model in a cyclical manner, the errors encountered when performing segmentation can be eliminated rather than propagated. In particular, the approach to segmentation described herein allows the relationship between a reference mask and each target frame for which a mask is to be produced to be explicitly bridged or established. Such an approach ensures that masks are accurate, which in turn means that the segmentation model is less prone to distractions.
    Type: Grant
    Filed: October 30, 2020
    Date of Patent: March 1, 2022
    Assignee: Adobe Inc.
    Inventor: Ning Xu
  • Patent number: 11244167
    Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media for generating a response to a question received from a user during display or playback of a video segment by utilizing a query-response-neural network. The disclosed systems can extract a query vector from a question corresponding to the video segment using the query-response-neural network. The disclosed systems further generate context vectors representing both visual cues and transcript cues corresponding to the video segment using context encoders or other layers from the query-response-neural network. By utilizing additional layers from the query-response-neural network, the disclosed systems generate (i) a query-context vector based on the query vector and the context vectors, and (ii) candidate-response vectors representing candidate responses to the question from a domain-knowledge base or other source.
    Type: Grant
    Filed: February 6, 2020
    Date of Patent: February 8, 2022
    Assignee: Adobe Inc.
    Inventors: Wentian Zhao, Seokhwan Kim, Ning Xu, Hailin Jin
  • Patent number: 11244207
    Abstract: The present disclosure relates to a tag-based font recognition system that utilizes a multi-learning framework to develop and improve tag-based font recognition using deep learning neural networks. In particular, the tag-based font recognition system jointly trains a font tag recognition neural network with an implicit font classification attention model to generate font tag probability vectors that are enhanced by implicit font classification information. Indeed, the font recognition system weights the hidden layers of the font tag recognition neural network with implicit font information to improve the accuracy and predictability of the font tag recognition neural network, which results in improved retrieval of fonts in response to a font tag query. Accordingly, using the enhanced tag probability vectors, the tag-based font recognition system can accurately identify and recommend one or more fonts in response to a font tag query.
    Type: Grant
    Filed: November 23, 2020
    Date of Patent: February 8, 2022
    Assignee: Adobe Inc.
    Inventors: Zhaowen Wang, Tianlang Chen, Ning Xu, Hailin Jin
  • Publication number: 20220038402
    Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a plurality of content communications from a plurality of client devices, each content communication comprising an associated piece of content and a corresponding metadata. Each content communication is processed to determine associated context values for each piece of content, each associated context value comprising at least one content value generated by machine vision processing of the associated piece of content. A first content collection is automatically generated based on context values, and a set of user accounts are associated with the collection. An identifier associated with the first content collection is published to user devices associated with user accounts. In various additional embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.
    Type: Application
    Filed: July 12, 2021
    Publication date: February 3, 2022
    Inventors: Jianchao Yang, Yuke Zhu, Ning Xu, Kevin Dechau Tang, Jia Li
  • Publication number: 20220027405
    Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a content message from a first content source, and analyzes the content message to determine one or more quality scores and one or more content values associated with the content message. The server computer system analyzes the content message with a plurality of content collections of the database to identify a match between at least one of the one or more content values and a topic associated with at least a first content collection of the one or more content collections and automatically adds the content message to the first content collection based at least in part on the match. In various embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.
    Type: Application
    Filed: August 9, 2021
    Publication date: January 27, 2022
    Inventors: Jianchao Yang, Yuke Zhu, Ning Xu, Kevin Dechau Tang, Jia Li
  • Publication number: 20220014390
    Abstract: A method, apparatus and computer program product are provided for generating a registered certified seal, sealing an asset, and verifying a sealed asset. In an example embodiment, a method is provided for receiving a request to generate a registered certified seal from an entity, accessing certifier entity data via a uniform resource locator of a certification authority identified by a certifying certificate, and verifying a digitally signed entity certifying certificate. The method further comprises upon verifying the digitally signed entity certifying certificate, receiving seal data comprising a seal data key for a certified seal, and saving the seal data for the entity within a digital seal registry, wherein the digital seal registry is searchable based at least in part on at least a portion of the seal data key.
    Type: Application
    Filed: September 24, 2021
    Publication date: January 13, 2022
    Inventors: Hongjun Li, Ning Xu
  • Patent number: 11215368
    Abstract: A range hood, including a housing with an opening at one side and a fume inlet panel component which is provided on the housing, the fume inlet panel component is provided at the opening of the housing, a fan is provided in an inner cavity of the housing, the fume inlet panel component is configured in such a way that at least a region of the opening of the housing corresponding to the fan can be opened, and the fan can be removed from the region. When the fan and an inner surface of a volute need to be cleaned, a user can conveniently remove the fan from one side of the fume inlet panel component and clean the removed fan and access an interior of the volute to clean an inside surface of the volute, ensuring extraction capability and increasing a service life of the range hood.
    Type: Grant
    Filed: December 27, 2017
    Date of Patent: January 4, 2022
    Assignees: GREE ELECTRIC APPLIANCES (WUHAN) CO., LTD, GREE ELECTRIC APPLIANCES, INC. OF ZHUHAI
    Inventors: Hai Deng, Xiaodi Hu, Luohuo Ding, Ning Xu, Hong Wang, Min Liu
  • Patent number: 11217131
    Abstract: The present disclosure relates to the field of circuit testing technologies and discloses a flexible circuit board and a test fixture. The flexible circuit board comprises: a flexible body which has a first crimping portion and an extension portion, the first crimping portion being used to be laminated with a second crimping portion of a substrate to be tested; a first electrically connected structure which is located on a first side of the flexible body, arranged on the first crimping portion, and used to be laminated with a second electrically connected structure on the second crimping portion; a support structure which is located on the first side of the flexible body and includes a first support portion and a second support portion; the first support portion is arranged on the extension portion and configured to support the extension portion in the laminating state.
    Type: Grant
    Filed: November 4, 2019
    Date of Patent: January 4, 2022
    Assignee: WUHAN TIANMA MICRO-ELECTRONICS CO., LTD.
    Inventors: Huijian Xia, Ning Xu