Patents by Inventor Ning Xu

Ning Xu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230300119
    Abstract: A method, apparatus and computer program product are provided for encrypting and decrypting data using multiple authority keys including receiving, from a first computing device, a data decrypt request to decrypt encrypted data, the data decrypt request comprising a user key, determining that the user key is associated with a key hierarchy that comprises a server key, decrypting the server key using the user key, decrypting the encrypted data using the decrypted server key and permitting access to the decrypted data by the first computing device.
    Type: Application
    Filed: March 20, 2023
    Publication date: September 21, 2023
    Inventors: Hongjun Li, Ning Xu
  • Patent number: 11763130
    Abstract: A compact neural network system can generate multiple individual filters from a compound filter. Each convolutional layer of a convolutional neural network can include a compound filters used to generate individual filters for that layer. The individual filters overlap in the compound filter and can be extracted using a sampling operation. The extracted individual filters can share weights with nearby filters thereby reducing the overall size of the convolutional neural network.
    Type: Grant
    Filed: November 23, 2020
    Date of Patent: September 19, 2023
    Assignee: SNAP INC.
    Inventors: Yingzhen Yang, Jianchao Yang, Ning Xu
  • Patent number: 11755910
    Abstract: Systems and methods are disclosed for capturing multiple sequences of views of a three-dimensional object using a plurality of virtual cameras. The systems and methods generate aligned sequences from the multiple sequences based on an arrangement of the plurality of virtual cameras in relation to the three-dimensional object. Using a convolutional network, the systems and methods classify the three-dimensional object based on the aligned sequences and identify the three-dimensional object using the classification.
    Type: Grant
    Filed: August 1, 2022
    Date of Patent: September 12, 2023
    Assignee: SNAP INC.
    Inventors: Yuncheng Li, Zhou Ren, Ning Xu, Enxu Yan, Tan Yu
  • Patent number: 11741611
    Abstract: Introduced here are computer programs and associated computer-implemented techniques for training and then applying computer-implemented models designed for segmentation of an object in the frames of video. By training and then applying the segmentation model in a cyclical manner, the errors encountered when performing segmentation can be eliminated rather than propagated. In particular, the approach to segmentation described herein allows the relationship between a reference mask and each target frame for which a mask is to be produced to be explicitly bridged or established. Such an approach ensures that masks are accurate, which in turn means that the segmentation model is less prone to distractions.
    Type: Grant
    Filed: January 26, 2022
    Date of Patent: August 29, 2023
    Assignee: Adobe Inc.
    Inventor: Ning Xu
  • Publication number: 20230259587
    Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for training a generative inpainting neural network to accurately generate inpainted digital images via object-aware training and/or masked regularization. For example, the disclosed systems utilize an object-aware training technique to learn parameters for a generative inpainting neural network based on masking individual object instances depicted within sample digital images of a training dataset. In some embodiments, the disclosed systems also (or alternatively) utilize a masked regularization technique as part of training to prevent overfitting by penalizing a discriminator neural network utilizing a regularization term that is based on an object mask.
    Type: Application
    Filed: February 14, 2022
    Publication date: August 17, 2023
    Inventors: Zhe Lin, Haitian Zheng, Jingwan Lu, Scott Cohen, Jianming Zhang, Ning Xu, Elya Shechtman, Connelly Barnes, Sohrab Amirghodsi
  • Patent number: 11727660
    Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: August 15, 2023
    Assignee: Snap Inc.
    Inventors: Jia Li, Linjie Luo, Rahul Bhupendra Sheth, Ning Xu, Jianchao Yang
  • Patent number: 11715223
    Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.
    Type: Grant
    Filed: January 31, 2022
    Date of Patent: August 1, 2023
    Assignee: Snap Inc.
    Inventors: Kun Duan, Daniel Ron, Chongyang Ma, Ning Xu, Shenlong Wang, Sumant Milind Hanumante, Dhritiman Sagar
  • Publication number: 20230237709
    Abstract: Systems and methods for image processing are described. Embodiments of the present disclosure identify a first image depicting a first object; identify a plurality of candidate images depicting a second object; select a second image from the plurality of candidate images depicting the second object based on the second image and a sequence of previous images including the first image using a crop selection network trained to select a next compatible image based on the sequence of previous images; and generate a composite image depicting the first object and the second object based on the first image and the second image.
    Type: Application
    Filed: January 27, 2022
    Publication date: July 27, 2023
    Inventor: Ning Xu
  • Patent number: 11704893
    Abstract: Aspects of the present disclosure involve a system comprising a storage medium storing a program and method for receiving a video comprising a plurality of video segments; selecting a target action sequence that includes a sequence of action phases; receiving features of each of the video segments; computing, based on the received features, for each of the plurality of video segments, a plurality of action phase confidence scores indicating a likelihood that a given video segment includes a given action phase of the sequence of action phases; identifying a set of consecutive video segments of the plurality of video segments that corresponds to the target action sequence, wherein video segments in the set of consecutive video segments are arranged according to the sequence of action phases; and generating a display of the video that includes the set of consecutive video segments and skips other video segments in the video.
    Type: Grant
    Filed: September 2, 2021
    Date of Patent: July 18, 2023
    Assignee: Snap Inc.
    Inventors: Zhou Ren, Yuncheng Li, Ning Xu, Enxu Yan, Tan Yu
  • Patent number: 11694101
    Abstract: A system according to which a network of physical sensors are configured to detect and track the performance of aircraft engines. The physical sensors are placed in specific locations to detect an exhaust gas temperature, vibration, speed, oil pressure, and fuel flow for each aircraft engine. The performance of each aircraft engine is then viewed in combination with oil consumption associated with that aircraft engine and the routine maintenance program associated with that aircraft engine to route the aircraft and move the aircraft, in accordance with the routing, to a specific location. The sensors efficiently track the performance and physical condition of the engines. Moreover, a listing of identified “at-risk” engines is displayed on a screen of a GUI in a manner that allows for easy navigation and display. Data point(s) that triggered the identification of each “at-risk” engine are easily accessible and viewable.
    Type: Grant
    Filed: July 12, 2022
    Date of Patent: July 4, 2023
    Assignee: AMERICAN AIRLINES, INC.
    Inventors: Ning Xu, Jose Antonio Ramirez-Hernandez, Steven James Oakley, Mei Zhang, Ou Bai, Supreet Reddy Mandala
  • Publication number: 20230206793
    Abstract: A circuit board, a display module, and a display device are provided. The circuit board includes: a base substrate including a first surface and a second surface opposite to each other; bonding pads on the first surface; test pads electrically connected to the bonding pads and disposed on the second surface; a test auxiliary structure on the second surface; and a metal layer on the second surface. The test auxiliary structure overlaps with the test pads along a first direction which is a direction perpendicular to the first surface and the second surface of the base substrate; and the metal layer includes a metal structure for transmitting a first signal and the test auxiliary structure is insulated from the metal structure.
    Type: Application
    Filed: February 25, 2022
    Publication date: June 29, 2023
    Inventors: Ning XU, Xiong YANG, Zhihua YU
  • Publication number: 20230206462
    Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods that utilize a progressive refinement network to refine alpha mattes generated utilizing a mask-guided matting neural network. In particular, the disclosed systems can use the matting neural network to process a digital image and a coarse guidance mask to generate alpha mattes at discrete neural network layers. In turn, the disclosed systems can use the progressive refinement network to combine alpha mattes and refine areas of uncertainty. For example, the progressive refinement network can combine a core alpha matte corresponding to more certain core regions of a first alpha matte and a boundary alpha matte corresponding to uncertain boundary regions of a second, higher resolution alpha matte. Based on the combination of the core alpha matte and the boundary alpha matte, the disclosed systems can generate a final alpha matte for use in image matting processes.
    Type: Application
    Filed: February 27, 2023
    Publication date: June 29, 2023
    Inventors: Qihang Yu, Jianming Zhang, He Zhang, Yilin Wang, Zhe Lin, Ning Xu
  • Patent number: 11670023
    Abstract: This disclosure involves executing artificial intelligence models that infer image editing operations from natural language requests spoken by a user. Further, this disclosure performs the inferred image editing operations using inferred parameters for the image editing operations. Systems and methods may be provided that infer one or more image editing operations from a natural language request associated with a source image, locate areas of the source that are relevant to the one or more image editing operations to generate image masks, and performing the one or more image editing operations to generate a modified source image.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: June 6, 2023
    Assignee: Adobe Inc.
    Inventors: Ning Xu, Trung Bui, Jing Shi, Franck Dernoncourt
  • Publication number: 20230169326
    Abstract: A method for training a neural network system for generating paired low resolution (LR) and high resolution (HR) images, the neural network system, an apparatus, and a non-transitory computer-readable storage medium thereof are provided. The method includes that a first generator in the neural network system generates a LR image based on a random vector; a second generator in the neural network system generates a HR image based on the random vector, where the HR image is paired with the LR image; obtaining a plurality of losses based on the LR image and the HR image; and updating the first generator based on the plurality of losses.
    Type: Application
    Filed: November 30, 2021
    Publication date: June 1, 2023
    Applicant: KWAI INC.
    Inventors: Ahmed Cheikh SIDIYA, Xuan XU, Ning XU
  • Publication number: 20230169626
    Abstract: A neural network system for restoring images, a method and a non-transitory computer-readable storage medium thereof are provided. The neural network system includes an encoder and a generative adversarial network (GAN) prior network. The encoder includes a plurality of encoder blocks, where each encoder block includes at least one transformer block and one convolution layer, where the encoder receives an input image and generates a plurality of encoder features and a plurality of latent vectors. Additionally, the GAN prior network includes a plurality of pre-trained generative prior layers, where the GAN prior network receives the plurality of encoder features and the plurality of latent vectors from the encoder and generates an output image with super-resolution.
    Type: Application
    Filed: November 30, 2021
    Publication date: June 1, 2023
    Applicant: KWAI INC.
    Inventors: Ahmed Cheikh SIDIYA, Xuan XU, Ning XU
  • Publication number: 20230127652
    Abstract: Systems and methods for natural language processing are described. One or more embodiments of the present disclosure generate a word representation vector for each word of a text comprising an event trigger word and an argument candidate word; generate a dependency tree based on the text and the word representation vector; determine that at least one word of the text is independent of a relationship between the event trigger word and the argument candidate word; remove the at least one word from the dependency tree based on the determination to obtain a pruned dependency tree; generate a modified representation vector for each word of the pruned dependency tree using a graph convolutional network (GCN); and identify the relationship between the event trigger word and the argument candidate word based on the modified representation vector for each word of the pruned dependency tree.
    Type: Application
    Filed: October 25, 2021
    Publication date: April 27, 2023
    Inventors: Amir Pouran Ben Veyseh, Franck Dernoncourt, Ning Xu
  • Publication number: 20230126177
    Abstract: The present disclosure relates to systems and methods for automatically processing images based on a user request. In some examples, a request is divided into a retouching command (e.g., a global edit) and an inpainting command (e.g., a local edit). A retouching mask and an inpainting mask are generated to indicate areas where the edits will be applied. A photo-request attention and a multi-modal modulation process are applied to features representing the image, and a modified image that incorporates the user's request is generated using the modified features.
    Type: Application
    Filed: October 27, 2021
    Publication date: April 27, 2023
    Inventors: Ning Xu, Zhe Lin, Franck Dernoncourt
  • Patent number: 11636147
    Abstract: The present disclosure relates to a tag-based font recognition system that utilizes a multi-learning framework to develop and improve tag-based font recognition using deep learning neural networks. In particular, the tag-based font recognition system jointly trains a font tag recognition neural network with an implicit font classification attention model to generate font tag probability vectors that are enhanced by implicit font classification information. Indeed, the font recognition system weights the hidden layers of the font tag recognition neural network with implicit font information to improve the accuracy and predictability of the font tag recognition neural network, which results in improved retrieval of fonts in response to a font tag query. Accordingly, using the enhanced tag probability vectors, the tag-based font recognition system can accurately identify and recommend one or more fonts in response to a font tag query.
    Type: Grant
    Filed: January 26, 2022
    Date of Patent: April 25, 2023
    Assignee: Adobe Inc.
    Inventors: Zhaowen Wang, Tianlang Chen, Ning Xu, Hailin Jin
  • Patent number: 11637797
    Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a content message from a first content source, and analyzes the content message to determine one or more quality scores and one or more content values associated with the content message. The server computer system analyzes the content message with a plurality of content collections of the database to identify a match between at least one of the one or more content values and a topic associated with at least a first content collection of the one or more content collections and automatically adds the content message to the first content collection based at least in part on the match. In various embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.
    Type: Grant
    Filed: August 9, 2021
    Date of Patent: April 25, 2023
    Assignee: Snap Inc.
    Inventors: Jianchao Yang, Yuke Zhu, Ning Xu, Kevin Dechau Tang, Jia Li
  • Patent number: 11636570
    Abstract: This disclosure describes one or more implementations of a digital image semantic layout manipulation system that generates refined digital images resembling the style of one or more input images while following the structure of an edited semantic layout. For example, in various implementations, the digital image semantic layout manipulation system builds and utilizes a sparse attention warped image neural network to generate high-resolution warped images and a digital image layout neural network to enhance and refine the high-resolution warped digital image into a realistic and accurate refined digital image.
    Type: Grant
    Filed: April 1, 2021
    Date of Patent: April 25, 2023
    Assignee: Adobe Inc.
    Inventors: Haitian Zheng, Zhe Lin, Jingwan Lu, Scott Cohen, Jianming Zhang, Ning Xu