Patents by Inventor Qing Jin

Qing Jin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12705875
    Abstract: Described is a system for improving machine learning models by accessing a first latent diffusion machine learning model, accessing a second latent diffusion machine learning model that was derived from the first latent diffusion machine learning model, the second latent diffusion machine learning model trained to perform a second number of denoising steps, generating noise data, processing the noise data via the first latent diffusion machine learning model to generate one or more first latent features, processing the noise data via the second latent diffusion machine learning model to generate one or more second latent features, and inputting the one or more first latent features and the one or more second latent features into a loss function. The system then modifies a parameter of the second latent diffusion machine learning model based on the output of the loss function.
    Type: Grant
    Filed: March 5, 2024
    Date of Patent: August 11, 2026
    Assignee: Snap Inc.
    Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
  • Patent number: 12645936
    Abstract: Techniques for training a neural network having a plurality of computational layers with associated weights and activations for computational layers in fixed-point formats include determining an optimal fractional length for weights and activations for the computational layers; training a learned clipping-level with fixed-point quantization using a PACT process for the computational layers; and quantizing on effective weights that fuses a weight of a convolution layer with a weight and running variance from a batch normalization layer. A fractional length for weights of the computational layers is determined from current values of weights using the determined optimal fractional length for the weights of the computational layers. A fixed-point activation between adjacent computational layers is related using PACT quantization of the clipping-level and an activation fractional length from a node in a following computational layer.
    Type: Grant
    Filed: December 31, 2021
    Date of Patent: June 2, 2026
    Assignee: Snap Inc.
    Inventors: Sumant Milind Hanumante, Qing Jin, Sergei Korolev, Denys Makoviichuk, Jian Ren, Dhritiman Sagar, Patrick Timothy McSweeney Simons, Sergey Tulyakov, Yang Wen, Richard Zhuang
  • Patent number: 12630993
    Abstract: A system for loading dynamic stress on subgrade or foundation based on multi-servo channel and a control method thereof. The system comprises: connecting plate; five dynamic actuators are hinged between connecting frame and the connecting plate; four of them form 4-RPR parallel mechanism, another one is arranged in middle of the 4-RPR parallel mechanism; loading part is mounted at center under the connecting frame; and restraining plate is arranged under the loading part and freely contacts with the loading part; four static actuators are arranged between the restraining plate and the connecting plate; wherein, the static actuators and dynamic actuators are dynamic-static cooperative controlled through multi-servo channel, to simulate principal stress axes rotation effect of a soil body of subgrade or foundation The system can realize the principal stress axes rotation effect in the subgrade or foundation through dynamic-static cooperative loading and can simulate different traffic load forms.
    Type: Grant
    Filed: October 18, 2023
    Date of Patent: May 19, 2026
    Assignees: SHANDONG JIAOTONG UNIVERSITY, SHANDONG UNIVERSITY, CHONGQING UNIVERSITY, JINAN DOCER TESTING MACHINE TECHNOLOGY CO., LTD.
    Inventors: Xinzhuang Cui, Jin Li, Zhenhao Bao, Jianwen Hao, Yefeng Du, Qing Jin, Xiaoning Zhang, Xudong Wang, Jiong Zhang, Shengqi Zhang, Yilin Wang, Xiangyang Li, Shirong Yan, Tiancai Cao
  • Patent number: 12620216
    Abstract: Described is a system for improving machine learning models. In some cases, the system improves such models by identifying an autoencoder for a latent diffusion machine learning model, the latent diffusion machine learning model is trained to receive text as input and output an image based on the received text. The system identifies a number of channels in a decoder of the autoencoder, the decoder being configured to receive latent features as input and output images. The system further identifies a performance characteristic of the decoder and changes the node topology of the decoder based on the performance characteristic to generate an updated decoder. The system retrains the latent diffusion machine learning model using the updated decoder by inputting latent features to the updated decoder, receiving an outputted image from the updated decoder, and updating one or more weights of the decoder based on an assessment of the outputted image.
    Type: Grant
    Filed: December 29, 2023
    Date of Patent: May 5, 2026
    Assignee: SNAP INC.
    Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
  • Patent number: 12608593
    Abstract: Systems and methods herein describe an image compression system. The image compression system generates a first generative adversarial network (GAN), identifies a threshold, based on the threshold, generates a second GAN by pruning channels of the first GAN, trains the second GAN using similarity-based knowledge distillation from the first GAN, and stores the trained second GAN.
    Type: Grant
    Filed: December 21, 2021
    Date of Patent: April 21, 2026
    Assignee: Snap Inc.
    Inventors: Jian Ren, Oliver Woodford, Sergey Tulyakov, Jiazhuo Wang, Qing Jin
  • Patent number: 12579406
    Abstract: Systems and methods herein describe an image compression system. The image compression system generates a first generative adversarial network (GAN), identifies a threshold, based on the threshold, generates a second GAN by pruning channels of the first GAN, trains the second GAN using similarity-based knowledge distillation from the first GAN, and stores the trained second GAN.
    Type: Grant
    Filed: December 21, 2021
    Date of Patent: March 17, 2026
    Assignee: Snap Inc.
    Inventors: Jian Ren, Oliver Woodford, Sergey Tulyakov, Jiazhuo Wang, Qing Jin
  • Patent number: 12522984
    Abstract: An adjustment method of moisture content and dense state for a hydrogel improved subgrade based on weather-resistance during an in-service period, including: step 1: carrying out surface cleaning and compaction of ground; step 2: preparing hydrogel improved subgrade raw material; step 3: paving the prepared material on the surface to form first-layer improved subgrade; and step 4: paving plain soil subgrade onto the first-layer. The method combines the water absorption and release function of the modified resin and the characteristic of the gel state thereof, to pave the improved subgrade in layers, which can absorb water and slightly expand when the water content in the subgrade is increased to a certain threshold value, and a strength and compactness protective layer can also be formed at the connection sections of the ground and the subgrade, and the subgrade and the pavement, to prevent the pot-cover effect from occurring.
    Type: Grant
    Filed: October 31, 2022
    Date of Patent: January 13, 2026
    Assignees: SHANDONG JIAOTONG UNIVERSITY, SHANDONG UNIVERSITY, CHONGQING UNIVERSITY, JINAN JINYUE HIGHWAY ENGINEERING CO., LTD.
    Inventors: Xinzhuang Cui, Jin Li, Qing Jin, Shen Zuo, Dalu Xiong, Peng Jiang, Xiaoning Zhang, Yefeng Du, Kai Yuan, Chongsheng Xin
  • Publication number: 20260009200
    Abstract: A system for loading dynamic stress on subgrade or foundation based on multi-servo channel and a control method thereof. The system comprises: connecting plate; five dynamic actuators are hinged between connecting frame and the connecting plate; four of them form 4-RPR parallel mechanism, another one is arranged in middle of the 4-RPR parallel mechanism; loading part is mounted at center under the connecting frame; and restraining plate is arranged under the loading part and freely contacts with the loading part; four static actuators are arranged between the restraining plate and the connecting plate; wherein, the static actuators and dynamic actuators are dynamic-static cooperative controlled through multi-servo channel, to simulate principal stress axes rotation effect of a soil body of subgrade or foundation The system can realize the principal stress axes rotation effect in the subgrade or foundation through dynamic-static cooperative loading and can simulate different traffic load forms.
    Type: Application
    Filed: October 18, 2023
    Publication date: January 8, 2026
    Inventors: Xinzhuang CUI, Jin LI, Zhenhao BAO, Jianwen HAO, Yefeng DU, Qing JIN, Xiaoning ZHANG, Xudong WANG, Jiong ZHANG, Shengqi ZHANG, Yilin WANG, Xiangyang LI, Shirong YAN, Tiancai CAO
  • Patent number: 12469273
    Abstract: Described is a system for improving machine learning models. In some cases, the system improves such models by identifying a performance characteristic for machine learning model blocks in an iterative denoising process of a machine learning model, connecting a prior machine learning model block with a subsequent machine learning model block of the machine learning model blocks within the machine learning model based on the identified performance characteristic, identifying a prompt of a user, the prompt indicative of an intent of the user for generative images, and analyzing data corresponding to the prompt using the machine learning model to generate one or more images, the machine learning model trained to generate images based on data corresponding to prompts.
    Type: Grant
    Filed: December 29, 2023
    Date of Patent: November 11, 2025
    Assignee: Snap Inc.
    Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
  • Publication number: 20250054199
    Abstract: System and methods for compressing image-to-image models. Generative Adversarial Networks (GANs) have achieved success in generating high-fidelity images. An image compression system and method adds a novel variant to class-dependent parameters (CLADE), referred to as CLADE-Avg, which recovers the image quality without introducing extra computational cost. An extra layer of average smoothing is performed between the parameter and normalization layers. Compared to CLADE, this image compression system and method smooths abrupt boundaries, and introduces more possible values for the scaling and shift. In addition, the kernel size for the average smoothing can be selected as a hyperparameter, such as a 3×3 kernel size. This method does not introduce extra multiplications but only addition, and thus does not introduce much computational overhead, as the division can be absorbed into the parameters after training.
    Type: Application
    Filed: October 22, 2024
    Publication date: February 13, 2025
    Inventors: Jian Ren, Menglei Chai, Sergey Tulyakov, Qing Jin
  • Publication number: 20240395028
    Abstract: Described is a system for improving machine learning models. In some cases, the system improves such models by identifying an autoencoder for a latent diffusion machine learning model, the latent diffusion machine learning model is trained to receive text as input and output an image based on the received text. The system identifies a number of channels in a decoder of the autoencoder, the decoder being configured to receive latent features as input and output images. The system further identifies a performance characteristic of the decoder and changes the node topology of the decoder based on the performance characteristic to generate an updated decoder. The system retrains the latent diffusion machine learning model using the updated decoder by inputting latent features to the updated decoder, receiving an outputted image from the updated decoder, and updating one or more weights of the decoder based on an assessment of the outputted image.
    Type: Application
    Filed: December 29, 2023
    Publication date: November 28, 2024
    Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
  • Publication number: 20240394933
    Abstract: Described is a system for improving machine learning models by accessing a first latent diffusion machine learning model, accessing a second latent diffusion machine learning model that was derived from the first latent diffusion machine learning model, the second latent diffusion machine learning model trained to perform a second number of denoising steps, generating noise data, processing the noise data via the first latent diffusion machine learning model to generate one or more first latent features, processing the noise data via the second latent diffusion machine learning model to generate one or more second latent features, and inputting the one or more first latent features and the one or more second latent features into a loss function. The system then modifies a parameter of the second latent diffusion machine learning model based on the output of the loss function.
    Type: Application
    Filed: March 5, 2024
    Publication date: November 28, 2024
    Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
  • Publication number: 20240394843
    Abstract: Described is a system for improving machine learning models by accessing a first latent diffusion machine learning model, the first latent diffusion machine learning model trained to perform a first number of denoising steps, accessing a second latent diffusion machine learning model that was derived from the first latent diffusion machine learning model, the second latent diffusion machine learning model trained to perform a second number of denoising steps, generating noise data, processing the noise data via the first latent diffusion machine learning model to generate one or more first images, processing the noise data via the second latent diffusion machine learning model to generate one or more second images, and modify a parameter of the second latent diffusion machine learning model based on a comparison of the one or more first images with the one or more second images.
    Type: Application
    Filed: February 6, 2024
    Publication date: November 28, 2024
    Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
  • Publication number: 20240394932
    Abstract: Described is a system for improving machine learning models. In some cases, the system improves such models by identifying a performance characteristic for machine learning model blocks in an iterative denoising process of a machine learning model, connecting a prior machine learning model block with a subsequent machine learning model block of the machine learning model blocks within the machine learning model based on the identified performance characteristic, identifying a prompt of a user, the prompt indicative of an intent of the user for generative images, and analyzing data corresponding to the prompt using the machine learning model to generate one or more images, the machine learning model trained to generate images based on data corresponding to prompts.
    Type: Application
    Filed: December 29, 2023
    Publication date: November 28, 2024
    Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhgritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
  • Patent number: 12154303
    Abstract: System and methods for compressing image-to-image models. Generative Adversarial Networks (GANs) have achieved success in generating high-fidelity images. An image compression system and method adds a novel variant to class-dependent parameters (CLADE), referred to as CLADE-Avg, which recovers the image quality without introducing extra computational cost. An extra layer of average smoothing is performed between the parameter and normalization layers. Compared to CLADE, this image compression system and method smooths abrupt boundaries, and introduces more possible values for the scaling and shift. In addition, the kernel size for the average smoothing can be selected as a hyperparameter, such as a 3×3 kernel size. This method does not introduce extra multiplications but only addition, and thus does not introduce much computational overhead, as the division can be absorbed into the parameters after training.
    Type: Grant
    Filed: August 28, 2023
    Date of Patent: November 26, 2024
    Assignee: Snap Inc.
    Inventors: Jian Ren, Menglei Chai, Sergey Tulyakov, Qing Jin
  • Publication number: 20240158994
    Abstract: An adjustment method of moisture content and dense state for a hydrogel improved subgrade based on weather-resistance during an in-service period, including: step 1: carrying out surface cleaning and compaction of ground; step 2: preparing hydrogel improved subgrade raw material; step 3: paving the prepared material on the surface to form first-layer improved subgrade; and step 4: paving plain soil subgrade onto the first-layer. The method combines the water absorption and release function of the modified resin and the characteristic of the gel state thereof, to pave the improved subgrade in layers, which can absorb water and slightly expand when the water content in the subgrade is increased to a certain threshold value, and a strength and compactness protective layer can also be formed at the connection sections of the ground and the subgrade, and the subgrade and the pavement, to prevent the pot-cover effect from occurring.
    Type: Application
    Filed: October 31, 2022
    Publication date: May 16, 2024
    Applicants: SHANDONG JIAOTONG UNIVERSITY, SHANDONG UNIVERSITY, CHONGQING UNIVERSITY, JINAN JINYUE HIGHWAY ENGINEERING CO., LTD.
    Inventors: Xinzhuang CUI, Jin LI, Qing JIN, Shen ZUO, Dalu XIONG, Peng JIANG, Xiaoning ZHANG, Yefeng DU, Kai YUAN, Chongsheng XIN
  • Publication number: 20230410376
    Abstract: System and methods for compressing image-to-image models. Generative Adversarial Networks (GANs) have achieved success in generating high-fidelity images. An image compression system and method adds a novel variant to class-dependent parameters (CLADE), referred to as CLADE-Avg, which recovers the image quality without introducing extra computational cost. An extra layer of average smoothing is performed between the parameter and normalization layers. Compared to CLADE, this image compression system and method smooths abrupt boundaries, and introduces more possible values for the scaling and shift. In addition, the kernel size for the average smoothing can be selected as a hyperparameter, such as a 3×3 kernel size. This method does not introduce extra multiplications but only addition, and thus does not introduce much computational overhead, as the division can be absorbed into the parameters after training.
    Type: Application
    Filed: August 28, 2023
    Publication date: December 21, 2023
    Inventors: Jian Ren, Menglei Chai, Sergey Tulyakov, Qing Jin
  • Patent number: 11790565
    Abstract: System and methods for compressing image-to-image models. Generative Adversarial Networks (GANs) have achieved success in generating high-fidelity images. An image compression system and method adds a novel variant to class-dependent parameters (CLADE), referred to as CLADE-Avg, which recovers the image quality without introducing extra computational cost. An extra layer of average smoothing is performed between the parameter and normalization layers. Compared to CLADE, this image compression system and method smooths abrupt boundaries, and introduces more possible values for the scaling and shift. In addition, the kernel size for the average smoothing can be selected as a hyperparameter, such as a 3×3 kernel size. This method does not introduce extra multiplications but only addition, and thus does not introduce much computational overhead, as the division can be absorbed into the parameters after training.
    Type: Grant
    Filed: March 4, 2021
    Date of Patent: October 17, 2023
    Assignee: Snap Inc.
    Inventors: Jian Ren, Menglei Chai, Sergey Tulyakov, Qing Jin
  • Publication number: 20230214639
    Abstract: Techniques for training a neural network having a plurality of computational layers with associated weights and activations for computational layers in fixed-point formats include determining an optimal fractional length for weights and activations for the computational layers; training a learned clipping-level with fixed-point quantization using a PACT process for the computational layers; and quantizing on effective weights that fuses a weight of a convolution layer with a weight and running variance from a batch normalization layer. A fractional length for weights of the computational layers is determined from current values of weights using the determined optimal fractional length for the weights of the computational layers. A fixed-point activation between adjacent computational layers is related using PACT quantization of the clipping-level and an activation fractional length from a node in a following computational layer.
    Type: Application
    Filed: December 31, 2021
    Publication date: July 6, 2023
    Inventors: Sumant Milind Hanumante, Qing Jin, Sergei Korolev, Denys Makoviichuk, Jian Ren, Dhritiman Sagar, Patrick Timothy McSweeney Simons, Sergey Tulyakov, Yang Wen, Richard Zhuang
  • Publication number: 20220292724
    Abstract: System and methods for compressing image-to-image models. Generative Adversarial Networks (GANs) have achieved success in generating high-fidelity images. An image compression system and method adds a novel variant to class-dependent parameters (CLADE), referred to as CLADE-Avg, which recovers the image quality without introducing extra computational cost. An extra layer of average smoothing is performed between the parameter and normalization layers. Compared to CLADE, this image compression system and method smooths abrupt boundaries, and introduces more possible values for the scaling and shift. In addition, the kernel size for the average smoothing can be selected as a hyperparameter, such as a 3×3 kernel size. This method does not introduce extra multiplications but only addition, and thus does not introduce much computational overhead, as the division can be absorbed into the parameters after training.
    Type: Application
    Filed: March 4, 2021
    Publication date: September 15, 2022
    Inventors: Jian Ren, Menglei Chai, Sergey Tulyakov, Qing Jin