Patents by Inventor Qing Jin
Qing Jin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12705875Abstract: Described is a system for improving machine learning models by accessing a first latent diffusion machine learning model, accessing a second latent diffusion machine learning model that was derived from the first latent diffusion machine learning model, the second latent diffusion machine learning model trained to perform a second number of denoising steps, generating noise data, processing the noise data via the first latent diffusion machine learning model to generate one or more first latent features, processing the noise data via the second latent diffusion machine learning model to generate one or more second latent features, and inputting the one or more first latent features and the one or more second latent features into a loss function. The system then modifies a parameter of the second latent diffusion machine learning model based on the output of the loss function.Type: GrantFiled: March 5, 2024Date of Patent: August 11, 2026Assignee: Snap Inc.Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
-
Patent number: 12645936Abstract: Techniques for training a neural network having a plurality of computational layers with associated weights and activations for computational layers in fixed-point formats include determining an optimal fractional length for weights and activations for the computational layers; training a learned clipping-level with fixed-point quantization using a PACT process for the computational layers; and quantizing on effective weights that fuses a weight of a convolution layer with a weight and running variance from a batch normalization layer. A fractional length for weights of the computational layers is determined from current values of weights using the determined optimal fractional length for the weights of the computational layers. A fixed-point activation between adjacent computational layers is related using PACT quantization of the clipping-level and an activation fractional length from a node in a following computational layer.Type: GrantFiled: December 31, 2021Date of Patent: June 2, 2026Assignee: Snap Inc.Inventors: Sumant Milind Hanumante, Qing Jin, Sergei Korolev, Denys Makoviichuk, Jian Ren, Dhritiman Sagar, Patrick Timothy McSweeney Simons, Sergey Tulyakov, Yang Wen, Richard Zhuang
-
Patent number: 12630993Abstract: A system for loading dynamic stress on subgrade or foundation based on multi-servo channel and a control method thereof. The system comprises: connecting plate; five dynamic actuators are hinged between connecting frame and the connecting plate; four of them form 4-RPR parallel mechanism, another one is arranged in middle of the 4-RPR parallel mechanism; loading part is mounted at center under the connecting frame; and restraining plate is arranged under the loading part and freely contacts with the loading part; four static actuators are arranged between the restraining plate and the connecting plate; wherein, the static actuators and dynamic actuators are dynamic-static cooperative controlled through multi-servo channel, to simulate principal stress axes rotation effect of a soil body of subgrade or foundation The system can realize the principal stress axes rotation effect in the subgrade or foundation through dynamic-static cooperative loading and can simulate different traffic load forms.Type: GrantFiled: October 18, 2023Date of Patent: May 19, 2026Assignees: SHANDONG JIAOTONG UNIVERSITY, SHANDONG UNIVERSITY, CHONGQING UNIVERSITY, JINAN DOCER TESTING MACHINE TECHNOLOGY CO., LTD.Inventors: Xinzhuang Cui, Jin Li, Zhenhao Bao, Jianwen Hao, Yefeng Du, Qing Jin, Xiaoning Zhang, Xudong Wang, Jiong Zhang, Shengqi Zhang, Yilin Wang, Xiangyang Li, Shirong Yan, Tiancai Cao
-
Patent number: 12620216Abstract: Described is a system for improving machine learning models. In some cases, the system improves such models by identifying an autoencoder for a latent diffusion machine learning model, the latent diffusion machine learning model is trained to receive text as input and output an image based on the received text. The system identifies a number of channels in a decoder of the autoencoder, the decoder being configured to receive latent features as input and output images. The system further identifies a performance characteristic of the decoder and changes the node topology of the decoder based on the performance characteristic to generate an updated decoder. The system retrains the latent diffusion machine learning model using the updated decoder by inputting latent features to the updated decoder, receiving an outputted image from the updated decoder, and updating one or more weights of the decoder based on an assessment of the outputted image.Type: GrantFiled: December 29, 2023Date of Patent: May 5, 2026Assignee: SNAP INC.Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
-
Patent number: 12608593Abstract: Systems and methods herein describe an image compression system. The image compression system generates a first generative adversarial network (GAN), identifies a threshold, based on the threshold, generates a second GAN by pruning channels of the first GAN, trains the second GAN using similarity-based knowledge distillation from the first GAN, and stores the trained second GAN.Type: GrantFiled: December 21, 2021Date of Patent: April 21, 2026Assignee: Snap Inc.Inventors: Jian Ren, Oliver Woodford, Sergey Tulyakov, Jiazhuo Wang, Qing Jin
-
Patent number: 12579406Abstract: Systems and methods herein describe an image compression system. The image compression system generates a first generative adversarial network (GAN), identifies a threshold, based on the threshold, generates a second GAN by pruning channels of the first GAN, trains the second GAN using similarity-based knowledge distillation from the first GAN, and stores the trained second GAN.Type: GrantFiled: December 21, 2021Date of Patent: March 17, 2026Assignee: Snap Inc.Inventors: Jian Ren, Oliver Woodford, Sergey Tulyakov, Jiazhuo Wang, Qing Jin
-
Patent number: 12522984Abstract: An adjustment method of moisture content and dense state for a hydrogel improved subgrade based on weather-resistance during an in-service period, including: step 1: carrying out surface cleaning and compaction of ground; step 2: preparing hydrogel improved subgrade raw material; step 3: paving the prepared material on the surface to form first-layer improved subgrade; and step 4: paving plain soil subgrade onto the first-layer. The method combines the water absorption and release function of the modified resin and the characteristic of the gel state thereof, to pave the improved subgrade in layers, which can absorb water and slightly expand when the water content in the subgrade is increased to a certain threshold value, and a strength and compactness protective layer can also be formed at the connection sections of the ground and the subgrade, and the subgrade and the pavement, to prevent the pot-cover effect from occurring.Type: GrantFiled: October 31, 2022Date of Patent: January 13, 2026Assignees: SHANDONG JIAOTONG UNIVERSITY, SHANDONG UNIVERSITY, CHONGQING UNIVERSITY, JINAN JINYUE HIGHWAY ENGINEERING CO., LTD.Inventors: Xinzhuang Cui, Jin Li, Qing Jin, Shen Zuo, Dalu Xiong, Peng Jiang, Xiaoning Zhang, Yefeng Du, Kai Yuan, Chongsheng Xin
-
Publication number: 20260009200Abstract: A system for loading dynamic stress on subgrade or foundation based on multi-servo channel and a control method thereof. The system comprises: connecting plate; five dynamic actuators are hinged between connecting frame and the connecting plate; four of them form 4-RPR parallel mechanism, another one is arranged in middle of the 4-RPR parallel mechanism; loading part is mounted at center under the connecting frame; and restraining plate is arranged under the loading part and freely contacts with the loading part; four static actuators are arranged between the restraining plate and the connecting plate; wherein, the static actuators and dynamic actuators are dynamic-static cooperative controlled through multi-servo channel, to simulate principal stress axes rotation effect of a soil body of subgrade or foundation The system can realize the principal stress axes rotation effect in the subgrade or foundation through dynamic-static cooperative loading and can simulate different traffic load forms.Type: ApplicationFiled: October 18, 2023Publication date: January 8, 2026Inventors: Xinzhuang CUI, Jin LI, Zhenhao BAO, Jianwen HAO, Yefeng DU, Qing JIN, Xiaoning ZHANG, Xudong WANG, Jiong ZHANG, Shengqi ZHANG, Yilin WANG, Xiangyang LI, Shirong YAN, Tiancai CAO
-
Patent number: 12469273Abstract: Described is a system for improving machine learning models. In some cases, the system improves such models by identifying a performance characteristic for machine learning model blocks in an iterative denoising process of a machine learning model, connecting a prior machine learning model block with a subsequent machine learning model block of the machine learning model blocks within the machine learning model based on the identified performance characteristic, identifying a prompt of a user, the prompt indicative of an intent of the user for generative images, and analyzing data corresponding to the prompt using the machine learning model to generate one or more images, the machine learning model trained to generate images based on data corresponding to prompts.Type: GrantFiled: December 29, 2023Date of Patent: November 11, 2025Assignee: Snap Inc.Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
-
Publication number: 20250054199Abstract: System and methods for compressing image-to-image models. Generative Adversarial Networks (GANs) have achieved success in generating high-fidelity images. An image compression system and method adds a novel variant to class-dependent parameters (CLADE), referred to as CLADE-Avg, which recovers the image quality without introducing extra computational cost. An extra layer of average smoothing is performed between the parameter and normalization layers. Compared to CLADE, this image compression system and method smooths abrupt boundaries, and introduces more possible values for the scaling and shift. In addition, the kernel size for the average smoothing can be selected as a hyperparameter, such as a 3×3 kernel size. This method does not introduce extra multiplications but only addition, and thus does not introduce much computational overhead, as the division can be absorbed into the parameters after training.Type: ApplicationFiled: October 22, 2024Publication date: February 13, 2025Inventors: Jian Ren, Menglei Chai, Sergey Tulyakov, Qing Jin
-
Publication number: 20240395028Abstract: Described is a system for improving machine learning models. In some cases, the system improves such models by identifying an autoencoder for a latent diffusion machine learning model, the latent diffusion machine learning model is trained to receive text as input and output an image based on the received text. The system identifies a number of channels in a decoder of the autoencoder, the decoder being configured to receive latent features as input and output images. The system further identifies a performance characteristic of the decoder and changes the node topology of the decoder based on the performance characteristic to generate an updated decoder. The system retrains the latent diffusion machine learning model using the updated decoder by inputting latent features to the updated decoder, receiving an outputted image from the updated decoder, and updating one or more weights of the decoder based on an assessment of the outputted image.Type: ApplicationFiled: December 29, 2023Publication date: November 28, 2024Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
-
Publication number: 20240394933Abstract: Described is a system for improving machine learning models by accessing a first latent diffusion machine learning model, accessing a second latent diffusion machine learning model that was derived from the first latent diffusion machine learning model, the second latent diffusion machine learning model trained to perform a second number of denoising steps, generating noise data, processing the noise data via the first latent diffusion machine learning model to generate one or more first latent features, processing the noise data via the second latent diffusion machine learning model to generate one or more second latent features, and inputting the one or more first latent features and the one or more second latent features into a loss function. The system then modifies a parameter of the second latent diffusion machine learning model based on the output of the loss function.Type: ApplicationFiled: March 5, 2024Publication date: November 28, 2024Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
-
Publication number: 20240394843Abstract: Described is a system for improving machine learning models by accessing a first latent diffusion machine learning model, the first latent diffusion machine learning model trained to perform a first number of denoising steps, accessing a second latent diffusion machine learning model that was derived from the first latent diffusion machine learning model, the second latent diffusion machine learning model trained to perform a second number of denoising steps, generating noise data, processing the noise data via the first latent diffusion machine learning model to generate one or more first images, processing the noise data via the second latent diffusion machine learning model to generate one or more second images, and modify a parameter of the second latent diffusion machine learning model based on a comparison of the one or more first images with the one or more second images.Type: ApplicationFiled: February 6, 2024Publication date: November 28, 2024Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
-
Publication number: 20240394932Abstract: Described is a system for improving machine learning models. In some cases, the system improves such models by identifying a performance characteristic for machine learning model blocks in an iterative denoising process of a machine learning model, connecting a prior machine learning model block with a subsequent machine learning model block of the machine learning model blocks within the machine learning model based on the identified performance characteristic, identifying a prompt of a user, the prompt indicative of an intent of the user for generative images, and analyzing data corresponding to the prompt using the machine learning model to generate one or more images, the machine learning model trained to generate images based on data corresponding to prompts.Type: ApplicationFiled: December 29, 2023Publication date: November 28, 2024Inventors: Pavlo Chemerys, Colin Eles, Ju Hu, Qing Jin, Yanyu Li, Ergeta Muca, Jian Ren, Dhgritiman Sagar, Aleksei Stoliar, Sergey Tulyakov, Huan Wang
-
Patent number: 12154303Abstract: System and methods for compressing image-to-image models. Generative Adversarial Networks (GANs) have achieved success in generating high-fidelity images. An image compression system and method adds a novel variant to class-dependent parameters (CLADE), referred to as CLADE-Avg, which recovers the image quality without introducing extra computational cost. An extra layer of average smoothing is performed between the parameter and normalization layers. Compared to CLADE, this image compression system and method smooths abrupt boundaries, and introduces more possible values for the scaling and shift. In addition, the kernel size for the average smoothing can be selected as a hyperparameter, such as a 3×3 kernel size. This method does not introduce extra multiplications but only addition, and thus does not introduce much computational overhead, as the division can be absorbed into the parameters after training.Type: GrantFiled: August 28, 2023Date of Patent: November 26, 2024Assignee: Snap Inc.Inventors: Jian Ren, Menglei Chai, Sergey Tulyakov, Qing Jin
-
Publication number: 20240158994Abstract: An adjustment method of moisture content and dense state for a hydrogel improved subgrade based on weather-resistance during an in-service period, including: step 1: carrying out surface cleaning and compaction of ground; step 2: preparing hydrogel improved subgrade raw material; step 3: paving the prepared material on the surface to form first-layer improved subgrade; and step 4: paving plain soil subgrade onto the first-layer. The method combines the water absorption and release function of the modified resin and the characteristic of the gel state thereof, to pave the improved subgrade in layers, which can absorb water and slightly expand when the water content in the subgrade is increased to a certain threshold value, and a strength and compactness protective layer can also be formed at the connection sections of the ground and the subgrade, and the subgrade and the pavement, to prevent the pot-cover effect from occurring.Type: ApplicationFiled: October 31, 2022Publication date: May 16, 2024Applicants: SHANDONG JIAOTONG UNIVERSITY, SHANDONG UNIVERSITY, CHONGQING UNIVERSITY, JINAN JINYUE HIGHWAY ENGINEERING CO., LTD.Inventors: Xinzhuang CUI, Jin LI, Qing JIN, Shen ZUO, Dalu XIONG, Peng JIANG, Xiaoning ZHANG, Yefeng DU, Kai YUAN, Chongsheng XIN
-
Publication number: 20230410376Abstract: System and methods for compressing image-to-image models. Generative Adversarial Networks (GANs) have achieved success in generating high-fidelity images. An image compression system and method adds a novel variant to class-dependent parameters (CLADE), referred to as CLADE-Avg, which recovers the image quality without introducing extra computational cost. An extra layer of average smoothing is performed between the parameter and normalization layers. Compared to CLADE, this image compression system and method smooths abrupt boundaries, and introduces more possible values for the scaling and shift. In addition, the kernel size for the average smoothing can be selected as a hyperparameter, such as a 3×3 kernel size. This method does not introduce extra multiplications but only addition, and thus does not introduce much computational overhead, as the division can be absorbed into the parameters after training.Type: ApplicationFiled: August 28, 2023Publication date: December 21, 2023Inventors: Jian Ren, Menglei Chai, Sergey Tulyakov, Qing Jin
-
Patent number: 11790565Abstract: System and methods for compressing image-to-image models. Generative Adversarial Networks (GANs) have achieved success in generating high-fidelity images. An image compression system and method adds a novel variant to class-dependent parameters (CLADE), referred to as CLADE-Avg, which recovers the image quality without introducing extra computational cost. An extra layer of average smoothing is performed between the parameter and normalization layers. Compared to CLADE, this image compression system and method smooths abrupt boundaries, and introduces more possible values for the scaling and shift. In addition, the kernel size for the average smoothing can be selected as a hyperparameter, such as a 3×3 kernel size. This method does not introduce extra multiplications but only addition, and thus does not introduce much computational overhead, as the division can be absorbed into the parameters after training.Type: GrantFiled: March 4, 2021Date of Patent: October 17, 2023Assignee: Snap Inc.Inventors: Jian Ren, Menglei Chai, Sergey Tulyakov, Qing Jin
-
Publication number: 20230214639Abstract: Techniques for training a neural network having a plurality of computational layers with associated weights and activations for computational layers in fixed-point formats include determining an optimal fractional length for weights and activations for the computational layers; training a learned clipping-level with fixed-point quantization using a PACT process for the computational layers; and quantizing on effective weights that fuses a weight of a convolution layer with a weight and running variance from a batch normalization layer. A fractional length for weights of the computational layers is determined from current values of weights using the determined optimal fractional length for the weights of the computational layers. A fixed-point activation between adjacent computational layers is related using PACT quantization of the clipping-level and an activation fractional length from a node in a following computational layer.Type: ApplicationFiled: December 31, 2021Publication date: July 6, 2023Inventors: Sumant Milind Hanumante, Qing Jin, Sergei Korolev, Denys Makoviichuk, Jian Ren, Dhritiman Sagar, Patrick Timothy McSweeney Simons, Sergey Tulyakov, Yang Wen, Richard Zhuang
-
Publication number: 20220292724Abstract: System and methods for compressing image-to-image models. Generative Adversarial Networks (GANs) have achieved success in generating high-fidelity images. An image compression system and method adds a novel variant to class-dependent parameters (CLADE), referred to as CLADE-Avg, which recovers the image quality without introducing extra computational cost. An extra layer of average smoothing is performed between the parameter and normalization layers. Compared to CLADE, this image compression system and method smooths abrupt boundaries, and introduces more possible values for the scaling and shift. In addition, the kernel size for the average smoothing can be selected as a hyperparameter, such as a 3×3 kernel size. This method does not introduce extra multiplications but only addition, and thus does not introduce much computational overhead, as the division can be absorbed into the parameters after training.Type: ApplicationFiled: March 4, 2021Publication date: September 15, 2022Inventors: Jian Ren, Menglei Chai, Sergey Tulyakov, Qing Jin