Patents by Inventor Xiuyu Xu

Xiuyu Xu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12175959
    Abstract: One disclosed example method includes a device receiving an audio signal recorded in a physical environment and applying a de-noise and de-reverberation model onto the audio signal to generate a cleaned audio signal. The de-noise and de-reverberation model is configured to remove noise and reverberation from the audio signal and is trained via a training process. The training process includes training the de-noise and de-reverberation model based on a trained de-noise teacher model and a trained de-reverberation teacher model. The training includes adjusting a portion of parameters of the de-noise and de-reverberation model based on values generated by the de-noise teacher model and the de-reverberation teacher model and then adjusting the parameters of the de-noise and de-reverberation model independently of the de-noise teacher model and the de-reverberation teacher model.
    Type: Grant
    Filed: September 11, 2023
    Date of Patent: December 24, 2024
    Assignee: Zoom Video Communications, Inc.
    Inventors: Xiuyu Xu, Jianfang Zhai
  • Patent number: 12020679
    Abstract: One disclosed example method includes a device receiving an audio signal recorded in a physical environment and applying a machine learning model onto the audio signal to generate an enhanced audio signal. The machine learning model is configured to simultaneously remove interference and distortion from the audio signal and is trained via a training process. The training process includes generating a training dataset by generating a clean audio signal and generating a noisy distorted audio signal based on the clean audio signal that includes both an interference and a distortion. The training further includes constructing the machine learning model as a generative adversarial network (GAN) model that includes a generator model and multiple discriminator models, and training the machine learning model using the training dataset to minimize a loss function defined based on the clean audio signal and the noisy distorted audio signal.
    Type: Grant
    Filed: August 3, 2023
    Date of Patent: June 25, 2024
    Assignee: Zoom Video Communications, Inc.
    Inventors: Xiuyu Xu, Jianfang Zhai
  • Patent number: 11790880
    Abstract: One disclosed example method includes a device receiving an audio signal recorded in a physical environment and applying a de-noise and de-reverberation model onto the audio signal to generate a cleaned audio signal. The de-noise and de-reverberation model is configured to remove noise and reverberation from the audio signal and is trained via a training process. The training process includes training the de-noise and de-reverberation model based on a trained de-noise teacher model and a trained de-reverberation teacher model. The training includes adjusting a portion of parameters of the de-noise and de-reverberation model based on values generated by the de-noise teacher model and the de-reverberation teacher model and then adjusting the parameters of the de-noise and de-reverberation model independently of the de-noise teacher model and the de-reverberation teacher model.
    Type: Grant
    Filed: October 27, 2021
    Date of Patent: October 17, 2023
    Assignee: Zoom Video Communications, Inc.
    Inventors: Xiuyu Xu, Jianfang Zhai
  • Patent number: 11756525
    Abstract: One disclosed example method includes a device receiving an audio signal recorded in a physical environment and applying a machine learning model onto the audio signal to generate an enhanced audio signal. The machine learning model is configured to simultaneously remove interference and distortion from the audio signal and is trained via a training process. The training process includes generating a training dataset by generating a clean audio signal and generating a noisy distorted audio signal based on the clean audio signal that includes both an interference and a distortion. The training further includes constructing the machine learning model as a generative adversarial network (GAN) model that includes a generator model and multiple discriminator models, and training the machine learning model using the training dataset to minimize a loss function defined based on the clean audio signal and the noisy distorted audio signal.
    Type: Grant
    Filed: April 26, 2022
    Date of Patent: September 12, 2023
    Assignee: Zoom Video Communications, Inc.
    Inventors: Xiuyu Xu, Jianfang Zhai
  • Publication number: 20230206938
    Abstract: Methods and systems provide users of a communication platform with intelligent, real-time noise suppression for audio signals broadcasted in a communication session. The system receives an input audio signal from an audio capture device; processes the input audio signal to provide a second version of the audio signal with noise suppression based on DSP techniques; transmits the second version of the audio signal to a communication platform for real-time streaming; classifies, via a machine learning algorithm, whether the second version of the audio signal contains noise beyond a noise threshold; based on a classification that the second version of the audio signal contains noise beyond the noise threshold, processes the second version of the audio signal to provide a third version of the audio signal with noise suppression based on AI techniques; and transmits the third version of the audio signal to the communication platform.
    Type: Application
    Filed: February 28, 2023
    Publication date: June 29, 2023
    Inventors: Jiachuan Deng, Qiyong Liu, Chuanfei Wang, Xiuyu Xu
  • Publication number: 20230127386
    Abstract: One disclosed example method includes a device receiving an audio signal recorded in a physical environment and applying a de-noise and de-reverberation model onto the audio signal to generate a cleaned audio signal. The de-noise and de-reverberation model is configured to remove noise and reverberation from the audio signal and is trained via a training process. The training process includes training the de-noise and de-reverberation model based on a trained de-noise teacher model and a trained de-reverberation teacher model. The training includes adjusting a portion of parameters of the de-noise and de-reverberation model based on values generated by the de-noise teacher model and the de-reverberation teacher model and then adjusting the parameters of the de-noise and de-reverberation model independently of the de-noise teacher model and the de-reverberation teacher model.
    Type: Application
    Filed: October 27, 2021
    Publication date: April 27, 2023
    Applicant: Zoom Video Communications, Inc.
    Inventors: Xiuyu XU, Jianfang Zhai
  • Patent number: 11621016
    Abstract: Methods and systems provide users of a communication platform with intelligent, real-time noise suppression for audio signals broadcasted in a communication session. The system receives an input audio signal from an audio capture device; processes the input audio signal to provide a second version of the audio signal with noise suppression based on DSP techniques; transmits the second version of the audio signal to a communication platform for real-time streaming; classifies, via a machine learning algorithm, whether the second version of the audio signal contains noise beyond a noise threshold; based on a classification that the second version of the audio signal contains noise beyond the noise threshold, processes the second version of the audio signal to provide a third version of the audio signal with noise suppression based on AI techniques; and transmits the third version of the audio signal to the communication platform.
    Type: Grant
    Filed: July 31, 2021
    Date of Patent: April 4, 2023
    Assignee: Zoom Video Communications, Inc.
    Inventors: Jiachuan Deng, Qiyong Liu, Chuanfei Wang, Xiuyu Xu