Patents by Inventor Yongtao Sha
Yongtao Sha has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12080274Abstract: A system and method for concurrent multi-path processing of audio signals for automatic speech recognition is presented. Audio information defining a set of audio signals may be obtained (502). The audio signals may convey mixed audio content produced by multiple audio sources. A set of source-specific audio signals may be determined by demixing the mixed audio content produced by the multiple audio sources. Determining the set of source-specific audio signals may comprises providing the set of audio signals to both a first signal processing path and a second signal processing path (504). The first signal processing path may determine a value of a demixing parameter for demixing the mixed audio content (506). The second signal processing path may apply the value of the demixing parameter to the individual audio signals of the set of audio signals (508) to generate the individual source-specific audio signals (510).Type: GrantFiled: February 28, 2019Date of Patent: September 3, 2024Assignee: Beijing DiDi Infinity Technology and Development Co., Ltd.Inventors: Yi Zhang, Hui Song, Yongtao Sha, Chengyun Deng
-
Publication number: 20230094630Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media for acoustic echo cancellation and suppression are provided. An exemplary method comprises receiving a far-end acoustic signal and a corrupted near-end acoustic signal, wherein the corrupted near-end acoustic signal is generated based on (1) an echo of the far-end acoustic signal and (2) a near-end acoustic signal; feeding the far-end acoustic signal and the corrupted near-end acoustic signal into a neural network as an input to output a time-frequency (TF) mask that suppresses the echo and retains the near-end acoustic signal, and generating an enhanced version of the corrupted near-end acoustic signal by applying the obtained TF mask to the corrupted near-end acoustic signal.Type: ApplicationFiled: December 6, 2022Publication date: March 30, 2023Applicant: BEIJING DIDI INFINITY TECHNOLOGY AND DEVELOPMENT CO., LTD.Inventors: Yi ZHANG, Chengyun DENG, Shiqian MA, Yongtao SHA, Hui SONG
-
Patent number: 11508351Abstract: A method of echo path delay destination and echo cancellation is described in this disclosure. The method includes: obtaining a reference signal, a microphone signal, and a trained multi-task deep neural network, wherein the multi-task deep neural network comprises a first neural network and a second neural network; generating, using the first neural network of the multi-task deep neural network, an estimated echo path delay based on the reference signal and the microphone signal; updating the reference signal based on the estimated echo path delay; and generating, using the second neural network of the multi-task deep neural network, an enhanced microphone signal based on the microphone signal and the updated reference signal.Type: GrantFiled: March 1, 2021Date of Patent: November 22, 2022Assignee: Beijing DiDi Infinity Technology and Development Co., Ltd.Inventors: Yi Zhang, Chengyun Deng, Shiqian Ma, Yongtao Sha, Hui Song
-
Publication number: 20220277721Abstract: A method of echo path delay destination and echo cancellation is described in this disclosure. The method includes: obtaining a reference signal, a microphone signal, and a trained multi-task deep neural network, wherein the multi-task deep neural network comprises a first neural network and a second neural network; generating, using the first neural network of the multi-task deep neural network, an estimated echo path delay based on the reference signal and the microphone signal; updating the reference signal based on the estimated echo path delay; and generating, using the second neural network of the multi-task deep neural network, an enhanced microphone signal based on the microphone signal and the updated reference signal.Type: ApplicationFiled: March 1, 2021Publication date: September 1, 2022Inventors: Yi ZHANG, Chengyun DENG, Shiqian MA, Yongtao SHA, Hui SONG
-
Patent number: 11393488Abstract: Embodiments of the disclosure provide systems and methods for enhancing audio signals. The system may include a communication interface configured to receive multi-channel audio signals acquired from a common signal source. The system may further include at least one processor. The at least one processor may be configured to separate the multi-channel audio signals into a first audio signal and a second audio signal in a time domain. The at least one processor may be further configured to decompose the first audio signal and the second audio signal in a frequency domain to obtain a first decomposition data and a second decomposition data, respectively. The at least one processor may be also configured to estimate a noise component in the frequency domain based on the first decomposition data and the second decomposition data. The at least one processor may be additionally configured to enhance the first audio signal based on the estimated noise component.Type: GrantFiled: April 24, 2020Date of Patent: July 19, 2022Assignee: BEIJING DIDI INFINITY TECHNOLOGY AND DEVELOPMENT CO., LTD.Inventors: Yi Zhang, Hui Song, Chengyun Deng, Yongtao Sha
-
Publication number: 20220139368Abstract: A system and method for concurrent multi-path processing of audio signals for automatic speech recognition is presented. Audio information defining a set of audio signals may be obtained (502). The audio signals may convey mixed audio content produced by multiple audio sources. A set of source-specific audio signals may be determined by demixing the mixed audio content produced by the multiple audio sources. Determining the set of source-specific audio signals may comprises providing the set of audio signals to both a first signal processing path and a second signal processing path (504). The first signal processing path may determine a value of a demixing parameter for demixing the mixed audio content (506). The second signal processing path may apply the value of the demixing parameter to the individual audio signals of the set of audio signals (508) to generate the individual source-specific audio signals (510).Type: ApplicationFiled: February 28, 2019Publication date: May 5, 2022Inventors: Yi ZHANG, Hui SONG, Yongtao SHA, Chengyun DENG
-
Patent number: 11289109Abstract: Embodiments of the disclosure provide systems and methods for audio signal processing. An exemplary system may include a communication interface configured to receiving a first audio signal acquired from an audio source through a first channel, and a second audio signal acquired from the same audio source through a second channel. The system may also include at least one processor coupled to the communication interface. The at least one processor may be configured to determine channel features based on the first audio signal and the second audio signal individually and determine a cross-channel feature based on the first audio signal and the second audio signal collectively. The at least one processor may further be configured to concatenate the channel features and the cross-channel feature and estimate spectral-spatial masks for the first channel and the second channel using the concatenated channel features and the cross-channel feature.Type: GrantFiled: April 24, 2020Date of Patent: March 29, 2022Assignee: BEIJING DIDI INFINITY TECHNOLOGY AND DEVELOPMENT CO., LTD.Inventors: Chengyun Deng, Hui Song, Yi Zhang, Yongtao Sha
-
Patent number: 11227622Abstract: A speech communication system for improving speech intelligibility may comprise one or more processors; and a memory storing instructions that, when executed by the one or more processors, cause the system to perform: determining a cutoff frequency based on an estimation of a spectrum of noise, wherein the cutoff frequency defines a noise dominant region of frequency; lifting a spectrum of a speech above the noise dominant region of frequency, wherein a frequency range of the spectrum of the speech increases by the cutoff frequency; and applying an adaptive filter to the speech to achieve echo cancelation, wherein the adaptive filter is controlled by a volume of the noise.Type: GrantFiled: December 6, 2018Date of Patent: January 18, 2022Assignee: Beijing DiDi Infinity Technology and Development Co., Ltd.Inventors: Yi Zhang, Hui Song, Yongtao Sha, Si Qin
-
Publication number: 20210225388Abstract: A speech communication system for improving speech intelligibility may comprise one or more processors; and a memory storing instructions that, when executed by the one or more processors, cause the system to perform: determining a cutoff frequency based on an estimation of a spectrum of noise, wherein the cutoff frequency defines a noise dominant region of frequency; lifting a spectrum of a speech above the noise dominant region of frequency, wherein a frequency range of the spectrum of the speech increases by the cutoff frequency; and applying an adaptive filter to the speech to achieve echo cancelation, wherein the adaptive filter is controlled by a volume of the noise.Type: ApplicationFiled: December 6, 2018Publication date: July 22, 2021Inventors: Yi ZHANG, Hui SONG, Yongtao SHA, Si QIN
-
Publication number: 20200342891Abstract: Embodiments of the disclosure provide systems and methods for audio signal processing. An exemplary system may include a communication interface configured to receiving a first audio signal acquired from an audio source through a first channel, and a second audio signal acquired from the same audio source through a second channel. The system may also include at least one processor coupled to the communication interface. The at least one processor may be configured to determine channel features based on the first audio signal and the second audio signal individually and determine a cross-channel feature based on the first audio signal and the second audio signal collectively. The at least one processor may further be configured to concatenate the channel features and the cross-channel feature and estimate spectral-spatial masks for the first channel and the second channel using the concatenated channel features and the cross-channel feature.Type: ApplicationFiled: April 24, 2020Publication date: October 29, 2020Applicant: BEIJING DIDI INFINITY TECHNOLOGY AND DEVELOPMENT CO., LTD.Inventors: Chengyun Deng, Hui Song, Yi Zhang, Yongtao Sha
-
Publication number: 20200342889Abstract: Embodiments of the disclosure provide systems and methods for enhancing audio signals. The system may include a communication interface configured to receive multi-channel audio signals acquired from a common signal source. The system may further include at least one processor. The at least one processor may be configured to separate the multi-channel audio signals into a first audio signal and a second audio signal in a time domain. The at least one processor may be further configured to decompose the first audio signal and the second audio signal in a frequency domain to obtain a first decomposition data and a second decomposition data, respectively. The at least one processor may be also configured to estimate a noise component in the frequency domain based on the first decomposition data and the second decomposition data. The at least one processor may be additionally configured to enhance the first audio signal based on the estimated noise component.Type: ApplicationFiled: April 24, 2020Publication date: October 29, 2020Applicant: BEIJING DIDI INFINITY TECHNOLOGY AND DEVELOPMENT CO., LTD.Inventors: Yi Zhang, Hui Song, Chengyun Deng, Yongtao Sha