Patents by Inventor Xueman Li

Xueman Li has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11211061
    Abstract: Voice control in a multi-talker and multimedia environment is disclosed. In one aspect, there is provided a method comprising: receiving a microphone signal for each zone in a plurality of zones of an acoustic environment; generating a processed microphone signal for each zone in the plurality of zones of the acoustic environment, the generating including removing echo caused by audio transducers in the acoustic environment from each of the microphone signals, and removing interference from each of the microphone signals; and performing speech recognition on the processed microphone signals.
    Type: Grant
    Filed: January 7, 2019
    Date of Patent: December 28, 2021
    Assignee: 2236008 Ontario Inc.
    Inventors: Xueman Li, Mark Robert Every, Darrin Kenneth John Fry
  • Publication number: 20200219493
    Abstract: Voice control in a multi-talker and multimedia environment is disclosed. In one aspect, there is provided a method comprising: receiving a microphone signal for each zone in a plurality of zones of an acoustic environment; generating a processed microphone signal for each zone in the plurality of zones of the acoustic environment, the generating including removing echo caused by audio transducers in the acoustic environment from each of the microphone signals, and removing interference from each of the microphone signals; and performing speech recognition on the processed microphone signals.
    Type: Application
    Filed: January 7, 2019
    Publication date: July 9, 2020
    Applicant: 2236008 Ontario Inc.
    Inventors: Xueman Li, Mark Robert Every, Darrin Kenneth John Fry
  • Patent number: 9916841
    Abstract: The invention includes a method, apparatus, and computer program to selectively suppress wind noise while preserving narrow-band signals in acoustic data. Sound from one or several microphones is digitized into binary data. A time-frequency transform is applied to the data to produce a series of spectra. The spectra are analyzed to detect the presence of wind noise and narrow band signals. Wind noise is selectively suppressed while preserving the narrow band signals. The narrow band signal is interpolated through the times and frequencies when it is masked by the wind noise. A time series is then synthesized from the signal spectral estimate that can be listened to. This invention overcomes prior art limitations that require more than one microphone and an independent measurement of wind speed. Its application results in good-quality speech from data severely degraded by wind noise.
    Type: Grant
    Filed: June 9, 2016
    Date of Patent: March 13, 2018
    Assignee: 2236008 Ontario Inc.
    Inventors: Phillip Alan Hetherington, Xueman Li, Pierre Zakarauskas
  • Patent number: 9536536
    Abstract: An adaptive equalization system that adjusts the spectral shape of a speech signal based on an intelligibility measurement of the speech signal may improve the intelligibility of the output speech signal. Such an adaptive equalization system may include a speech intelligibility measurement module, a spectral shape adjustment module, and an adaptive equalization module. The speech intelligibility measurement module is configured to calculate a speech intelligibility measurement of a speech signal. The spectral shape adjustment module is configured to generate a weighted long-term speech curve based on a first predetermined long-term average speech curve, a second predetermined long-term average speech curve, and the speech intelligibility measurement. The adaptive equalization module is configured to adapt equalization coefficients for the speech signal based on the weighted long-term speech curve.
    Type: Grant
    Filed: July 2, 2015
    Date of Patent: January 3, 2017
    Assignee: 2236008 Ontario Inc.
    Inventors: Phillip Alan Hetherington, Xueman Li
  • Publication number: 20160343385
    Abstract: The invention includes a method, apparatus, and computer program to selectively suppress wind noise while preserving narrow-band signals in acoustic data. Sound from one or several microphones is digitized into binary data. A time-frequency transform is applied to the data to produce a series of spectra. The spectra are analyzed to detect the presence of wind noise and narrow band signals. Wind noise is selectively suppressed while preserving the narrow band signals. The narrow band signal is interpolated through the times and frequencies when it is masked by the wind noise. A time series is then synthesized from the signal spectral estimate that can be listened to. This invention overcomes prior art limitations that require more than one microphone and an independent measurement of wind speed. Its application results in good-quality speech from data severely degraded by wind noise.
    Type: Application
    Filed: June 9, 2016
    Publication date: November 24, 2016
    Inventors: Phillip Alan Hetherington, Xueman Li, Pierre Zakarauskas
  • Patent number: 9503813
    Abstract: A system and method for dynamic residual noise shaping configured to reduce hiss noise in an audio signal. The system and method may detect an amount and type of hiss noise. The system and method may limit calculated noise suppression gains responsive to the detected amount and type of hiss noise. The limited noise suppression gains may be applied to the audio signal and may reduce the hiss noise.
    Type: Grant
    Filed: August 7, 2015
    Date of Patent: November 22, 2016
    Assignee: 2236008 Ontario Inc.
    Inventors: Xueman Li, Phillip Alan Hetherington
  • Patent number: 9373340
    Abstract: The invention includes a method, apparatus, and computer program to selectively suppress wind noise while preserving narrow-band signals in acoustic data. Sound from one or several microphones is digitized into binary data. A time-frequency transform is applied to the data to produce a series of spectra. The spectra are analyzed to detect the presence of wind noise and narrow band signals. Wind noise is selectively suppressed while preserving the narrow band signals. The narrow band signal is interpolated through the times and frequencies when it is masked by the wind noise. A time series is then synthesized from the signal spectral estimate that can be listened to. This invention overcomes prior art limitations that require more than one microphone and an independent measurement of wind speed. Its application results in good-quality speech from data severely degraded by wind noise.
    Type: Grant
    Filed: January 25, 2011
    Date of Patent: June 21, 2016
    Assignee: 2236008 Ontario, Inc.
    Inventors: Phil Hetherington, Xueman Li, Pierre Zakarauskas
  • Publication number: 20150348568
    Abstract: A system and method for dynamic residual noise shaping configured to reduce hiss noise in an audio signal. The system and method may detect an amount and type of hiss noise. The system and method may limit calculated noise suppression gains responsive to the detected amount and type of hiss noise. The limited noise suppression gains may be applied to the audio signal and may reduce the hiss noise.
    Type: Application
    Filed: August 7, 2015
    Publication date: December 3, 2015
    Inventors: Xueman Li, Phillip Alan Hetherington
  • Publication number: 20150302862
    Abstract: An adaptive equalization system that adjusts the spectral shape of a speech signal based on an intelligibility measurement of the speech signal may improve the intelligibility of the output speech signal. Such an adaptive equalization system may include a speech intelligibility measurement module, a spectral shape adjustment module, and an adaptive equalization module. The speech intelligibility measurement module is configured to calculate a speech intelligibility measurement of a speech signal. The spectral shape adjustment module is configured to generate a weighted long-term speech curve based on a first predetermined long-term average speech curve, a second predetermined long-term average speech curve, and the speech intelligibility measurement. The adaptive equalization module is configured to adapt equalization coefficients for the speech signal based on the weighted long-term speech curve.
    Type: Application
    Filed: July 2, 2015
    Publication date: October 22, 2015
    Inventors: Phillip Alan Hetherington, Xueman Li
  • Patent number: 9137600
    Abstract: A system and method for dynamic residual noise shaping configured to reduce hiss noise in an audio signal. The system and method may detect an amount and type of hiss noise. The system and method may limit calculated noise suppression gains responsive to the detected amount and type of hiss noise. The limited noise suppression gains may be applied to the audio signal and may reduce the hiss noise.
    Type: Grant
    Filed: February 15, 2013
    Date of Patent: September 15, 2015
    Assignee: 2236008 Ontario Inc.
    Inventors: Phillip Alan Hetherington, Xueman Li
  • Patent number: 9099084
    Abstract: An adaptive equalization system that adjusts the spectral shape of a speech signal based on an intelligibility measurement of the speech signal may improve the intelligibility of the output speech signal. Such an adaptive equalization system may include a speech intelligibility measurement module, a spectral shape adjustment module, and an adaptive equalization module. The speech intelligibility measurement module is configured to calculate a speech intelligibility measurement of a speech signal. The spectral shape adjustment module is configured to generate a weighted long-term speech curve based on a first predetermined long-term average speech curve, a second predetermined long-term average speech curve, and the speech intelligibility measurement. The adaptive equalization module is configured to adapt equalization coefficients for the speech signal based on the weighted long-term speech curve.
    Type: Grant
    Filed: August 26, 2014
    Date of Patent: August 4, 2015
    Assignee: 2236008 Ontario Inc.
    Inventors: Phillip Alan Hetherington, Xueman Li
  • Patent number: 9020813
    Abstract: A speech enhancement system improves speech conversion within an encoder and decoder. The system includes a first device that converts sound waves into operational signals. A second device selects a template that represents an expected signal model. The selected template models speech characteristics of the operational signals through a speech codebook that is further accessed in a communication channel.
    Type: Grant
    Filed: November 14, 2012
    Date of Patent: April 28, 2015
    Assignee: 2236008 Ontario Inc.
    Inventors: Shreyas Paranjpe, Phillip A. Hetherington, Xueman Li
  • Patent number: 8930186
    Abstract: A speech enhancement system enhances transitions between speech and non-speech segments. The system includes a background noise estimator that approximates the magnitude of a background noise of an input signal that includes a speech and a non-speech segment. A slave processor is programmed to perform the specialized task of modifying a spectral tilt of the input signal to match a plurality of expected spectral shapes selected by a Codec.
    Type: Grant
    Filed: November 14, 2012
    Date of Patent: January 6, 2015
    Assignee: 2236008 Ontario Inc.
    Inventors: Phillip A. Hetherington, Shreyas Paranjpe, Xueman Li
  • Publication number: 20140365211
    Abstract: An adaptive equalization system that adjusts the spectral shape of a speech signal based on an intelligibility measurement of the speech signal may improve the intelligibility of the output speech signal. Such an adaptive equalization system may include a speech intelligibility measurement module, a spectral shape adjustment module, and an adaptive equalization module. The speech intelligibility measurement module is configured to calculate a speech intelligibility measurement of a speech signal. The spectral shape adjustment module is configured to generate a weighted long-term speech curve based on a first predetermined long-term average speech curve, a second predetermined long-term average speech curve, and the speech intelligibility measurement. The adaptive equalization module is configured to adapt equalization coefficients for the speech signal based on the weighted long-term speech curve.
    Type: Application
    Filed: August 26, 2014
    Publication date: December 11, 2014
    Inventors: Phillip Alan Hetherington, Xueman Li
  • Patent number: 8843367
    Abstract: An adaptive equalization system that adjusts the spectral shape of a speech signal based on an intelligibility measurement of the speech signal may improve the intelligibility of the output speech signal. Such an adaptive equalization system may include a speech intelligibility measurement module, a spectral shape adjustment module, and an adaptive equalization module. The speech intelligibility measurement module is configured to calculate a speech intelligibility measurement of a speech signal. The spectral shape adjustment module is configured to generate a weighted long-term speech curve based on a first predetermined long-term average speech curve, a second predetermined long-term average speech curve, and the speech intelligibility measurement. The adaptive equalization module is configured to adapt equalization coefficients for the speech signal based on the weighted long-term speech curve.
    Type: Grant
    Filed: May 4, 2012
    Date of Patent: September 23, 2014
    Assignee: 8758271 Canada Inc.
    Inventors: Phillip Alan Hetherington, Xueman Li
  • Patent number: 8606566
    Abstract: A system improves speech intelligibility by reconstructing speech segments. The system includes a low-frequency reconstruction controller programmed to select a predetermined portion of a time domain signal. The low-frequency reconstruction controller substantially blocks signals above and below the selected predetermined portion. A harmonic generator generates low-frequency harmonics in the time domain that lie within a frequency range controlled by a background noise modeler. A gain controller adjusts the low-frequency harmonics to substantially match the signal strength to the time domain original input signal.
    Type: Grant
    Filed: May 23, 2008
    Date of Patent: December 10, 2013
    Assignee: QNX Software Systems Limited
    Inventors: Xueman Li, Rajeev Nongpiur, Frank Linseisen, Phillip A. Hetherington
  • Publication number: 20130297306
    Abstract: An adaptive equalization system that adjusts the spectral shape of a speech signal based on an intelligibility measurement of the speech signal may improve the intelligibility of the output speech signal. Such an adaptive equalization system may include a speech intelligibility measurement module, a spectral shape adjustment module, and an adaptive equalization module. The speech intelligibility measurement module is configured to calculate a speech intelligibility measurement of a speech signal. The spectral shape adjustment module is configured to generate a weighted long-term speech curve based on a first predetermined long-term average speech curve, a second predetermined long-term average speech curve, and the speech intelligibility measurement. The adaptive equalization module is configured to adapt equalization coefficients for the speech signal based on the weighted long-term speech curve.
    Type: Application
    Filed: May 4, 2012
    Publication date: November 7, 2013
    Applicant: QNX Software Systems Limited
    Inventors: Phillip Alan Hetherington, Xueman Li
  • Patent number: 8520859
    Abstract: A noise injection system adds comfort noise to an audio signal. The system includes a background noise estimator that determines a spectral content of a background noise associated with the audio signal. A comfort noise generator generates a comfort noise signal having a random phase. A gain circuit adjusts the comfort noise signal based on the spectral content of the background noise. A combining circuit combines a gain-adjusted comfort noise signal and the audio signal to generate an output signal.
    Type: Grant
    Filed: March 6, 2012
    Date of Patent: August 27, 2013
    Assignee: QNX Software Systems Limited
    Inventors: Xueman Li, Frank Linseisen, Kyle MacDonald
  • Patent number: 8489396
    Abstract: The system provides a technique for suppressing or eliminating tonal noise in and input signal. The system operates on the input signal at a plurality of frequency bins and uses information generated at a prior bin to assist in calculating values at subsequent bins. The system first identifies peaks in a signal and then determines if the peaks are from tonal effects. This can be done by comparing the estimated background noise of a current bin to the smoothed background noise of the same bin. The smoothed background noise can be calculated using an asymmetric IIR filter. When the ratio of the current background noise estimate to the currently calculated smoothed background noise is far greater than 1, tonal noise is assumed. When tonal noise is found, a number of suppression techniques can be applied to reduce the tonal noise, including gain suppression with fixed floor factor, an adaptive floor factor gain suppression technique, and a random phase technique.
    Type: Grant
    Filed: December 20, 2007
    Date of Patent: July 16, 2013
    Assignee: QNX Software Systems Limited
    Inventors: Phil A. Hetherington, Xueman Li
  • Patent number: 8352257
    Abstract: The present system proposes a technique called the spectro-temporal varying technique, to compute the suppression gain. This method is motivated by the perceptual properties of human auditory system; specifically, that the human ear has higher frequency resolution in the lower frequencies band and less frequency resolution in the higher frequencies, and also that the important speech information in the high frequencies are consonants which usually have random noise spectral shape. A second property of the human auditory system is that the human ear has lower temporal resolution in the lower frequencies and higher temporal resolution in the higher frequencies. Based on that, the system uses a spectro-temporal varying method which introduces the concept of frequency-smoothing by modifying the estimation of the a posteriori SNR. In addition, the system also makes the a priori SNR time-smoothing factor depend on frequency.
    Type: Grant
    Filed: December 20, 2007
    Date of Patent: January 8, 2013
    Assignee: QNX Software Systems Limited
    Inventors: Phil A. Hetherington, Xueman Li