Patents by Inventor Ernan Liu

Ernan Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11967316
    Abstract: Embodiments of this application disclose method and apparatus for positioning a target audio signal by an audio interaction device, and an audio interaction device The method includes: obtaining audio signals in a plurality of directions in a space, and performing echo cancellation on the audio signal, the audio signal including a target-audio direct signal; obtaining weights of a plurality of time-frequency points in the audio signals, a weight of each time-frequency point indicating, at the time-frequency point, a relative proportion of the target-audio direct signal in the audio signals; weighting time-frequency components of the audio signal at the plurality of time-frequency points separately for each of the plurality of directions by using the weights of the plurality of time-frequency points, to obtain a weighted audio signal energy distribution; and obtaining a sound source azimuth corresponding to the target-audio direct signal in the audio signals accordingly.
    Type: Grant
    Filed: February 23, 2021
    Date of Patent: April 23, 2024
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Jimeng Zheng, Ian Ernan Liu, Yi Gao, Weiwei Li
  • Patent number: 11908456
    Abstract: Embodiments of this application discloses an azimuth estimation method performed at a computing device, the method including: obtaining, in real time, multi-channel sampling signals and buffering the multi-channel sampling signals; performing wakeup word detection on one or more sampling signals of the multi-channel sampling signals, and determining a wakeup word detection score for each channel of the one or more sampling signals; performing a spatial spectrum estimation on the buffered multi-channel sampling signals to obtain a spatial spectrum estimation result, when the wakeup word detection scores of the one or more sampling signals indicates that a wakeup word exists in the one or more sampling signals; and determining an azimuth of a target voice associated with the multi-channel sampling signals according to the spatial spectrum estimation result and a highest wakeup word detection score, thereby improving the accuracy of the azimuth estimation in a voice interaction process.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: February 20, 2024
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Jimeng Zheng, Yi Gao, Meng Yu, Ian Ernan Liu
  • Patent number: 11749262
    Abstract: A keyword detection method includes: obtaining an enhanced speech signal of a to-be-detected speech signal, the enhanced speech signal corresponding to a target speech speed; performing speed adjustment on the enhanced speech signal to obtain a first speed-adjusted speech signal having a first speech speed, the first speech speed being different from the target speech speed; obtaining a first speech feature signal according to the first speed-adjusted speech signal; obtaining a detection result according to a first keyword detection result corresponding to the first speech feature signal, the detection result indicating whether a target keyword exists in the to-be-detected speech signal; and performing an operation corresponding to the target keyword in response to determining that the target keyword exists according to the detection result.
    Type: Grant
    Filed: June 10, 2021
    Date of Patent: September 5, 2023
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Yi Gao, Ian Ernan Liu, Min Luo
  • Patent number: 11528571
    Abstract: A system configured to perform microphone occlusion event detection. When a device detects a microphone occlusion event, the device will modify audio processing performed prior to speech processing, such as by disabling spatial processing and only processing audio data from a single microphone. The device detects the microphone occlusion event by determining inter-level difference (ILD) values between two microphone signals and using the ILD values as input features to a classifier. For example, when a far-end reference signal is inactive, the classifier may process a first ILD value within a high frequency band. However, when the far-end reference signal is active, the classifier may process the first ILD value and a second ILD value within a low frequency band.
    Type: Grant
    Filed: January 15, 2021
    Date of Patent: December 13, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Ian Ernan Liu, Carlo Murgia, Huiqun Han, Zhouhui Miao
  • Publication number: 20210304735
    Abstract: A keyword detection method includes: obtaining an enhanced speech signal of a to-be-detected speech signal, the enhanced speech signal corresponding to a target speech speed; performing speed adjustment on the enhanced speech signal to obtain a first speed-adjusted speech signal having a first speech speed, the first speech speed being different from the target speech speed; obtaining a first speech feature signal according to the first speed-adjusted speech signal; obtaining a detection result according to a first keyword detection result corresponding to the first speech feature signal, the detection result indicating whether a target keyword exists in the to-be-detected speech signal; and performing an operation corresponding to the target keyword in response to determining that the target keyword exists according to the detection result.
    Type: Application
    Filed: June 10, 2021
    Publication date: September 30, 2021
    Inventors: Yi GAO, Ian Ernan LIU, Min LUO
  • Publication number: 20210174792
    Abstract: Embodiments of this application disclose method and apparatus for positioning a target audio signal by an audio interaction device, and an audio interaction device The method includes: obtaining audio signals in a plurality of directions in a space, and performing echo cancellation on the audio signal, the audio signal including a target-audio direct signal; obtaining weights of a plurality of time-frequency points in the audio signals, a weight of each time-frequency point indicating, at the time-frequency point, a relative proportion of the target-audio direct signal in the audio signals; weighting time-frequency components of the audio signal at the plurality of time-frequency points separately for each of the plurality of directions by using the weights of the plurality of time-frequency points, to obtain a weighted audio signal energy distribution; and obtaining a sound source azimuth corresponding to the target-audio direct signal in the audio signals accordingly.
    Type: Application
    Filed: February 23, 2021
    Publication date: June 10, 2021
    Inventors: Jimeng ZHENG, Ian Ernan LIU, Yi GAO, Weiwei LI
  • Patent number: 10431211
    Abstract: An apparatus includes multiple microphones to generate audio signals based on sound of a far-field acoustic environment. The apparatus also includes a signal processing system to process the audio signals to generate at least one processed audio signal. The signal processing system is configured to update one or more processing parameters while operating in a first operational mode and is configured to use a static version of the one or more processing parameters while operating in the second operational mode. The apparatus further includes a keyword detection system to perform keyword detection based on the at least one processed audio signal to determine whether the sound includes an utterance corresponding to a keyword and, based on a result of the keyword detection, to send a control signal to the signal processing system to change an operational mode of the signal processing system.
    Type: Grant
    Filed: December 21, 2016
    Date of Patent: October 1, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Lae-Hoon Kim, Erik Visser, Asif Mohammad, Ian Ernan Liu, Ye Jiang
  • Patent number: 9936290
    Abstract: A method for multi-channel echo cancellation and noise suppression is described. One of multiple echo estimates is selected for non-linear echo cancellation. Echo notch masking is performed on a noise-suppressed signal based on an echo direction of arrival (DOA) to produce an echo-suppressed signal. Non-linear echo cancellation is performed on the echo-suppressed signal based, at least in part, on the selected echo estimate.
    Type: Grant
    Filed: January 15, 2014
    Date of Patent: April 3, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Asif Iqbal Mohammad, Lae-Hoon Kim, Ian Ernan Liu, Erik Visser
  • Publication number: 20180033428
    Abstract: An apparatus includes multiple microphones to generate audio signals based on sound of a far-field acoustic environment. The apparatus also includes a signal processing system to process the audio signals to generate at least one processed audio signal. The signal processing system is configured to update one or more processing parameters while operating in a first operational mode and is configured to use a static version of the one or more processing parameters while operating in the second operational mode. The apparatus further includes a keyword detection system to perform keyword detection based on the at least one processed audio signal to determine whether the sound includes an utterance corresponding to a keyword and, based on a result of the keyword detection, to send a control signal to the signal processing system to change an operational mode of the signal processing system.
    Type: Application
    Filed: December 21, 2016
    Publication date: February 1, 2018
    Inventors: Lae-Hoon Kim, Erik Visser, Asif Mohammad, Ian Ernan Liu, Ye Jiang
  • Patent number: 9552840
    Abstract: A method for audio signal processing is described. The method includes decomposing a recorded auditory scene into a first category of localizable sources and a second category of ambient sound. The method also includes recording an indication of the directions of each of the localizable sources. The method may be performed with a device having a microphone array.
    Type: Grant
    Filed: October 24, 2011
    Date of Patent: January 24, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Lae-Hoon Kim, Erik Visser, Pei Xiang, Ian Ernan Liu, Dinesh Ramakrishnan
  • Patent number: 9258661
    Abstract: A method includes receiving, at a processor, a first data frame at a first time from a first microphone. The method also includes receiving a second data frame at the first time from a second microphone. The method further includes calculating a power ratio of the first microphone and the second microphone based on the first data frame and the second data frame in response to determining that the first data frame and the second data frame are noise data frames.
    Type: Grant
    Filed: December 23, 2013
    Date of Patent: February 9, 2016
    Assignee: Qualcomm Incorporated
    Inventors: Jimeng Zheng, Ian Ernan Liu, Dinesh Ramakrishnan, Deepak Kumar Challa
  • Patent number: 9165567
    Abstract: Implementations and applications are disclosed for detection of a transition in a voice activity state of an audio signal, based on a change in energy that is consistent in time across a range of frequencies of the signal. For example, such detection may be based on a time derivative of energy for each of a number of different frequency components of the signal.
    Type: Grant
    Filed: April 22, 2011
    Date of Patent: October 20, 2015
    Assignee: QUALCOMM Incorporated
    Inventors: Erik Visser, Ian Ernan Liu, Jongwon Shin
  • Patent number: 9031256
    Abstract: A method of orientation-sensitive recording control includes indicating, within a portable device and at a first time, that the portable device has a first orientation relative to a gravitational axis and, based on the indication, selecting a first pair among at least three microphone channels of the portable device. This method also includes indicating, within the portable device and at a second time that is different than the first time, that the portable device has a second orientation relative to the gravitational axis that is different than the first orientation and, based on the indication, selecting a second pair among the at least three microphone channels that is different than the first pair. In this method, each the at least three microphone channels is based on a signal produced by a corresponding one of at least three microphones of the portable device.
    Type: Grant
    Filed: October 24, 2011
    Date of Patent: May 12, 2015
    Assignee: QUALCOMM Incorporated
    Inventors: Erik Visser, Ian Ernan Liu, Dinesh Ramakrishnan, Lae-Hoon Kim, Pei Xiang
  • Patent number: 9025782
    Abstract: A multi-microphone system performs location-selective processing of an acoustic signal, wherein source location is indicated by directions of arrival relative to microphone pairs at opposite sides of a midsagittal plane of a user's head.
    Type: Grant
    Filed: July 25, 2011
    Date of Patent: May 5, 2015
    Assignee: QUALCOMM Incorporated
    Inventors: Erik Visser, Ian Ernan Liu
  • Patent number: 8898058
    Abstract: Systems, methods, apparatus, and machine-readable media for voice activity detection in a single-channel or multichannel audio signal are disclosed.
    Type: Grant
    Filed: October 24, 2011
    Date of Patent: November 25, 2014
    Assignee: QUALCOMM Incorporated
    Inventors: Jongwon Shin, Erik Visser, Ian Ernan Liu
  • Patent number: 8897455
    Abstract: A disclosed method selects a plurality of fewer than all of the channels of a multichannel signal, based on information relating to the direction of arrival of at least one frequency component of the multichannel signal.
    Type: Grant
    Filed: February 17, 2011
    Date of Patent: November 25, 2014
    Assignee: QUALCOMM Incorporated
    Inventors: Erik Visser, Ernan Liu
  • Publication number: 20140341380
    Abstract: A method includes receiving, at a processor, a first data frame at a first time from a first microphone. The method also includes receiving a second data frame at the first time from a second microphone. The method further includes calculating a power ratio of the first microphone and the second microphone based on the first data frame and the second data frame in response to determining that the first data frame and the second data frame are noise data frames.
    Type: Application
    Filed: December 23, 2013
    Publication date: November 20, 2014
    Applicant: QUALCOMM Incorporated
    Inventors: Jimeng Zheng, Ian Ernan Liu, Dinesh Ramakrishnan, Deepak Kumar Challa
  • Patent number: 8811601
    Abstract: A method for echo cancellation and noise suppression is disclosed. Linear echo cancellation (LEC) is performed for a primary microphone channel on an entire frequency band or in a range of frequencies where echo is audible. LEC is performed on one or more secondary microphone channels only on a lower frequency range over which spatial processing is effective. The microphone channels are spatially processed over the lower frequency range after LEC. Non-linear noise suppression post-processing is performed on the entire frequency band. Echo post-processing is performed on the entire frequency band.
    Type: Grant
    Filed: April 4, 2011
    Date of Patent: August 19, 2014
    Assignee: QUALCOMM Incorporated
    Inventors: Asif I. Mohammad, Kwokleung Chan, Ian Ernan Liu, Erik Visser, Dinesh Ramakrishnan
  • Patent number: 8724829
    Abstract: Based on phase differences between corresponding frequency components of different channels of a multichannel signal, a measure of directional coherency is calculated. Application of such a measure to voice activity detection and noise reduction are also disclosed.
    Type: Grant
    Filed: October 23, 2009
    Date of Patent: May 13, 2014
    Assignee: QUALCOMM Incorporated
    Inventors: Erik Visser, Ian Ernan Liu
  • Patent number: 8620672
    Abstract: Phase-based processing of a multichannel signal, and applications including proximity detection, are disclosed.
    Type: Grant
    Filed: June 8, 2010
    Date of Patent: December 31, 2013
    Assignee: QUALCOMM Incorporated
    Inventors: Erik Visser, Ernan Liu