Patents by Inventor Ernan Liu
Ernan Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240233719Abstract: This application discloses a method for positioning a target audio signal by a computer device. The method includes: performing echo cancellation on the audio signals collected in a plurality of directions in a space, the audio signals comprising a target-audio direct signal; obtaining weights of a plurality of time-frequency points in the echo-canceled audio signals, a weight of each time-frequency point indicating a relative proportion of the target-audio direct signal in the echo-canceled audio signals at the time-frequency point; obtaining a weighted audio signal energy distribution of the audio signals in the plurality of directions by using the weights of the plurality of time-frequency points in the echo-canceled audio signals; and obtaining a sound source azimuth corresponding to the target-audio direct signal in the audio signals by using the weighted audio signal energy distribution of the audio signals in the plurality of directions.Type: ApplicationFiled: March 20, 2024Publication date: July 11, 2024Inventors: Jimeng ZHENG, Ian Ernan Liu, Yi Gao, Weiwei Li
-
Patent number: 11967316Abstract: Embodiments of this application disclose method and apparatus for positioning a target audio signal by an audio interaction device, and an audio interaction device The method includes: obtaining audio signals in a plurality of directions in a space, and performing echo cancellation on the audio signal, the audio signal including a target-audio direct signal; obtaining weights of a plurality of time-frequency points in the audio signals, a weight of each time-frequency point indicating, at the time-frequency point, a relative proportion of the target-audio direct signal in the audio signals; weighting time-frequency components of the audio signal at the plurality of time-frequency points separately for each of the plurality of directions by using the weights of the plurality of time-frequency points, to obtain a weighted audio signal energy distribution; and obtaining a sound source azimuth corresponding to the target-audio direct signal in the audio signals accordingly.Type: GrantFiled: February 23, 2021Date of Patent: April 23, 2024Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Jimeng Zheng, Ian Ernan Liu, Yi Gao, Weiwei Li
-
Patent number: 11908456Abstract: Embodiments of this application discloses an azimuth estimation method performed at a computing device, the method including: obtaining, in real time, multi-channel sampling signals and buffering the multi-channel sampling signals; performing wakeup word detection on one or more sampling signals of the multi-channel sampling signals, and determining a wakeup word detection score for each channel of the one or more sampling signals; performing a spatial spectrum estimation on the buffered multi-channel sampling signals to obtain a spatial spectrum estimation result, when the wakeup word detection scores of the one or more sampling signals indicates that a wakeup word exists in the one or more sampling signals; and determining an azimuth of a target voice associated with the multi-channel sampling signals according to the spatial spectrum estimation result and a highest wakeup word detection score, thereby improving the accuracy of the azimuth estimation in a voice interaction process.Type: GrantFiled: August 28, 2020Date of Patent: February 20, 2024Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Jimeng Zheng, Yi Gao, Meng Yu, Ian Ernan Liu
-
Patent number: 11749262Abstract: A keyword detection method includes: obtaining an enhanced speech signal of a to-be-detected speech signal, the enhanced speech signal corresponding to a target speech speed; performing speed adjustment on the enhanced speech signal to obtain a first speed-adjusted speech signal having a first speech speed, the first speech speed being different from the target speech speed; obtaining a first speech feature signal according to the first speed-adjusted speech signal; obtaining a detection result according to a first keyword detection result corresponding to the first speech feature signal, the detection result indicating whether a target keyword exists in the to-be-detected speech signal; and performing an operation corresponding to the target keyword in response to determining that the target keyword exists according to the detection result.Type: GrantFiled: June 10, 2021Date of Patent: September 5, 2023Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITEDInventors: Yi Gao, Ian Ernan Liu, Min Luo
-
Patent number: 11528571Abstract: A system configured to perform microphone occlusion event detection. When a device detects a microphone occlusion event, the device will modify audio processing performed prior to speech processing, such as by disabling spatial processing and only processing audio data from a single microphone. The device detects the microphone occlusion event by determining inter-level difference (ILD) values between two microphone signals and using the ILD values as input features to a classifier. For example, when a far-end reference signal is inactive, the classifier may process a first ILD value within a high frequency band. However, when the far-end reference signal is active, the classifier may process the first ILD value and a second ILD value within a low frequency band.Type: GrantFiled: January 15, 2021Date of Patent: December 13, 2022Assignee: Amazon Technologies, Inc.Inventors: Ian Ernan Liu, Carlo Murgia, Huiqun Han, Zhouhui Miao
-
Publication number: 20210304735Abstract: A keyword detection method includes: obtaining an enhanced speech signal of a to-be-detected speech signal, the enhanced speech signal corresponding to a target speech speed; performing speed adjustment on the enhanced speech signal to obtain a first speed-adjusted speech signal having a first speech speed, the first speech speed being different from the target speech speed; obtaining a first speech feature signal according to the first speed-adjusted speech signal; obtaining a detection result according to a first keyword detection result corresponding to the first speech feature signal, the detection result indicating whether a target keyword exists in the to-be-detected speech signal; and performing an operation corresponding to the target keyword in response to determining that the target keyword exists according to the detection result.Type: ApplicationFiled: June 10, 2021Publication date: September 30, 2021Inventors: Yi GAO, Ian Ernan LIU, Min LUO
-
Publication number: 20210174792Abstract: Embodiments of this application disclose method and apparatus for positioning a target audio signal by an audio interaction device, and an audio interaction device The method includes: obtaining audio signals in a plurality of directions in a space, and performing echo cancellation on the audio signal, the audio signal including a target-audio direct signal; obtaining weights of a plurality of time-frequency points in the audio signals, a weight of each time-frequency point indicating, at the time-frequency point, a relative proportion of the target-audio direct signal in the audio signals; weighting time-frequency components of the audio signal at the plurality of time-frequency points separately for each of the plurality of directions by using the weights of the plurality of time-frequency points, to obtain a weighted audio signal energy distribution; and obtaining a sound source azimuth corresponding to the target-audio direct signal in the audio signals accordingly.Type: ApplicationFiled: February 23, 2021Publication date: June 10, 2021Inventors: Jimeng ZHENG, Ian Ernan LIU, Yi GAO, Weiwei LI
-
Patent number: 10431211Abstract: An apparatus includes multiple microphones to generate audio signals based on sound of a far-field acoustic environment. The apparatus also includes a signal processing system to process the audio signals to generate at least one processed audio signal. The signal processing system is configured to update one or more processing parameters while operating in a first operational mode and is configured to use a static version of the one or more processing parameters while operating in the second operational mode. The apparatus further includes a keyword detection system to perform keyword detection based on the at least one processed audio signal to determine whether the sound includes an utterance corresponding to a keyword and, based on a result of the keyword detection, to send a control signal to the signal processing system to change an operational mode of the signal processing system.Type: GrantFiled: December 21, 2016Date of Patent: October 1, 2019Assignee: Qualcomm IncorporatedInventors: Lae-Hoon Kim, Erik Visser, Asif Mohammad, Ian Ernan Liu, Ye Jiang
-
Patent number: 9936290Abstract: A method for multi-channel echo cancellation and noise suppression is described. One of multiple echo estimates is selected for non-linear echo cancellation. Echo notch masking is performed on a noise-suppressed signal based on an echo direction of arrival (DOA) to produce an echo-suppressed signal. Non-linear echo cancellation is performed on the echo-suppressed signal based, at least in part, on the selected echo estimate.Type: GrantFiled: January 15, 2014Date of Patent: April 3, 2018Assignee: QUALCOMM IncorporatedInventors: Asif Iqbal Mohammad, Lae-Hoon Kim, Ian Ernan Liu, Erik Visser
-
Publication number: 20180033428Abstract: An apparatus includes multiple microphones to generate audio signals based on sound of a far-field acoustic environment. The apparatus also includes a signal processing system to process the audio signals to generate at least one processed audio signal. The signal processing system is configured to update one or more processing parameters while operating in a first operational mode and is configured to use a static version of the one or more processing parameters while operating in the second operational mode. The apparatus further includes a keyword detection system to perform keyword detection based on the at least one processed audio signal to determine whether the sound includes an utterance corresponding to a keyword and, based on a result of the keyword detection, to send a control signal to the signal processing system to change an operational mode of the signal processing system.Type: ApplicationFiled: December 21, 2016Publication date: February 1, 2018Inventors: Lae-Hoon Kim, Erik Visser, Asif Mohammad, Ian Ernan Liu, Ye Jiang
-
Patent number: 9552840Abstract: A method for audio signal processing is described. The method includes decomposing a recorded auditory scene into a first category of localizable sources and a second category of ambient sound. The method also includes recording an indication of the directions of each of the localizable sources. The method may be performed with a device having a microphone array.Type: GrantFiled: October 24, 2011Date of Patent: January 24, 2017Assignee: QUALCOMM IncorporatedInventors: Lae-Hoon Kim, Erik Visser, Pei Xiang, Ian Ernan Liu, Dinesh Ramakrishnan
-
Patent number: 9258661Abstract: A method includes receiving, at a processor, a first data frame at a first time from a first microphone. The method also includes receiving a second data frame at the first time from a second microphone. The method further includes calculating a power ratio of the first microphone and the second microphone based on the first data frame and the second data frame in response to determining that the first data frame and the second data frame are noise data frames.Type: GrantFiled: December 23, 2013Date of Patent: February 9, 2016Assignee: Qualcomm IncorporatedInventors: Jimeng Zheng, Ian Ernan Liu, Dinesh Ramakrishnan, Deepak Kumar Challa
-
Patent number: 9165567Abstract: Implementations and applications are disclosed for detection of a transition in a voice activity state of an audio signal, based on a change in energy that is consistent in time across a range of frequencies of the signal. For example, such detection may be based on a time derivative of energy for each of a number of different frequency components of the signal.Type: GrantFiled: April 22, 2011Date of Patent: October 20, 2015Assignee: QUALCOMM IncorporatedInventors: Erik Visser, Ian Ernan Liu, Jongwon Shin
-
Systems, methods, apparatus, and computer-readable media for orientation-sensitive recording control
Patent number: 9031256Abstract: A method of orientation-sensitive recording control includes indicating, within a portable device and at a first time, that the portable device has a first orientation relative to a gravitational axis and, based on the indication, selecting a first pair among at least three microphone channels of the portable device. This method also includes indicating, within the portable device and at a second time that is different than the first time, that the portable device has a second orientation relative to the gravitational axis that is different than the first orientation and, based on the indication, selecting a second pair among the at least three microphone channels that is different than the first pair. In this method, each the at least three microphone channels is based on a signal produced by a corresponding one of at least three microphones of the portable device.Type: GrantFiled: October 24, 2011Date of Patent: May 12, 2015Assignee: QUALCOMM IncorporatedInventors: Erik Visser, Ian Ernan Liu, Dinesh Ramakrishnan, Lae-Hoon Kim, Pei Xiang -
Patent number: 9025782Abstract: A multi-microphone system performs location-selective processing of an acoustic signal, wherein source location is indicated by directions of arrival relative to microphone pairs at opposite sides of a midsagittal plane of a user's head.Type: GrantFiled: July 25, 2011Date of Patent: May 5, 2015Assignee: QUALCOMM IncorporatedInventors: Erik Visser, Ian Ernan Liu
-
Patent number: 8897455Abstract: A disclosed method selects a plurality of fewer than all of the channels of a multichannel signal, based on information relating to the direction of arrival of at least one frequency component of the multichannel signal.Type: GrantFiled: February 17, 2011Date of Patent: November 25, 2014Assignee: QUALCOMM IncorporatedInventors: Erik Visser, Ernan Liu
-
Patent number: 8898058Abstract: Systems, methods, apparatus, and machine-readable media for voice activity detection in a single-channel or multichannel audio signal are disclosed.Type: GrantFiled: October 24, 2011Date of Patent: November 25, 2014Assignee: QUALCOMM IncorporatedInventors: Jongwon Shin, Erik Visser, Ian Ernan Liu
-
Publication number: 20140341380Abstract: A method includes receiving, at a processor, a first data frame at a first time from a first microphone. The method also includes receiving a second data frame at the first time from a second microphone. The method further includes calculating a power ratio of the first microphone and the second microphone based on the first data frame and the second data frame in response to determining that the first data frame and the second data frame are noise data frames.Type: ApplicationFiled: December 23, 2013Publication date: November 20, 2014Applicant: QUALCOMM IncorporatedInventors: Jimeng Zheng, Ian Ernan Liu, Dinesh Ramakrishnan, Deepak Kumar Challa
-
Patent number: 8811601Abstract: A method for echo cancellation and noise suppression is disclosed. Linear echo cancellation (LEC) is performed for a primary microphone channel on an entire frequency band or in a range of frequencies where echo is audible. LEC is performed on one or more secondary microphone channels only on a lower frequency range over which spatial processing is effective. The microphone channels are spatially processed over the lower frequency range after LEC. Non-linear noise suppression post-processing is performed on the entire frequency band. Echo post-processing is performed on the entire frequency band.Type: GrantFiled: April 4, 2011Date of Patent: August 19, 2014Assignee: QUALCOMM IncorporatedInventors: Asif I. Mohammad, Kwokleung Chan, Ian Ernan Liu, Erik Visser, Dinesh Ramakrishnan
-
Patent number: 8724829Abstract: Based on phase differences between corresponding frequency components of different channels of a multichannel signal, a measure of directional coherency is calculated. Application of such a measure to voice activity detection and noise reduction are also disclosed.Type: GrantFiled: October 23, 2009Date of Patent: May 13, 2014Assignee: QUALCOMM IncorporatedInventors: Erik Visser, Ian Ernan Liu