Patents by Inventor Haohai Sun
Haohai Sun has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11399100Abstract: A loudspeaker is driven with a loudspeaker signal to generate sound, and sound is converted to one or more microphone signals with one or more microphones. The microphone signals are concurrently transformed into far-field beam signals and near-field beam signals. The far-field beam signals and the near-field beam signals are concurrently processed to produce one or more far-field output signals and one or more near-field output signals, respectively. Echo is detected and canceled in the far-field beam signals and in the near-field beam signals. When the echo is not detected above a threshold, the one or more far-field output signals are outputted. When the echo is detected above the threshold, the one or more near-field output signals are outputted. A signal based on the one or more output signals is transmitted.Type: GrantFiled: June 28, 2019Date of Patent: July 26, 2022Assignee: CISCO TECHNOLOGY, INC.Inventors: Haohai Sun, Johan Ludvig Nielsen
-
Publication number: 20220189267Abstract: A security system for detecting a predefined event at an entrance area. The system comprises a camera for visually monitoring the entrance area, a microphone device for detecting sound at the entrance area; and a processor. The processor is configured to receive a visual signal from the camera and an audio signal from the microphone device; and trigger an alert when both the visual signal and the audio signal indicate that the predefined event has occurred.Type: ApplicationFiled: December 14, 2021Publication date: June 16, 2022Inventor: Haohai SUN
-
Patent number: 11322137Abstract: A video camera, a computer-implemented method, and a computer-readable storage medium. The video camera including one or more microphones and a processor. The processor is configured to: acquire an output from the or each microphone; apply one or more pre-analysis filters to the or each acquired output, wherein the or each pre-analysis filter determines if the or each acquired output contains a corresponding predetermined feature of interest; and analyse the or each output, when it is determined by the or each pre-analysis filter that the corresponding output contains at least one predetermined feature of interest.Type: GrantFiled: January 31, 2020Date of Patent: May 3, 2022Assignee: Ava Video Security LimitedInventor: Haohai Sun
-
Publication number: 20200275199Abstract: A microphone array includes one or more front-facing microphones disposed on a front surface of the collaboration endpoint and a plurality of secondary microphones disposed on a second surface of the collaboration endpoint. The sound signals received at each of the one or more front-facing microphones and the plurality of secondary microphones are converted into microphone signals. When the sound signals have a frequency below a threshold frequency, an output signal is generated from microphone signals generated by the one or more front-facing microphones and the plurality of secondary microphones. When the sound signals have a frequency at or above a threshold frequency, an output signal is generated from microphone signals generated by only the one or more front-facing microphones.Type: ApplicationFiled: May 13, 2020Publication date: August 27, 2020Inventors: Gisle Langen Enstad, Haohai Sun, Johan Ludvig Nielsen
-
Publication number: 20200252587Abstract: A video camera, a computer-implemented method, and a computer-readable storage medium. The video camera including one or more microphones and a processor. The processor is configured to: acquire an output from the or each microphone; apply one or more pre-analysis filters to the or each acquired output, wherein the or each pre-analysis filter determines if the or each acquired output contains a corresponding predetermined feature of interest; and analyse the or each output, when it is determined by the or each pre-analysis filter that the corresponding output contains at least one predetermined feature of interest.Type: ApplicationFiled: January 31, 2020Publication date: August 6, 2020Inventor: Haohai SUN
-
Patent number: 10687139Abstract: A microphone array includes one or more front-facing microphones disposed on a front surface of the collaboration endpoint and a plurality of secondary microphones disposed on a second surface of the collaboration endpoint. The sound signals received at each of the one or more front-facing microphones and the plurality of secondary microphones are converted into microphone signals. When the sound signals have a frequency below a threshold frequency, an output signal is generated from microphone signals generated by the one or more front-facing microphones and the plurality of secondary microphones. When the sound signals have a frequency at or above a threshold frequency, an output signal is generated from microphone signals generated by only the one or more front-facing microphones.Type: GrantFiled: September 20, 2019Date of Patent: June 16, 2020Assignee: Cisco Technology, Inc.Inventors: Gisle Langen Enstad, Haohai Sun, Johan Ludvig Nielsen
-
Publication number: 20200120418Abstract: A microphone array includes one or more front-facing microphones disposed on a front surface of the collaboration endpoint and a plurality of secondary microphones disposed on a second surface of the collaboration endpoint. The sound signals received at each of the one or more front-facing microphones and the plurality of secondary microphones are converted into microphone signals. When the sound signals have a frequency below a threshold frequency, an output signal is generated from microphone signals generated by the one or more front-facing microphones and the plurality of secondary microphones. When the sound signals have a frequency at or above a threshold frequency, an output signal is generated from microphone signals generated by only the one or more front-facing microphones.Type: ApplicationFiled: September 20, 2019Publication date: April 16, 2020Inventors: Gisle Langen Enstad, Haohai Sun, Johan Ludvig Nielsen
-
Patent number: 10504529Abstract: A method and apparatus for providing binaural audio for a headset is provided. In one embodiment, a method includes encoding audio signals to provide binaural audio to a headset. The method includes receiving audio signals from a microphone array comprising a first plurality of elements and applying far-field array processing to the audio signals to generate a first plurality of channels. The channels can be beam channels and each channel is associated with a particular beam angle. The method further includes selecting a second plurality of channels from the first plurality of channels that is a subset of the first plurality of channels. The method includes encoding the audio signals from the selected second plurality of channels with information associated with the particular beam angle for each of the selected second plurality of channels. The encoded audio signals are configured to provide binaural audio to a headset.Type: GrantFiled: November 9, 2017Date of Patent: December 10, 2019Assignee: Cisco Technology, Inc.Inventor: Haohai Sun
-
Patent number: 10491995Abstract: A microphone array includes one or more front-facing microphones disposed on a front surface of the collaboration endpoint and a plurality of secondary microphones disposed on a second surface of the collaboration endpoint. The sound signals received at each of the one or more front-facing microphones and the plurality of secondary microphones are converted into microphone signals. When the sound signals have a frequency below a threshold frequency, an output signal is generated from microphone signals generated by the one or more front-facing microphones and the plurality of secondary microphones. When the sound signals have a frequency at or above a threshold frequency, an output signal is generated from microphone signals generated by only the one or more front-facing microphones.Type: GrantFiled: October 11, 2018Date of Patent: November 26, 2019Assignee: Cisco Technology, Inc.Inventors: Gisle Langen Enstad, Haohai Sun, Johan Ludvig Nielsen
-
Publication number: 20190342456Abstract: A loudspeaker is driven with a loudspeaker signal to generate sound, and sound is converted to one or more microphone signals with one or more microphones. The microphone signals are concurrently transformed into far-field beam signals and near-field beam signals. The far-field beam signals and the near-field beam signals are concurrently processed to produce one or more far-field output signals and one or more near-field output signals, respectively. Echo is detected and canceled in the far-field beam signals and in the near-field beam signals. When the echo is not detected above a threshold, the one or more far-field output signals are outputted. When the echo is detected above the threshold, the one or more near-field output signals are outputted. A signal based on the one or more output signals is transmitted.Type: ApplicationFiled: June 28, 2019Publication date: November 7, 2019Inventors: Haohai Sun, Johan Ludvig Nielsen
-
Patent number: 10389885Abstract: A loudspeaker is driven with a loudspeaker signal to generate sound, and sound is converted to one or more microphone signals with one or more microphones. The microphone signals are concurrently transformed into far-field beam signals and near-field beam signals. The far-field beam signals and the near-field beam signals are concurrently processed to produce one or more far-field output signals and one or more near-field output signals, respectively. Echo is detected and canceled in the far-field beam signals and in the near-field beam signals. When the echo is not detected above a threshold, the one or more far-field output signals are outputted. When the echo is detected above the threshold, the one or more near-field output signals are outputted. A signal based on the one or more output signals is transmitted.Type: GrantFiled: February 1, 2017Date of Patent: August 20, 2019Assignee: Cisco Technology, Inc.Inventors: Haohai Sun, Johan Ludvig Nielsen
-
Patent number: 10375474Abstract: The disclosed technology relates to a microphone array. The array comprises a plurality of microphones with each microphone having a horn portion. Each microphone of the array further comprises an instrument disposed at a distal end of the horn portion. Each instrument of the array is configured to convert sound waves into an electrical signal. The microphone array further comprises a beamforming signal processing circuit electrically coupled to each instrument and configured to create a plurality of beam signals based on respective electrical signals.Type: GrantFiled: June 12, 2017Date of Patent: August 6, 2019Assignee: CISCO TECHNOLOGY, INC.Inventors: Rune Skramstad, Haohai Sun
-
Publication number: 20190139554Abstract: A method and apparatus for providing binaural audio for a headset is provided. In one embodiment, a method includes encoding audio signals to provide binaural audio to a headset. The method includes receiving audio signals from a microphone array comprising a first plurality of elements and applying far-field array processing to the audio signals to generate a first plurality of channels. The channels can be beam channels and each channel is associated with a particular beam angle. The method further includes selecting a second plurality of channels from the first plurality of channels that is a subset of the first plurality of channels. The method includes encoding the audio signals from the selected second plurality of channels with information associated with the particular beam angle for each of the selected second plurality of channels. The encoded audio signals are configured to provide binaural audio to a headset.Type: ApplicationFiled: November 9, 2017Publication date: May 9, 2019Inventor: Haohai Sun
-
Publication number: 20180359562Abstract: The disclosed technology relates to a microphone array. The array comprises a plurality of microphones with each microphone having a horn portion. Each microphone of the array further comprises an instrument disposed at a distal end of the horn portion. Each instrument of the array is configured to convert sound waves into an electrical signal. The microphone array further comprises a beamforming signal processing circuit electrically coupled to each instrument and configured to create a plurality of beam signals based on respective electrical signals.Type: ApplicationFiled: June 12, 2017Publication date: December 13, 2018Inventors: Rune Skramstad, Haohai Sun
-
Patent number: 10136217Abstract: At a microphone array, a soundfield is detected to produce a set of microphone signals each from a corresponding microphone in the microphone array. The set of microphone signals represents the soundfield. The detected soundfield is decomposed into a set of sub-soundfield signals based on the set of microphone signals. Each sub-soundfield signal is processed, such that each sub-soundfield signal is separately dereverberated using other ones of the sub-soundfield signals to remove reverberation from the sub-soundfield signal, to produce a set of processed sub-soundfield signals. The set of processed sub-sound field signals are mixed into a mixed output signal.Type: GrantFiled: October 17, 2017Date of Patent: November 20, 2018Assignee: Cisco Technology, Inc.Inventor: Haohai Sun
-
Patent number: 10129409Abstract: A system and method for joint acoustic echo control and adaptive array processing, comprising the decomposition of a captured sound field into N sub-sound fields, applying linear echo cancellation to each sub-sound field, selecting L sub-sound fields from the N sub-sound fields, performing L channel adaptive array processing utilizing the L selected sub-sound fields, and applying non-linear audio echo cancellation.Type: GrantFiled: November 21, 2016Date of Patent: November 13, 2018Assignee: Cisco Technology, Inc.Inventor: Haohai Sun
-
Publication number: 20180220007Abstract: A loudspeaker is driven with a loudspeaker signal to generate sound, and sound is converted to one or more microphone signals with one or more microphones. The microphone signals are concurrently transformed into far-field beam signals and near-field beam signals. The far-field beam signals and the near-field beam signals are concurrently processed to produce one or more far-field output signals and one or more near-field output signals, respectively. Echo is detected and canceled in the far-field beam signals and in the near-field beam signals. When the echo is not detected above a threshold, the one or more far-field output signals are outputted. When the echo is detected above the threshold, the one or more near-field output signals are outputted. A signal based on the one or more output signals is transmitted.Type: ApplicationFiled: February 1, 2017Publication date: August 2, 2018Inventors: Haohai Sun, Johan Ludvig Nielsen
-
Publication number: 20180041835Abstract: At a microphone array, a soundfield is detected to produce a set of microphone signals each from a corresponding microphone in the microphone array. The set of microphone signals represents the soundfield. The detected soundfield is decomposed into a set of sub-soundfield signals based on the set of microphone signals. Each sub-soundfield signal is processed, such that each sub-soundfield signal is separately dereverberated using other ones of the sub-soundfield signals to remove reverberation from the sub-soundfield signal, to produce a set of processed sub-soundfield signals. The set of processed sub-sound field signals are mixed into a mixed output signal.Type: ApplicationFiled: October 17, 2017Publication date: February 8, 2018Inventor: Haohai Sun
-
Patent number: 9883142Abstract: In one embodiment, a method includes retrieving positions P1, P2 and P3 of a first, second and third attendee position, respectively, P1, P2, P3 being determined based on detecting speech from the first, second and third attendee position, respectively, by a first microphone array of a first collaboration apparatus, retrieving distances D1, D2 and D3 from the first, second and third attendee position, respectively, to a second microphone array of a second collaboration apparatus, D1, D2, D3 being determined based on detecting speech from the first, second and third attendee position, respectively, by the second microphone array, P1 and D1 defining a circle C1 centered at P1 with radius D1, P2 and D2 defining a circle C2 centered at P2 with radius D2, P3 and D3 defining a circle C3 centered at P3 with radius D3, calculating a position P4 based on a proximity of a circumference of C1, C2 and C3.Type: GrantFiled: March 21, 2017Date of Patent: January 30, 2018Assignee: Cisco Technology, Inc.Inventor: HaoHai Sun
-
Patent number: 9813811Abstract: At a microphone array, a soundfield is detected to produce a set of microphone signals each from a corresponding microphone in the microphone array. The set of microphone signals represents the soundfield. The detected soundfield is decomposed into a set of sub-soundfield signals based on the set of microphone signals. Each sub-soundfield signal is processed, such that each sub-soundfield signal is separately dereverberated to remove reverberation therefrom, to produce a set of processed sub-soundfield signals. The set of processed sub-sound field signals are mixed into a mixed output signal.Type: GrantFiled: June 1, 2016Date of Patent: November 7, 2017Assignee: Cisco Technology, Inc.Inventor: Haohai Sun