Patents by Inventor Changbao ZHU

Changbao ZHU has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240021194
    Abstract: This disclosure provides a voice interaction method and apparatus. At least one target device is determined from various electronic devices by receiving a wakeup signal sent by at least one wakeup device in the various electronic devices in response to a voice instruction of a user. Each target device is instructed to recognize a semantic meaning of the voice instruction to obtain semantic information, so as to determine a first response device in the various target devices based on the semantic information. In this case, the first response device is enabled to respond to the voice instruction. In this way, a problem that it is difficult for a plurality of devices to interact with the user accurately is resolved, thereby facilitating user experience.
    Type: Application
    Filed: July 7, 2023
    Publication date: January 18, 2024
    Applicant: Nanjing Horizon Robotics Technology Co., Ltd.
    Inventor: Changbao ZHU
  • Publication number: 20240004606
    Abstract: Disclosed in the embodiments of the present disclosure are an audio playback method and apparatus, a computer readable storage medium, and an electronic device. The method includes: acquiring intention determination data collected for at least one user within a target space; determining that at least one user has a target vocal intention based on the intention determination data, and then determining feature information representing a current feature of the at least one user; and extracting and playing an audio corresponding to the feature information from a preset audio library. According to the embodiments of the present disclosure, it is achieved to automatically perform a determination on the target vocal intention of the user by the electronic device, without triggering an audio playing operation by the user, the steps of performing the audio playing operation by the user being omitted, and the convenience of the audio playing operation being improved.
    Type: Application
    Filed: February 14, 2022
    Publication date: January 4, 2024
    Applicant: Shenzhen Horizon Robotics Technology Co., Ltd.
    Inventors: Changbao ZHU, Jianwei NIU, Kai YU
  • Patent number: 11856379
    Abstract: Disclosed are a method, an apparatus and an electronic device for controlling audio playback of multiple loudspeakers, wherein the method comprises: determining the location information of each speaker and voice signals issued by each speaker; determining the area where each speaker is located according to the location information of each speaker; determining voice instruction corresponding to each voice signal; and controlling the multiple loudspeakers to play the audio indicated by the corresponding voice instruction respectively for the area where the speaker of each voice instruction is located. According to the method and apparatus and/or the electronic device in an embodiment of the present disclosure, different audios can be played for different areas in a preset space.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: December 26, 2023
    Assignee: BEIJING HORIZON ROBOTICS TECHNOLOGY RESEARCH AND DEVELOPMENT CO., LTD.
    Inventor: Changbao Zhu
  • Publication number: 20220217468
    Abstract: Disclosed are a method, an apparatus and an electronic device for controlling audio playback of multiple loudspeakers, wherein the method comprises: determining the location information of each speaker and voice signals issued by each speaker; determining the area where each speaker is located according to the location information of each speaker; determining voice instruction corresponding to each voice signal; and controlling the multiple loudspeakers to play the audio indicated by the corresponding voice instruction respectively for the area where the speaker of each voice instruction is located. According to the method and apparatus and/or the electronic device in an embodiment of the present disclosure, different audios can be played for different areas in a preset space.
    Type: Application
    Filed: November 27, 2019
    Publication date: July 7, 2022
    Applicant: BEIJING HORIZON ROBOTICS TECHNOLOGY RESEARCH AND DEVELOPMENT CO., LTD.
    Inventor: Changbao ZHU
  • Publication number: 20220139389
    Abstract: Embodiments of the present disclosure disclose a speech interaction method and apparatus. The method includes: acquiring videos shot by a camera device in a target space and at least one channel of audio acquired by at least one audio acquisition device; determining to-be-recognized audio that respectively corresponds to each of the sound areas in the target space based on the at least one channel of audio; determining a target sound area from the target space based on the video and at least one channel of to-be-recognized audio; performing speech recognition on the at least one channel of to-be-recognized audio to obtain a recognition result; and controlling a speech interaction-targeting device in the target sound area for speech interaction in a preset mode according to the recognition result.
    Type: Application
    Filed: October 25, 2021
    Publication date: May 5, 2022
    Inventor: Changbao Zhu
  • Patent number: 11183179
    Abstract: Disclosed is a method and an apparatus for recognizing speech, and the method comprises: separating an input audio signal into at least two separated signals; generating a denoised signal at a current frame; performing a preliminary recognition on each interesting signal at the current frame; and performing a recognition decision according to a recognition score of each interesting signal at the current frame. The method and apparatus of the present disclosure deeply integrate an array signal processing and a speech recognition and use multiway recognitions such that a good recognition rate may be obtained even in a case of a low signal-to-noise ratio.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: November 23, 2021
    Assignee: Nanjing Horizon Robotics Technology Co., Ltd.
    Inventors: Changbao Zhu, Jianwei Niu, Ding Liu
  • Patent number: 11120815
    Abstract: A method and an apparatus for reducing noise of mixed signal are disclosed. The method includes: separating a collected mixed signal to obtain a first signal and a second signal; selecting one of the first signal and the second signal as a current reference signal, and the other as a current expected signal; and performing adaptive filtering based on the selected current reference signal and the selected current expected signal. By the method and the apparatus, the noise can be reduced significantly or removed in a case where reference signal cannot be directly obtained from a hardware.
    Type: Grant
    Filed: May 14, 2019
    Date of Patent: September 14, 2021
    Assignee: Nanjing Horizon Robotics Technology Co., Ltd
    Inventor: Changbao Zhu
  • Patent number: 10978089
    Abstract: Disclosed are a method and an apparatus for blind signal separation and an electronic device. The method includes modeling a sound source with a complex Gaussian distribution to determine a probability density distribution of the sound source; updating a blind signal separation model based on the probability density distribution; and separating an audio signal with the updated blind signal separation model to obtain a plurality of separated output signals. In this way, the blind signal separation model may be updated through the probability density distribution of the sound source obtained based on the complex Gaussian distribution, thereby effectively improving separation performance of a blind signal separation algorithm in specific scenario.
    Type: Grant
    Filed: August 29, 2019
    Date of Patent: April 13, 2021
    Assignee: NANJING HORIZON ROBOTICS TECHNOLOGY CO., LTD.
    Inventors: Yuxiang Hu, Changbao Zhu
  • Publication number: 20200082838
    Abstract: Disclosed are a method and an apparatus for blind signal separation and an electronic device. The method includes modeling a sound source with a complex Gaussian distribution to determine a probability density distribution of the sound source; updating a blind signal separation model based on the probability density distribution; and separating an audio signal with the updated blind signal separation model to obtain a plurality of separated output signals. In this way, the blind signal separation model may be updated through the probability density distribution of the sound source obtained based on the complex Gaussian distribution, thereby effectively improving separation performance of a blind signal separation algorithm in specific scenario.
    Type: Application
    Filed: August 29, 2019
    Publication date: March 12, 2020
    Inventors: Yuxiang Hu, Changbao Zhu
  • Publication number: 20200027450
    Abstract: Disclosed is a method and an apparatus for recognizing speech, and the method comprises: separating an input audio signal into at least two separated signals; generating a denoised signal at a current frame; performing a preliminary recognition on each interesting signal at the current frame; and performing a recognition decision according to a recognition score of each interesting signal at the current frame. The method and apparatus of the present disclosure deeply integrate an array signal processing and a speech recognition and use multiway recognitions such that a good recognition rate may be obtained even in a case of a low signal-to-noise ratio.
    Type: Application
    Filed: July 12, 2019
    Publication date: January 23, 2020
    Inventors: Changbao Zhu, Jianwei Niu, Ding Liu
  • Patent number: 10522170
    Abstract: A method for acquiring the number of modified frames for active sound, and a method and apparatus for voice activity detection are disclosed. Firstly, a first voice activity detection decision result and a second voice activity detection decision result are obtained (501), the number of hangover frames for active sound is obtained (502), and the number of background noise updates is obtained (503), and then the number of modified frames for active sound is calculated according to the first voice activity detection decision result, the number of background noise updates and the number of hangover frames for active sound (504), and finally, a voice activity detection decision result of a current frame is calculated according to the number of modified frames for active sound and the second voice activity detection decision result (505).
    Type: Grant
    Filed: November 5, 2015
    Date of Patent: December 31, 2019
    Assignee: ZTE CORPORATION
    Inventors: Changbao Zhu, Hao Yuan
  • Publication number: 20190355374
    Abstract: A method and an apparatus for reducing noise of mixed signal are disclosed. The method includes: separating a collected mixed signal to obtain a first signal and a second signal; selecting one of the first signal and the second signal as a current reference signal, and the other as a current expected signal; and performing adaptive filtering based on the selected current reference signal and the selected current expected signal. By the method and the apparatus, the noise can be reduced significantly or removed in a case where reference signal cannot be directly obtained from a hardware.
    Type: Application
    Filed: May 14, 2019
    Publication date: November 21, 2019
    Inventor: Changbao Zhu
  • Patent number: 10339961
    Abstract: Provided are a Voice Activity Detection (VAD) method and apparatus. The method includes that: at least one first class feature in a first feature category, at least one second class feature in a second feature category and at least two existing VAD judgment results are acquired, the first class feature and the second class feature are features used for VAD detection (S102); and VAD is carried out according to the first class feature, the second class feature and the at least two existing VAD judgment results, to obtain a combined VAD judgment result (S104).
    Type: Grant
    Filed: October 24, 2014
    Date of Patent: July 2, 2019
    Assignee: ZTE CORPORATION
    Inventors: Changbao Zhu, Hao Yuan
  • Publication number: 20180158470
    Abstract: A method for acquiring the number of modified frames for active sound, and a method and apparatus for voice activity detection are disclosed. Firstly, a first voice activity detection decision result and a second voice activity detection decision result are obtained (501), the number of hangover frames for active sound is obtained (502), and the number of background noise updates is obtained (503), and then the number of modified frames for active sound is calculated according to the first voice activity detection decision result, the number of background noise updates and the number of hangover frames for active sound (504), and finally, a voice activity detection decision result of a current frame is calculated according to the number of modified frames for active sound and the second voice activity detection decision result (505).
    Type: Application
    Filed: November 5, 2015
    Publication date: June 7, 2018
    Inventors: Changbao ZHU, Hao YUAN
  • Patent number: 9978398
    Abstract: Disclosed are a voice activity detection method and device, wherein the method includes: obtaining a combined VAD judgment result according to the number of continuous active frames, an average total SNR of all sub-bands, a tonal signal flag, and at least two existing VAD judgment results (107). The method and device are suitable for voice service, solve the problem of inaccurate VAD detection and realize highly accurate VAD judgment.
    Type: Grant
    Filed: May 16, 2014
    Date of Patent: May 22, 2018
    Assignee: ZTE Corporation
    Inventors: Changbao Zhu, Hao Yuan
  • Publication number: 20180039767
    Abstract: Provided is a voiceprint-recognition-based security protection method. The method includes: acquiring voice data of a current user of a terminal and extracting voiceprint characteristic information from the voice data; matching the extracted voiceprint characteristic information of the current user of the terminal with a pre-saved voiceprint model of an owner of the terminal, and judging whether the current user of the terminal is the owner of the terminal; and when judging that the current user of the terminal is not the owner of the terminal, performing security protection processing on the terminal.
    Type: Application
    Filed: January 20, 2016
    Publication date: February 8, 2018
    Applicant: ZTE CORPORATION
    Inventors: Chunhua QIN, Changbao ZHU, Xue BAI, Hao YUAN
  • Publication number: 20170206916
    Abstract: Provided are a Voice Activity Detection (VAD) method and apparatus. The method includes that: at least one first class feature in a first feature category, at least one second class feature in a second feature category and at least two existing VAD judgment results are acquired, the first class feature and the second class feature are features used for VAD detection (S102); and VAD is carried out according to the first class feature, the second class feature and the at least two existing VAD judgment results, to obtain a combined VAD judgment result (S104).
    Type: Application
    Filed: October 24, 2014
    Publication date: July 20, 2017
    Inventors: Changbao ZHU, Hao YUAN
  • Patent number: 9672841
    Abstract: The present document relates to a voice activity detection (VAD) method and methods used for voice activity detection and apparatus thereof, the VAD method includes: obtaining sub-band signals and spectrum amplitudes of a current frame; computing values of a energy feature and a spectral centroid feature of the current frame according to the sub-band signals; computing a signal to noise ratio parameter of the current frame according to a background noise energy estimated from a previous frame, an energy of SNR sub-bands and a energy feature of the current frame; computing a VAD decision result according to a tonality signal flag, a signal to noise ratio parameter, a spectral centroid feature, and a frame energy feature. The methods and apparatus of the present document can improve the accuracy of non-stationary noise (such as office noise) and music detection.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: June 6, 2017
    Assignee: ZTE Corporation
    Inventors: Dongping Jiang, Hao Yuan, Changbao Zhu
  • Publication number: 20170004840
    Abstract: The present document relates to a voice activity detection (VAD) method and methods used for voice activity detection and apparatus thereof, the VAD method includes: obtaining sub-band signals and spectrum amplitudes of a current frame; computing values of a energy feature and a spectral centroid feature of the current frame according to the sub-band signals; computing a signal to noise ratio parameter of the current frame according to a background noise energy estimated from a previous frame, an energy of SNR sub-bands and a energy feature of the current frame; computing a VAD decision result according to a tonality signal flag, a signal to noise ratio parameter, a spectral centroid feature, and a frame energy feature. The methods and apparatus of the present document can improve the accuracy of non-stationary noise (such as office noise) and music detection.
    Type: Application
    Filed: June 30, 2015
    Publication date: January 5, 2017
    Inventors: Dongping JIANG, Hao YUAN, Changbao ZHU
  • Publication number: 20160285086
    Abstract: The present invention relates to a method of manufacturing an electrode material having the general formula AaMb(XY(1, 2, 3 or 4))c, where A is an alkali Metal, or an alkaline earth metal, especially one of Na, Li, K, Ca, Ag, Mg and mixtures thereof, M is a transition metal, which is capable of undergoing oxidation to a higher valence state, especially one of V, Fe, Mn, Co, Ti and Ni or a combination thereof, X is one of P, Si, Ge, B, S, As, Sb and mixtures thereof and Y is one of O, OH, F, Cl, Br, I and mixtures thereof. The invention further relates to such an electrode material and to a vehicle comprising a battery including such an electrode material.
    Type: Application
    Filed: November 8, 2013
    Publication date: September 29, 2016
    Inventors: Changbao ZHU, Yan YU, Joachim MAIER