Bandwidth Extension Taking Place At The Receiving Side, E.g., Generation Of Low- Or High-frequency Components, Regeneration Of Spectral Holes, Etc. (epo) Patents (Class 704/E21.011)
  • Patent number: 11763830
    Abstract: A method for decoding an encoded audio bitstream is disclosed. The method includes receiving the encoded audio bitstream and decoding the audio data to generate a decoded lowband audio signal. The method further includes extracting high frequency reconstruction metadata and filtering the decoded lowband audio signal with an analysis filterbank to generate a filtered lowband audio signal. The method also includes extracting a flag indicating whether either spectral translation or harmonic transposition is to be performed on the audio data and regenerating a highband portion of the audio signal using the filtered lowband audio signal and the high frequency reconstruction metadata in accordance with the flag.
    Type: Grant
    Filed: October 11, 2022
    Date of Patent: September 19, 2023
    Assignee: DOLBY INTERNATIONAL AB
    Inventors: Lars Villemoes, Heiko Purnhagen, Per Ekstrand
  • Patent number: 11676616
    Abstract: A method for decoding an encoded audio bitstream is disclosed. The method includes receiving the encoded audio bitstream and decoding the audio data to generate a decoded lowband audio signal. The method further includes extracting high frequency reconstruction metadata and filtering the decoded lowband audio signal with an analysis filterbank to generate a filtered lowband audio signal. The method also includes extracting a flag indicating whether either spectral translation or harmonic transposition is to be performed on the audio data and regenerating a highband portion of the audio signal using the filtered lowband audio signal and the high frequency reconstruction metadata in accordance with the flag.
    Type: Grant
    Filed: October 11, 2022
    Date of Patent: June 13, 2023
    Assignee: DOLBY INTERNATIONAL AB
    Inventors: Lars Villemoes, Heiko Purnhagen, Per Ekstrand
  • Patent number: 11650945
    Abstract: A cascade extension device and a cascade system having the cascade extension device are provided. The cascade extension device includes a control module, a buffer module, a storage module, and a selecting output module. The cascade system includes a processor and a plurality of extension devices. The processor may simultaneously control the plurality of extension devices through judging the data packet received as a write command, a read command, or a bypass command by a plurality of extension devices.
    Type: Grant
    Filed: April 15, 2021
    Date of Patent: May 16, 2023
    Assignee: NUVOTON TECHNOLOGY CORPORATION
    Inventors: Ming-Hung Wu, Hao-Yang Chang, Fong-Jhu Wu, Ciao-Ling Lu
  • Patent number: 11621013
    Abstract: A method for decoding an encoded audio bitstream is disclosed. The method includes receiving the encoded audio bitstream and decoding the audio data to generate a decoded lowband audio signal. The method further includes extracting high frequency reconstruction metadata and filtering the decoded lowband audio signal with an analysis filterbank to generate a filtered lowband audio signal. The method also includes extracting a flag indicating whether either spectral translation or harmonic transposition is to be performed on the audio data and regenerating a highband portion of the audio signal using the filtered lowband audio signal and the high frequency reconstruction metadata in accordance with the flag.
    Type: Grant
    Filed: October 11, 2022
    Date of Patent: April 4, 2023
    Assignee: DOLBY INTERNATIONAL AB
    Inventors: Lars Villemoes, Heiko Purnhagen, Per Ekstrand
  • Patent number: 11605391
    Abstract: A method for decoding an encoded audio bitstream is disclosed. The method includes receiving the encoded audio bitstream and decoding the audio data to generate a decoded lowband audio signal. The method further includes extracting high frequency reconstruction metadata and filtering the decoded lowband audio signal with an analysis filterbank to generate a filtered lowband audio signal. The method also includes extracting a flag indicating whether either spectral translation or harmonic transposition is to be performed on the audio data and regenerating a highband portion of the audio signal using the filtered lowband audio signal and the high frequency reconstruction metadata in accordance with the flag.
    Type: Grant
    Filed: October 11, 2022
    Date of Patent: March 14, 2023
    Assignee: DOLBY INTERNATIONAL AB
    Inventors: Lars Villemoes, Heiko Purnhagen, Per Ekstrand
  • Patent number: 8965758
    Abstract: In the field of audio encoding/decoding technologies, a signal de-noising method is provided. The method includes: selecting, according to a degree of inter-frame correlation of a frame where a spectral coefficient to be adjusted resides, at least two spectral coefficients having high correlation with the spectral coefficient to be adjusted; performing weighting on the at least two selected spectral coefficients and the spectral coefficient to be adjusted to acquire a predicted value of the spectral coefficient to be adjusted; and adjusting a spectrum of a decoded signal by using the acquired predicted value, and outputting the adjusted decoded signal. A signal de-noising apparatus corresponding to the signal de-noising method and an audio decoding system using the signal de-noising apparatus are also provided.
    Type: Grant
    Filed: September 29, 2011
    Date of Patent: February 24, 2015
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Longyin Chen, Lei Miao, Chen Hu, Zexin Liu, Qing Zhang
  • Patent number: 8655649
    Abstract: A linear prediction coefficient of a signal represented in a frequency domain is obtained by performing linear prediction analysis in a frequency direction by using a covariance method or an autocorrelation method. After the filter strength of the obtained linear prediction coefficient is adjusted, filtering may be performed in the frequency direction on the signal by using the adjusted coefficient, whereby the temporal envelope of the signal is shaped. This reduces the occurrence of pre-echo and post-echo and improves the subjective quality of the decoded signal, without significantly increasing the bit rate in a bandwidth extension technique in the frequency domain represented by spectral band replication.
    Type: Grant
    Filed: September 23, 2011
    Date of Patent: February 18, 2014
    Assignee: NTT DoCoMo, Inc.
    Inventors: Kosuke Tsujino, Kei Kikuiri, Nobuhiko Naka
  • Patent number: 8447621
    Abstract: The present invention proposes a new method and a new apparatus for enhancement of audio source coding systems utilizing high frequency reconstruction (HFR). It utilizes a detection mechanism on the encoder side to assess what parts of the spectrum will not be correctly reproduced by the HFR method in the decoder. Information on this is efficiently coded and sent to the decoder, where it is combined with the output of the HFR unit.
    Type: Grant
    Filed: August 9, 2011
    Date of Patent: May 21, 2013
    Assignee: Dolby International AB
    Inventors: Kristofer Kjörling, Per Ekstrand, Holger Hörich
  • Patent number: 8401862
    Abstract: An audio encoder for providing an output signal using an input audio signal includes a patch generator, a comparator and an output interface. The patch generator generates at least one bandwidth extension high-frequency signal, wherein a bandwidth extension high-frequency signal includes a high-frequency band. The high-frequency band of the bandwidth extension high-frequency signal is based on a low frequency band of the input audio signal. A comparator calculates a plurality of comparison parameters. A comparison parameter is calculated based on a comparison of the input audio signal and a generated bandwidth extension high-frequency signal. Each comparison parameter of the plurality of comparison parameters is calculated based on a different offset frequency between the input audio signal and a generated bandwidth extension high-frequency signal.
    Type: Grant
    Filed: June 13, 2011
    Date of Patent: March 19, 2013
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der Angewandten Forschung e.V.
    Inventors: Frederik Nagel, Sascha Disch, Guillaume Fuchs, Juergen Herre, Christian Greibel
  • Patent number: 8386268
    Abstract: An apparatus for generating a synthesis audio signal using a patching control signal has a first converter, a spectral domain patch generator, a high frequency reconstruction manipulator and a combiner. The first converter is configured for converting a time portion of an audio signal into a spectral representation. The spectral domain patch generator is configured for performing a plurality of different spectral domain patching algorithms, wherein each patching algorithm generates a modified spectral representation having spectral components in an upper frequency band derived from corresponding spectral components in a core frequency band of the audio signal.
    Type: Grant
    Filed: May 13, 2011
    Date of Patent: February 26, 2013
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Frederik Nagel, Markus Multrus, Jeremie Lecomte, Stefan Bayer, Guillaume Fuchs, Johannes Hilpert, Julien Robilliard
  • Patent number: 8255233
    Abstract: Methods and an apparatus for enhancement of source coding systems utilizing high frequency reconstruction (HFR) are introduced. The problem of insufficient noise contents is addressed in a reconstructed highband, by using Adaptive Noise-floor Addition. New methods are also introduced for enhanced performance by means of limiting unwanted noise, interpolation and smoothing of envelope adjustment amplification factors. The methods and apparatus used are applicable to both speech coding and natural audio coding systems.
    Type: Grant
    Filed: September 12, 2011
    Date of Patent: August 28, 2012
    Assignee: Dolby International AB
    Inventors: Lars G. Liljeryd, Kristofer Kjoerling, Per Ekstrand, Frederik Henn
  • Patent number: 8112284
    Abstract: The present invention proposes a new method and a new apparatus for enhancement of audio source coding systems utilizing high frequency reconstruction (HFR). It utilizes a detection mechanism on the encoder side to assess what parts of the spectrum will not be correctly reproduced by the HFR method in the decoder. Information on this is efficiently coded and sent to the decoder, where it is combined with the output of the HFR unit.
    Type: Grant
    Filed: November 19, 2008
    Date of Patent: February 7, 2012
    Assignee: Coding Technologies AB
    Inventors: Kristofer Kjörling, Per Ekstrand, Holger Hörich
  • Patent number: 8069049
    Abstract: A system for enhancing a signal regenerated from an encoded audio signal. The system comprises a decoder arranged to receive the encoded audio signal and produce a decoded audio signal, a feature extraction means arranged to receive at least one of the decoded and encoded audio signal and extract at least one feature from at least one of the decoded and encoded audio signal, a mapping means arranged to map the at least one feature to an enhancement signal and operable to generate and output the enhancement signal, whereby the enhancement signal has a frequency band that is within the decoded audio signal frequency band, and a mixing means arranged to receive the decoded audio signal and the enhancement signal and mix the enhancement signal with the decoded audio signal.
    Type: Grant
    Filed: December 28, 2007
    Date of Patent: November 29, 2011
    Assignee: Skype Limited
    Inventors: Mattias Nilsson, Jonas Lindblom, Renat Vafin, Soren Vang Andersen
  • Patent number: 8046235
    Abstract: An apparatus and method encode audio data, and an apparatus and method decode encoded audio data. An audio data encoding apparatus includes: a scalable encoding unit dividing audio data into a plurality of layers, representing the audio data in predetermined numbers of bits in each of the plurality of layers, and encoding a lower layer prior to encoding an upper layer and an upper bit of each layer prior to encoding a lower bit of each layer; an SBR encoding unit generating spectral band replication (SBR) data that has information with respect to audio data in a frequency band of frequencies equal to or greater than a predetermined frequency among the audio data to be encoded, and encoding the SBR data; and a bitstream production unit generating a bitstream using the encoded SBR data and the encoded audio data corresponding to a predetermined bitrate.
    Type: Grant
    Filed: September 7, 2010
    Date of Patent: October 25, 2011
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Miyoung Kim, Sangwook Kim, Dohyung Kim, Shihwa Lee, Junghoe Kim
  • Patent number: 8036880
    Abstract: Methods and an apparatus for enhancement of source coding systems utilizing high frequency reconstruction (HFR) are introduced. The problem of insufficient noise contents is addressed in a reconstructed highband, by using Adaptive Noise-floor Addition. New methods are also introduced for enhanced performance by means of limiting unwanted noise, interpolation and smoothing of envelope adjustment amplification factors. The methods and apparatus used are applicable to both speech coding and natural audio coding systems.
    Type: Grant
    Filed: June 24, 2009
    Date of Patent: October 11, 2011
    Assignee: Coding Technologies Sweden AB
    Inventors: Lars G. Liljeryd, Kristofer Kjoerling, Per Ekstrand, Fredrik Henn
  • Patent number: 8019612
    Abstract: The present invention proposes a new method and a new apparatus for enhancement of audio source coding systems utilizing high frequency reconstruction (HFR). It utilizes a detection mechanism on the encoder side to assess what parts of the spectrum will not be correctly reproduced by the HFR method in the decoder. Information on this is efficiently coded and sent to the decoder, where it is combined with the output of the HFR unit.
    Type: Grant
    Filed: June 29, 2009
    Date of Patent: September 13, 2011
    Assignee: Coding Technologies AB
    Inventors: Kristofer Kjörling, Per Ekstrand, Holger Hörich
  • Patent number: 7953604
    Abstract: An audio encoder performs frequency extension coding that comprises determining one or more shape parameters using a displacement vector that corresponds to a displacement of an even number (e.g., an even number of sub-bands between a sub-band in a baseband frequency range and a sub-band in an extended-band frequency range). The shape parameters can be determined on a per-audio-block basis. Restricting a displacement to an even number (in frequency extension coding or in other signal modulation schemes) can improve the quality of reconstructed audio. An audio encoder also can perform frequency extension coding that comprises determining one or more scale parameters at one or more audio blocks, and determining one or more anchor points for interpolating the one or more scale parameters.
    Type: Grant
    Filed: January 20, 2006
    Date of Patent: May 31, 2011
    Assignee: Microsoft Corporation
    Inventors: Sanjeev Mehrotra, Wei-Ge Chen, Kazuhito Koishida, Chao He
  • Publication number: 20090138267
    Abstract: A receiver in an audio coding system receives a signal conveying frequency subband signals representing an audio signal. The subband signals are examined to assess one or more characteristics of the audio signal including temporal shape. Spectral components are synthesized having the one or more assessed characteristics, integrated with the subband signals and passed through a synthesis filterbank to generate an output signal.
    Type: Application
    Filed: February 4, 2009
    Publication date: May 28, 2009
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Grant Allen Davidson, Michael Mead Truman, Matthew Conrad Fellers, Mark Stuart Vinton
  • Publication number: 20090041111
    Abstract: The present invention relates to a new method and apparatus for improvement of High Frequency Reconstruction (HFR) techniques using frequency translation or folding or a combination thereof. The proposed invention is applicable to audio source coding systems, and offers significantly reduced computational complexity. This is accomplished by means of frequency translation or folding in the subband domain, preferably integrated with spectral envelope adjustment in the same domain. The concept of dissonance guard-band filtering is further presented. The proposed invention offers a low-complexity, intermediate quality HFR method useful in speech and natural audio coding applications.
    Type: Application
    Filed: October 16, 2008
    Publication date: February 12, 2009
    Applicant: Coding Technologies Sweden AB
    Inventors: LARS LILJERYD, PER EKSTRAND, FREDRIK HENN, KRISTOFER KJORLING
  • Publication number: 20080167861
    Abstract: There is provided a mobile phone that detects bio-information on the user and makes information communications reflecting the detected bio-information. The mobile phone (1) includes sensors (18) that detect bio-information data. The bio-information data detected by the sensors (18) are sent to a sensor data analyzer (19) in which psychology corresponding to the detected bio-information data is analyzed based on bio-information data stored in a psychology memory (20) and psychology of the user. The sensor data analyzer (19) extracts characteristic signal patterns from the bio-information data detected by the sensors (18) and analyzes psychology corresponding to the extracted signal patterns. The psychology includes, for example, “pleased and delightful”, “discouraged”, “excited”, etc. and these states of mind are stored in association with bio-information data in the psychology memory (20).
    Type: Application
    Filed: August 13, 2004
    Publication date: July 10, 2008
    Applicant: Sony Corporation
    Inventors: Akiko Inoue, Yoichiro Sako, Toshiro Terauchi, Makoto Inoue, Katsuya Shirai, Yasushi Miyajima, Kenichi Makino, Motoyuki Takai
  • Publication number: 20080126081
    Abstract: A method for the artificial extension of the bandwidth of speech signals involves: a) Provision of a wideband input speech signal (swbi(k)); b) Determination of the signal components (seb(k)) of the wideband input speech signal (swbi(k)) required for the bandwidth extension from an extension band from the wideband input speech signal (swbi(k)); c) Determination of the temporal envelopes of the signal components (seb(k)) determined for the bandwidth extension; d) Determination of the spectral envelopes of the signal components (seb(k)) determined for bandwidth extension; e) Encoding of the information for the temporal envelopes and the spectral envelopes, and provision of the encoded information by carrying out the extension of the bandwidth; f) Decoding of the encoded information and generation of the temporal envelopes and the spectral envelopes from the encoded information for the production of a bandwidth-extended output speech signal (swbo(k)).
    Type: Application
    Filed: June 30, 2006
    Publication date: May 29, 2008
    Applicant: SIEMANS AKTIENGESELLSCHAFT
    Inventors: Bernd Geiser, Peter Jax, Stefan Schandl, Herve Taddei, Aulis Telle, Peter Vary
  • Publication number: 20080120095
    Abstract: A method and apparatus to encode and/or decode a speech signal and/or an audio signal. The apparatus includes a first domain transforming unit, a frequency domain encoding unit, and a multiplexing unit to encode the speech signal and/or an audio signal. The apparatus includes a demultiplexing unit, a frequency domain decoding unit, and a second domain inverse transformation unit to decode the speech signal and/or the audio signal. The method and apparatus are capable of effectively encoding or decoding all of a speech signal, an audio signal, and a mixed signal of a speech signal and an audio signal, and improving the quality of sound by using a small number of bits.
    Type: Application
    Filed: November 16, 2007
    Publication date: May 22, 2008
    Applicant: Samsung Electronics Co., Ltd.
    Inventors: Eun-mi OH, Chang-youg Son, Ki-hyun Choo, Jung-hoe Kim