# Audio coding/decoding method and apparatus using excess quantization information

There is provided an audio coding device which appropriately sets the quantization bit number by a small calculation amount in each stage when coding an input audio signal by performing multi-stage normalization/quantization. A quantization information calculation section determines total quantization information idwl0, based on normalization information idsf, and allocates the total quantization information idwl0 for quantization information idwl1 and quantization information idwl2. At this time, the quantization information calculation section limits the quantization information idwl1 by a limiter lim1, and allocates the total quantization information idwl0 for quantization information idwl1. If the quantization information idwl1 exceeds the limiter lim1, the excess is allocated for the quantization information idwl2. A first normalization section and a first quantization section normalizes and quantizes a frequency spectrum mdspec1 in the first stage. A second normalization section and a second quantization section normalizes and quantizes a differential frequency spectrum mdspec2 in the second stage.

## Latest SONY CORPORATION Patents:

- TRANSMISSION APPARATUS, RECEPTION APPARATUS, AND DATA PROCESSING METHOD
- TELECOMMUNICATIONS APPARATUS AND METHODS
- Reception apparatus, reception method, and image processing system
- Information processing apparatus and information processing method
- Image pickup element, stacked image pickup element, and solid-state image pickup apparatus that exel in characteristics of transferring an electric charge accmlarted in photoelectric conversion layer

**Description**

**CROSS REFERENCES TO RELATED APPLICATIONS**

The present invention contains subject matter related to Japanese Patent Application JP 2005-137667 filed in the Japanese Patent Office on May 10, 2005, the entire contents of which being incorporated herein by reference. This application is both a continuation application of reissue application U.S. application Ser. No. 14/835,121, filed on Aug. 25, 2015, now RE46,388 issued on May 2, 2017 and a reissue application of U.S. Pat. No. 8,521,522 issued on Aug. 27, 2013 which was U.S. application Ser. No. 11/381,791 filed on May 5, 2006, claiming benefit to Japanese Patent Application JP 2005-137667 filed in the Japanese Patent Office on May 10, 2005, the disclosures of all of which are incorporated herein by reference.

**BACKGROUND OF THE INVENTION**

1. Field of the Invention

The present invention relates to an audio coding device and a method thereof by which an input audio signal is coded according to so-called transform coding and an obtained code string is transferred or recorded onto a recording medium, and also relates to an audio decoding device and a method thereof by which a code string transferred or red from a recording medium is decoded to obtain an output audio signal.

2. Description of the Related Art

There has been a known method in which spectrums obtained by performing time-frequency transform on an input audio signal are subjected to normalization/quantization and differential frequency spectrums as quantization errors are subjected again to normalization/quantization (see Patent Documents 1 and 2: Japanese Patent Publications No. 3227945 and No. 3227948). Quantization accuracy of the audio coding device can be improved by this method, and scalability can be realized to fit performance and use environment of the audio decoding device.

**SUMMARY OF THE INVENTION**

However, no method has been established yet at present to appropriately set the quantization bit number by a small calculation amount in each of multiple stages in case where multistage normalization/quantization is realized according to the known technology including the above patent publications.

The present invention has been proposed in view of the situation of known technology as described above. It is desirable to provide an audio coding device and a method thereof, which are capable of appropriately setting the quantization bit number in each stage by a small calculation amount when coding an input audio signal by performing multistage normalization/quantization, and an audio decoding device and a method thereof, which obtain an output audio signal by decoding a code string obtained by the audio coding device.

According to an embodiment of the present invention, there is provided an audio coding device including: a time-frequency transform means for performing time-frequency transform on an input audio signal to generate a frequency spectrum; quantization information calculation means for generating total quantization information indicating a quantization bit number on the basis of predetermined normalization information, and for allocating the total quantization information, to generate first quantization information and second quantization information each indicating a quantization bit number; a first normalization means for normalizing the frequency spectrum for every frequency component by use of a first normalization coefficient corresponding to the normalization information, to generate a normalized frequency spectrum; a first quantization means for linearly quantizing the normalized frequency spectrum by use of a first quantization coefficient corresponding to the first quantization information, to generate a quantized frequency spectrum; a subtraction means for subtracting, from the frequency spectrum, a frequency spectrum obtained by inversely quantizing and inversely normalizing the quantized frequency spectrum, to generate a differential frequency spectrum; a second normalization means for normalizing the differential frequency spectrum by use of a second normalization coefficient corresponding to the normalization information and the first quantization information, to generate a differential normalized frequency spectrum; a second quantization means for linearly quantizing the differential normalized frequency spectrum by use of a second quantization coefficient corresponding to the second quantization information, to generate a differential quantized frequency spectrum; and a code string coding means for coding the normalization information, the first quantization information, the second quantization information, the quantized frequency spectrum, and the differential quantized frequency spectrum, to output a code string, wherein the quantization information calculation means sets a predetermined limit to the first quantization information, allocates the total quantization information for the first quantization information, and allocates an excess beyond the predetermined limit, for the second quantization information, to generate the first quantization information and the second quantization information.

According to an embodiment of the present invention, there is provided an audio coding method including: a time-frequency transform step of performing time-frequency transform on an input audio signal to generate a frequency spectrum; a quantization information calculation step of generating total quantization information indicating a quantization bit number on the basis of predetermined normalization information, and of allocating the total quantization information, to generate first quantization information and second quantization information each indicating a quantization bit number; a first normalization step of normalizing the frequency spectrum for every frequency component by use of a first normalization coefficient corresponding to the normalization information, to generate a normalized frequency spectrum; a first quantization step of linearly quantizing the normalized frequency spectrum by use of a first quantization coefficient corresponding to the first quantization information, to generate a quantized frequency spectrum; a subtraction step of subtracting, from the frequency spectrum, a frequency spectrum obtained by inversely quantizing and inversely normalizing the quantized frequency spectrum, to generate a differential frequency spectrum; a second normalization step of normalizing the differential frequency spectrum by use of a second normalization coefficient corresponding to the normalization information and the first quantization information, to generate a differential normalized frequency spectrum; a second quantization step of linearly quantizing the differential normalized frequency spectrum by use of a second quantization coefficient corresponding to the second quantization information, to generate a differential quantized frequency spectrum; and a code string coding step of coding the normalization information, the first quantization information, the second quantization information, the quantized frequency spectrum, and the differential quantized frequency spectrum, to output a code string, wherein in the quantization information calculation step, a predetermined limit is set to the first quantization information, the total quantization information is allocated for the first quantization information, and an excess beyond the predetermined limit is allocated for the second quantization information, to generate the first quantization information and the second quantization information.

According to an embodiment of the present invention, there is provided an audio coding device including: a time-frequency transform means for performing time-frequency transform on an input audio signal, to generate a frequency spectrum; a quantization information calculation means for generating total quantization information indicating a quantization bit number on the basis of predetermined normalization information, and for allocating the total quantization information, to generate first quantization information and second quantization information each indicating a quantization bit number; a first normalization means for normalizing the frequency spectrum for every frequency component by use of a first normalization coefficient corresponding to the normalization information, to generate a normalized frequency spectrum; a first quantization means for linearly quantizing the normalized frequency spectrum by use of a first quantization coefficient corresponding to the first quantization information, to generate a quantized frequency spectrum; a subtraction means for subtracting, from the frequency spectrum, a frequency spectrum obtained by inversely quantizing and inversely normalizing the quantized frequency spectrum, to generate a differential frequency spectrum; a second normalization means for normalizing the differential frequency spectrum by use of a second normalization coefficient corresponding to the normalization information and the first quantization information, to generate a differential normalized frequency spectrum; a second quantization means for linearly quantizing the differential normalized frequency spectrum by use of a second quantization coefficient corresponding to the second quantization information, to generate a differential quantized frequency spectrum; and a code string coding means for coding the normalization information, the quantized frequency spectrum, and the differential quantized frequency spectrum, to output a code string, wherein the quantization information calculation means sets a predetermined limit to the first quantization information, allocates the total quantization information for the first quantization information, and allocates an excess beyond the predetermined limit, for the second quantization information, to generate the first quantization information and the second quantization information.

According to an embodiment of the present invention, there is provided an audio coding method including: a time-frequency transform step of performing time-frequency transform on an input audio signal to generate a frequency spectrum; a quantization information calculation step of generating total quantization information indicating a quantization bit number on the basis of predetermined normalization information, and of allocating the total quantization information, to generate first quantization information and second quantization information each indicating a quantization bit number; a first normalization step of normalizing the frequency spectrum for every frequency component by use of a first normalization coefficient corresponding to the normalization information, to generate a normalized frequency spectrum; a first quantization step of linearly quantizing the normalized frequency spectrum by use of a first quantization coefficient corresponding to the first quantization information, to generate a quantized frequency spectrum; a subtraction step of subtracting, from the frequency spectrum, a frequency spectrum obtained by inversely quantizing and inversely normalizing the quantized frequency spectrum, to generate a differential frequency spectrum; a second normalization step of normalizing the differential frequency spectrum by use of a second normalization coefficient corresponding to the normalization information and the first quantization information, to generate a differential normalized frequency spectrum; a second quantization step of linearly quantizing the differential normalized frequency spectrum by use of a second quantization coefficient corresponding to the second quantization information, to generate a differential quantized frequency spectrum; and a code string coding step of coding the normalization information, the quantized frequency spectrum, and the differential quantized frequency spectrum, to output a code string, wherein in the quantization information calculation step, a predetermined limit is set to the first quantization information, the total quantization information is allocated for the first quantization information, and an excess beyond the predetermined limit is allocated for the second quantization information, to generate the first quantization information and the second quantization information.

According to an embodiment of the present invention, there is provided an audio coding device including: a time-frequency transform means for performing time-frequency transform on an input audio signal to generate a frequency spectrum; a quantization information calculation means for generating total quantization information indicating a quantization bit number on the basis of predetermined normalization information, and for allocating the total quantization information, to generate first quantization information and second quantization information each indicating a quantization bit number; a first normalization means for normalizing the frequency spectrum for every frequency component by use of a first normalization coefficient corresponding to the normalization information, to generate a normalized frequency spectrum; a first quantization means for linearly quantizing the normalized frequency spectrum by use of a first quantization coefficient corresponding to the first quantization information, to generate a quantized frequency spectrum; a subtraction means for subtracting, from the normalized frequency spectrum, a normalized frequency spectrum obtained by inversely quantizing the quantized frequency spectrum, to generate a differential normalized frequency spectrum; a second normalization means for normalizing the differential normalized frequency spectrum by use of a second normalization coefficient corresponding to the first quantization information, to generate a differential renormalized frequency spectrum; a second quantization means for linearly quantizing the differential renormalized frequency spectrum by use of a second quantization coefficient corresponding to the second quantization information, to generate a differential quantized frequency spectrum; and a code string coding means for coding the normalization information, the first quantization information, the second quantization information, the quantized frequency spectrum, and the differential quantized frequency spectrum, to output a code string, wherein the quantization information calculation means sets a predetermined limit to the first quantization information, allocates the total quantization information for the first quantization information, and allocates an excess beyond the predetermined limit, for the second quantization information, to generate the first quantization information and the second quantization information.

According to an embodiment of the present invention, there is provided an audio coding method including: a time-frequency transform step of performing time-frequency transform on an input audio signal to generate a frequency spectrum; a quantization information calculation step of generating total quantization information indicating a quantization bit number on the basis of predetermined normalization information, and of allocating the total quantization information, to generate first quantization information and second quantization information each indicating a quantization bit number; a first normalization step of normalizing the frequency spectrum for every frequency component by use of a first normalization coefficient corresponding to the normalization information, to generate a normalized frequency spectrum; a first quantization step of linearly quantizing the normalized frequency spectrum by use of a first quantization coefficient corresponding to the first quantization information, to generate a quantized frequency spectrum; a subtraction step of subtracting, from the normalized frequency spectrum, a normalized frequency spectrum obtained by inversely quantizing the quantized frequency spectrum, to generate a differential normalized frequency spectrum; a second normalization step of normalizing the differential normalized frequency spectrum by use of a second normalization coefficient corresponding to the first quantization information, to generate a differential renormalized frequency spectrum; a second quantization step of linearly quantizing the differential renormalized frequency spectrum by use of a second quantization coefficient corresponding to the second quantization information, to generate a differential quantized frequency spectrum; and a code string coding step of coding the normalization information, the first quantization information, the second quantization information, the quantized frequency spectrum, and the differential quantized frequency spectrum, to output a code string, wherein in the quantization information calculation step, a predetermined limit is set to the first quantization information, the total quantization information is allocated for the first quantization information, and an excess beyond the predetermined limit is allocated for the second quantization information, to generate the first quantization information and the second quantization information.

According to an embodiment of the present invention, there is provided an audio decoding device including: a code string decoding means for decoding an input code string, to generate normalization information, a quantized frequency spectrum, and a differential quantized frequency spectrum; a quantization information calculation means for generating total quantization information indicating a quantization bit number on the basis of the normalization information, and for allocating the total quantization information, to generate first quantization information and second quantization information each indicating a quantization bit number; a first inverse quantization means for linearly inversely quantizing the quantized frequency spectrum by use of a first inverse quantization coefficient corresponding to the first quantization information, to generate a normalized frequency spectrum; a first inverse normalization means for inversely normalizing the normalized frequency spectrum by use of a first inverse normalization coefficient corresponding to the normalization information, to generate a frequency spectrum; a second inverse quantization means for linearly inversely quantizing the differential quantized frequency spectrum by use of a second inverse quantization coefficient corresponding to the second quantization information, to generate a differential normalized frequency spectrum; a second inverse normalization means for inversely normalizing the differential normalized frequency spectrum by use of a second inverse normalization coefficient corresponding to the normalization information and the first quantization information, to generate a differential frequency spectrum; an addition means for adding up the frequency spectrum and the differential frequency spectrum; and a frequency-time transform means for performing frequency-time transform on a frequency spectrum obtained by the addition means, to generate an output audio signal, wherein the quantization information calculation means sets a predetermined limit to the first quantization information, allocates the total quantization information for the first quantization information, and allocates an excess beyond the predetermined limit, for the second quantization information, to generate the first quantization information and the second quantization information.

According to an embodiment of the present invention, there is provided an audio decoding method including: a code string decoding step of decoding an input code string, to generate normalization information, a quantized frequency spectrum, and a differential quantized frequency spectrum; a quantization information calculation step of generating total quantization information indicating a quantization bit number on the basis of the normalization information, and of allocating the total quantization information, to generate first quantization information and second quantization information each indicating a quantization bit number; a first inverse quantization step of linearly inversely quantizing the quantized frequency spectrum by use of a first inverse quantization coefficient corresponding to the first quantization information, to generate a normalized frequency spectrum; a first inverse normalization step of inversely normalizing the normalized frequency spectrum by use of a first inverse normalization coefficient corresponding to the normalization information, to generate a frequency spectrum; a second inverse quantization step of linearly inversely quantizing the differential quantized frequency spectrum by use of a second inverse quantization coefficient corresponding to the second quantization information, to generate a differential normalized frequency spectrum; a second inverse normalization step of inversely normalizing the differential normalized frequency spectrum by use of a second inverse normalization coefficient corresponding to the normalization information and the first quantization information, to generate a differential frequency spectrum; an addition step of adding up the frequency spectrum and the differential frequency spectrum; and a frequency-time transform step of performing frequency-time transform on a frequency spectrum obtained by the addition step, to generate an output audio signal, wherein in the quantization information calculation step, a predetermined limit is set to the first quantization information, the total quantization information is allocated for the first quantization information, and an excess beyond the predetermined limit is allocated for the second quantization information, to generate the first quantization information and the second quantization information.

In the audio coding device and the method thereof according to the embodiments of the present invention as well as the audio decoding device and the method thereof according to the embodiments of the present invention, an input audio signal is coded by performing multi-stage normalization/quantization, to generate a code string. When the code string is decoded to obtain an output audio signal, the quantization bit number in each stage can be appropriately set with a small calculation amount.

**BRIEF DESCRIPTION OF THE DRAWINGS**

**DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS**

Embodiments to which the present invention is applied will now be specifically described below with reference to the drawings. In the embodiments, the present invention is applied to an audio coding device and a method thereof by which two-stage normalization/quantization is preformed on frequency spectrums obtained by subjecting an input audio signal to time-frequency transform, to generate a code string. The present invention is also applied to an audio decoding device and a method thereof by which the code string is decoded to obtain an output audio signal.

[First Embodiment]

At first, **10** shown in

In step S**1** in **11** is inputted with an audio signal (e.g., PCM (Pulse Code Modulation) data) for every predetermined unit time (frame). In step S**2**, the time-frequency transform section **11** performs time-frequency transform on the input audio signal, to generate a frequency spectrum mdspec**1**. For example, if modified discrete cosine transform (MDCT) is used as the time-frequency transform, an audio signal of N samples are transferred into MDCT coefficients of N/2 samples. The time-frequency transform section **11** supplies a first normalization section **13** and a subtraction section **17** with the frequency spectrum mdspec**1** as well as a quantization information calculation section **12** with normalization information idsf.

Next in step S**3**, based on the normalization information idsf, the quantization information calculation section **12** determines quantization information idwl**1** expressing a quantization bit number to quantize the frequency spectrum mdspec**1** and quantization information idwl**2** expressing another quantization bit number for quantization in the second stage described later. The processing to determine quantization information idwl**1** and idwl**2** based on the normalization information idsf and the like in the quantization information calculation section **12** will be described in more details later.

In subsequent step S**4**, the first normalization section **13** normalizes the frequency spectrum mdspec**1** by use of a normalization coefficient sf**1** (idsf) corresponding to normalization information idsf, as expressed by the following equation (1):

nspec1=mdspec1※sf1(idsf) (1)

The first normalization section **13** supplies a first quantization section **14** with an obtained normalized frequency spectrum nspec**1**. By this processing, the frequency spectrum mdspec**1** is normalized to a range of ±f ϵ R. The relationship between the normalization information idsf and the normalization coefficient sf**1**(idsf) is expressed as shown in the table 1 below.

In subsequent step S**5**, the first quantization section **14** quantizes the normalized frequency spectrum nspec**1** by use of a quantization coefficient qf**1**(idwl**1**) corresponding to quantization information idwl**1**. The first quantization section **14** supplies an inverse quantization section **15** and a code string coding section **20** with a quantized frequency spectrum qspec**1** obtained. For example, if linear quantization is performed as shown in **1** is obtained as expressed below by the following equation (2):

qspec1=(int)(floor(nspec1※qf1(idwl1))+0.5) (2)

By this processing, the normalization frequency spectrum nspec**1** is quantized to a quantized frequency spectrum qspec**1** having step number expressed by a quantization step width nstep(idwl**1**). The relationship between the quantization information idwl**1**, quantization step width nstep(idwl**1**), and quantization coefficient qf**1**(idwl**1**) is expressed as shown in the table 2 below.

In subsequent step S**6**, the inverse quantization section **15** inversely quantizes the quantized frequency spectrum qspec**1** by use of an inverse quantization coefficient iqf**1**(idwl**1**) corresponding to quantization information idwl**1**, as expressed below by the following equation (3):

nspec1′=qspec1※iqf1(idwl1) (3)

The inverse quantization section **15** supplies an inverse normalization section **16** with an obtained normalization frequency spectrum nspec**1**′. The relationship between the quantization coefficient qf**1**(idwl**1**) and the inverse quantization coefficient iqf**1**(idwl**1**) is expressed below by the equation (4):

iqf1(idwl1)=1/qf1(idwl1) (4)

In subsequent step S**7**, the inverse normalization section **16** inversely normalizes the normalized frequency spectrum nspec**1**′ by use of an inverse normalization coefficient isf**1**(idsf) corresponding to the normalization information idsf, as expressed below by the following equation (5):

mdspec1′=nspec1′※isf1(idsf) (5)

The inverse normalization section **16** supplies the subtraction section **17** with an obtained frequency spectrum mdspec**1**′. The relationship between the normalization coefficient sf**1**(idsf) and the inverse normalization coefficient isf**1**(idsf) is expressed below by the equation (6):

isf1(idsf)=1/sf1(idsf) (6)

In subsequent step S**8**, the subtraction section **17** subtracts the frequency spectrum mdspec**1**′ from the frequency spectrum mdspec**1**, as expressed by the following equation (7):

mdspec2=mdspec1−mdspec1′ (7)

The subtraction section **17** supplies a second normalization section **18** with an obtained differential frequency spectrum mdspec**2**.

In subsequent step S**9**, the second normalization section **18** normalizes the differential frequency spectrum mdspec**2** by use of a normalization coefficient sf**2**, as expressed by the following equation (8):

nspec2=mdspec2*sf2 (8)

=(mdspec1−mdspec1′)*sf2

=((nspec1−nspec1′)*isf1(idsf))*sf2

The second normalization section **18** supplies a second quantization section **19** with an obtained differential normalized frequency spectrum nspec**2**.

The normalized frequency spectrum nspec**1** is normalized to a range of ±f ϵ R by the normalization coefficient sf**1**(idsf) corresponding to the normalization information idsf. Therefore, in case of performing linear quantization by which the quantization step width nstep(idwl**1**) is uniquely determined in correspondence with the quantization information idwl**1**, for example as shown in **1** and nspec**1**′ before and after the quantization falls within a range of ±f/nstep(idwl**1**) as a maximum quantization error. Accordingly, the normalization coefficient sf**2** can be calculated as expressed below by the equation (9):

sf2(idsf,idwl1)=sf1(idsf)※nstep(idwl1)/f (9)

That is, the normalization coefficient sf**2**(idsf,dw**11**) can be calculated based on the normalization information idsf and the quantization information idwl**1**.

In subsequent step S**10**, the second quantization section **19** quantizes the differential normalized frequency spectrum nspec**2** by use of the quantization coefficient qf**2**(idwl**2**) corresponding to the quantization information idwl**2**. The second quantization section **19** supplies the code string coding section **20** with an obtained differential quantized frequency spectrum qspec**2**. For example, in case of performing linear quantization as shown in **2** can be obtained as expressed below by the following equation (10):

qspec2=(int)(floor(nspec2※qf2(idwl2))+0.5) (10)

The relationship between the quantization information idwl**2** and the quantization coefficient qf**2**(idwl**2**) may be identical with or different from that in the table 2 described previously.

In subsequent step S**11**, the code string coding section **20** codes the quantized frequency spectrum qspec**1**, differential quantized frequency spectrum qspec**2**, normalization information idsf, quantization information idwl**1**, and quantization information idwl**2**. In step S**12**, the code string coding section **20** outputs an obtained code string.

In subsequent step S**13**, whether an input audio signal has ended or not is determined. If the input audio signal has not ended, the processing procedure returns to step S**1**. Otherwise, if the input audio signal has ended, the coding processing is terminated.

Hereinafter, a detailed description will be made of processing of determining the quantization information idwl**1** and idwl**2** on the basis of the normalization information idsf in the quantization information calculation section **12**. In the following description, a consideration is taken into a case of calculating the quantization information idwl**1** and idwl**2** for every processing unit, with respect to frequency spectrums having spectral envelope curves a drawn by continuous lines in

At first, the total quantization information idwl**0** is calculated based on the normalization information idsf or the like. For example, in case of a frequency spectrum having the spectral envelope curve as shown in **0** as shown below in the upper row in the table 3 is calculated. In case of another frequency spectrum having the spectral envelope curve as shown in **0** as shown below in the upper row in the table 4 is calculated.

If the maximum quantization bit number of, for example, 24 (bits) or so can be ensured by calculator simulation or large-scale hardware, quantization can be achieved based on the total quantization information idwl**0**. In normal cases, however, there are difficulties in granting limitless permission to the total quantization information idwl**0**. For example, the quantization bit number is limited to 16 (bits) at maximum. Therefore, higher quantization accuracy than that with a maximum SNR (Signal to Noise Ratio) of 16-bit quantization is not ensured with respect to a frequency spectrum which has to be of 16 or higher in total quantization information idwl**0**, i.e., a quantization bit number of 16 (bits) or higher. Noise floors as drawn by broken lines b in **0**.

Therefore, quantization in the second stage is performed on the differential frequency spectrum as an error obtained as a result of quantization in the first stage, to improve the SNR which has locally deteriorated. No method of setting appropriately the quantization bit number in each stage with a small calculation amount has been established.

Hence, the quantization information calculation section **12** in the present embodiment uses predetermined limiters lim**1** and lim**2** to set appropriately the quantization bit number in each stage with a small calculation amount. That is, the quantization information idwl**1** in the first quantization section **14** is limited by the limiter lim**1**. If this limit is exceeded, the excess over the limit is allocated for quantization information idwl**2** in the second quantization section **19**. The quantization information idwl**2** in the second quantization section **19** is limited by the other limiter lim**2**. If this limit is exceeded, the quantization information idwl**2** is set to fall within the limit.

The processing procedure of the quantization information calculation section **12** is shown in the flowchart of **21**, the total quantization information idwl**0** is determined based on the normalization information idsf or the like. In step S**22**, the total quantization information idwl**0** is set as the quantization information idwl**1**.

Next in step S**23**, whether the value of the quantization information idwl**1** is greater than the value of the limiter lim**1** or not. If the value of the quantization information idwl**1** is not greater than the value of the limiter lim**1**, the processing procedure goes to step S**25**. Otherwise, if the value of the quantization information idwl**1** is greater than the value of the limiter lim**1**, the value of the quantization information idwl**1** is limited to the value of the limiter lim**1**, in step S**24**, and the processing procedure then goes to step S**25**.

Next in step S**25**, a value obtained by subtracting the value of the quantization information idwl**1** from the value of the total quantization information idwl**0** is set as the value of the quantization information idwl**2**.

In a subsequent step S**26**, whether the value of the quantization information idwl**2** is greater than the value of the limiter lim**2** or not is determined. If the value of the quantization information idwl**2** is not greater than the value of the limiter lim**2**, the quantization information idwl**1** and the quantization information idwl**2** are determined, in step S**28**. Otherwise, if the value of the quantization information idwl**2** is greater than the value of the limiter lim**2**, the value of the quantization information idwl**2** is limited to the value of the limiter lim**2**, in step S**27**, and thereafter, the quantization information idwl**1** and the quantization information idwl**2** are determined, in step S**28**.

For example, if the total quantization information idwl**0** has been calculated as shown in the upper rows in the tables 3 and 4 described above, the quantization information idwl**1** and the quantization information idwl**2** are determined as shown in the middle and lower rows in each of the tables 3 and 4. In these tables, the maximum quantization bit number in the first quantization section **14** is set to 16 (bits), so that the quantization information idwl**1** falls within a range from 0 to 15 (nstep(idwl**1**)=65535(±32767)<2{circumflex over ( )}16 where idwl**1**=15). Therefore, the value of the limiter lim**1** is set to 15 with respect to the quantization information idwl**1**. Further, the total quantization information idwl**0** limited by the limiter lim**1** (=15) is set as the quantization information idwl**1**, and quantization information of an excess (idwl**0**−idwl**1**) is set as the quantization information idwl**2**.

By use of the quantization information idwl**1** and the quantization information idwl**2** thus determined, frequency spectrums having spectral envelope curves drawn by continuous lines a in **10** according to the present embodiment is capable of requantizing, in an appropriate bit allocation, a differential frequency spectrum as an error obtained as a result of quantization. The SNR which has locally deteriorated due to hardware limitations or the like can be improved.

Next, schematic structure of an audio decoding device corresponding to the audio coding device **10** is shown in **30** shown in

In step S**31** shown in **31** inputs a code string. In step S**32**, the code string decoding section **31** decodes this input code string to generate a quantized frequency spectrum qspec**1**, differential quantized frequency spectrum qspec**2**, normalization information idsf, quantization information idwl**1**, and quantization information idwl**2**. The code string decoding section **31** supplies a first inverse quantization section **32** with the quantized frequency spectrum qspec**1**, as well as a second inverse quantization section **34** with the differential quantized frequency spectrum qspec**2**.

Next in step S**33**, the first inverse quantization section **32** inversely quantizes the quantized frequency spectrum qspec**1** by use of an inverse quantization coefficient iqf**1**(idwl**1**) corresponding to the quantization information idwl**1**, as expressed by the following equation (11):

nspec1′=qspec1※iqf1(idwl1) (11)

The first inverse quantization section **32** supplies a first inverse normalization section **33** with an obtained normalized frequency spectrum nspec**1**′. The relationship between the quantization coefficient qf**1**(idwl**1**) and the inverse quantization coefficient iqf**1**(idwl**1**) is expressed by the equation (4) described previously.

In subsequent step S**34**, the first inverse normalization section **33** inversely normalizes the normalized frequency spectrum nspec**1**′ by use of an inverse normalization coefficient isf**1**(idsf) corresponding to the normalization information idsf, as expressed by the following equation (12):

mdspec1′=nspec1′※isf1(idsf) (12)

The first inverse normalization section **33** supplies an addition section **36** with an obtained frequency spectrum mdspec**1**′. The relationship between the normalization coefficient sf**1**(idsf) and the inverse normalization coefficient isf**1**(idsf) is expressed by the equation (6) described previously.

In subsequent step S**35**, the second inverse quantization section **34** inversely quantizes the differential quantized frequency spectrum qspec**2** by use of an inverse quantization coefficient iqf**2**(idwl**2**) corresponding to the quantization information idwl**2**, as expressed by the following equation (13):

nspec2′=qspec2※iqf2(idwl2) (13)

The second inverse quantization section **34** supplies a second inverse normalization section **35** with an obtained differential normalized frequency spectrum nspec**2**′. The relationship between the quantization coefficient qf**2**(idwl**2**) and the inverse quantization coefficient iqf**2**(idwl**2**) is expressed by the following equation (14):

iqf2(idwl2)=1/qf2(idwl2) (14)

In subsequent step S**36**, a second inverse normalization section **35** inversely normalizes the differential normalized frequency spectrum nspec**2**′ by use of an inverse normalization coefficient isf**2**(idsf,idwl**1**) corresponding to the normalization information idsf and the quantization information idwl**1**, as expressed by the following equation (15):

mdspec2′=nspec2′※isf2(idsf,idwl1) (15)

The second inverse normalization section **35** supplies the addition section **36** with an obtained differential frequency spectrum mdspec**2**′. The relationship between the inverse normalization coefficient isf**2**(idsf,idwl**1**), normalization information idsf, and quantization information idwl**1** is expressed by the following equation (16):

isf2(idsf,idwl1)=1/sf2(idsf,idwl1)=isf1(idsf)※f/nstep(idwl1) (16)

The processings of steps S**35** and S**36** may be executed either before or in parallel with the processings of steps S**33** and S**34**.

In subsequent step S**37**, the addition section **36** adds up the frequency spectrum mdspec**1**′ and the differential frequency spectrum mdspec**2**′, as expressed by the following equation (17):

mdspec′=mdspec1′+mdspec2′ (17)

The addition section **36** supplies a frequency-time transform section **37** with an obtained frequency spectrum mdspec′.

In subsequent step S**38**, the frequency-time transform section **37** performs frequency-time transform on the frequency spectrum mdspec′ to generate an audio signal. In step S**39**, the frequency-time transform section **37** outputs this audio signal. For example, if inverse MDCT (IMDCT) is used as the frequency-time transform, a MDCT coefficient of N/2 samples is transformed into an audio signal of N samples.

In subsequent step S**40**, whether an input code string has ended or not is determined. If not, the processing procedure returns to step S**31**. Otherwise, if the input code string has ended, the decoding processing is terminated.

[Second Embodiment]

In case of performing two-stage normalization/quantization as described above, the quantization information idwl**1** in the first stage and the quantization information idwl**2** in the second stage have to be coded. Therefore, the coding efficiency of frequency spectrum information lowers in accordance with the number of stages. Hence, the present embodiment will now be described with respect to a method of improving coding efficiency of frequency spectrum information by omitting the coding of the quantization information idwl**1** and quantization information idwl**2**.

**40** according to the present embodiment. **50** corresponding to the audio coding device **40**. In both of these devices, the same structural features as those of the audio coding device **10** and audio decoding device **30** described previously are denoted at the same reference symbols. Detailed descriptions thereof will be omitted herefrom.

In this audio coding device **40**, an quantization information calculation section **41** uniquely determines quantization information idwl**1** and quantization information idwl**2**, based on normalization information idsf and the like. Processing of uniquely determining the quantization information idwl**1** and quantization information idwl**2** based on the normalization information idsf and the like in the quantization information calculation section **41** will be specifically described later. The code string coding section **20** codes a quantized frequency spectrum qspec**1**, differential quantized frequency spectrum qspec**2**, and normalization information idsf, and outputs an obtained code string.

On the other side, in the audio decoding device **50**, a quantization information calculation section **51** uniquely determines quantization information idwl**1** and quantization information idwl**2**, based on the normalization information idsf and the like. Processing of uniquely determining the quantization information idwl**1** and quantization information idwl**2** based on the normalization information idsf and the like in the quantization information calculation section **51** will also be specifically described later.

Hereinafter, the processing of uniquely determining the quantization information idwl**1** and quantization information idwl**2** based on the normalization information idsf and the like in the quantization information calculation sections **41** and **51** will now be described specifically.

The quantization information calculation sections **41** and **51** uniquely determine quantization information idwl**0** from normalization information idsf and a predetermined parameter A, as shown in the table 5 below.

As can be seen from this table 5, the quantization information idwl**0** decreases by one as the normalization information idsf decreases by one. This is achieved by paying attention to the following. Suppose that the absolute SNR is SNRabs where the normalization information idsf is X and the quantization information is B. On this supposition, if the normalization information idsf is X-1, a quantization bit number indicated by the quantization information of substantial B-1 is necessary, in order to obtain an equivalent SNRabs. Alternatively, if the normalization information idsf is X-2, a quantization bit number indicated by the quantization information of substantial B-2 is necessary.

The parameter A described previously means the maximum quantization information assigned to the maximum normalization information idsf. This value is included as additional information in a code string. A maximum quantization bit number which is available from the standard is firstly set as the parameter A. If the total number of used bits exceeds the total usable number of bits, as a result of coding, the parameter A is decreased one by one.

In case where the value of the parameter A is 17 (bits), an example of a table representing the relationship between the normalization information idsf and the quantization information idwl**0** is shown in the table 6 below. In this table 6, circled numbers each represent the total quantization information idwl**0** determined for every spectrum.

As shown in the table 6, if the normalization information idsf is maximized to 31, and the total quantization information idwl**0** is maximized to 17. For example, if the normalization information idsf is 29 which is smaller by two than the maximum normalization information idsf, the total quantization information idwl**0** is 15. If corresponding normalization information idsf is smaller by 17 or more than the maximum normalization information idsf, the quantization bit number is a minus value. In this case, a lower limit of zero (bit) is set.

The quantization information calculation sections **41** and **51** determine the quantization information idwl**1** and the quantization information idwl**2**, based on the total quantization information idwl**0** thus obtained for every spectrum. That is, the quantization information idwl**1** is limited by a limiter lim**1**. If this limit is exceeded, the excess is allocated for the quantization information idwl**2**. The quantization information idwl**2** is limited by the limiter lim**2**. If this limit is exceeded, the quantization information idwl**2** is set to fall within the limit.

If the quantization information idwl**1** and the quantization information idwl**2** are thus uniquely determined, noise floors are substantially flat. That is, quantization is performed with equal quantization accuracy with respect to a low-frequency range which is important for human auditory sense as well as a high-frequency range which is not. Therefore, audible noise is not minimized.

Hence, in the quantization information calculation sections **41** and **51**, the normalization information idsf for every spectrum may be added with a weighting coefficient Wn[i](i=0 to N/2−1), to generate new normalization information idsf**1**, as shown in the table 7 below.

In the example of the table 7, a value of 4 to 1 is added to normalization information idsf for a low-frequency range while nothing is added to normalization information idsf for a high-frequency range. By thus adding the weighting coefficient Wn[i] to the normalization information idsf, bits can be concentrated on the low-frequency range, to improve tone quality in the range which is important for human auditory sense.

If the weighting coefficient Wn[i] is added as shown in the table 7, the maximum value of the normalization information idsf is 35. Therefore, if the table 6 is extended simply in a direction in which the normalization information idsf is increased by four as the maximum added number of the normalization information idsf, for example, the table 8 below is obtained. Numbers circled by broken lines in the table 8 each represent total quantization information idwl**0** for every spectrum in case where no weighting is executed. Other numbers circled by continuous lines represent total quantization information idwl**0** for every spectrum in case where weighting is executed.

In the example of this table 8, quantization accuracy in the low-frequency range improves. However, the maximum quantization information increases thereby to increase the total number of used bits. Therefore, bit adjustment should preferably be performed such that the total number of used bits falls below the total number of usable bits, in actual.

A fixed coefficient may be used as the weighting coefficient Wn[i] described above both in the coding side and decoding side. Alternatively, an optimal weighting coefficient Wn[i] may be generated based on characteristics of an audio source (frequency energy, transit characteristic, gain, masking characteristic, etc.) in the coding side. In the latter case, the quantization information calculation section **41** generates the weighting coefficient Wn[i], for example, based on the frequency spectrum mdspec**1**. The code string coding section **20** codes the weighting coefficient Wn[i] and includes the coded result in a code string.

Thus, according to the audio coding device **40** and audio decoding device **50** in the present embodiment, the quantization information idwl**1** and quantization information idwl**2** are determined uniquely based on the normalization information idsf. Based on the normalization information idsf and quantization information idwl**1**, the normalization coefficient sf**2**(idsf,dw**11**) is calculated. Therefore, the normalization information idsf has to be included as side information other than frequency spectrum information in a code string. Further, excessive bits generated by reducing the side information are used for coding the quantized frequency spectrum qspec**1** and the differential quantized frequency spectrum qspec**2**. In this manner, coding efficiency of the quantized frequency spectrum qspec**1** and differential quantized frequency spectrum qspec**2** can be improved.

[Third Embodiment]

An audio coding device **60** shown in **10** shown in **60** has a feature that normalization/quantization in the second stage is not performed on the difference between a frequency spectrum mdspec**1** and a frequency spectrum mdspec **1**′ but is performed on the difference between a normalized frequency spectrum nspec **1** and a normalized frequency spectrum nspec**1**′. Therefore, the same structural features as those of the audio coding device **10** previously shown in

In this audio coding device **60**, the subtraction section **61** subtracts the normalized frequency spectrum nspec**1**′ from the normalized frequency spectrum nspec**1**, as expressed by the following equation (18):

nspec2=nspec1−nspec1′ (18)

The subtraction section **61** supplies a second normalization section **62** with an obtained differential normalized frequency spectrum nspec**2**.

The second normalization section **62** normalizes the differential normalized frequency spectrum nspec**2** by use of a normalization coefficient sf**2**, as expressed by the following equation (19):

nnspec2=nspec2※sf2=(nspec1−nspec1′)※sf2 (19)

The second normalization section **62** supplies a second quantization section **63** with an obtained differential renormalized frequency spectrum nnspec**2**.

The normalized frequency spectrum nspec**1** is normalized to a range of ±f ϵ R by a normalization coefficient sf**1**(idsf) corresponding to the normalization information idsf. Therefore, in case of performing linear quantization by which the quantization step width nstep(idwl**1**) is uniquely determined in correspondence with the quantization information idwl**1**, for example as shown in **1** and nspec**1**′ before and after the quantization falls within a range of ±f/nstep(idwl**1**) as a maximum quantization error. Accordingly, a normalization coefficient sf**2** can be calculated as expressed below by the equation (20):

sf2(idwl1)=nstep(idwl1)/f (20)

That is, the normalization coefficient sf**2**(idwl**1**) can be calculated based on the quantization information idwl**1**.

The second quantization section **63** quantizes the differential renormalized frequency spectrum nnspec**2** by use of a quantization coefficient qf**2**(idwl**2**) corresponding to the quantization information idwl**2**. The second quantization section **63** supplies the code string coding section **20** with an obtained differential quantized frequency spectrum qspec**2**. For example, in case of performing linear quantization as shown in **2** can be obtained as expressed below by the following equation (21):

qspec2=(int)(floor(nnspec2※qf2(idwl2))+0.5) (21)

The code string coding section **20** codes the quantized frequency spectrum qspec**1**, differential quantized frequency spectrum qspec**2**, normalization information idsf, quantization information idwl**1**, and quantization information idwl**2**. The code string coding section **20** outputs an obtained code string.

Next, schematic structure of an audio decoding device corresponding to the audio coding device **60** is shown in **70** shown in **30** shown in **30** are denoted at the same reference symbols, and detailed descriptions thereof will be omitted.

In the audio decoding device **70**, a second inverse quantization section **71** inversely quantizes the differential quantized frequency spectrum qspec**2** by use of an inverse quantization coefficient iqf**2**(idwl**2**) corresponding to the quantization information idwl**2**, as expressed by the following equation (22):

nnspec2′=qspec2※iqf2(idwl2) (22)

The second inverse quantization section **71** supplies a second inverse normalization section **72** with an obtained differential renormalized frequency spectrum nnspec**2**′.

The second inverse normalization section **72** inversely normalizes the differential renormalized frequency spectrum nnspec**2**′ by use of an inverse normalization coefficient isf**2**(idwl**1**) corresponding to the quantization information idwl**1**, as expressed by the following equation (23):

nspec2′=nnspec2′※isf2(idwl1) (23)

The second inverse normalization section **72** supplies an addition section **73** with an obtained differential normalized frequency spectrum nspec**2**′. The relationship between the inverse normalization coefficient isf**2**(idwl**1**) and the quantization information idwl**1** is expressed by the following equation (24):

isf2(idwl1)=1/sf2(idwl1)=f/nstep(idwl1) (24)

The addition section **73** adds up the normalized frequency spectrum nspec**1**′ and the differential normalized frequency spectrum nspec**2**′, as expressed by the following equation (25):

nspec′=nspec1′+nspec2′ (25)

The addition section **73** supplies a first inverse normalization section **74** with an obtained normalized frequency spectrum nspec′.

The first inverse normalization section **74** inversely quantizes the normalized frequency spectrum nspec′ by use of an inverse normalization coefficient isf**1**(idsf) corresponding to the normalization information idsf, as expressed by the following equation (26):

mdspec′=nspec′※isf1(idsf) (26)

The first inverse normalization section **74** supplies the frequency-time transform section **37** with an obtained frequency spectrum mdspec′.

The frequency-time transform section **37** performs frequency-time transform on the frequency spectrum mdspec′ to generate an audio signal. The frequency-time transform section **37** outputs this audio signal.

[Fourth Embodiment]

In the first to third embodiments described above, three kinds of basic structures of audio coding devices and audio decoding devices have been described. In the present embodiment, however, modifications of the audio coding devices and the audio decoding devices will be described. The same structures as those of the audio coding device **10** and the audio decoding device **30** are denoted at the same reference symbols, and detailed descriptions thereof will be omitted.

At first, **80** according to a first modification. **90** corresponding to the audio coding device **80**. In the audio coding device **80**, a preprocessing section **81** performs bandwidth division, gain adjustment, and the like on an input audio signal before performing time-frequency transform on the input audio signal. On the other side, in the audio decoding device **90**, a postprocessing section **91** performs bandwidth synthesis, gain adjustment, and the like on an audio signal after performing the frequency-time transform on a frequency spectrum mdspec′.

Next, **100** according to a second modification. **110** corresponding to the audio coding device **100**. In this audio coding device **100**, a first preprocessing section **101** performs preprocessing such as non-linear transform corresponding to a frequency spectrum distribution, on a frequency spectrum mdspec**1**. A post processing section **102** performs postprocessing such as non-linear inverse transform corresponding to a frequency spectrum distribution, on a frequency spectrum mdspec**1**′. A second preprocessing section **103** performs preprocessing such as non-linear transform corresponding to a frequency spectrum distribution, on a differential frequency spectrum mdspec**2**. On the other side, in the audio decoding device **110**, a first postprocessing section **111** performs postprocessing such as non-linear inverse transform corresponding to the coding side, on the frequency spectrum mdspec**1**′. A second postprocessing section **112** performs postprocessing such as non-linear inverse transform corresponding to the coding side, on a differential frequency spectrum mdspec**2**′.

The foregoing first to third embodiments have been described on the assumption that the first quantization section **14** performs linear quantization. However, non-linear quantization is equivalent to linear quantization performed after non-linear transform. Therefore, if the first preprocessing section **101** to perform non-linear transform is provided in the front stage of the first quantization section **14**, these embodiments are applicable to a case of executing non-linear quantization, as shown in

Next, **120** according to a third modification. **130** corresponding to the audio coding device **120**. In this audio coding device **120**, a first normalization/quantization section **121** normalizes/quantizes a frequency spectrum mdspec**1** by use of a normalization/quantization coefficient sf**1**(idsf)※qf**1**(idwl**1**). An inverse-quantization/inverse-normalization section **122** inversely normalizes/quantizes a quantized frequency spectrum qspec**1** by use of an inverse-normalization/inverse-quantization coefficient iqf**1**(idwl**1**)※isf**1**(idsf). A second normalization/quantization section **123** normalizes/quantizes a differential frequency spectrum mdspec**2** by use of a normalization/quantization coefficient sf**2**(idsf,idwl**1**)※qf**2**(idwl**2**). On the other side, in the audio decoding device **130**, a first inverse-quantization/inverse-normalization section **131** inversely quantizes/normalizes a quantized frequency spectrum qspec**1** by use of an inverse-quantization/inverse-normalization coefficient iqf**1**(idwl**1**)※isf**1**(idsf). A second inverse-quantization/inverse-normalization section **132** inversely quantizes/normalizes a differential quantized frequency spectrum qspec**2** by use of an inverse-quantization/inverse-normalization coefficient iqf**2**(idwl**2**)※isf**2**(idsf,idwl**1**). By thus multiplying the normalization coefficient and the quantization coefficient by each other in advance, the normalization processing and the quantization processing can be put together into one processing. Further, by thus multiplying the inverse quantization coefficient and the inverse normalization coefficient by each other in advance, the inverse quantization processing and the inverse normalization processing can be put together into one processing. Accordingly, the calculation amount and processing amount can be reduced.

This modification has been described as a modification to the audio coding device **10** and the audio decoding device **30** in the first embodiment. However, the same modification may be made to the audio coding device **40** and the audio decoding device **50** in the second embodiment as well as the audio coding device **60** and the audio decoding device **70** in the third embodiment.

Although best modes for carrying out the present invention have thus been described above, the present invention is not limited to the embodiments as described above but various changes can be made without deviating from the subject matter of the invention.

For example, the above embodiments have been described such that coding is achieved by performing two-stage normalization/quantization on a frequency spectrum obtained by subjecting an input audio signal to time-frequency transform. The present invention is not limited to these embodiments but can be extended such that coding is achieved by performing normalization/quantization through an arbitrary number of stages. In this case, quantization information idwlk in the k-th stage (k is an integer not smaller than 1) is limited by a limiter link. If this limit is exceeded, the excess is allocated for quantization information idwl(k+1) for the (k+1)-th stage.

Although the above embodiments each have been described as hardware structure, the present invention is not limited to hardware structure. Arbitrary processing can be realized by letting a CPU (Central Processing Unit) execute a computer program. In this case, the computer program may be provided, recorded on a recording medium or transferred by a transfer medium such as the Internet, etc.

It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.

## Claims

1. An audio coding device including processing circuitry and programmed to execute a program via the processing circuitry, the program comprising:

- a time frequency transformation unit configured to perform time-frequency transform on an input audio signal to generate a frequency spectrum;

- a quantization unit configured to (a) generate total quantization information indicating a quantization bit number on the basis of predetermined normalization information, (b) allocate the total quantization information, by setting a predetermined limit to a first quantization information, allocating, up to the predetermined limit, the total quantization information to the first quantization information, and allocating an excess beyond the predetermined limit to the second quantization information, and (c) in each of a plurality of stages, (i) generate the first quantization information and the second quantization information, each indicating a respective quantization bit number, and (ii) normalize the frequency spectrum for every frequency component by use of a first normalization coefficient corresponding to the normalization information to generate a normalized frequency spectrum, each stage having a predetermined limit to quantization information, and if quantization information allocated for a k-th stage, ‘k’ being an integer greater than zero, exceeds a limit in the k-th stage, an excess for quantization information is allocated to a (k+1)-th stage, the limit being based on a predetermined allowed quantization bit number for each of the respective plurality of stages;

- a first quantization unit configured to linearly quantize the normalized frequency spectrum by use of a first quantization coefficient corresponding to the first quantization information, to generate a quantized frequency spectrum;

- a subtraction unit configured to subtract from the frequency spectrum, a frequency spectrum obtained by inversely quantizing and inversely normalizing the quantized frequency spectrum, to generate a differential frequency spectrum;

- a normalization unit configured to normalize the differential frequency spectrum by use of a second normalization coefficient corresponding to the normalization information and the first quantization information, to generate a differential normalized frequency spectrum;

- a second normalization unit configured to linearly quantize the differential normalized frequency spectrum by use of a second quantization coefficient corresponding to the second quantization information, to generate a differential quantized frequency spectrum; and a code unit configured to code the normalization information, the first quantization information, the second quantization information, the quantized frequency spectrum, and the differential quantized frequency spectrum, to output a code string.

2. The audio coding device of claim 1, wherein the program further comprises a non-linear transformation unit configured to:

- perform non-linear transform on the frequency spectrum or the normalized frequency spectrum; and

- perform non-linear inverse transform on a normalized frequency spectrum obtained by inversely quantizing the quantized frequency spectrum, or a frequency spectrum obtained by inversely normalizing the normalized frequency spectrum.

3. A method executed by an audio coding device comprising the steps of:

- a time-frequency transform step of performing time-frequency transform on an input audio signal to generate a frequency spectrum;

- a quantization information calculation step including the steps of (a) generating total quantization information indicating a quantization bit number on the basis of predetermined normalization information, (b) allocating the total quantization information by setting a predetermined limit to a first quantization information, (c) allocating, up to the predetermined limit, the total quantization information to the first quantization information, (d) allocating an excess beyond the predetermined limit to the second quantization information, and, (e) in each of a plurality of stages, generating the first quantization information and the second quantization information, each indicating a respective quantization bit number;

- a first normalization step of normalizing the frequency spectrum for every frequency component by use of a first normalization coefficient corresponding to the normalization information, to generate a normalized frequency spectrum, wherein, a predetermined limit to quantization information is set in each stage, and if quantization information allocated for a k-th stage, ‘k’ being an integer greater than zero, exceeds a limit in the k-th stage, an excess for quantization information is allocated for a (k+1)-th stage, the limit being based on a predetermined allowed quantization bit number for each of the respective plurality of stages;

- a first quantization step of linearly quantizing the normalized frequency spectrum by use of a first quantization coefficient corresponding to the first quantization information, to generate a quantized frequency spectrum;

- a subtraction step of subtracting, from the frequency spectrum, a frequency spectrum obtained by inversely quantizing and inversely normalizing the quantized frequency spectrum, to generate a differential frequency spectrum;

- a second normalization step of normalizing the differential frequency spectrum by use of a second normalization coefficient corresponding to the normalization information and the first quantization information, to generate a differential normalized frequency spectrum;

- a second quantization step of linearly quantizing the differential normalized frequency spectrum by use of a second quantization coefficient corresponding to the second quantization information, to generate a differential quantized frequency spectrum; and

- a code string coding step of coding the normalization information, the first quantization information, the second quantization information, the quantized frequency spectrum, and the differential quantized frequency spectrum, to output a code string.

4. An audio coding device including processing circuitry and programmed to execute a program via the processing circuitry, the program comprising:

- a time frequency transformation unit configured to perform time-frequency transform on an input audio signal, to generate a frequency spectrum;

- a quantization unit configured to (a) generate total quantization information indicating a quantization bit number on the basis of predetermined normalization information, (b) allocate the total quantization information, by setting a predetermined limit to a first quantization information, allocating, up to the predetermined limit, the total quantization information to the first quantization information, and allocating an excess beyond the predetermined limit to the second quantization information and (c) in each of a plurality of stages, (i) generate the first quantization information and the second quantization information, each indicating a respective quantization bit number, and (ii) normalize the frequency spectrum for every frequency component by use of a first normalization coefficient corresponding to the normalization information to generate a normalized frequency spectrum, each stage having a predetermined limit to quantization information, and if quantization information allocated for a k-th stage, ‘k’ being an integer greater than zero, exceeds a limit in the k-th stage, an excess for quantization information is allocated to a (k+1)-th stage, the limit being based on a predetermined allowed quantization bit number for each of the respective plurality of stages;

- a first quantization unit configured to linearly quantize the normalized frequency spectrum by use of a first quantization coefficient corresponding to the first quantization information, to generate a quantized frequency spectrum;

- subtraction unit configured to subtract from the frequency spectrum, a frequency spectrum obtained by inversely quantizing and inversely normalizing the quantized frequency spectrum, to generate a differential frequency spectrum;

- a normalization unit configured to normalize the differential frequency spectrum by use of a second normalization coefficient corresponding to the normalization information and the first quantization information, to generate a differential normalized frequency spectrum;

- a second quantization unit configured to linearly quantize the differential normalized frequency spectrum by use of a second quantization coefficient corresponding to the second quantization information, to generate a differential quantized frequency spectrum; and

- a code unit configured to code string the normalization information, the quantized frequency spectrum, and the differential quantized frequency spectrum, to output a code string.

5. The device according to claim 4, wherein:

- a maximum quantization error, corresponding to the first quantization information, is uniquely determined and

- the second normalization coefficient is determined by the product of the first normalization coefficient and the reciprocal of the maximum quantization error.

6. The device according to claim 4, wherein the quantization bit number indicated by the total quantization information increases or decreases one by one as the normalization information is increased or decreased one by one.

7. The device according to claim 4, wherein the audio coding device is further configured to:

- perform non-linear transform on the frequency spectrum or the normalized frequency spectrum; and

- perform non-linear inverse transform on a normalized frequency spectrum obtained by inversely quantizing the quantized frequency spectrum, or a frequency spectrum obtained by inversely normalizing the normalized frequency spectrum.

8. A method executed by an audio coding device comprising the steps of:

- a time-frequency transform step of performing time-frequency transform on an input audio signal to generate a frequency spectrum;

- a quantization information calculation step including the steps of (a) generating total quantization information indicating a quantization bit number on the basis of predetermined normalization information, (b) allocating the total quantization information by setting a predetermined limit to a first quantization information, (c) allocating, up to the predetermined limit, the total quantization information to the first quantization information, and (d) in each of a plurality of stages, allocating an excess beyond the predetermined limit to the second quantization information to generate, the first quantization information and the second quantization information each indicating a respective quantization bit number;

- a first normalization step of normalizing the frequency spectrum for every frequency component by use of a first normalization coefficient corresponding to the normalization information, to generate a normalized frequency spectrum, wherein, a predetermined limit to quantization information is set in each stage, and if quantization information allocated for a k-th stage, ‘k’ being an integer greater than zero, exceeds a limit in the k-th stage, an excess for quantization information is allocated for a (k+1)-th stage, the limit being based on a predetermined allowed quantization bit number for each of the respective plurality of stages;

- a first quantization step of linearly quantizing the normalized frequency spectrum by use of a first quantization coefficient corresponding to the first quantization information, to generate a quantized frequency spectrum;

- a subtraction step of subtracting, from the frequency spectrum, a frequency spectrum obtained by inversely quantizing and inversely normalizing the quantized frequency spectrum, to generate a differential frequency spectrum;

- a second normalization step of normalizing the differential frequency spectrum by use of a second normalization coefficient corresponding to the normalization information and the first quantization information, to generate a differential normalized frequency spectrum;

- a second quantization step of linearly quantizing the differential normalized frequency spectrum by use of a second quantization coefficient corresponding to the second quantization information, to generate a differential quantized frequency spectrum; and

- a code string coding step of coding the normalization information, the quantized frequency spectrum, and the differential quantized frequency spectrum, to output a code string.

9. An apparatus including an audio coding device with processing circuitry and programmed to execute a program via the processing circuitry, the program comprising:

- a time frequency transformation unit configured to perform time-frequency transform on an input audio signal to generate a frequency spectrum;

- a quantization unit configured to (a) generate total quantization information indicating a quantization bit number on the basis of predetermined normalization information (b) allocate the total quantization information, by setting a predetermined limit to a first quantization information, allocating, up to the predetermined limit, the total quantization information to the first quantization information, and allocating an excess beyond the predetermined limit to the second quantization information (c) in each of a plurality of stages, (i) generate the first quantization information and the second quantization information, each indicating a respective quantization bit number, and (ii) normalize the frequency spectrum for every frequency component by use of a first normalization coefficient corresponding to the normalization information, to generate a normalized frequency spectrum each stage having a predetermined limit to quantization information, and if quantization information allocated for a k-th stage, ‘k’ being an integer greater than zero, exceeds a limit in the k-th stage, an excess for quantization information is allocated to a (k+1)-th stage, the limit being based on a predetermined allowed quantization bit number for each of the respective plurality of stages;

- a first quantization unit configured to linearly quantize the normalized frequency spectrum by use of a first quantization coefficient corresponding to the first quantization information, to generate a quantized frequency spectrum;

- a subtraction unit configured to subtract from the normalized frequency spectrum, a normalized frequency spectrum obtained by inversely quantizing the quantized frequency spectrum, to generate a differential normalized frequency spectrum;

- a normalization unit configured to normalize the differential normalized frequency spectrum by use of a second normalization coefficient corresponding to the first quantization information, to generate a differential renormalized frequency spectrum;

- a second quantization unit configured to linearly quantize the differential renormalized frequency spectrum by use of a second quantization coefficient corresponding to the second quantization information, to generate a differential quantized frequency spectrum; and

- a code unit configured to code the normalization information, the first quantization information, the second quantization information, the quantized frequency spectrum, and the differential quantized frequency spectrum, to output a code string.

10. The apparatus according to claim 9, wherein the audio coding device is further configured to:

- perform non-linear transform on the frequency spectrum or the normalized frequency spectrum; and

- perform non-linear inverse transform on a normalized frequency spectrum obtained by inversely quantizing the quantized frequency spectrum, or a frequency spectrum obtained by inversely normalizing the normalized frequency spectrum.

11. A method executed by an audio coding device comprising the steps of:

- a time-frequency transform step of performing time-frequency transform on an input audio signal to generate a frequency spectrum;

- a quantization information calculation step including the steps of (a) generating total quantization information indicating a quantization bit number on the basis of predetermined normalization information, (b) allocating the total quantization information by setting a predetermined limit to a first quantization information, (c) allocating, up to the predetermined limit, the total quantization information to the first quantization information, and (d) in each of a plurality of stages, allocating an excess beyond the predetermined limit to the second quantization information, and generating the first quantization information and the second quantization information, each indicating a respective quantization bit number;

- a first normalization step of normalizing the frequency spectrum for every frequency component by use of a first normalization coefficient corresponding to the normalization information, to generate a normalized frequency spectrum, wherein, a predetermined limit to quantization information is set in each stage, and if quantization information allocated for a k-th stage, ‘k’ being an integer greater than zero, exceeds a limit in the k-th stage, an excess for quantization information is allocated for a (k+1)-th stage, the limit being based on a predetermined allowed quantization bit number for each of the respective plurality of stages;

- a first quantization step of linearly quantizing the normalized frequency spectrum by use of a first quantization coefficient corresponding to the first quantization information, to generate a quantized frequency spectrum;

- a subtraction step of subtracting, from the normalized frequency spectrum, a normalized frequency spectrum obtained by inversely quantizing the quantized frequency spectrum, to generate a differential normalized frequency spectrum;

- a second normalization step of normalizing the differential normalized frequency spectrum by use of a second normalization coefficient corresponding to the first quantization information, to generate a differential renormalized frequency spectrum;

- a second quantization step of linearly quantizing the differential renormalized frequency spectrum by use of a second quantization coefficient corresponding to the second quantization information, to generate a differential quantized frequency spectrum; and

- a code string coding step of coding the normalization information, the first quantization information, the second quantization information, the quantized frequency spectrum, and the differential quantized frequency spectrum, to output a code string.

12. An apparatus comprising an audio decoding device including processing circuitry and programmed to execute a program via the processing circuitry, the program comprising:

- a time frequency transformation unit configured to decode an input code string, to generate normalization information, a quantized frequency spectrum, and a differential quantized frequency spectrum;

- a quantization unit configured to (a) generate total quantization information indicating a quantization bit number on the basis of the normalization information (b) allocate the total quantization information, by setting a predetermined limit to a first quantization information, allocating, up to the predetermined limit, the total quantization information to the first quantization information, and allocating an excess beyond the predetermined limit to the second quantization information, and (c) in each of a plurality of stages, (i) generate the first quantization information and the second quantization information, each indicating a respective quantization bit number and linearly inversely quantize the quantized frequency spectrum by use of a first inverse quantization coefficient corresponding to the first quantization information and (ii) generate a normalized frequency spectrum, each stage having a predetermined limit to quantization information, and if quantization information allocated for a k-th stage, ‘k’ being an integer greater than zero, exceeds a limit in the k-th stage, an excess for quantization information is allocated to a (k+1)-th stage, the limit being based on a predetermined allowed quantization bit number for each of the respective plurality of stages;

- a first normalization unit configured to inversely normalize the normalized frequency spectrum by use of a first inverse normalization coefficient corresponding to the normalization information, to generate a frequency spectrum;

- a subtraction unit configured to linearly inversely quantize the differential quantized frequency spectrum by use of a second inverse quantization coefficient corresponding to the second quantization information, to generate a differential normalized frequency spectrum;

- a second normalization unit configured to inversely normalize the differential normalized frequency spectrum by use of a second inverse normalization coefficient corresponding to the normalization information and the first quantization information, to generate a differential frequency spectrum;

- an addition unit configured to add the frequency spectrum and the differential frequency spectrum; and

- a second time transformation unit configured to perform frequency-time transform on a frequency spectrum obtained by the addition means, to generate an output audio signal.

13. A method executed by an audio coding device comprising the steps of:

- a code string decoding step of decoding an input code string, to generate normalization information, a quantized frequency spectrum, and a differential quantized frequency spectrum;

- a quantization information calculation step including the steps of (a) generating total quantization information indicating a quantization bit number on the basis of the normalization information, (b) allocating the total quantization information, by setting a predetermined limit to a first quantization information, (c) allocating, up to the predetermined limit, the total quantization information to the first quantization information, and allocating an excess beyond the predetermined limit to the second quantization information (d) in each of a plurality of stages, generate the first quantization information and second quantization information each indicating a quantization bit number;

- a first inverse quantization step of linearly inversely quantizing the quantized frequency spectrum by use of a first inverse quantization coefficient corresponding to the first quantization information, to generate a normalized frequency spectrum, wherein, a predetermined limit to quantization information is set in each stage, and if quantization information allocated for a k-th stage, ‘k’ being an integer greater than zero, exceeds a limit in the k-th stage, an excess for quantization information is allocated for a (k+1)-th stage, the limit being based on a predetermined allowed quantization bit number for each of the respective plurality of stages;

- a first inverse normalization step of inversely normalizing the normalized frequency spectrum by use of a first inverse normalization coefficient corresponding to the normalization information, to generate a frequency spectrum;

- a second inverse quantization step of linearly inversely quantizing the differential quantized frequency spectrum by use of a second inverse quantization coefficient corresponding to the second quantization information, to generate a differential normalized frequency spectrum;

- a second inverse normalization step of inversely normalizing the differential normalized frequency spectrum by use of a second inverse normalization coefficient corresponding to the normalization information and the first quantization information, to generate a differential frequency spectrum;

- an addition step of adding the frequency spectrum and the differential frequency spectrum; and

- a frequency-time transform step of performing frequency-time transform on a frequency spectrum obtained by the addition step, to generate an output audio signal.

14. An apparatus comprising an audio decoding device including processing circuitry and programmed to execute a program via the processing circuitry, the program comprising:

- a code string decoding unit configured to decode an input code string, to generate normalization information, a quantized frequency spectrum, and a differential quantized frequency spectrum;

- a quantization information calculation unit configured to (a) generate total quantization information indicating a quantization bit number on the basis of the normalization information, (b) for a plurality of stages, allocate the total quantization information, each stage having a predetermined limit to quantization information, and if quantization information allocated to a k-th stage (“k’ being an integer greater than zero) exceeds the predetermined limit of the k-th stage, an excess of the quantization information is allocated to a (k+1)-th stage, the limit being based on predetermined allowed quantization bit number for each stage of the respective plurality of stages, wherein the allocating includes allocating, up to the predetermined limit, the total quantization information to a first quantization information, and allocating an excess beyond the predetermined limit to a second quantization information, and generating the first quantization information and the second quantization information, each of the first quantization information and the second quantization information indicating a respective quantization bit number;

- a first inverse quantization unit configured to linearly inversely quantize the quantized frequency spectrum by use of a first inverse quantization coefficient corresponding to the first quantization information, and generate a normalized frequency spectrum;

- a first inverse normalization unit configured to inversely normalize the normalized frequency spectrum by use of a first inverse normalization coefficient corresponding to the normalization information, to generate a frequency spectrum;

- a second inverse quantization unit configured to linearly inversely quantize the differential quantized frequency spectrum by use of a second inverse quantization coefficient corresponding to the second quantization information, to generate a differential normalized frequency spectrum;

- a second normalization unit configured to inversely normalize the differential normalized frequency spectrum by use of a second inverse normalization coefficient corresponding to the normalization information and the first quantization information, to generate a differential frequency spectrum;

- an addition unit configured to add the frequency spectrum and the differential frequency spectrum in a frequency domain and generate a resultant frequency spectrum; and

- a frequency to time transformation unit configured to perform a frequency-time transform on the resultant frequency spectrum, to generate an output audio signal.

15. A method executed by an audio coding device comprising:

- a transform step of transforming an input audio signal and generating a normalization information and a first frequency spectrum;

- a quantization information calculation step of (a) generating total quantization information indicating a quantization bit number on the basis of the normalization information, and (b) for a plurality of stages, allocating the total quantization information among the plurality of stages, each stage having a predetermined limit to quantization information, such that quantization information is first allocated to a k-th stage (“k’ being an integer greater than zero) and quantization information for a (k+1)-th stage being set to the predetermined limit of the (k+1)-th stage or the excess of the quantization information not allocated to the k-th stage, the limit being based on predetermined allowed quantization bit number for each stage of the respective plurality of stages, wherein the allocating includes allocating up to the predetermined limit, the total quantization information to a first quantization information, and allocating an excess beyond the predetermined limit or a predetermined limit to a second quantization information, and generating the first quantization information and the second quantization information, each of the first quantization information and the second quantization information indicating a respective quantization bit number;

- a first normalization step of normalizing the first frequency spectrum by use of a first normalization coefficient corresponding to the normalization information and generating a first normalized frequency spectrum;

- a first quantization step of linearly quantizing the first normalized frequency spectrum by use of a first quantization coefficient corresponding to the first quantization information and generating a first quantized frequency spectrum;

- an inverse quantization step of linearly inversely quantizing the first quantized frequency spectrum by use of an inverse quantization coefficient corresponding to the first quantization information and generating a second normalized frequency spectrum;

- an inverse normalization step of inversely normalizing the second normalized frequency spectrum by use of an inverse normalization coefficient corresponding to the normalization information and generating a second frequency spectrum;

- an subtraction step of subtracting the second frequency spectrum from the first frequency spectrum in a frequency domain and generating a differential frequency spectrum;

- a second normalization step of normalizing the differential frequency spectrum by use of a second normalization coefficient corresponding to the normalization information and the first quantization information and generating a differential normalized frequency spectrum;

- a second quantization step of linearly quantizing the differential normalized frequency spectrum by use of a second quantization coefficient corresponding to the second quantization information and generating a differential quantized frequency spectrum; and

- a code string coding step of coding the normalization information, the first quantization information, the second quantization information, and the differential quantized frequency spectrum and generating an output code string.

**Referenced Cited**

**U.S. Patent Documents**

5774844 | June 30, 1998 | Akagiri |

5966688 | October 12, 1999 | Nandkumar et al. |

6593872 | July 15, 2003 | Makino et al. |

6826526 | November 30, 2004 | Norimatsu |

6871106 | March 22, 2005 | Ishikawa et al. |

6904404 | June 7, 2005 | Norimatsu et al. |

7212973 | May 1, 2007 | Toyama et al. |

7283967 | October 16, 2007 | Nishio et al. |

7406412 | July 29, 2008 | Vernon et al. |

8090577 | January 3, 2012 | El-Maleh et al. |

20010047256 | November 29, 2001 | Tsurushima et al. |

20020010577 | January 24, 2002 | Matsumoto et al. |

20040002859 | January 1, 2004 | Liu et al. |

20040024593 | February 5, 2004 | Tsuji et al. |

20050075872 | April 7, 2005 | Kikuiri et al. |

**Patent History**

**Patent number**: RE48272

**Type:**Grant

**Filed**: Feb 16, 2017

**Date of Patent**: Oct 20, 2020

**Assignee**: SONY CORPORATION (Tokyo)

**Inventors**: Yuuki Matsumura (Saitama), Shiro Suzuki (Kanagawa), Keisuke Toyama (Kanagawa), Mitsuyuki Hatanaka (Kanagawa), Yuhki Mitsufuji (Tokyo)

**Primary Examiner**: Rachna S Desai

**Application Number**: 15/434,964

**Classifications**

**Current U.S. Class**:

**Silence Decision (704/215)**

**International Classification**: H04B 14/06 (20060101); G10L 19/032 (20130101);