Abstract: Provided is an acoustic signal processing device for a spatially extended sound source and a method thereof. The acoustic signal processing device includes a memory configured to store instructions, and a processor electrically connected to the memory and configured to execute the instructions. When the instructions are executed by the processor, the processor performs a plurality of operations, and the plurality of operations includes transforming an object provided as a spatially extended sound source into a cuboid in a virtual reality (VR) space, obtaining coordinates of the cuboid, and determining a position of a sound source of the object based on the coordinates of the cuboid and coordinates of a user in the VR space.

Abstract: An apparatus and method for pitch-shifting an audio signal with low complexity are disclosed. The method includes identifying a distance between an audio object included in the audio signal and a listener, checking whether the distance between the audio object and the listener decreases, and performing stepwise stretching pitch-shifting of repeatedly using at least one of frequency components of the audio signal when the distance between the audio object and the listener decreases.

Abstract: A method and apparatus for performing binaural rendering of an audio signal are provided. The method includes identifying an input signal that is based on an object, and metadata that includes distance information indicating a distance to the object, generating a binaural filter that is based on the metadata, using a binaural room impulse response, obtaining a binaural filter to which a low-pass filter (LPF) is applied, using a frequency response control that is based on the distance information, and generating a binaural-rendered output signal by performing a convolution of the input signal and the binaural filter to which the LPF is applied.

Abstract: Disclosed is an apparatus and method for processing a multichannel audio signal. A multichannel audio signal processing method may include: generating an N-channel audio signal of N channels by down-mixing an M-channel audio signal of M channels; and generating a stereo audio signal by performing binaural rendering of the N-channel audio signal.

Abstract: A method and apparatus for rendering a volume sound source are disclosed. The method of rendering a volume sound source may include identifying information about a listener and information about the volume sound source, determining a corresponding area in which a source element is disposed in the volume sound source in consideration of the information about the listener, determining an angle between the listener and the corresponding area based on the information about the listener and the information about the volume sound source, determining a number of source elements disposed in the corresponding area according to the angle, determining a position and a gain of the source element using i) the number of source elements and ii) a distance between the listener and the volume sound source, and rendering the volume sound source according to the position and the gain of the source element.

Abstract: A method and system for processing an obstacle effect in a virtual acoustic space are disclosed. The method includes receiving a parameter for an obstacle candidate plane extracted from spatial information, determining, in response to the parameter, whether the obstacle candidate plane is an obstacle related to a path between a position of a virtual sound source and a position of a user, and applying a sound effect according to the obstacle to an audio signal when the obstacle candidate plane is the obstacle. The obstacle candidate plane is a plane of an object that may become the obstacle in a sound propagation path between the virtual sound source and the user.

Abstract: Disclosed is an apparatus and method for processing a multichannel audio signal. A multichannel audio signal processing method may include: generating an N-channel audio signal of N channels by down-mixing an M-channel audio signal of M channels; and generating a stereo audio signal by performing binaural rendering of the N-channel audio signal.

Abstract: A method of applying a Doppler effect to an object audio signal and a rendering apparatus performing the method are disclosed. The method includes determining a relative velocity between an audio object and an observer based on a velocity and a direction of the audio object and a position of the observer, determining whether to apply the Doppler effect based on the relative velocity, applying the Doppler effect based on the relative velocity to the object audio signal in response to a determination to apply the Doppler effect, and rendering an object audio signal to which the Doppler effect is applied.

Abstract: Disclosed is a method and apparatus for processing an audio signal based on an extent sound source. The method includes identifying information on a reference area of the extent sound source and information on a position of a listener, determining a position of a virtual sound source within the extent sound source based on a relationship between the position of the listener and the reference area of the extent sound source, and rendering an audio signal based on the determined position of the virtual sound source, wherein the reference area may be determined based on a position and a size of the extent sound source.

Abstract: An audio signal controlling method includes identifying whether an audio zooming effect is used for at least one audio object present in a virtual reality (VR) through an audio zooming effect field included in metadata, and controlling an audio signal corresponding to the audio object based on a preset method when the audio zooming effect is identified as being used.

Abstract: A method and apparatus for performing binaural rendering of an audio signal are provided. The method includes identifying an input signal that is based on an object, and metadata that includes distance information indicating a distance to the object, generating a binaural filter that is based on the metadata, using a binaural room impulse response, obtaining a binaural filter to which a low-pass filter (LPF) is applied, using a frequency response control that is based on the distance information, and generating a binaural-rendered output signal by performing a convolution of the input signal and the binaural filter to which the LPF is applied.

Abstract: An audio signal controlling method includes identifying whether an audio zooming effect is used for at least one audio object present in a virtual reality (VR) through an audio zooming effect field included in metadata, and controlling an audio signal corresponding to the audio object based on a preset method when the audio zooming effect is identified as being used.

Abstract: Disclosed is a binaural rendering method and apparatus for decoding a multichannel audio signal. The binaural rendering method may include: extracting an early reflection component and a late reverberation component from a binaural filter; generating a stereo audio signal by performing binaural rendering of a multichannel audio signal base on the early reflection component; and applying the late reverberation component to the generated stereo audio signal.

Abstract: An audio metadata providing apparatus and method and a multichannel audio data playback apparatus and method to support a dynamic format conversion are provided. Dynamic format conversion information may include information about a plurality of format conversion schemes that are used to convert a first format set by a writer of multichannel audio data into a second format that is based on a playback environment of the multichannel audio data and that are set for each of playback periods of the multichannel audio data. The audio metadata providing apparatus may provide audio metadata including the dynamic format conversion information. The multichannel audio data playback apparatus may identify the dynamic format conversion information from the audio metadata, may convert the first format of the multichannel audio data into the second format based on the identified dynamic format conversion information, and may play back the multichannel audio data with the second format.

Abstract: Disclosed is a binaural rendering method and apparatus for decoding a multichannel audio signal. The binaural rendering method may include: extracting an early reflection component and a late reverberation component from a binaural filter; generating a stereo audio signal by performing binaural rendering of a multichannel audio signal base on the early reflection component; and applying the late reverberation component to the generated stereo audio signal.

Abstract: An audio metadata providing apparatus and method and a multichannel audio data playback apparatus and method to support a dynamic format conversion are provided. Dynamic format conversion information may include information about a plurality of format conversion schemes that are used to convert a first format set by a writer of multichannel audio data into a second format that is based on a playback environment of the multichannel audio data and that are set for each of playback periods of the multichannel audio data. The audio metadata providing apparatus may provide audio metadata including the dynamic format conversion information. The multichannel audio data playback apparatus may identify the dynamic format conversion information from the audio metadata, may convert the first format of the multichannel audio data into the second format based on the identified dynamic format conversion information, and may play back the multichannel audio data with the second format.

Abstract: The present invention relates to a system for transmitting and receiving audio, particularly, to a method and apparatus for transmitting and receiving of object-based audio contents, which packetizes audio objects having the same characteristic. To achieve the above, the present invention includes filtering a plurality of ESs according to common information, adding a packet header to the respective filtered ESs and generate ES packets, aggregating all the generated ES packets and then adding a multi-object packet header to the aggregated ES packets to generate an object packet, and multiplexing the generated object packet, packetizing the multiplexed object packet according to a transmitting media and transmitting the packetized object packet.

Abstract: Disclosed is a binaural rendering method and apparatus for decoding a multichannel audio signal. The binaural rendering method may include: extracting an early reflection component and a late reverberation component from a binaural filter; generating a stereo audio signal by performing binaural rendering of a multichannel audio signal base on the early reflection component; and applying the late reverberation component to the generated stereo audio signal.

Abstract: Disclosed is an apparatus and method for processing a multichannel audio signal. A multichannel audio signal processing method may include: generating an N-channel audio signal of N channels by down-mixing an M-channel audio signal of M channels; and generating a stereo audio signal by performing binaural rendering of the N-channel audio signal.

Abstract: Disclosed is an audio signal processing method including identifying a sound source provided inside a preset reference distance and a sound source provided outside the reference distance to represent a sound field based on virtual reality (VR) content that is represented in a predetermined virtual space in which a user is located in a VR environment, processing a sound field using three-dimensional (3D) ambisonics based on height information and horizontal information of the sound source provided inside the reference distance, and processing a sound field using two-dimensional (2D) ambisonics based on horizontal information of the sound source provided outside the reference distance.