Abstract: An image processing apparatus includes a generating unit configured to generate image signals for displaying content on each of a plurality of screens; and a synthesizing unit configured to synthesize a plurality of sound signals corresponding to the plurality of image signals to cause positions where sounds based on the plurality of sound signals are localized to vary from each other.

Abstract: An audio locating and tracking apparatus, a method of directing a camera to view an audio source, and a video conferencing terminal are disclosed herein. In one embodiment, the apparatus includes: (1) an audio source identifier configured to locate an audio source based on multimodal sensor data from at least two different types of sensors and (2) an image selector configured to automatically direct a camera to view the audio source.

Abstract: An apparatus for controlling a wave field synthesis renderer with audio objects includes a provider for providing a scene description, wherein the scene description defines a temporal sequence of audio objects in an audio scene and further includes information on the source position of a virtual source as well as on a start or an end of the virtual source. Furthermore, the audio object includes at least a reference to an audio file associated with the virtual source. The audio objects are processed by a processor, in order to generate a single output data stream for each renderer module, wherein both information on the position of the virtual source and the audio file itself are included in mutual association in this output data stream. With this, high portability on the one hand and high quality due to secure data consistency on the other hand are achieved.

Abstract: An apparatus includes a head-mountable support structure, a transducer array coupled to the support structure, and a processor configured to control the transducer array to radiate ultrasonic waves toward an ear of a user of the head-mountable support structure. The ultrasonic waves are audible.

Abstract: A spatial element is added to communications, including over telephone conference calls heard through headphones or a stereo speaker setup. Functions are created to modify signals from different callers to create the illusion that the callers are speaking from different parts of the room.

Abstract: An acoustic user interface system and method for tracking spatial location data. A location tracking unit provides location information with respect to an object in an environment. The location information may be further employed to synthesize a perception of three-dimensional spatial location data with respect to multiple objects in the environment. The acoustic user interface communicates the three-dimensional spatial location data via an auditory channel to a stereophonic device based on a human stereophonic perception of one or more acoustic signal variable correlated with a relative location of the objects in order to co-ordinate and communicate location information effectively.

Abstract: The invention relates to a method and device for processing sound data comprising determining a listener position; determining a virtual sound source position; receiving sound data; processing the sound data for reproduction by at least one speaker to let the listener perceive the processed sound data reproduced by the speaker to originate from the virtual sound position. This provides the listener with a realistic experience of sound by the speaker. Implementation of the invention allows sound data to be provided also in a dynamic environment, where positions of the listener, the virtual sound source or both can change. For example, sound data may be reproduced by a mobile device by means of headphones to a moving listener, where the virtual sound source is a shop. As the listener moves, the sound data is processed such that when reproduced via the headphones, it is perceived as to originate from the shop.

Abstract: An object decoding unit receives a plurality of pieces of coded acoustic information coded on an object basis and decodes the received coded acoustic information on an object basis to generate object signals. A rendering unit positions, for each acoustic signal resulting from synthesizing the object signals, a virtual sound source of each of the object signals resulting from the object-based decoding, in a listening space, and priority information indicating a priority of the acoustic signal is multiplexed with the coded acoustic information. The rendering unit determines, with reference to the priority indicated in the priority information or the number of object signals included in the acoustic signal, a size of an area of the listening space which is allocated to the acoustic signal, and positions, within the area, the virtual sound source of each of the object signals included in the acoustic signal.

Abstract: A telescopic spatial radio system is provided for sending a signal representative of a sound at a speaker location to a listener location, the signal providing positioning information of the speaker location relative to the listener location and processing the signal using the positioning information to provide a telescopic zoomable binaural sound at the listener location having a simulated spatial relationship based on the position information of the speaker location relative to the listener location.

Abstract: An information processing apparatus that detects a current location of the information processing apparatus; obtains a direction of a destination from the detected current location as a target direction; detects a facial orientation of a user wearing a headphone unit connected to the information processing apparatus via a wired or wireless connection in relation to a reference orientation based on outputs of a geomagnetic sensor and an acceleration sensor connected to the headphone unit; obtains a relative target angle based on a difference between the target direction and the user's facial orientation; and generates sound to be output by the headphone unit based on the obtained relative target angle.

Abstract: This application relates to a system for compression and mixing for hearing assistance devices by application of compression to individual sound sources before mixing, according to one example. Variations of the present system using surround sound provide separate signals from a surround sound synthesizer which are compressed prior to mixing of the signals.

Abstract: A method for generating and playing audio signals and a system for processing audio signals are disclosed. The method for generating audio signals includes: generating distance information about an audio signal corresponding to a view point position, according to obtained auxiliary video and direction information about the audio signal, where the auxiliary video is a disparity map or a depth map; encoding the direction information and distance information about the audio signal, and sending the encoded information. The apparatus for generating audio signals includes an audio signal distance information obtaining module and an audio signal encoding module. With the present invention, the position information, including direction information and distance information, about the audio signal may be obtained accurately in combination with a three-dimensional video signal and a three-dimensional audio signal, without increasing the size of a microphone array, and the audio signal is sent and played.

Abstract: A surround sound virtualization apparatus and method. The surround sound virtualization apparatus may include an audio decoder to perform head-related transfer function (HRTF) filtering, and a time delay unit to provide a time delay to a plurality of output signals of the audio decoder.

Abstract: The conference device (EMCU) according to the invention has several monaural HRTF filters (HRTF1, . . . , HRTFN), each of which is to be allocated to a conference participant. The abbreviation HRTF stands for “Head Related Transfer Function”. A corresponding HRTF filter (HRTF1, . . . , HRTFN) is used for filtering a monaural audio signal coming from the conference participant to whom it is allocated. An individual, monaural HRTF filter coefficient set is responsible in this case for defining the filter characteristics of a particular HRTF filter. The conference device (EMCU) also has a conference mixing device (MP) coupled to the HRTF filters (HRTF1, . . . , HRTFN), for mixing the individually filtered audio signals from various conference participants and for transferring the mixed audio signals to conference participants.

Abstract: A headphone system includes sound processor which calculates properties of the environment from signals from an internal microphone and an external microphone. The impulse response of the environment may be calculated from the signals received from the internal and external microphones as the user speaks.

Abstract: In reverberant environments, reflected waves including an echoic sound and a muffled sound affect and disable recognition of sound arrival directions. As a result, the subjective clearness of the sounds deteriorates. In order to enhance the clearness of a reproduced sound in a reverberant environment, a pre-processing filter unit corrects an input sound signal portion having a frequency band relating to human auditory recognition on a sound wave arrival direction, and speakers reproduce the sound signal. The correction involves attenuating an input sound signal in the frequency band portion, based on the relationship between the frequencies of the input sound signal and the magnitude of influence to the recognition of the sound wave arrival direction. This attenuation is achieved by filtering using filter coefficients that are set by a first filter characteristic setting unit using hearing characteristic parameters that are set by a hearing characteristic setting unit.

Abstract: A front surround sound reproduction system which improves the performance of beam steering by using a speaker array arranged geometrically on two or more planes or on one curved surface, and a signal reproducing method of the system. The audio reproduction apparatus to reproduce a multi-channel audio signal by using a plurality of speakers includes a signal distribution unit to duplicate a multi-channel audio signal and to distribute the duplicated signals as one or more groups of multi-channel signals corresponding to one or more speaker array groups, a steering processing unit to form sound beams with steering angles predetermined in relation to each speaker array group, from the groups of multi-channel signals distributed by the signal distribution unit, and a speaker array unit having one or more speaker array groups to reproduce the sound beams of each group formed by the steering processing unit, in the speaker array group.

Abstract: A method of processing an audio signal is disclosed. The present invention includes receiving a downmix signal including at least one object signal and object information extracted when the downmix signal is generated, receiving mix information including mode selection information, the mix information for controlling the object signal, bypassing the downmix signal or extracting a background object and at least one independent object from the downmix signal, based on the mode selection information, and if the downmix signal is bypassed, generating multi-channel information using the object information and the mix information, wherein the downmix signal corresponds to a mono signal and wherein the mode selection information includes information indicating which one of modes including a normal mode, a mode for controlling the background object, and a mode for controlling the at least one independent object.

Abstract: Wearers of hearing apparatuses and in particular of hearing device systems having two speakers are to be able to enjoy the experience of spatial multi-channel reproduction. Provision is accordingly made to generate a dual-channel audio signal for a binaural hearing apparatus comprising a multi-channel audio signal having at least three individual channels. Accordingly at least one spatial impression-influencing signal level in at least one of the individual channels is changed, and a signal of at least one of the individual channels is connected with signals of the remaining individual channels to the dual-channel audio signal. A corresponding hearing apparatus and in particular a corresponding hearing device have a transformation system that takes over this preprocessing from the multi-channel audio signal to the dual-channel audio signal.

Abstract: In accordance with a method for providing a distinct perceptual location for an audio source within an audio mixture, a foreground signal may be processed to provide a foreground perceptual angle for the foreground signal. The foreground signal may also be processed to provide a desired attenuation level for the foreground signal. A background signal may be processed to provide a background perceptual angle for the background signal. The background signal may also be processed to provide a desired attenuation level for the background signal. The foreground signal and the background signal may be combined into an output audio source.

Abstract: A method of processing an audio signal is disclosed. The present invention includes receiving a downmix signal including at least one object signal, and object information extracted when the downmix signal is generated, receiving mix information including mode selection information, the mix information for controlling the object signal, and generating a stereo output signal using the downmix signal or extracting a background object and at least one independent object from the downmix signal, based on the mode selection information, wherein the downmix signal corresponds to a mono signal, wherein the stereo output signal corresponds to a time-domain signal including a signal generated from decorrelating the downmix signal, and wherein the mode selection information includes information indicating which one of modes including a normal mode, a mode for controlling the background object, and a mode for controlling the at least one independent object.

Abstract: An information processing system includes a display, a display sensor that detects a movement or a rotation of the display, a transducer unit as an earphone unit or a headphone unit, a sound processing part that processes an audio signal so as to localize a sound image in a position outside a head of a listener wearing the transducer unit and listening to sound, and an operation controller that computes an output from the display sensor to obtain a moving direction and a moving distance, or a rotation direction and a rotation angle of the display, and controls sound processing performed by the sound processing part in accordance with a result of the computation so that a positional relation between the display and the head of the listener is mapped as a positional relation between an image display surface and the head of the listener in a virtual viewing space.

Abstract: A system and method include obtaining an aural impulse signature at a first location in a simulated space. An aural impulse signature at a second location in a simulated space is also obtained. Aural impulse signature morphing is applied via a computer to aural impulse signatures of the first and second locations to provide an intermediate aural impulse signature between the first and second locations.

Abstract: A method consistent with the present invention involves displaying a window on a computer monitor; at one or more programmed processors, determining a position of the window on the computer monitor; at the one or more programmed processors, deducing a user position for a user of the window with the window based on the position of the window on the computer monitor; and steering audio signals from an application running in the window to a loudspeaker in an array of loudspeakers, where the loudspeaker is a loudspeaker in the array of loudspeakers closer to the deduced user position than another loudspeaker in the array. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.

Abstract: One or more devices may receive, from a media presentation device worn by a user, sensory data comprising at least information describing orientation of the media presentation device. The one or more devices may also determine an approximate direction of a gaze of the user in a three dimensional audio space based on the information describing the orientation of the media presentation device, identify a sound source at which the user gazes based on the approximate direction of the gaze of the user in the three dimensional audio space, obtain audio data associated with the sound source based on an identity of the identified sound source, determine an action to perform on the audio data associated with the sound source, and perform the determined action.

Abstract: A method, medium, and system generating a 3-dimensional (3D) stereo signal in a decoder by using a surround data stream. According to such a method, medium, and system, a head related transfer function (HRTF) is applied in a quadrature mirror filter (QMF) domain, thereby generating a 3D stereo signal by using a surround data stream.

Abstract: The present invention describes techniques that can be used to provide novel methods of spatial audio rendering using adapted M-S matrix shuffler topologies. Such techniques include headphone and loudspeaker-based binaural signal simulation and rendering, stereo expansion, multichannel upmix and pseudo multichannel surround rendering.

Abstract: An apparatus and a method for providing a stereo effect when playing an audio file at a portable terminal are provided. The apparatus includes a component extractor for extracting a mono component and stereo components from an audio signal and a gain controller for determining a signal ratio of the stereo components to the mono component and for controlling a stereo gain according to the signal ratio.

Abstract: A sound image localization apparatus comprises an L direct output section that produces an output signal by inputting an audio signal of a rear left audio input channel to a filter having a characteristic obtained by dividing RLD by LD, an L cross output section that produces an output signal by inputting the audio signal of the rear left audio input channel to a filter having a characteristic obtained by dividing RLC by LC, an R cross output section that produces an output signal by inputting an audio signal of a rear right audio input channel to a filter having a characteristic obtained by dividing RRC by RC, an R direct output section that produces an output signal by inputting the audio signal of the rear right audio input channel to a filter having a characteristic obtained by dividing RRD by RD, a first adding section that adds a difference signal between the output signal of the L direct output section and the output signal of the R cross output section to an audio signal of a front left audio input ch

Abstract: An apparatus, such as a decoder is arranged to modify the sweet-spot of a spatial M-channel audio signal by modifying spatial parameters. Specifically, a receiver (201) receives an N-channel audio signal where N<M. The M-channel signal may specifically be an MPEG Surround sound signal and the N-channel signal may be a stereo signal. A parameter unit (203) determines spatial parameters relating the N-channel audio signal to the spatial M-channel audio signal and a modifying unit (207) modifies the sweet-spot of the spatial M-channel audio signal by modifying at least one of the spatial parameters. A generating unit (205) then generates the spatial M-channel audio signal by up-mixing the N-channel audio signal using the at least one modified spatial parameter. An efficient and/or low complexity sweet-spot manipulation is achieved by an integration of sweet-spot manipulation and multi-channel generation.

Abstract: Modern electronic devices are getting more portable and smaller leading to smaller distances between speakers. In particular, computers are now so compact that the notebook computer is one of the most popular computer types. However, with the proliferation of media available in digital form, both music recordings and video features, the demand for high quality reproductions on computers has increased. Systems and methods for producing wider speaker effects and immersion effects disclosed can enhance a listener's experience even in a notebook computer.

Abstract: Method and apparatus for processing audio signals are provided. The method for decoding an audio signal includes extracting a downmix signal and spatial information from a received audio signal and generating a pseudo-surround signal using the downmix signal and the spatial information. The apparatus for decoding an audio signal includes a demultiplexing part extracting a downmix signal and spatial information from a received audio signal and a pseudo-surround decoding part generating a pseudo-surround signal from the downmix signal, using the spatial information.

Abstract: A head-related transfer function (HRTF) convolution method arranged, when an audio signal is reproduced acoustically by an electro-acoustic conversion unit disposed in a nearby position of both ears of a listener, to convolute an HRTF into the audio signal, which allows the listener to listen to the audio signal such that a sound image is localized in a perceived virtual sound image localization position, the method including the steps of: measuring, when a sound source is disposed in the virtual sound image localization position, and a sound-collecting unit is disposed in the position of the electro-acoustic conversion unit, a direct-wave direction HRTF regarding the direction of a direct wave, and reflected-wave direction HRTFs regarding the directions of selected one or more reflected waves, from the sound source to the sound-collecting unit, separately beforehand; and convoluting the obtained direct-wave direction HRTF, and the reflected-wave direction HRTFs into the audio signal.

Abstract: A method and a system are described providing multiple display systems with an enhanced acoustics experience. A source audio signal having a plurality of source audio channels is generated from an audio signal source. The system includes a plurality of speakers connected to a plurality of display systems. A speaker configuration gatherer determines the spatial configuration of the speakers. An audio signal processor is provided to generate synthesized audio signal based on the contents of the source audio signal and spatial configuration of the speakers. The synthesized audio signal is mapped and delivered to the speakers to produce an enhanced sound field.

Abstract: Embodiments of the present invention allow participants in a networked virtual world to converse naturally as in a real-life situation. Each participant can hear “nearby” participants localized according to their positions in the virtual world, desirably with reverberation and environmental audio effects derived from properties of the virtual world.

Abstract: A device for generating an encoded stereo signal from a multi-channel representation includes a multi-channel decoder generating three of more multi-channels from at least one basic channel and parametric information. The three or more multi-channels are subjected to headphone signal processing to generate an uncoded first stereo channel and an uncoded second stereo channel which are then supplied to a stereo encoder to generate an encoded stereo file on the output side. The encoded stereo file may be supplied to any suitable player in the form of a CD player or a hardware player such that a user of the player does not only get a normal stereo impression but a multi-channel impression.

Abstract: A method and apparatus for compensating for a near-field effect in a speaker array system is provided. The method includes generating a virtual sound signal at a position, which is separated from a speaker array by a predetermined distance, based on an input sound signal, and outputting the generated virtual sound signal using the speaker array. Therefore, the near-field effect, in which a sound radiated from a speaker array is distorted to have non-uniform radiation characteristics near the speaker array, can be compensated for. Consequently, the method and apparatus can provide a stable sound field, into which non-uniform radiation characteristics uniformly converge, to a listener.

Abstract: An augmented reality (AR) audio system for augmenting environment or ambient sound with sounds from a virtual speaker or sound source positioned at a location in the space surrounding an AR participant. The sound from the virtual speaker may be triggered by an action of the listener and/or by the location or relative orientation of the listener. The AR audio system includes stereo earphones receiving an augmented audio track from a control unit, and binaural microphones are provided to capture ambient sounds. The control unit operates to process trigger signals and retrieve one or more augmentation sounds. The control unit uses an AR audio mixer to combine the ambient sound from the microphones with the augmentation sounds to generate left and right ear augmented audio or binaural audio, which may be modified for acoustic effects of the environment including virtual objects in the environment or virtual characteristics of real objects.

Abstract: A device for processing parameters representing Head-Related Transfer Functions includes an input stage configured to receive audio signals of sound sources, a determinor configured to receive reference parameters representing Head-Related Transfer Functions and configured to determine, from the audio signals, position information representing positions and/or directions of the sound sources. A processor is configured to process the audio signals; and an influencer is configured to influence the processing of the audio signals based on the position information yielding an influenced output audio signal.

Abstract: An apparatus to perform sound processing in a virtual reality system includes a sound processing unit to process and produce sound output in sound areas divided into a focus area within a predetermined visual field and a non-focus area out of the predetermined visual field in a virtual reality space for sound sources; and a control unit to divide the sound areas into the focus area and the non-focus area, and to control the sound output of the sound processing unit such that a volume of sound in a first space is gradually decreased while a volume of sound in a second space is gradually increased when a space shift from the first space to the second space in the virtual reality space is detected.

Abstract: Methods are disclosed for improving sound localization of the human ear. In some embodiments, the method may include creating virtual movement of a plurality of localized sources by applying a periodic function to one or more location parameters of a head related transfer function (HRTF).

Abstract: A piezoelectric micro speaker and a method of manufacturing the same are provided. The piezoelectric micro speaker includes a device plate, a front plate bonded on a front surface of the device plate, and a rear plate bonded on a rear surface of the device plate. The device plate includes a diaphragm, a piezoelectric actuator that vibrates the diaphragm, and a front cavity disposed in front of the diaphragm. The front plate includes a radiation hole connected to the front cavity. The rear plate includes a rear cavity formed in a surface of the rear plate facing the piezoelectric actuator, and a bent hole connected to the rear cavity. A sound absorption layer is formed on an inner surface of the rear cavity and absorbs sound radiated backward from the diaphragm so as to suppress the sound from being reflected on the rear plate.

Abstract: [Object] To provide a headphone device in which the influence of individual differences in virtual sound field reproduction is less likely to occur and which may listen external sounds naturally, [Solution] A left-side headphone body and a right-side headphone body include speaker arrays which are formed of a plurality of speaker units which are arranged to surround auricles, respectively. The speaker array of the headphone body reproduces a sound field inside a closed curved surface in the vicinity of the auricle using wave field synthesis, and since reverberation or a diffraction effect occurs in the ear of each individual, the influence caused by individual differences is less likely to occur. In addition, the speaker array has the plurality of the speaker units arranged to surround the auricle and is not of a shape that blocks the ear of the listener, and then the external sound can be heard naturally.

Abstract: An earphone produces a three-dimensional stereo sound effect. The earphone has an ear cup with a front portion, a back portion, a front sound effect unit disposed in the front portion, a front sound resonator disposed in the front portion, a back sound resonator disposed in the back portion, and a back sound effect disposed in the back portion. A front speaker is disposed in the front portion of the ear cup. A back speaker is disposed in the back portion of the ear cup. A sound controller is disposed in the ear cup. A sound output unit is connected with the ear cup. The front speaker and the back speaker work together to create stereo sound in a first dimension and in a second dimension. One of the front speaker and the back speaker creates stereo sound in a third dimension.

Abstract: A system and method for generating a sound that simulates a fictitious sound perceived to emanate from a fictitious sound location is disclosed. In at least one aspect, the system includes a first surface serving to at least partially enclose a first region, a first speaker positioned on the first surface, a second region within the first region, and a sound reflecting boundary to enclose the first region. The system further includes a first fictitious source location within the first region, the location being outside of the second region, and a control device coupled at least indirectly within the first speaker. The control device generates control signals configured to cause the first speaker to generate sounds that in turn produce actual sounds that simulate fictitious sounds perceived to emanate from fictitious sound locations.

Abstract: A method for providing an interface to a processing engine that utilizes intelligent audio mixing techniques may include receiving a request to change a perceptual location of an audio source within an audio mixture from a current perceptual location relative to a listener to a new perceptual location relative to the listener. The audio mixture may include at least two audio sources. The method may also include generating one or more control signals that are configured to cause the processing engine to change the perceptual location of the audio source from the current perceptual location to the new perceptual location via separate foreground processing and background processing. The method may also include providing the one or more control signals to the processing engine.

Abstract: A method for processing audio signals can include applying at least one front perspective filter to each of left and right front audio signals to yield filtered left and right front output signals, where the left and right front output signals each drive a front speaker. Moreover, the method can include applying at least one rear perspective filter to each of left and right rear audio signals to yield left and right rear output signals, where the left and right rear output signals each drive a rear speaker to simulate a rear surround sound effect when positioned in front of a listener.

Abstract: Aspects of the invention provide methods, computer-readable media, and apparatuses for spatially manipulating sound that is played back to a listener over a set of output transducers, e.g., headphones. The listener can direct spatial attention to focus on a portion of an audio scene, analogous to a magnifying glass being used to pick out details in a picture. An input multi-channel audio signal that is generated by audio sources is obtained, and directional information is determined for each of the audio sources. The user provides a desired direction of spatial attention so that audio processing can focus on the desired direction and render a corresponding multi-channel audio signal to the user. A region of an audio scene is expanded around the desired direction while the audio scene is compressed in another portion of the audio scene.

Abstract: An audio reproducing system includes a pair of speaker units, a mounting unit for mounting the pair of speaker units, without being attached to a baffle board, to the vicinity of a listener's ears in a manner such that sounds emitted from the front and back of a diaphragm of each speaker unit are mixed, and an audio signal output unit for virtual sound imaging an input audio signal and outputting the virtual sound imaged signal to the pair of speaker units in a manner such that the listener listens to a sound reproduced by the pair of speaker units feeling as if the sound is emitted from a different speaker device.

Abstract: A method for simulating spatially extended sound sources comprising: panning a first input signal over a plurality of output channels to generate a first multi-channel directionally encoded signal; panning a second input signal over the plurality of output channels to generate a second multi-channel directionally encoded signal; combining the first and second multi-channel directionally encoded signals to generate a plurality of loudspeaker output channels; and applying a bank of decorrelation filters on the loudspeaker output channels.