Abstract: An apparatus for spatial audio signal decoding associated with a plurality of speaker nodes (201, 203, 205, 207, 209) placed within a three dimensional space, the apparatus comprising at least one processor and at least one memory including a computer program code. The at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to determine a non-overlapping virtual surface arrangement (400), the virtual surface arrangement (400) comprising a plurality of virtual surfaces (421, 423, 431, 433) with corners positioned at at least three speaker nodes of the plurality of speaker nodes (201, 203, 205, 207, 209) and sides connecting pairs of corners configured to be non-intersecting with at least one defined virtual plane within the three dimensional space.

Abstract: A electronic device displays an image that has sound. One or more processors process the sound for the image into binaural sound for a user. The binaural sound has a sound localization point (SLP) with a coordinate location that occurs behind the image while the image is located a near-field distance from a head of the user.

Abstract: One or more embodiments include techniques for generating audio for a speaker system worn by a listener. The speaker system analyzes an audio input signal to determine that a sound component of the audio input signal has an apparent location that is at a vertical distance from a listener. The speaker system selects an externally facing speaker included in the speaker system that faces at least partially upward or at least partially downward based on the vertical distance from the listener. The speaker system transmits the sound component to the externally facing speaker.

Abstract: An audio system processes a multi-channel input audio signal into a stereo signal for left and right speakers, while preserving the spatial sense of the sound field of the input audio signal. The multi-channel input audio signal includes a first left-right channel pair including a left input channel and a right input channel, and a second left-right channel pair including a left peripheral input channel and a right peripheral input channel. Subband spatial processing may be applied to the first and second left-right channel pairs. A first crosstalk processing is applied to the first left-right channel pair to generate first crosstalk processed channels. A second crosstalk processing is applied to the second left-right channel pair to generate second crosstalk processed channels. A left output channel and a right output channel are generated from the first and second crosstalk processed channels. The crosstalk processing may include crosstalk cancellation or crosstalk simulation.

Abstract: A specification of a mesh of filters may be defined on a grid in a three-dimensional space presented in a user interface. A plurality of sound tracks may be determined, wherein each of the sound tracks is associated with a corresponding sound source that may be represented in the three-dimensional space along with a listener. Responsive to user configuration of a position of the listener and/or positions of the sound sources in the three-dimensional space, a plurality of filters may be selected based on the mesh of filters and the positions of the sound sources and the listener in the three-dimensional space. Each of the filters may be applied to a corresponding one of the plurality of sound tracks to generate a plurality of filtered sound tracks and the three-dimensional sound may be generated based on the plurality of filtered sound tracks.

Abstract: The present disclosure relates to systems and methods for directing the audio output of a wearable device having a plurality of speakers. In one implementation, the system may include an image sensor configured to capture one or more images from an environment of the user of the wearable apparatus, a plurality of speakers, and at least one processing device. The at least one processing device may be configured to analyze the one or more images to determine at least one indicator of head orientation of the user of the wearable apparatus, select at least one of the plurality of speakers based on the at least one indicator of head orientation, and output the audio to the user of the wearable apparatus via the selected at least one of the plurality of speakers.

Abstract: An audio system (e.g., of an artificial reality headset) determines a position of the headset relative to a position of a head of a user wearing the headset. The determination is based in part on an image of a portion of the head from a tracking camera (e.g., eye tracking and/or face tracking) on the headset. The audio system adjusts an acoustic parameter based in part on the determined position of the headset. The audio system performs an action that uses the adjusted acoustic parameter.

Abstract: An electronic device identifies a location of a physical object that is away from a listener. The electronic device convolves sound so the sound externally localizes as binaural sound to the physical object. The sound plays to the listener through earphones so the listener hears the sound as emanating from the physical object.

Abstract: A speech providing device includes a memory that stores instructions, and a processor that executes the instructions. The instructions cause the processor to perform acquiring a position of a user and a direction that the user is facing, and providing a speech corresponding to an area existing in a direction that the user is facing on the basis of the position of the user, to the user.

Abstract: An audio system and a method of using the audio system to generate a head-related transfer function (HRTF) map, are described. The audio system can determine one or more HRTF and corresponding HRTF locations along an azimuthal path of an azimuth extending around a head of a user. The HRTFs or HRTF locations can be measured, and other HRTFs or HRTF locations can be interpolated or extrapolated. The HRTF map can include the HRTFs assigned to HRTF locations along the azimuth. HRTFs from the HRTF map are used to render spatial audio to the user. Other aspects are also described and claimed.

Abstract: The present technology relates to a signal processing device, method, and program that can improve encoding efficiency. A signal processing device includes: an acquisition unit that acquires reverb information including at least one of space reverb information specific to a space around an audio object or object reverb information specific to the audio object and an audio object signal of the audio object; and a reverb processing unit that generates a signal of a reverb component of the audio object on the basis of the reverb information and the audio object signal. The present technology can be applied to a signal processing device.

Abstract: The disclosed computer-implemented method may include capturing, via a headset microphone of a speaker's artificial reality device, voice input of a speaker in communication with a listener in an artificial reality environment. The method may include detecting a pose of the speaker within the artificial reality environment and determining a position of the speaker relative to a position of the listener within the artificial reality environment. The method may further include processing, based on the pose and the relative position of the speaker within the artificial reality environment, the voice input to create a directivity-attuned voice signal for the listener, and delivering the directivity-attuned voice signal to an artificial reality device of the listener. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A sound signal processor includes a memory storing instructions and a processor configured to implement the stored instructions to execute a plurality of tasks, the tasks including a receiving task configured to receive audio information, a sound source position setting task configured to set position information of a sound source based on the received audio information, and a sound image localization processing task configured to calculate an output level of a sound signal of the sound source for a plurality of speakers to thereby perform sound image localization processing of the sound source to localize a sound image of the sound source in a sound image localization position based on the set position information.

Abstract: The present invention relates to an ambisonic encoder for a sound wave having a plurality of reflections. The ambisonic encoder according to the invention makes it possible to improve the sensation of immersion in a 3D audio scene. The complexity of encoding of the reflections of sound sources for an ambisonic encoder according to the invention is less than the complexity of encoding of the reflections of sound sources of an ambisonic encoder according to the prior art. The ambisonic encoder according to the invention makes it possible to encode a greater number of reflections of a sound source in real time. The ambisonic encoder according to the invention makes it possible to reduce the power consumption related to ambisonic encoding, and to increase the life of a battery of a mobile device used for said application.

Abstract: A communication device includes a processor; a radio interface for connection to a radio unit; and an output interface; wherein the processor is configured to: obtain a first position signal indicative of first position of a first source; obtain a user position signal indicative of position of the user; obtain a direction signal indicative of a head direction of the user; determine a first angle between the head direction and a first direction from the user to the first source; determine a first filter function based on the first angle; apply the first filter function to a first audio signal for provision of a first left output signal and a first right output signal; and output a left signal and a right signal, wherein the left signal is based on the first left output signal, and wherein the right signal is based on the first right output signal.

Abstract: An apparatus, electronic device, method and computer program wherein the apparatus includes: processing circuitry; and memory circuitry including computer program code, the memory circuitry and the computer program code configured to, with the processing circuitry, enable the apparatus to perform: obtaining spatial information relating to a captured sound field from a first set of microphones; obtaining one or more signals from a second set of microphones where the one or more signals relate to the captured sound field; and using the obtained spatial information from the first set of microphones to process the one or more signals obtained from the second set of microphones; wherein the first set of microphones is provided within an electronic device and the second set of microphones is provided external to the electronic device.

Abstract: An information transmission device includes: a determining unit that determines a situation of an interlocutor who interacts with a user; and a transmission unit that transmits, to the user, information to be provided according to the situation of the interlocutor determined by the determining unit. In a further modification of the invention, the determining unit may determine a situation related to a body or conversation of the interlocutor as the situation of the interlocutor.

Abstract: An apparatus for audio signal rendering, the apparatus including at least one processor configured to: receive at least one microphone audio signal captured by at least one microphone within a capture environment; receive at least one projection audio signal, wherein the at least one projection audio signal is a room-impulse-response filtered at least one microphone audio signal within the capture environment; receive at least one residual audio signal, wherein the at least one residual audio signal is a result of removing the at least one projection audio signal from at least one audio signal captured by a microphone array within the capture environment; and generate at least two volumetric audio signals based on the at least one microphone audio signal, the at least one projection audio signal and the at least one residual audio signal.

Abstract: The present invention is directed to systems, methods and apparatus for processing media content for reproduction by a first apparatus. The method includes obtaining pose information indicative of a position and/or orientation of a user. The pose information is transmitted to a second apparatus that provides the media content. The media content is rendered based on the pose information to obtain rendered media content. The rendered media content is transmitted to the first apparatus for reproduction. The present invention may include a first apparatus for reproducing media content and a second apparatus storing the media content. The first apparatus is configured to obtain pose information indicative and transmit the pose information to the second apparatus; and the second apparatus is adapted to: render the media content based on the pose information to obtain rendered media content; and transmit the rendered media content to the first apparatus for reproduction.

Abstract: The present invention provides for an apparatus, system, and method for generating a head related audio transfer function in real time. Specifically, the present invention utilizes unique structural components including a tragus structure and an antihelix structure in connection with a microphone in order to communicate the location of a sound in three dimensional space to a user. The invention also utilizes an audio processor to digitally process the head related audio transfer function. The system may also be utilized to pan the directionality of audio sources within a virtual environment at least partially in response to movement of a user.

Abstract: A vocal feedback device comprising: a microphone; a fundamental frequency accentuator electrically connected to the microphone, a delay circuit electrically connected to the fundamental frequency accentuator, and a speaker electrically connected to the delay circuit. The device configured to convert vocal utterances received at the microphone into an electrical signal, impose a time delay before transmitting the electrical signal, after the time delay, transmit the electrical signal to the speaker, and convert the electrical signal to an audio signal using the speaker, the audio signal being a replication of the vocal utterances.

Abstract: An information transmission device includes: a determining unit that determines a situation of an interlocutor who interacts with a user; and a transmission unit that transmits, to the user, information to be provided according to the situation of the interlocutor determined by the determining unit. In a further modification of the invention, the determining unit may determine a situation related to a body or conversation of the interlocutor as the situation of the interlocutor.

Abstract: A sound effect controlling method and a sound outputting device with dynamic gain adjustment are disclosed. The sound effect controlling method includes the following steps. An original left sound signal and an original right sound signal are transformed to a virtual center sound signal, a virtual left sound signal, a virtual left surrounding sound signal, a virtual right surrounding sound signal and a virtual right sound signal according to a center gain, a left gain, a left surrounding gain, a right surrounding gain and a right gain, which are calculated according to a rotation angle and a dual sound relationship. An updated left sound signal and an updated right sound signal are obtained according to the virtual center sound signal, the virtual left sound signal, the virtual left surrounding sound signal, the virtual right surrounding sound signal and the virtual right sound signal.

Abstract: A virtual reality (VR) audio rendering system and method of using HRTF functions to quickly capture new positional cues to pre-computed audio frames responsive to changes in user position relative to sound systems. In a client-server VR system, when a user position change is detected, the client determines an appropriate HRTF based on the new position and convolves them with a set of audio frames that have been generated by the server based on a prior position, resulting in modified frames for rendering. Meanwhile, the client propagates the new position to the server to generate subsequent audio frames for the corrected position. As HRTF convolution is computationally inexpensive, the latency between user position change and the resultant sound change as perceived by the user can be significantly reduced. As a result, an immersive VR experience of the user can be preserved.

Abstract: Apparatus including a processor configured to: provide a position for at least one sound source relative to a reference position; analyse at least one input audio signal associated with the at least one sound source to determine at least one gain value based on the at least one input audio signal and the position for the at least one sound source relative to the reference position; and synthesize at least two output channels based on the at least one input audio signal, a directional transfer function pair, the at least one gain value and the position for the at least one sound source relative to the reference position.

Abstract: Example embodiments disclosed herein relate to orientation-aware surround sound playback. A method for processing audio on an electronic device that includes a plurality of loudspeakers is disclosed, the loudspeakers arranged in more than one dimension of the electronic device. The method includes, responsive to receipt of a plurality of received audio streams, generating a rendering component associated with the plurality of received audio streams, determining an orientation dependent component of the rendering component, processing the rendering component by updating the orientation dependent component according to an orientation of the loudspeakers and dispatching the received audio streams to the plurality of loudspeakers for playback based on the processed rendering component. Corresponding system and computer program products are also disclosed.

Abstract: The present document describes a method (700) for determining the position of at least one audio source (200). The method (700) includes capturing (701) first and second microphone signals at two or more microphone arrays (210, 220, 230), wherein the two or more microphone arrays (210, 220, 230) are placed at different positions. The two or more microphone arrays (210, 220, 230) each comprise at least a first microphone capsule to capture a first microphone signal and a second microphone capsule to capture a second microphone signal, wherein the first and second microphone capsules have differently oriented spatial directivities. Furthermore, the method (700) comprises determining (702), for each microphone array (210, 220, 230) and based on the respective first and second microphone signals, an incident direction (211, 221, 231) of at least one audio source (200) at the respective microphone array (210, 220, 230).

Abstract: The present disclosure relates to an information processing apparatus and method capable of performing compensation to achieve a standard sound regardless of a recording environment. The microphone picks up sound from a sound source and inputs the sound to a recording apparatus as an analog audio signal. The recording apparatus is an apparatus that performs binaural recording and generates an audio file of a sound obtained by binaural recording. The recording apparatus adds metadata related to a recording environment of binaural content to the audio file generated by binaural recording and transmits the file with the metadata to a reproducing apparatus. The present disclosure is applicable to a recording/reproducing system that performs binaural recording and reproduction of the sound, for example.

Abstract: A method comprising: causing classification of sound objects, within a rendered virtual space, as a first class of sound object or a second class of sound object in dependence upon historic action of a user within the virtual space; rendering one or more sound objects of the first class according to at least first rules; and rendering one or more sound objects of the second class according to at least second rules, different to the first rules, and a current position of the user within the virtual space.

Abstract: An input unit receives input of an assumed listening position of sound of an object, which is a sound source, and outputs assumed listening position information indicating the assumed listening position. A position information correction unit corrects position information of each object on the basis of the assumed listening position information to obtain corrected position information. A gain/frequency characteristic correction unit performs gain correction and frequency characteristic correction on a waveform signal of an object on the basis of the position information and the corrected position information. A spatial acoustic characteristic addition unit further adds a spatial acoustic characteristic to the waveform signal resulting from the gain correction and the frequency characteristic correction on the basis of the position information of the object and the assumed listening position information. The present technology is applicable to an audio processing device.

Abstract: A method for operating a wearable loudspeaker device that is worn on the upper part of the body of a user distant to the user's ears and head comprises determining sensor data, based on the sensor data, and determining at least one parameter related to the current position of the user's head in relation to the wearable loudspeaker device. The method further includes adapting a filter transfer function of at least one filter unit for the current position of the user's head based on the at least one parameter, and an audio output signal that is output to at least one loudspeaker of the wearable loudspeaker device depends on the filter transfer function.

Abstract: A method provides binaural sound to a user. An intelligent personal assistant selects a location for the user where the user hears binaural sound that emanates from a sound localization point (SLP) in empty space away from a head of the user. A wearable electronic device (WED) receives a voice command from the user to move the SLP to another location.

Abstract: A sound system for a vehicle including an engine and an audio device for an internal space of a cabin as sound sources disposed at given positions of the vehicle is provided which includes an engine sound localizer configured to localize a first sound generated by the engine to cause a vehicle driver inside the cabin to hear the first sound from a first position, and change the first position, and a traveling state detector configured to detect a traveling state of the vehicle. The engine sound localizer normally sets the first position at a default position and, when a given traveling state is detected by the traveling state detector, changes the first position to a specific position at which the vehicle driver is able to recognize the engine sound more clearly than at the default position.

Abstract: A digital signal processor (DSP) in headphones processes sound with head-related transfer functions (HRTFs) to produce binaural sound that externally localizes away from a head of a user wearing the headphones. The headphones include a microphone that receives a voice command that causes the headphones to move a location of the binaural sound.

Abstract: A wearable electronic device (WED) worn on a head of a user displays first and second virtual images. A digital signal processor (DSP) processes sound to a first sound localization point (SLP) at the first virtual image and to a second SLP at the second virtual image. A command controls the first and second SLPs when a head orientation of the user is directed to the SLP.

Abstract: A digital signal processor (DSP) in headphones processes sound with head-related transfer functions (HRTFs) to produce binaural sound that externally localizes away from a head of a user wearing the headphones. The headphones include a microphone that receives a voice command to an intelligent personal assistant that causes the headphones to change a location of the binaural sound.

Abstract: A digital signal processor (DSP) in a wearable electronic device (WED) worn on a head of a user processes sound with head-related transfer functions (HRTFs) to produce binaural sound that externally localizes away from the head of the user wearing the WED. The WED includes a microphone that receives a voice command to an intelligent personal assistant that causes the WED to move a location of the binaural sound.

Abstract: The disclosure relates to a processing multi-channel audio signals, an example embodiment including a method of processing a multi-channel audio signal, the method comprising: determining a location of sound sources (101, 102) within the signal; applying a rotation operation to the signal, a direction of the rotation operation dependent on the location of the sound sources in the signal; and generating a rotated audio signal.

Abstract: The present technique relates to sound processing apparatus and method, and a program that can more efficiently reproduce sound; A sound processing apparatus includes: a head direction acquisition unit that acquires a head direction of a user listening to sound; a rotation matrix generation unit that selects two first rotation matrices on the basis of the head direction from a plurality of first rotation matrices for rotation in a first direction held in advance, selects one second rotation matrix on the basis of the head direction from a plurality of second rotation matrices for rotation in a second direction held in advance, and generates a third rotation matrix on the basis of the selected two first rotation matrices and the selected one second rotation matrix; and a head-related transfer function composition unit that composes an input signal in a spherical harmonic domain, a head-related transfer function in the spherical harmonic domain, and the third rotation matrix to generate a headphone drive signal

Abstract: A method provides a voice in binaural sound to a user. A wearable electronic device (WED) selects head-related transfer functions (HRTFs) based on a distance between eyes of the user. A digital signal processor (DSP) in the WED processes the voice with the HRTFs to generate the voice in the binaural sound that localizes at a sound localization point (SLP) at a location in empty space to the user.

Abstract: An exemplary ambient sound extraction system accesses a location-confined A-format signal that includes a first set of audio signals captured by different capsules of a multi-capsule microphone disposed at a first location with respect to a capture zone of a real-world scene. The ambient sound extraction system also accesses a second set of audio signals captured by a plurality of microphones disposed at a plurality of other locations with respect to the capture zone. The ambient sound extraction system generates a location-diffused A-format signal. The location-diffused A-format signal includes a third set of audio signals that is based on the first and second sets of audio signals. Based on the location-diffused A-format signal, the ambient sound extraction system generates a location-diffused B-format signal representative of ambient sound in the capture zone. Corresponding methods are also disclosed.

Abstract: Headphones include a digital signal processor (DSP) that processes sound into binaural sound that externally localizes to a user wearing the headphones at a sound localization point (SLP) in empty space at least one meter away from a head of the user. A microphone receives a voice command that executes to change the sound from playing as the binaural sound that externally localizes to the user at the SLP in empty space at least one meter away from the head of the user to playing as stereo sound.

Abstract: A method for binaural synthesis of at least one virtual sound source comprises operating a first device comprising at least four physical sound sources, wherein, when the first device is used by a user, at least two physical sound sources are positioned closer to a first ear of the user than to a second ear, and at least two physical sound sources are positioned closer to the second ear than to the first ear, and wherein, for each ear, at least two physical sound sources are configured to acoustically induce natural directional pinna cues associated with different directions of sound arrival at the ear of the user. The method further comprises receiving and processing at least one audio input signal and distributing at least one processed version of the audio input signal at least between 4 kHz and 12 kHz over at least two physical sound sources for each ear.

Abstract: One illustrative system disclosed herein includes a computing device in communication with a display device and a sensor. The display device is configured to display a plurality of content and the sensor is configured to detect a field of view of a user of the computing device relative to the display device. The sensor can transmit a signal associated with the field of view to a processor in communication with the sensor. The processor is configured to determine a direction of the field of view of the user based on the signal. The processor is also configured to determine that a content displayed by the display device and associated with a haptic effect is within the field of view of the user. The processor is also configured to determine a haptic effect associated with the content and transmit a haptic signal associated with the haptic effect. The illustrative system also includes a haptic output device configured to receive the haptic signal and output the haptic effect.

Abstract: A headphone arrangement is configured to induce natural directional pinna cues. The arrangement comprises an ear cup comprising a frame configured to at least partly encircle the ear of a user, wherein the frame is at least partially hollow. The arrangement further comprises a loudspeaker arranged within a wall of a frontal part, a rear part, an upper part, and/or a lower part of the frame, the loudspeaker comprising a membrane, a first side of the membrane facing a cavity inside the frame, and a second side of the membrane facing the outside. At least one loudspeaker is arranged at a first angle with respect to a median plane crossing a user's head midway between the user's ears such that a main direction of sound propagation is directed away from the median plane, and the second side of the membrane is directed away from the median plane.

Abstract: A virtual reality (VR) attraction method includes implementing a kit corresponding to plans associated with VR representations. The kit includes fixed accessories, moveable accessories, a platform having a pattern of markings, and sections. The platform has mounts to affix the fixed stage accessories to the platform. The pattern identifies coordinates corresponding to a location of the mounts. The sections interconnect according to the pattern to form the platform. The platform is configurable according to stage plans.

Abstract: A method for outputting an audio signal corresponding to scene orientation information is disclosed. The method includes receiving an audio signal interacting with a video, generating a decoded audio signal, object metadata, and scene orientation information through decoding, receiving external control information, and generating modified object metadata suitable for a playback environment by modifying the object metadata based on the received external control information, rendering the decoded audio signal using the modified object metadata, and modifying the rendered audio signal according to the scene orientation information.

Abstract: A method comprising: automatically applying a selection criterion or criteria to a sound object; if the sound object satisfies the selection criterion or criteria then performing one of correct or incorrect rendering of the sound object; and if the sound object does not satisfy the selection criterion or criteria then performing the other of correct or incorrect rendering of the sound object, wherein correct rendering of the sound object comprises at least rendering the sound object at a correct position within a rendered sound scene compared to a recorded sound scene and wherein incorrect rendering of the sound object comprises at least rendering of the sound object at an incorrect position in a rendered sound scene compared to a recorded sound scene or not rendering the sound object in the rendered sound scene.

Abstract: Embodiments relate to b-chain processing for a spatially enhanced audio signal. A system includes a b-chain processor. The b-chain processor determines asymmetries between the left speaker and the right speaker in frequency response, time alignment, and signal level for a listening position; and generates a left output channel for the left speaker and a right output channel for the right speaker by: applying an N-band equalization to the spatially enhanced signal to adjust for the asymmetry in the frequency response; applying a delay to the spatially enhanced signal to adjust for the asymmetry in the time alignment; and applying a gain to the spatially enhanced signal to adjust for the asymmetry in the signal level.

Abstract: A virtual reality (VR) experience augmentation method includes: generating VR representations, each preprogrammed to simulate a virtual environment with virtually represented objects; associating stage kits with one or more of the representations, each kit having a modular stage and stage accessories, the modular stage marked to aid assembly; and building one of the kits, by: assembling the accessories to the stage according to the one of the kits by using coordinates identified by stage markings; and configuring a motion tracking system to track a VR participant's movements and movements of one of more of the stage accessories by communicating identity, location and/or orientation information to a VR simulation engine. Locations and orientations of the objects within the virtual environment correspond to locations and orientations of the stage accessories that are arranged according to the one of the kits.