Abstract: An information processing device (100) according to the present disclosure includes: an acquisition unit (141) configured to acquire a first image including a content image of an ear of a user; and a calculation unit (142) configured to calculate, based on the first image acquired by the acquisition unit (141), a head-related transfer function corresponding to the user by using a learned model having learned to output a head-related transfer function corresponding to an ear when an image including a content image of the ear is input.

Abstract: An audio system is proposed, dynamically playing optimized audio signals based on user position. A sensor circuits dynamically senses a target space to generate field context information. First speaker and second speaker are arranged for audio playback. A host device recognizes a user from the field context information, determines the user position corresponding to the target space, and adaptively assigns the user position as a target listening spot. A sensor circuit contains a camera capturing an ambient image out of the target space. A recognizer circuit analyzes the ambient image to obtain from the target space, the location, size, and acoustic attribute information of an ambient object, allowing the control circuit to accordingly perform a channel-based compensation operation on the target listening spot to generate optimized first channel audio signal and second channel audio signal.

Abstract: A method processes binaural sound to externally localize to a first user at a first location. This location is shared such that an electronic device processes the binaural sound to externally localize to a second user at a second location. The first and second locations occur at a same or similar location such that the first and second users hear the binaural sound as originating from the same or similar location.

Abstract: An audio system is proposed, dynamically playing optimized audio signals based on user position. A sensor circuits dynamically senses a target space to generate field context information. First speaker and second speaker are arranged for audio playback. A host device recognizes a user from the field context information, determines the user position corresponding to the target space, and adaptively assigns the user position as a target listening spot. A sensor circuit contains a camera capturing an ambient image out of the target space. A recognizer circuit analyzes the ambient image to obtain from the target space, the location, size and acoustic attribute information of an ambient object, allowing the control circuit to accordingly perform an object-based compensation operation on the target listening spot to generate optimized first channel audio signal and second channel audio signal.

Abstract: A computer-implemented method including: triggering, with at least one processor, an acoustic wave generator to generate a predefined acoustic wave directed toward a 3-dimensional (3D) layout associated with an entity from plurality of entities, wherein each of the plurality of entities is registered with a corresponding 3D layout embedded with a predefined number of 3D geometric figures; in response to receiving a modified acoustic wave from the 3D layout, comparing, with at least one processor, the modified acoustic wave with a plurality of calibrated acoustic waves associated with the plurality of entities to determine identification details comprising a match between the modified acoustic wave and a calibrated acoustic wave from the plurality of calibrated acoustic waves; and based on the identification details, identifying, with at least one processor, the entity related to the calibrated acoustic wave. A system and medium are also disclosed.

Abstract: A real-time communication software application for generating spatial audio with uniform reverberation in a real-time communication session is performed by an electronic communication device. The application is adapted to remove the reverberation of recorded speech signals from far-end participants by the dereverberation approach, render the direct sound parts by filtering the output signals by head-related transfer functions of desired directions, generate reverberant sound parts by convolving the output signals from with uniform room impulse responses or an artificial reverberator, and combine direct and reverberant sound components to generate spatialized speech signals. When speakers and listeners are located in two virtual conference rooms, the reverberation of the two rooms are coupled. The reverberant sound parts are then generated by convolving the output signals and coupled RIRs from the two rooms.

Abstract: The present disclosure provides a display device, a sound-emitting control method, and a sound-emitting control device. The device includes: a display screen which includes a first display region, a middle display region, and a second display region; a plurality of sound-emitting units, which include: a plurality of first sound-emitting units, a plurality of second sound-emitting units and a plurality of third sound-emitting units; the plurality of first sound-emitting units and the plurality of second sound-emitting units respectively include a sound-emitting unit which emits sounds at a first frequency band, a sound-emitting unit which emits sounds at a second frequency band, and a sound-emitting unit which emits sounds at a third frequency band; the first, second, and third frequency bands increase in turn; and all of the plurality of third sound-emitting units are the sound-emitting units emitting sound in the second frequency band.

Abstract: An information processing method receives settings of a plurality of pieces of information on a plurality of physical spaces that respectively correspond to a plurality of pieces of information on a plurality of logical spaces, receives a first group of a plurality of pieces of first acoustic image localization information that indicates a position of an acoustic image to be localized in each of the plurality of logical spaces using first coordinates in the plurality of logical spaces, receives a change in one piece of first acoustic image localization information, among the first group of the plurality of pieces of first acoustic image localization information, changes other pieces of first acoustic image localization information, among the first group of the plurality of pieces of first acoustic image localization, in response to the received change in the one piece of first acoustic image localization information, and transforms the first group of the plurality of pieces of first acoustic image localizatio

Abstract: A method and an associated device for the combined conversion of multiple characteristics of an audio signal are disclosed. The changes allow the signal to be typed on the basis of a profile selected by a control unit. The method and the device are particularly intended for the field of loudspeakers.

Abstract: Examples of wearable devices that can present to a user of the display device an audible or visual representation of an audio file comprising a plurality of stem tracks that represent different audio content of the audio file are described. Systems and methods are described that determine the pose of the user; generate, based on the pose of the user, an audio mix of at least one of the plurality of stem tracks of the audio file; generate, based on the pose of the user and the audio mix, a visualization of the audio mix; communicate an audio signal representative of the audio mix to the speaker; and communicate a visual signal representative of the visualization of the audio mix to the display.

Abstract: A method is provided, including: executing an interactive application, wherein executing the interactive application includes rendering video and audio of a virtual environment, the video being presented on a display viewed by a user, and the audio being presented through headphones worn by the user, and wherein executing the interactive application is responsive to user input generated from interactivity by the user with the presented video and audio; receiving environmental input from at least one sensor that senses a local environment in which the user is disposed; analyzing the environmental input to identify activity occurring in the local environment; responsive to identifying the activity, then adjusting a level of active noise cancellation applied by the headphones.

Abstract: Sound objects are identified within a content item, and location metadata is extracted from the content item for each sound object. A reference layout is generated, relative to a user position, for the sound objects based on the location metadata. A user's gaze is then determined using pupil tracking, body movement data, head orientation data, or other techniques. Using the reference layout, a sound object along a path defined by the gaze of the user is identified, and audio of the identified object is enhanced.

Abstract: An audio bitstream is decoded into audio objects and audio metadata for the audio objects. The audio objects include a specific audio object. The audio metadata specifies frame-level gains that include a first gain and a second gain respectively for a first audio frame and a second audio frame. It is determined, based on the first and second gains, whether sub-frame gains are to be generated for the specific audio object. If so, a ramp length is determined for a ramp used to generate the sub-frame gains for the specific audio object. The ramp of the ramp length is used to generate the sub-frame gains for the specific audio object. A sound field represented by the audio objects with the sub-frame gains is rendered by audio speakers.

Abstract: Spatial audio is rendered at a companion device or server connected to a wearable device, where the spatial audio is rendered based on a first pose estimate of the wearable device that is estimated at the companion device or server. The rendered spatial audio is then transmitted to the wearable device. The rendered spatial audio is refined at the wearable device based on a second pose estimate of the wearable device that is estimated at the wearable device. The refined spatial audio is then provided for playback via speakers of the wearable device.

Abstract: A self-diagnosis method performed in audio playback equipment including an audio playback unit having at least one loudspeaker and an audio capture unit having at least one microphone includes the steps of acquiring or producing emission audio test signals and outputting them via the loudspeaker(s), thereby producing sound test signals; acquiring reception audio test signals produced by the microphone(s) as a result of the microphones receiving the sound test signals; and analyzing the reception audio test signals in order to establish a first diagnosis of the audio playback unit and a second diagnosis of the audio capture unit.

Abstract: An audio device is disclosed, the audio device comprising an interface, memory, and a processor, wherein the processor is configured according to any of the following: obtain a first microphone input signal and a second microphone input signal; process the first microphone input signal and the second microphone input signal for provision of an output audio signal; and output the output audio signal. Processing of the input signals includes determine a first set of covariance parameters and a second set of covariance parameters; determine a first beamforming; apply the first beamforming to the first microphone input signal and the second microphone input signal; determine a second beamforming; apply the second beamforming to the first microphone input signal and the second microphone input signal; and provide the output audio signal based on first beamforming output signal and/or second beamforming output signal.

Abstract: Aspects of the disclosure provide methods and apparatuses for audio processing. In some examples, an apparatus for media processing includes processing circuitry. The processing circuitry receives first six degrees of freedom (6 DoF) information associated with a media content for a scene in a media application. The first 6 DoF information includes a first spatial location and a first rotation orientation for rotation about a center at the first spatial location. The processing circuitry determines that a rendering platform for rendering the media content is a three degrees of freedom (3 DoF) platform; and calculates, a revolution orientation of the media content on a sphere centered other than the first spatial location, according to at least the first spatial location. The revolution orientation is 3 DoF information associated with the media content for rendering on the 3 DoF platform.

Abstract: The present disclosure generally relates to user interfaces for managing spatial audio. Some exemplary techniques include user interfaces for transitioning between visual elements. Some exemplary techniques include user interfaces for previewing audio. Some exemplary techniques include user interfaces for discovering music. Some exemplary techniques include user interfaces for managing headphone transparency. Some exemplary techniques include user interfaces for manipulating multiple audio streams of an audio source.

Abstract: A method and apparatus for rendering an object-based audio signal considering an obstacle are disclosed. A method for rendering an object-based audio signal according to an example embodiment, the method includes identifying an object-based input signal and metadata for the input signal, generating a binaural filter based on the metadata using a binaural room impulse response (BRIR), determining, based on the metadata, whether an obstacle is present between a listener and an object, modifying the generated binaural filter when it is determined that the obstacle is present, and generating a rendered output signal by convolving the modified binaural filter and the input signal.

Abstract: An apparatus includes at least one memory, instructions, and processor circuitry to execute the instructions to track movement of a head of a user wearing earphones, the earphones to move with the movement of the head of the user, the earphones to be communicatively coupled to a computing device. The processor circuitry is to obtain media content, the media content including first audio data for a first channel and second audio data for a second channel. The processor circuitry is to adjust, based on the movement of the head of the user, the first audio data for the first channel and the second audio data for the second channel. The processor circuitry is to cause the adjusted first audio data and the adjusted second audio data to be played by the earphones.

Abstract: A device includes one or more processors configured to receive, via wireless transmission from a playback device, data associated with a pose of the playback device. The one or more processors are also configured to select, based on the data, a particular representation of a sound field from a plurality of representations of the sound field. Each respective representation of the sound field corresponds to a different sector of a set of sectors. A sector represents a range of values associated with movement of the playback device. The one or more processors are further configured to generate audio data corresponding to the selected representation of the sound field. one or more processors are also configured to send, via wireless transmission, the audio data as streaming data to the playback device.

Abstract: There is disclosed inter alia a method for rendering a virtual reality audio scene comprising: receiving information defining a limited area audio scene within the virtual reality audio scene (301), wherein the limited area audio scene defines a sub space of the virtual reality audio scene (304), wherein the information defines the limited area audio scene by defining an extent a user can move within the virtual audio scene; determining if the movement of the user within the limited area audio scene meets a condition of an audio scene change (302); and processing the audio scene change when the movement of the user within the limited area audio scene meets the condition of an audio scene change (306).

Abstract: A method comprises: receiving an image of a real-world environment; using a machine learning classifier, classifying the image to produce classifications associated with acoustic presets for an acoustic environment simulation, the acoustic presets each including acoustic parameters that represent sound reverberation; and selecting an acoustic preset among the acoustic presets based on the classifications.

Abstract: An audio system is proposed, dynamically playing optimized audio signals based on user position. A sensor circuits dynamically senses a target space to generate field context information. First speaker and second speaker are arranged for audio playback. A host device recognizes a user from the field context information, determines the user position corresponding to the target space, and adaptively assigns the user position as a target listening spot. A sensor circuit contains a camera capturing an ambient image out of the target space. A control circuit utilizes a user interface circuit to perform a configuration procedure which determines location, size and acoustic attribute information of an ambient object, allowing the control circuit to accordingly perform an object-based compensation operation on the target listening spot to generate optimized first channel audio signal and second channel audio signal.

Abstract: A system for clustering data into corresponding files comprises one or more processors and a memory. The one or more processors is/are configured to: 1) determine to cluster a set of data into a set of files; 2) determine a set of split points in a corresponding set of dimensions of the set of data to determine the set of files, wherein each file of the set of files has an approximate target size; and 3) store one or more items of the set of data into a corresponding file of the set of files based at least in part on the set of split points. The memory is coupled to the one or more processors and configured to provide the processor with instructions.

Abstract: A situation awareness system is provided and includes sensors configured to sense an object and generate signals of the sensed object. An identification and classification module is in communication with the sensors. The identification and classification module is configured to identify the sensed object and determine the position, speed and direction of each sensed object. A sound synthesis module is in communication with the identification and classification module. The sound synthesis module is configured to create sounds for the sensed object and further configured to create a binaural virtual acoustic model for the sensed object. The binaural virtual acoustic model is used to position the sensed object in virtual space at a location corresponding to its location in real space. One or more beam forming arrays is in communication with the sound synthesis module and configured to delivery sound. The delivered sound increases the situational awareness of a vehicle operator.

Abstract: An information processing apparatus for causing a rhythm providing device to provide a rhythm to be shared among a plurality of participants participating in an online communication includes circuitry. The circuitry obtains first setting information and second setting information respectively set by a first participant and a second participant of the plurality of participants with respect to a level of intensity of the rhythm to be provided to the second participant. The circuitry adjusts the level of intensity of the rhythm to be provided to the second participant based on the first setting information and the second setting information, and generates intensity information related to the adjusted level of intensity of the rhythm.

Abstract: Provided is a sound image localization device capable of flexibly controlling directivity with a short calculation time. A sound image localization device that reflects, on a reflector 50, a sound signal radiated from a speaker array 40 arranged with a plurality of speakers SP1 to SPQ on a straight line to localize a sound image includes an expansion coefficient calculation unit 10 configured to analytically calculate expansion coefficients by performing a spherical harmonic function expansion on a window function representing desired directivity, a filter coefficient generation unit 20 configured to convert the expansion coefficients into filter coefficients corresponding to each of the speakers SP1 to SPQ, and a speaker drive unit 30 configured to generate a speaker drive signal for driving each of the speakers SP1 to SPQ by convolving the filter coefficients in a voice signal.

Abstract: The present invention relates to a method and an apparatus for binaural rendering an audio signal using variable order filtering in frequency domain. To this end, provided are a method for processing an audio signal including: receiving an input audio signal; receiving a set of truncated subband filter coefficients for filtering each subband signal of the input audio signal, the set of truncated subband filter coefficients being constituted by one or more FFT filter coefficients generated by performing FFT by a predetermined block size; generating at least one subframe for each subband; generating at least one filtered subframe for each subband; performing inverse FFT on the filtered subframe for each subband; and generating a filtered subband signal by overlap-adding the transformed subframe for each subband and an apparatus for processing an audio signal using the same.

Abstract: A transmission apparatus includes a first transmission unit that transmits sound data to a first sound channel in a transmission path, and a second transmission unit that transmits meta data related to the sound data to a second sound channel in the transmission path while ensuring synchronization with the sound data.

Abstract: A method improves performance of a computer that provides binaural sound to a listener. A memory stores coordinate locations that follow a path of how the head of the listener moves. This path is retrieved in anticipation of subsequent head movements of the listener to improve computer performance of executing binaural sound.

Abstract: A method performed by a programmed processor, the method including receiving an input noise signal, generating, using a machine learning model that has an input based on the input noise signal, a mono audio signal that includes a sound and a spatial parameter for the mono audio signal, and generating spatial audio data by spatially encoding the mono audio signal according to the spatial parameter.

Abstract: Spatial audio signals can include audio objects that can be respectively encoded and rendered at each of multiple different depths. In an example, a method for encoding a spatial audio signal can include receiving audio scene information from an audio capture source in an environment, and receiving a depth characteristic of a first object in the environment. The depth characteristic can be determined using information from a depth sensor. A correlation can be identified between at least a portion of the audio scene information and the first object. The spatial audio signal can be encoded using the portion of the audio scene and the depth characteristic of the first object.

Abstract: System and method for projecting audio signals to an operator of a teleoperational surgical system to convey spatial orientation associated with the audio signals to the operator. Characteristics of the audio signals such as direction and volume may be selected to give the impression that the remote operator is positioned locally next to the patient. Characteristics of the audio signals may also be modified to provide spatial translations between actual locations of audio sources within a physical audio environment and simulations locations of the audio sources with a virtual audio environment.

Abstract: A method for processing a sound effect is provided. The method includes obtaining relative orientation information of a first electronic device worn by a first user relative to at least one sound source object in a preset virtual environment, obtaining a processed sound source signal by performing sound effect processing on a sound source signal of the at least one sound source object based on the relative orientation information, and providing the processed sound source signal to the first user through the first electronic device.

Abstract: A sound controlling system including a user terminal having a sound source, a wireless communication device, a digital to analog converter (DAC) and first processing electronics. The first processing electronics are configured to: provide data of a backing sound to the sound source; control the sound source to generate a sound signal based on the data; receive a first input instruction including a first instruction to transmit the sound signal and a second instruction to play back the backing sound; provide the sound signal to the wireless communication device as the first input instruction being the first instruction, and provide the sound signal to the DAC as being the second instruction; control the wireless communication device to convert the sound signal to a wireless signal and transmit the wireless signal; and convert the sound signal from a digital signal to an analog signal for play back of the backing sound.

Abstract: An apparatus, method and computer program is described comprising capturing spatial audio data during an image capturing process, determining an orientation of an image capturing device during the spatial audio data capture, generating an audio focus signal from said captured spatial audio data (wherein said audio focus signal is focused in an image capturing direction of said image capturing device), generating modified spatial audio data (e.g. by modifying the captured spatial audio data to compensate for changes in orientation during the spatial audio data capture), and generating an audio output signal from a combination of the audio focus signal and the modified spatial audio data.

Abstract: A display device and an operation method of the display device are provided in the present disclosure. The display device includes a display screen a sound-generation driving module, and further includes an acoustic scanning module, arranged on a non-display side of the display screen and configured to determine a spatial contour of a space where the display device is located through acoustic scanning; a viewer position detection module, configured to detect viewer coordinates in the space where the display device is located; and a control module, configured to control the sound-generation driving module to generate sound in accordance with the spatial contour and the viewer coordinates.

Abstract: Processing sound in an enhanced reality environment can include generating, based on an image of a physical environment, an acoustic model of the physical environment. Audio signals captured by a microphone array, can capture a sound in the physical environment. Based on these audio signals, one or more measured acoustic parameters of the physical environment can be generated. A target audio signal can be processed using the model of the physical environment and the measured acoustic parameters, resulting in a plurality of output audio channels having a virtual sound source with a virtual location. The output audio channels can be used to drive a plurality of speakers. Other aspects are also described and claimed.

Abstract: Provided are a computer system for transmitting audio content to realize a user-customized being-there and a method thereof. The computer system may be configured to detect audio files that are generated for a plurality of objects at a venue, respectively, and metadata including spatial features that are set for the objects at the venue, respectively, and to transmit the audio files and the metadata for a user. An electronic device of the user may realize a being-there at the venue by rendering the audio files based on the spatial features in the metadata. That is, the user may feel a user-customized being-there as if the user directly listens to audio signals generated from corresponding objects at a venue in which the objects are provided.

Abstract: Aspects of the disclosure provide methods and apparatuses for audio processing. In some examples, an apparatus for media processing includes processing circuitry. The processing circuitry receive audio inputs associated with a layered description for a space of interest in an audio scene. The space of interest includes a plurality of subspaces. The layered description includes a first layer and a second layer. The first layer has a common node with a first value that is a common attribute value of two or more subspaces in the plurality of subspaces. The second layer has individual nodes respectively associated with each of the plurality of subspaces. The processing circuitry determines the plurality of subspaces of the space of interest based on the layered description, and renders an audio output based on the audio inputs in response to a location of a subject of the audio scene being in the space of interest.

Abstract: A system and method includes generating a virtual n-dimensional space that includes one or more positions of one or more source nodes and a position of a receiver node; executing a plurality of simulations including simulating acoustic signals emanating from the one or more source nodes within the virtual n-dimensional room; estimating a measure of the acoustic signals received at the receiver node; computing a plurality of acoustic signal data samples based on the estimation for each of the plurality of simulations; and creating a training data corpus for training an artificial neural network, the training data corpus including at least a sampling of the plurality of acoustic data samples, and the artificial neural network, once trained, is configured to generate an inference indicating a likely intended sound to a target receiver of a mixture of acoustic signals.

Abstract: A method by a computer system including generating audio files based on respective audio signals, the audio signals having been respectively generated from a plurality of objects at a venue, generating metadata including spatial features at the venue that are respectively set for the objects, and transmitting the audio files and the metadata for the objects to a first electronic device to cause the first electronic device to realize a being-there at the venue by rendering the audio files based on the spatial features in the metadata may be provided.

Abstract: Methods and systems are provided for integrating media cues into virtual reality scenes presented on a head mounted display (HMD) is disclosed. The method includes presenting a virtual reality scene on a display of an HMD. The method further includes receiving sensor data from one or more sensors in a real-world space in which the HMD is located. Then, identifying an object location of an object in the real-world space that produces a sound. The method includes generating a media cue in the virtual reality scene presented in the HMD. The media cue is presented in a virtual location that is correlated to the object location of the object in the real-world space.

Abstract: A microphone device comprising, for example, a mid microphone cartridge and two side microphone cartridges. The mid microphone cartridge may be, for example, a cardioid microphone cartridge, and the side microphone cartridges may each be, for example, a bidirectional microphone cartridge. Each of the mid microphone cartridge and of the two side microphone cartridges may be orthogonal to the other two microphone cartridges. The microphone device, which may be referred to herein as a mid dual-side microphone, may provide a combined pickup pattern, such as a beam and/or a toroid, that may be steerable.

Abstract: A sound signal processing method includes: obtaining a plurality of sound signals respectively collected by a plurality of microphones arranged in a space; adjusting respective levels of the plurality of sound signals in accordance with respective positions of the plurality of microphones; mixing the plurality of sound signals having the adjusted respective levels to thereby obtain a mixed signal; and generating a reflected sound by using the obtained mixed signal.

Abstract: In at least one embodiment, a system for synchronizing an audio stream is provided. The system includes a first loudspeaker and an audio controller. The first loudspeaker plays back a first audio output signal including first signature information. The audio controller provides a first audio input signal and superimpose the first signature information on the first audio input signal. The audio controller receives the first audio output signal including the first audio packets and the first signature information and to detect the first signature information. The audio controller determines a delay attributed to a transmission of the first audio input signal and the first audio output signal based on the first signature information and synchronizes the transmission of a second audio input signal from the audio controller to the first loudspeaker with the playback of another audio output signal from a second loudspeaker based at least on the delay.

Abstract: An audio signal processing method detects a position, in a sound space, of a sound source that generates an audio signal, the sound space being divisible into a plurality of areas, and generates an initial reflected sound control signal by convolving (i) an impulse response of an initial reflected sound linked to a first area of the sound space, among the plurality of areas of the sound space, corresponding to the detected position of the sound source to (ii) the audio signal of the sound source without convolving (iii) an impulse response of an initial reflected sound linked to any of the plurality of areas of the sound space other than the first area of the sound space corresponding to the detected position of the sound source to (ii) the audio signal of the sound source.

Abstract: Systems and methods for spatially emulating a sound source. An apparatus includes a microphone array including microphones; and a sound profiler communicatively connected to the microphone array, the sound profiler including a processing circuitry and a memory which contains instructions that, when executed by the processing circuitry, configure the apparatus to: generate synthesized audio based on sound beam metadata, a sound profile, and target listener location data, wherein the sound beam metadata includes timed sound beams defining a directional dependence of a spatial sound wave, wherein the sound profile includes timed sound coefficients determined based on audio signals captured in a space wherein the target listener location data includes a position and an orientation, wherein the synthesized audio emulates sound that would be heard by a listener at the position and orientation of the target listener location data; and providing the synthesized audio for projection.

Abstract: The description relates to representing acoustic characteristics of real or virtual scenes. One method includes generating directional impulse responses for a scene. The directional impulse responses can correspond to sound departing from multiple sound source locations and arriving at multiple listener locations in the scene. The method can include processing the directional impulse responses to obtain coherent sound signals and incoherent sound signals. The method can also include encoding first perceptual acoustic parameters from the coherent sound signals and second perceptual acoustic parameters from the incoherent sound signals, and outputting the encoded first perceptual acoustic parameters and the encoded second perceptual acoustic parameters.