Abstract: First video frames that include a visual object and a non-spatialized first audio segment that includes an auditory event are received. If that second video frames do not include the visual object and a first time difference between the first video frames and the second video frames does not exceed a certain time, a motion vector of the visual object is used to assign a spatial location to the auditory event in at least one of the second video frames. A second audio segment that includes the auditory event and third video frames are received. If the third video frames do not include the visual object and a second time difference between the first video frames and the third video frames exceeds the certain time, the auditory event is assigned to a diffuse sound field. An audio output that conveys spatial locations of the visual object is output.

Abstract: First video frames that include a visual object and a non-spatialized first audio segment that includes an auditory event are received. If that second video frames do not include the visual object and a first time difference between the first video frames and the second video frames does not exceed a certain time, a motion vector of the visual object is used to assign a spatial location to the auditory event in at least one of the second video frames. A second audio segment that includes the auditory event and third video frames are received. If the third video frames do not include the visual object and a second time difference between the first video frames and the third video frames exceeds the certain time, the auditory event is assigned to a diffuse sound field. An audio output that conveys spatial locations of the visual object is output.

Abstract: Assigning spatial information to audio segments is disclosed. A method includes receiving a first audio segment that is non-spatialized and is associated with first video frames; identifying visual objects in the first video frames; identifying auditory events in the first audio segment; identifying a match between a visual object of the visual objects and an auditory event of the auditory events; and assigning a spatial location to the auditory event based on a location of the visual object.

Abstract: Assigning spatial information to audio segments is disclosed. A method includes receiving a first audio segment that is non-spatialized and is associated with first video frames; identifying visual objects in the first video frames; identifying auditory events in the first audio segment; identifying a match between a visual object of the visual objects and an auditory event of the auditory events; and assigning a spatial location to the auditory event based on a location of the visual object.

Abstract: A method of encoding sound objects includes receiving a set of monophonic sound inputs. Each of the set of monophonic sound inputs includes position and orientation information of a sound object relative to a source position. The set of monophonic sound inputs are encoded into a higher order ambisonic (HOA) sound field in a spherical harmonics domain based on a spherical harmonics dataset including a subset of all spherical harmonic coefficients for a given subset of azimuth and elevation angles. Some embodiments include decoding the HOA sound field to generate a set of loudspeaker signals.

Abstract: A method of encoding sound objects includes receiving a set of monophonic sound inputs. Each of the set of monophonic sound inputs includes position and orientation information of a sound object relative to a source position. The set of monophonic sound inputs are encoded into a higher order ambisonic (HOA) sound field in a spherical harmonics domain based on a spherical harmonics dataset including a subset of all spherical harmonic coefficients for a given subset of azimuth and elevation angles. Some embodiments include decoding the HOA sound field to generate a set of loudspeaker signals.

Abstract: Provided are methods and systems for updating a sound field in response to user movement. The methods and systems are less computationally expensive than existing approaches for updating a sound field, and are also suitable for use with arbitrary loudspeaker configurations. The methods and systems provide a dynamic binaural sound field rendering realized with the use of “virtual loudspeakers.” Rather than loudspeaker signals being fed into the physical loudspeakers, the signals are instead filtered with left and right HRIRs (Head Related Impulse Response) corresponding to the spatial locations of these loudspeakers. The sums of the left and right ear signals are then fed into the audio output device of the user.

Abstract: Provided are methods and systems for delivering three-dimensional, immersive spatial audio to a user over a headphone, where the headphone includes one or more virtual speaker conditions. The methods and systems recreate a naturally sounding sound field at the user's ears, including cues for elevation and depth perception. Among numerous other potential uses and applications, the methods and systems of the present disclosure may be implemented for virtual reality applications.

Abstract: A method of providing an audio signal comprising spatial information relating to a location of at least one virtual source (202) in a sound field with respect to a first user position comprises obtaining a first audio signal comprising a plurality of signal components, each of the signal components corresponding to a respective one of a plurality of virtual loudspeakers (200a-e) located in the sound field; obtaining an indication of user movement; determining a plurality of panned signal components by applying, in accordance with the indication of user movement, a panning function of a respective order to each of the signal components; and outputting a second audio signal comprising the panned signal components.

Abstract: Provided are methods and systems for delivering three-dimensional, immersive spatial audio to a user over a headphone, where the headphone includes one or more virtual speaker conditions. The methods and systems recreate a naturally sounding sound field at the user's ears, including cues for elevation and depth perception. Among numerous other potential uses and applications, the methods and systems of the present disclosure may be implemented for virtual reality applications.

Abstract: Provided are methods and systems for updating a sound field in response to user movement. The methods and systems are less computationally expensive than existing approaches for updating a sound field, and are also suitable for use with arbitrary loudspeaker configurations. The methods and systems provide a dynamic binaural sound field rendering realized with the use of “virtual loudspeakers.” Rather than loudspeaker signals being fed into the physical loudspeakers, the signals are instead filtered with left and right HRIRs (Head Related Input Response) corresponding to the spatial locations of these loudspeakers. The sums of the left and right ear signals are then fed into the audio output device of the user.

Abstract: A method of providing an audio signal comprising spatial information relating to a location of at least one virtual source (202) in a sound field with respect to a first user position comprises obtaining a first audio signal comprising a plurality of signal components, each of the signal components corresponding to a respective one of a plurality of virtual loudspeakers (200a-e) located in the sound field; obtaining an indication of user movement; determining a plurality of panned signal components by applying, in accordance with the indication of user movement, a panning function of a respective order to each of the signal components; and outputting a second audio signal comprising the panned signal components.