Abstract: Determination of a set of acoustic parameters for a headset is presented herein. The set of acoustic parameters can be determined based on a virtual model of physical locations stored at a mapping server. The virtual model describes a plurality of spaces and acoustic properties of those spaces, wherein the location in the virtual model corresponds to a physical location of the headset. A location in the virtual model for the headset is determined based on information describing at least a portion of the local area received from the headset. The set of acoustic parameters associated with the physical location of the headset is determined based in part on the determined location in the virtual model and any acoustic parameters associated with the determined location. The headset presents audio content using the set of acoustic parameters received from the mapping server.

Abstract: An audio playback device detects via an acoustic sensor of an audio playback device, ambient noise surrounding the audio playback device. The audio playback device updates an equalization filter based on the detected ambient noise, wherein the equalization filter adjusts one or more acoustic parameters of content presented by the audio playback device. The audio playback device adjusts a leakage control parameter based on the detected ambient noise, wherein the leakage control parameter adjusts an amount of leakage of content presented by the audio playback device. The audio playback device applies the equalization filter and the adjusted leakage control parameter to audio content. The audio playback device provides, via one or more acoustic speakers, the audio content to a user.

Abstract: A headset generates an output audio signal to provide a virtual sound source for an object or virtual object by using a room impulse response generated by a simulation using a model of a room generated from image data. The headset may include processing circuitry that obtains the model of the room determined based on the image data. The image data includes depth image data from a depth camera assembly and color image data from a color camera. The model includes surfaces of the room and acoustic absorptions of the surfaces. The processing circuitry adjusts audio content presented by the headset based on a room impulse response determined based on one or more simulations of sound propagation between a target position of an object and a position of the headset within the room using the surfaces of the room and the acoustic absorptions of the surfaces.

Abstract: The disclosed computer-implemented method for performing natural language translation in AR may include accessing an audio input stream that includes words spoken by a speaking user in a first language. The method may next include performing active noise cancellation on the words in the audio input stream so that the spoken words are suppressed before reaching a listening user. Still further, the method may include processing the audio input stream to identify the words spoken by the speaking user, and translating the identified words spoken by the speaking user into a second, different language. The method may also include generating spoken words in the second, different language using the translated words, and replaying the generated spoken words in the second language to the listening user. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A system creates an audio profile. The audio profile may be stored in a database. For example, the audio profile may be securely stored in a database of a social network and associated with a user account. The audio profile may contain data describing the way in which the specific user hears and interprets sounds. Systems and applications which present sounds to the user may access the audio profile and modify the sounds presented to the user based on the data in the audio profile to enhance the audio experience for the user.

Abstract: The disclosed computer-implemented method for performing directional beamforming according to an anticipated position may include accessing environment data indicating a sound source within an environment. The device may include various audio hardware components configured to generate steerable audio beams. The method may also include identifying the location of the sound source within the environment based on the accessed environment data, and then steering the audio beams of the device to the identified location of the sound source within the environment. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed computer-implemented method may include (1) establishing a communication channel to indirectly convey a conversation, (2) receiving, via the communication channel, a portion of the conversation, (3) presenting the portion of the conversation to a user, (4) receiving, via the communication channel, an additional portion of the conversation, (5) detecting an additional communication channel capable of conveying the conversation, (6) determining a human-perceivable difference between how the conversation has been conveyed via the communication channel and how the conversation will be conveyed via the additional communication channel, and (7) compensating for the human-perceivable difference when presenting the additional portion of the conversation to the user in order to smoothly transition the conversation from the communication channel to the additional communication channel. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A system reduces power consumption by optimizing a selection of acoustic sensors of a sensor array based on environmental parameters of a local area. The system includes the sensor array including the acoustic sensors configured to detect sound in a local area, and processing circuitry. The processing circuitry is configured to: determine an environmental parameter of the local area; determine a performance metric for the sensor array; determine a selection of a subset of acoustic sensors from the acoustic sensors of the sensor array that satisfies the performance metric based on the environmental parameter of the local area; and process audio data from the subset of the acoustic sensors of the sensor array.

Abstract: A system creates an audio profile. The audio profile may be stored in a database. For example, the audio profile may be securely stored in a database of a social network and associated with a user account. The audio profile may contain data describing the way in which the specific user hears and interprets sounds. Systems and applications which present sounds to the user may access the audio profile and modify the sounds presented to the user based on the data in the audio profile to enhance the audio experience for the user.

Abstract: An audio system on a headset presents, to a user, audio content simulating a target artificial reality environment. The system receives audio content from an environment and analyzes the audio content to determine a set of acoustic properties associated with the environment. The audio content may be user generated or ambient sound. After receiving a set of target acoustic properties for a target environment, the system determines a transfer function by comparing the set of acoustic properties and the target environment's acoustic properties. The system adjusts the audio content based on the transfer function and presents the adjusted audio content to the user. The presented adjusted audio content includes one or more of the target acoustic properties for the target environment.

Abstract: A system reduces power consumption by optimizing a selection of acoustic sensors of a sensor array based on environmental parameters of a local area. The system includes the sensor array including the acoustic sensors configured to detect sound in a local area, and processing circuitry. The processing circuitry is configured to: determine an environmental parameter of the local area; determine a performance metric for the sensor array; determine a selection of a subset of acoustic sensors from the acoustic sensors of the sensor array that satisfies the performance metric based on the environmental parameter of the local area; and process audio data from the subset of the acoustic sensors of the sensor array.

Abstract: An audio system on a headset presents, to a user, audio content simulating a target artificial reality environment. The system receives audio content from an environment and analyzes the audio content to determine a set of acoustic properties associated with the environment. The audio content may be user generated or ambient sound. After receiving a set of target acoustic properties for a target environment, the system determines a transfer function by comparing the set of acoustic properties and the target environment's acoustic properties. The system adjusts the audio content based on the transfer function and presents the adjusted audio content to the user. The presented adjusted audio content includes one or more of the target acoustic properties for the target environment.

Abstract: A shared communication channel allows for the transmitting and receiving audio content between multiple users. Each user is associated with a headset configured to transmit and receive audio data to and from headsets of other users. After the headset of a first user receives audio data corresponding to a second user, the headset spatializes the audio data based upon the relative positions of the first and second users such that when the audio data is presented to the first user, the sounds of the audio data appear to originate at a location corresponding to the second user. The headset reinforces the audio data based upon a deviation between the location of the second user and a gaze direction of the first user, allowing for the first user to more clearly hear audio data from other users that they are paying attention to.

Abstract: A system creates an audio profile. The audio profile may be stored in a database. For example, the audio profile may be securely stored in a database of a social network and associated with a user account. The audio profile may contain data describing the way in which the specific user hears and interprets sounds. Systems and applications which present sounds to the user may access the audio profile and modify the sounds presented to the user based on the data in the audio profile to enhance the audio experience for the user.

Abstract: A controller is adapted to recognize an input from a user using an input interface, determine if a user gaze information indicates that the user is gazing at a device, and when the user gaze information indicates that the user is gazing at the device, route response information to the device.

Abstract: A shared communication channel allows for the transmitting and receiving audio content between multiple users. Each user is associated with a headset configured to transmit and receive audio data to and from headsets of other users. After the headset of a first user receives audio data corresponding to a second user, the headset spatializes the audio data based upon the relative positions of the first and second users such that when the audio data is presented to the first user, the sounds of the audio data appear to originate at a location corresponding to the second user. The headset reinforces the audio data based upon a deviation between the location of the second user and a gaze direction of the first user, allowing for the first user to more clearly hear audio data from other users that they are paying attention to.

Abstract: The disclosed computer-implemented method may include (1) receiving, at a first device, a first stream that includes first media data from a first media object, (2) receiving, at the first device, a second stream that includes second media data from a second media object, (3) mixing, at the first device, the first media data and the second media data into a third stream, (4) compiling, while mixing the third stream, a metadata stream that includes information enabling separation of the first media data and the second media data from the third stream, (5) transmitting, from the first device to a second device, the third stream, and (6) transmitting, from the first device to the second device, the metadata stream to enable the second device to separate the first media data and the second media data from the third stream. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Determination of a set of acoustic parameters for a headset is presented herein. The set of acoustic parameters can be determined based on a virtual model of physical locations stored at a mapping server. The virtual model describes a plurality of spaces and acoustic properties of those spaces, wherein the location in the virtual model corresponds to a physical location of the headset. A location in the virtual model for the headset is determined based on information describing at least a portion of the local area received from the headset. The set of acoustic parameters associated with the physical location of the headset is determined based in part on the determined location in the virtual model and any acoustic parameters associated with the determined location. The headset presents audio content using the set of acoustic parameters received from the mapping server.

Abstract: An audio system generates virtual acoustic environments with three-dimensional (3-D) sound from legacy video with two-dimensional (2-D) sound. The system relocates sound sources within the video from 2-D to into a 3-D geometry to create an immersive 3-D virtual scene of the video that can be viewed using a headset. Accordingly, an audio processing system obtains a video that includes flat mono or stereo audio being generated by one or more sources in the video. The system isolates the audio from each source by segmenting the individual audio sources. Reverberation is removed from the audio from each source to obtain each source's direct sound component. The direct sound component is then re-spatialized to the 3-D local area of the video to generate the 3-D audio based on acoustic characteristics obtained for the local area in the video.

Abstract: A shared communication channel allows for the transmitting and receiving audio content between multiple users. Each user is associated with a headset configured to transmit and receive audio data to and from headsets of other users. After the headset of a first user receives audio data corresponding to a second user, the headset spatializes the audio data based upon the relative positions of the first and second users such that when the audio data is presented to the first user, the sounds of the audio data appear to originate at a location corresponding to the second user. The headset reinforces the audio data based upon a deviation between the location of the second user and a gaze direction of the first user, allowing for the first user to more clearly hear audio data from other users that they are paying attention to.