Abstract: A participant in a capture volume can speak through a microphone. The microphone can capture the speech and transmit it to a wearable computing device of the participant. The wearable computing device can process the speech to generate audio data. The wearable computing device can transmit the audio data to a simulator engine. The simulator engine can receive the audio data and processes the audio data to determine an attribute of the audio data (e.g., amplitude) at the location of a virtual character in a simulated virtual environment based on one or more attenuation factors. The attenuation factors can be calculated based on 3D motion data of the participant. Further, the simulator engine can drive an change in state of the virtual character in the simulated virtual environment based on the attribute of the audio data.

Abstract: A wearable computing device of the listener entity can receive 3D motion data of a virtual representation of the listener entity, 3D motion data of a virtual representation of a sound emitter entity and audio data. The audio data may be associated with an audio event triggered by the sound emitter entity in a capture volume. The wearable computing device of the listener entity can process the 3D motion data of the virtual representation of a listener entity, the 3D motion data of the virtual representation of the sound emitter entity and the audio data to generate a multi channel audio output data customized to the perspective of the virtual representation of a first entity. The multi channel audio output data may be associated with the audio event. The multi channel audio output data can be communicated to the listener entity through a surround sound audio output device.