Abstract: Systems and methods to improve video conferencing may include various improvements and modifications to image and audio data to simulate mutual presence among users. For example, automated positioning and presentation of image data of users via presentation devices may present users at a position, size, and scale to simulate mutual presence of users within a same physical space. In addition, rendering image data of users from virtual camera positions via presentation devices may simulate mutual eye gaze and mutual presence of users. Further, blending a background, or accentuating a user, within image data that is presented via presentation devices may match visual characteristics of the environment or the user to simulate mutual presence of users. Moreover, dynamic steering of individual audio transducers of an audio transducer array, and simulating audio point sources using a combination of speakers, may simulate direct communication and mutual presence of users.

Abstract: The described implementations of a head-mounted speaker array apparatus (“HMSAA”) include speaker arrays having one or more speakers that, when the HMSAA is worn on the head of a listener, are positioned forward of the pinna of each ear of the listener. For example, the HMSAA may include a first speaker array that is coupled to a frame that, when worn by a listener, positions the first speaker array forward of a first pinna of a first ear of the listener. A second speaker array may also be coupled to the frame at a position that, when the frame is worn by the listener, the second speaker array is positioned forward of a second pinna of the second ear of the listener.