Abstract: Social interactions between two or more users in a mixed reality environment are described. Techniques describe receiving data from a sensor. Based at least in part on receiving the data, the techniques describe determining that an object associated with a first user that is physically present in a real scene interacts with a second user that is present in the real scene. Based at least in part on determining that the object interacts with the second user, causing virtual content corresponding to the interaction and at least one of the first user or the second user to be presented on a user interface corresponding to a mixed reality device associated with the first user. The user interface can present a view of the real scene as viewed by the first user that is enhanced with the virtual content.

Abstract: Techniques for enabling two or more remotely located users to interact with one another and for causing virtual content that corresponds to individual users of the two or more users to augment virtual representations of the individual users in a remote communication environment is described. A service provider can receive image data and tracking data associated with a first user corresponding to a first device. Further, a service provider can cause a virtual representation of the first user to be presented on a display of a second device corresponding to a second user, determine an interaction between an object associated with the second user and the virtual representation of the first user, and based at least in part on determining the interaction, cause virtual content to be presented on the virtual representation of the first user on at least the display.