Abstract: A virtual object system can coordinate interactions between multiple virtual objects in an artificial reality environment. Embodiments receive a first virtual object, the first virtual object including first properties, where the artificial reality environment is set in a real-world environment. Embodiments register the first properties of the first virtual object to receive notifications of events from the artificial reality environment. Embodiments receive one or more queries from a second virtual object and in response to the one or more queries, respond to the second virtual object with identified features of the real-world environment in which the artificial reality environment is set and identifications of one or more other virtual objects (e.g., the first virtual object). The second virtual object can use the identification of the first virtual object to register for events related to the first virtual object and/or communicate with the first virtual object.

Abstract: Systems, methods, client devices, and non-transitory computer-readable media are disclosed for utilizing an augmented reality (AR) data channel to enable shared augmented reality video calls which facilitate the sharing of and interaction with AR elements during video calls. For example, the disclosed systems can establish a video call between client devices that include a video (and audio) data channel and an AR data channel. Moreover, in one or more embodiments, the disclosed systems enable one of the client devices to transmit AR data (e.g., AR element identifiers, AR elements, object vectors, participant identifiers) through an AR data channel to cause the other client device to render an AR element on a video captured by the other client device during a video call. Indeed, the disclosed systems can enable AR environments, AR effects, AR-based activities, and/or individual AR elements during a video call utilizing an AR data channel.

Abstract: One embodiment is directed to controlling a computing system based on an interpreted user intention. Another embodiment is directed to generating a smoothed position of a feature based upon detected and reprojected positions of the feature. Another embodiment is directed to performing one or more image treatments on a facial region of a user until the perceived SQS satisfies the predetermined target SQS. Another embodiment is directed to video conferencing monitoring the quality of video feed coming from the participants of the video conferencing and creating an image or video from the feed when that participant's feed is good and replacing the live video with the newly created good quality image or video when the feed is bad. Another embodiment is directed to a process of baked triplanar projection using triangles generated from a tessellation, where the baked triplanar projection can generate a 2D mesh including UV coordinates.