Abstract: The present technology pertains to full body or partial body tracking in a multiuser extended reality (XR) application. In one aspect, a client device that is participating in the multiuser XR application and may be configured to determine a position of a first elbow associated with an arm of an avatar in the virtual world based on at least a position associated with a wrist or hand of a user; determine whether the position of the elbow is inside a boundary associated with an opposing shoulder; adjust the position of the elbow to be outside of the boundary associated with the opposing shoulder; and render the arm of the avatar based on the position of the elbow outside of the boundary. Additional aspects include compound motion tracking and rendering of a shoulder in an XR application.

Abstract: The present technology pertains to analyzing a user-created game object at a platform server to characterize features of the user-created game object. The present technology can further generate statistics indicative of the estimated performance of user-created game objects and modify the user-created game objects in accordance to improve their performance or to bring them into compliance with a software development kit. Further, client applications can include configurations to determine whether to download a user-created game object based on the statistics indicative of the estimated performance of user-created game objects.

Abstract: The present technology combines low latency sensor data from gyroscopes and accelerometers with accurate but higher latency data from AR frames by reordering a received series of data collected from the gyroscopes, accelerometers, and AR frames so that the AR frame is placed in the series of data earlier in time than it was received—to a time that corresponds with gyroscope and accelerometer data corresponding to a position and time which the AR frame capture was initiated. The correctly ordered data can then be used to project where the user will be looking at a future time so that the virtual reality application can render a scene that corresponds with the user's expectations. In this way, a smartphone can be used to provide a good virtual reality experience when used with a simple viewer, thus making virtual reality experiences more accessible.

Abstract: The present technology provides a more natural audio experience in a virtual world. In particular, the present technology provides an inner cone around a local player where audio sources within the inner cone are presented at full volume and an outer cone where audio sources outside the outer cone are presented at a minimum volume, or not at all. Audio sources that originate between the inner cone and outer cone are scaled based on their distance between the inner cone and outer cone. The present technology also provides a spatial aspect by shaping the inner cone and outer cone based on the forward vector of the local player so that more sounds are audible that are in front of the local player and less sounds behind the local player are audible.

Abstract: The present technology provides a mechanism by which a player can make a gesture with their hands which can bring up a virtual controller, wherein hand movements and finger tracking can result in locomotion of an avatar through a virtual world without need for a hardware controller. Therefore, a player can have a natural conversion or otherwise control the hands of their avatar to interact with other objects in the virtual world, and then use the avatar's hands to bring up a virtual controller to control locomotive movements of their avatar without the player of a physical controller.

Abstract: The present technology pertains to supporting contact interactions between avatars. For example, the present technology supports collisions between a collider and a receiver on avatars and effectuating a resulting effect. In another example, the present technology supports contact interactions that result in secondary motion behaviors from portions of an avatar. Portions of an avatar can be manipulated by forces from colliders that are exerted on the portions of the avatar configured with secondary motion. In addition to supporting interactions between avatars and portions of avatars, the present technology also solves other problems that are collateral to the supporting of contact interactions between avatars. One such problem is one of consent to engage in contact between avatars.

Abstract: The present technology generates a simplified version of a dynamic object by capturing sprites from segments of the complex dynamic object while the complex dynamic object is rendered. When the complex dynamic object is requested in an environment in which it is not desirable to display the complex dynamic object, the sprite information can be used to provide a simplified version of the dynamic object. The simplified version of the dynamic object can have a similar visual appearance but can be easier to render. The spite information for the segments of the dynamic object can be recorded in texture data, and the sprite information can be looked up and selected in a GPU for rendering.

Abstract: The present technology pertains to full body or partial body tracking in a multiuser extended reality (XR) application. A client device executing in the multiuser XR application may be configured to determine a plurality of zones associated with the wearer; map a first motion sensor from the at least one motion sensor to a corresponding zone, wherein the first motion sensor corresponds to a first zone; determine a first measured offset based on a distance from a position of the first motion sensor within the first zone to a fixed point within the first zone; receive first motion data of the wearer from the first motion sensor; map the first motion data to an avatar within a virtual world based on the first measured offset; and render the avatar within the virtual world based on the first motion data associated with the first zone.

Abstract: The present technology combines low latency sensor data from gyroscopes and accelerometers with accurate but higher latency data from AR frames by reordering a received series of data collected from the gyroscopes, accelerometers, and AR frames so that the AR frame is placed in the series of data earlier in time than it was received—to a time that corresponds with gyroscope and accelerometer data corresponding to a position and time which the AR frame capture was initiated. The correctly ordered data can then be used to project where the user will be looking at a future time so that the virtual reality application can render a scene that corresponds with the user's expectations. In this way, a smartphone can be used to provide a good virtual reality experience when used with a simple viewer, thus making virtual reality experiences more accessible.

Abstract: The present technology generates a simplified version of a complex avatar by capturing images and 3-D volume information of segments of the complex avatar while the complex avatar is rendered. When the complex avatar is requested in an environment in which it is not desirable to display the complex avatar, the captured images and 3-D volume information can be used to provide a simplified version of the avatar. The simplified version of the avatar can have a similar visual appearance but can be easier to render. However, the present technology permits the user with the complex avatar to continue to have approximately the same visual appearance while avoiding the degraded performance on systems not capable of rendering the complex avatar quickly enough.

Abstract: The present technology pertains to variable updates to objects and synchronizing the objects within a multiuser virtual reality (VR) application. In one aspect, a client device that is participating in the multiuser VR application can subscribe to events from an object and receive updates at an identified subscription rate. Objects can have different subscription rates to ensure that relevant objects within the environment are updated more frequently that objects that are not relevant to the user experience. In another aspect, the client device can determine a simulation time associated with objects within the environment to synchronize objects that are related and provide a high-fidelity animation of those objects.

Abstract: Disclosed are methods, systems, and computer-readable recording media that encrypt user-created game objects and at least partially de-duplicate the objects during future downloads of overlapping content. A first object is downloaded to a user device and stored in cache—and also decompressed, recompressed, encrypted, and bundled into a file with a header at the server. When a second object is downloaded, the server can determine the chunks of the second object that are distinct from the chunks of the first object already stored in the cache, e.g., by using a deterministic identification number associated with a manifest of the file that contains the overlapping chunks. The server can then download the necessary chunks from a file that is not accessible to the user but that includes the chunks requested by the user and accessible to the user. Accordingly, bandwidth and computing resources can be saved.

Abstract: The present technology pertains to supporting contact interactions between avatars. For example, the present technology supports collisions between a collider and a receiver on avatars and effectuating a resulting effect. In another example, the present technology supports contact interactions that result in secondary motion behaviors from portions of an avatar. Portions of an avatar can be manipulated by forces from colliders that are exerted on the portions of the avatar configured with secondary motion. In addition to supporting interactions between avatars and portions of avatars, the present technology also solves other problems that are collateral to the supporting of contact interactions between avatars. One such problem is one of consent to engage in contact between avatars.

Abstract: The present technology receives raw assets of user-generated content at a platform server. The platform server can utilize techniques to recognize reused assets to avoid storing duplicate data. Additionally, the present technology can utilize a validation scheme by which portions of user content that include executable code are only permitted to be uploaded to the platform server when these portions of the user content are recognized and are already known to be safe. Additionally, the present technology can be configured to modify the raw assets of the content to be compatible with the latest updates to the platform and to the distribution platforms in which the user-generated content will be executed.

Abstract: The present technology pertains to analyzing a user-created game object at a platform server to characterize features of the user-created game object. The present technology can further generate statistics indicative of the estimated performance of user-created game objects and modify the user-created game objects in accordance to improve their performance or to bring them into compliance with a software development kit. Further, client applications can include configurations to determine whether to download a user-created game object based on the statistics indicative of the estimated performance of user-created game objects.

Abstract: The present technology provides a more natural audio experience in a virtual world. In particular, the present technology provides an inner cone around a local player where audio sources within the inner cone are presented at full volume and an outer cone where audio sources outside the outer cone are presented at a minimum volume, or not at all. Audio sources that originate between the inner cone and outer cone are scaled based on their distance between the inner cone and outer cone. The present technology also provides a spatial aspect by shaping the inner cone and outer cone based on the forward vector of the local player so that more sounds are audible that are in front of the local player and less sounds behind the local player are audible.

Abstract: The present technology generates a simplified version of a complex avatar by capturing images and 3-D volume information of segments of the complex avatar while the complex avatar is rendered. When the complex avatar is requested in an environment in which it is not desirable to display the complex avatar, the captured images and 3-D volume information can be used to provide a simplified version of the avatar. The simplified version of the avatar can have a similar visual appearance but can be easier to render. However, the present technology permits the user with the complex avatar to continue to have approximately the same visual appearance while avoiding the degraded performance on systems not capable of rendering the complex avatar quickly enough.

Abstract: The present technology provides a mechanism by which a player can make a gesture with their hands which can bring up a virtual controller, wherein hand movements and finger tracking can result in locomotion of an avatar through a virtual world without need for a hardware controller. Therefore, a player can have a natural conversion or otherwise control the hands of their avatar to interact with other objects in the virtual world, and then use the avatar's hands to bring up a virtual controller to control locomotive movements of their avatar without the player of a physical controller.

Abstract: The present technology provides a mechanism by which a player can make a gesture with their hands which can bring up a virtual controller, wherein hand movements and finger tracking can result in locomotion of an avatar through a virtual world without need for a hardware controller. Therefore, a player can have a natural conversion or otherwise control the hands of their avatar to interact with other objects in the virtual world, and then use the avatar's hands to bring up a virtual controller to control locomotive movements of their avatar without the player of a physical controller.

Abstract: The present technology pertains to shoulder positioning with body tracking in a multiuser virtual reality (VR) application. In one aspect, a client device that is participating in the multiuser VR application and may be configured to: determine a shoulder position based on a height of a user, wherein the shoulder position is mapped to an avatar in a virtual world; receive sensor data from an arm motion sensor attached to the user, wherein the sensor data identifies motion of an arm of the user; determine a movement vector of the shoulder position of the user using the sensor data; determine a shoulder avatar movement vector for a shoulder of the avatar from the movement vector; and render the avatar with the shoulder positioned based on the shoulder avatar movement vector.