Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object's data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object's components, which can be modified or overwritten as part of the extension.

Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object's data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object's components, which can be modified or overwritten as part of the extension.

Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object's data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object's components, which can be modified or overwritten as part of the extension.

Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object's data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object's components, which can be modified or overwritten as part of the extension.

Abstract: Aspects of the present disclosure are directed to a virtual object system for displaying invoked virtual objects in an artificial reality environment. An application can be defined as a collection of virtual objects, each having a definition that defines how and when each virtual object is displayed. For example, an invocation context can be defined for a virtual object, and the virtual object can be invoked when the invocation context is met. A virtual object manager can be provided to the artificial reality (“XR”) device that displays the virtual objects in the artificial reality environment. The virtual object manager can be capable of: selectively and dynamically retrieving virtual objects that are part of the application for on-device storage; and determining which of the application's virtual objects to display given current conditions (e.g., context for a user of the XR device and the device itself, currently displayed virtual objects, etc.

Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object's data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object's components, which can be modified or overwritten as part of the extension.

Abstract: In one embodiment, a method includes accessing a first image corresponding to a first frame of a video stream, rendering a first area of a second image corresponding to a second frame of the video stream, generating a second area of the second image corresponding to the second frame of the video stream by re-projecting the second area of the first image according to one or more warping parameters, and constructing the second image corresponding to the second frame by compositing the rendered first area and the generated second area of the second image. In another embodiment, a method includes an operating system receiving a set of data associated with an object from a first application, storing the set of data on the operating system, receiving a command to share the object with a second application, and allowing the second application to access the portion of the data associated with the object that it needs.

Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object's data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object's components, which can be modified or overwritten as part of the extension.

Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object’s data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object’s components, which can be modified or overwritten as part of the extension.

Abstract: Aspects of the present disclosure are directed to setting a display mode for a virtual object based on a display mode timer that is controlled by context factors. An artificial reality system can associate one or more virtual objects with a corresponding display mode timer. Various ranges on the display mode timer can be mapped to different display modes that the virtual object can assume. The display mode timer can be adjusted to add time based on a determination of a user focusing on the virtual object or other context factors. Display mode timers can also have rules for setting other display mode timer properties, such as how quickly the display mode timer runs down, that are evaluated based on context factors.

Abstract: Aspects of the present disclosure are directed to virtual interaction modes for social and group communication. Additional aspects of the present disclosure are directed to automated controls for connecting a trigger performed in an artificial reality environment to an action on a personal computing device. Further aspects of the present disclosure are directed to providing versions of person virtual objects in an artificial reality environment and contextual breakpoints to switch between them. Yet further aspects of the present disclosure are directed to extending a mouse for artificial reality environment input.

Abstract: Aspects of the present disclosure are directed to an avatar reaction system in which messaging can be initiated via an avatar. Aspects are also directed to automated controls for connecting an artificial reality trigger to an action. Aspects are further directed to adding a like to a gesture target based on interpreting a gesture. Aspects are yet further directed to administering a conversation thread, for a game, over a messaging platform. Additional aspects are directed to connecting a game with a conversation thread to coordinate game challenges. Further aspects are directed to establishing a shared space for a 3D call with participants' hologram representations mirrored as compared to how images of the participants are captured. Yet further aspects of the present disclosure are directed to scanning a physical space to onboard it as a messaging inbox and providing the scanned space for delivery point selection to a message sender.

Abstract: In some implementations, the disclosed systems and methods can automatically generate seller listing titles and descriptions for products; set a follow-me mode for various virtual objects, causing the virtual objects to be displayed as word-locked or body-locked in response to a current mode for the virtual objects and the location of the user of the XR device in relation to various anchor points for the virtual objects; create and/or apply XR profiles that specify one or more triggers for one or more effects that are applied to a user when the triggers are satisfied; and/or enable addition of external content in 3D applications.

Abstract: Aspects of the present disclosure are directed to setting a display mode for a virtual object based on a display mode timer that is controlled by context factors. An artificial reality system can associate one or more virtual objects with a corresponding display mode timer. Various ranges on the display mode timer can be mapped to different display modes that the virtual object can assume. The display mode timer can be adjusted to add time based on a determination of a user focusing on the virtual object or other context factors. Display mode timers can also have rules for setting other display mode timer properties, such as how quickly the display mode timer runs down, that are evaluated based on context factors.

Abstract: The disclosure provides methods and systems for spatial communication in a tele-presence system. In particular, the present technology provides human-robot interaction that allows users to feel a stronger sense of successful communication with a tele-presence system. Various embodiments of the present technology facilitate spatial communication between users via the tele-presence system, including communicating body language, spatial awareness, and improved information display, with a tele-presence device including a camera system and a hub. The methods and systems may include determining a user input, such as a gesture, indicative of an object, and detecting and tracking the object. The methods and systems may further include transmitting at least one control signal to one or more servo motors coupled to the camera system, the at least one control signal configured to reposition the camera system such that the detected object is kept within boundaries of a video signal.

Abstract: The disclosure provides tele-presence devices for spatial communication in a tele-presence system. In particular, the present technology provides a tele-presence device having a camera system wirelessly, communicatively, and rotationally coupled to a hub. The hub includes an upper housing having an aperture for removably receiving the camera system, and a lower housing rotatable coupled to the upper housing. The hub further includes first and second rotational assemblies, and a controller, for operatively rotating and otherwise repositioning the camera system. The hub frictionally engages the camera system, such that the camera system is selectively detachable from the hub without any manipulation of the hub itself. That is, a user may lift the camera system out of the hub, which advantageously allows the camera system to be portable and easily docked to the hub or other hubs.

Abstract: The disclosure provides tele-presence devices for spatial communication in a tele-presence system. In particular, the present technology provides a tele-presence device having a camera system wirelessly, communicatively, and rotationally coupled to a hub. The hub includes an upper housing having an aperture for removably receiving the camera system, and a lower housing rotatable coupled to the upper housing. The hub further includes first and second rotational assemblies, and a controller, for operatively rotating and otherwise repositioning the camera system. The hub frictionally engages the camera system, such that the camera system is selectively detachable from the hub without any manipulation of the hub itself. That is, a user may lift the camera system out of the hub, which advantageously allows the camera system to be portable and easily docked to the hub or other hubs.

Abstract: The disclosure provides methods and systems for spatial communication in a tele-presence system. In particular, the present technology provides human-robot interaction that allows users to feel a stronger sense of successful communication with a tele-presence system. Various embodiments of the present technology facilitate spatial communication between users via the tele-presence system, including communicating body language, spatial awareness, and improved information display, with a tele-presence device including a camera system and a hub. The methods and systems may include determining a user input, such as a gesture, indicative of an object, and detecting and tracking the object. The methods and systems may further include transmitting at least one control signal to one or more servo motors coupled to the camera system, the at least one control signal configured to reposition the camera system such that the detected object is kept within boundaries of a video signal.