Abstract: Methods, systems, apparatuses, and computer-readable media are provided for enabling collaboration between physical writers and virtual writers. In one implementation, the computer-readable medium includes instructions to cause a processor to receive, from an image sensor, image data representing a hand of a first physical writer holding a physical marking implement and engaging with a physical surface to create tangible markings. Information based on the image data is transmitted to a computing device associated with a second virtual writer, to thereby enable the second virtual writer to view the tangible markings created by the first physical writer. Annotation data are received from the computing device, and represent additional markings in relative locations with respect to the tangible markings created by the first physical writer. In response to receiving the annotation data, a wearable extended reality appliance overlays the physical surface with virtual markings in the relative locations.

Abstract: Systems, methods, and non-transitory computer readable media including instructions for selectively operating a wearable extended reality appliance are disclosed. Selectively operating the wearable extended reality appliance includes establishing a link between a wearable extended reality appliance and a keyboard device; receiving sensor data from at least one sensor associated with the wearable extended reality appliance, the sensor data being reflective of a relative orientation of the wearable extended reality appliance with respect to the keyboard device; based on the relative orientation, selecting from a plurality of operation modes a specific operation mode for the wearable extended reality appliance; identifying a user command based on at least one signal detected by the wearable extended reality appliance; and executing an action responding to the identified user command in a manner consistent with the selected operation mode.

Abstract: A method for tying a virtual speaker to a physical space. A first user with a first wearable extended reality appliance enters an area associated with a virtual speaker. First sounds are transmitted from the virtual speaker to the first wearable extended reality appliance. The first user hears the first sounds at first settings of the virtual speaker. The first user changes the settings of the virtual speaker to second settings. Second sounds are transmitted from the virtual speaker to the first wearable extended reality appliance, such that the first user hears the second sounds at the second settings. After the first user leaves the area, a second user with a second wearable extended reality appliance enters the area. Third sounds are transmitted from the virtual speaker to the second wearable extended reality appliance, such that the second user hears the third sounds at the second settings.

Abstract: Systems, methods, and non-transitory computer readable media including instructions for performing duty cycle control operations for a wearable extended reality appliance are disclosed. Performing the duty cycle control operations includes receiving data representing virtual content in an extended reality environment associated with a wearable extended reality appliance; identifying in the extended reality environment a first display region and a second display region separated from the first display region; determining a first duty cycle configuration for the first display region; determining a second duty cycle configuration for the second display region, wherein the second duty cycle configuration differs from the first duty cycle configuration; and causing the wearable extended reality appliance to display the virtual content in accordance with the determined first duty cycle configuration for the first display region and the determined second duty cycle configuration for the second display region.

Abstract: Methods, systems, apparatuses, and non-transitory computer-readable media are provided for tying virtual whiteboards to physical spaces. In one implementation, the computer-readable medium includes instructions to cause a processor to receive wirelessly, an indication of a location of a first wearable extended reality appliance; perform a lookup to determine that the location of the first wearable extended reality appliance corresponds to a location of a particular virtual whiteboard; transmit to the first wearable extended reality appliance, data corresponding to content of the particular virtual whiteboard; receive, during a first time period, virtual content added by a first user; receive wirelessly at a second time period an indication that a second wearable extended reality appliance is in the location of the particular virtual whiteboard; and transmit to the second wearable extended reality appliance, data corresponding to the content and the added content of the particular virtual whiteboard.

Abstract: Methods, systems, apparatuses, and non-transitory computer-readable media are provided for enabling gesture interaction with invisible virtual objects. In one implementation, the computer-readable medium includes instructions to cause a processor to receive image data captured by at least one image sensor of a wearable extended reality appliance in a field of view; display a plurality of virtual objects in a portion of the field of view; receive a selection of a specific physical object; receive a selection of a specific virtual object; dock the specific virtual object with the specific physical object; when the specific physical object and the specific virtual object are outside the portion of the field of view such that the specific virtual object is invisible to a user of the wearable extended reality appliance, receive a gesture input indicating interaction with the specific virtual object; and cause an output associated with the specific virtual object.

Abstract: Systems, methods, and non-transitory computer readable media configured for modifying the display of virtual objects docked to a movable input device are provided. In one implementation, the computer readable medium may be configured to receive image data from an image sensor, the image data representing an input device placed at a first location on a supporting surface. At least one processor may generate a presentation of at least one virtual object in proximity to the first location. Operations may include docking the at least one virtual object to the input device. The processor may determine that the input device is in a second location on the support surface. The virtual object presentation may be modified based on the second location. Operations may further include determining that the input device is in a third location removed from the support surface and modifying the virtual object presentation accordingly.

Abstract: Consistent with disclosed embodiments, systems, methods, and computer readable media including instructions for implementing hybrid virtual keys in an extended reality environment are disclosed. Embodiments may include a processor to receive signals from a touch-sensitive surface, wherein a wearable extended reality appliance may virtually project a plurality of virtual activatable elements on the touch-sensitive surface. The plurality of virtual activatable elements virtually projected on the touch-sensitive surface may be a proper sub-set of a group of virtual activatable elements, based on the action of a user. The processor may receive touch inputs from the user via the touch-sensitive surface and identify one of the plurality of virtual activatable elements. The processor may cause a change in virtual content based on the identified virtual activatable element.

Abstract: An integrated computational interface device includes a housing, at least one image sensor, and a foldable protective cover. The housing has a key region and a non-key region, and a keyboard associated with the key region. The foldable protective cover incorporates the at least one image sensor. The protective cover is configured to be manipulated into a plurality of folding configurations, including a first folding configuration, wherein the protective cover is configured to encase the key region and at least a portion of the non-key region, and a second folding configuration, wherein the protective cover is configured to stand in a manner that causes an optical axis of the at least one image sensor to generally face a user of the integrated computational interface device while the user types on the keyboard.

Abstract: Systems, methods, and non-transitory computer readable media containing instructions for causing at least one processor to perform operations for determining a display configuration for presenting virtual content are provided. In one implementation, the processor is configured for receiving image data from an image sensor associated with a wearable extended reality appliance; analyzing the image data to detect a particular input device placed on a surface; determining a value of at least one use parameter for the particular input device; retrieving from memory default display settings associated with the particular input device; determining a display configuration for presenting virtual content based on the value of the at least one use parameter and the retrieved default display settings; and causing a presentation of the virtual content via the wearable extended reality appliance according to the determined display configuration.

Abstract: An integrated computational interface device may include a portable housing having a key region and a non-key region; a keyboard associated with the key region of the housing; and a holder associated with the non-key region of the housing. The holder may be configured for selective engagement with and disengagement from the wearable extended reality appliance, such that when the wearable extended reality appliance is selectively engaged with the housing via the holder, the wearable extended reality appliance is transportable with the housing.

Abstract: Methods, systems, apparatuses, and computer-readable media are provided for simulating user interactions with shared content. In one implementation, the computer-readable medium includes instructions to cause a processor to establish a communication channel for sharing content and user interactions; transmit to at least one second wearable extended reality appliance, first data, representing an object associated with first wearable extended reality appliance, enabling a virtual representation of the object to be displayed through the at least one second wearable extended reality appliance; receive image data from an image sensor associated with the first wearable extended reality appliance; detect in the image data at least one user interaction including a human hand pointing to a specific portion of the object; and transmit to the at least one second wearable extended reality appliance second data indicating an area of the specific portion of the object.

Abstract: Systems, methods, and non-transitory computer readable media for controlling perspective in an extended reality environment are disclosed.

Abstract: Disclosed are systems, methods, and non-transitory computer readable media for making virtual colored markings on objects. Instructions may include receiving an indication of an object; receiving from an image sensor an image of a hand of an individual holding a physical marking implement; detecting in the image a color associated with the marking implement; receiving from the image sensor image data indicative of movement of a tip of the marking implement and locations of the tip; determining from the image data when the locations of the tip correspond to locations on the object; and generating, in the detected color, virtual markings on the object at the corresponding locations.

Abstract: Systems, methods, and non-transitory computer readable media containing instructions for causing at least one processor to perform operations to enable cursor control in an extended reality space are provided. In one implementation, the processor is configured to perform operations comprising receiving from an image sensor first image data reflecting a first region of focus of a user of a wearable extended reality appliance; causing a first presentation of a virtual cursor in the first region of focus; receiving from the image sensor second image data reflecting a second region of focus of the user outside the initial field of view in the extended reality space; receiving input data indicative of a desire of the user to interact with the virtual cursor; and causing a second presentation of the virtual cursor in the second region of focus in response to the input data.

Abstract: Systems, methods, and non-transitory computer readable media containing instructions for moving virtual content between virtual planes in three-dimensional space are provided. In one implementation, the wearable extended reality appliance may present a virtual object at a first location on a first virtual plane; intraplanar input signals may be received for causing the virtual object to move to a second location on the first virtual plane, and in response the wearable extended reality appliance may virtually display an intraplanar movement of the virtual object from the first location to the second location; and interplanar input signals may be received for causing the virtual object to move to a third location on a second virtual plane, while the virtual object is in the second location, and in response the wearable extended reality appliance may virtually display an interplanar movement of the virtual object from the second location to the third location.

Abstract: Systems, methods, and non-transitory computer readable media containing instructions for causing at least one processor to perform operations for changing display of virtual content based on temperature are provided. In one implementation, the processor is configured to perform operations comprising displaying virtual content via a wearable extended reality appliance, wherein during displaying of the virtual content, heat is generated by at least one component of the wearable extended reality appliance; receiving information indicative of a temperature associated with the wearable extended reality appliance; determining a need to change display settings of the virtual content based on the received information; and based on the determination, changing the display settings of the virtual content to achieve a target temperature.

Abstract: An integrated computational interface device may include a portable housing having a key region and a non-key region; a keyboard associated with the key region of the housing; and a holder associated with the non-key region of the housing. The holder may be configured for selective engagement with and disengagement from the wearable extended reality appliance, such that when the wearable extended reality appliance is selectively engaged with the housing via the holder, the wearable extended reality appliance is transportable with the housing.

Abstract: A method for facilitating an environmentally adaptive extended reality display in a physical environment includes virtually displaying content via a wearable extended reality appliance operating in the physical environment, wherein displaying content via the wearable extended reality appliance is associated with at least one adjustable extended reality display parameter. Image data is obtained from the wearable extended reality appliance and a specific environmental change unrelated to the virtually displayed content is detected in the image data. A group of rules associating environmental changes with changes in the at least one adjustable extended reality display parameter is accessed and a specific rule of the group of rules is determined, the specific rule corresponding to the specific environmental change. The specific rule is implemented to adjust the at least one adjustable extended reality display parameter based on the specific environmental change.

Abstract: Systems, methods, and non-transitory computer readable media for transferring virtual content to a physical display device are disclosed. An extended reality environment may be presented in a room via a wearable extended reality appliance configured to be paired with multiple display devices located in the room. Each display device may be associated with a unique network identifier. Input to cause presentation of a specific virtual object in the extended reality environment on a target display device and image data depicting the target display device may be received. The image data may be analyzed to identify the target display device. A network identifier of the target display device may be determined. A communications link with the target display device may be established. Data representing the specific virtual object may be transmitted to the target display device, to enable the target display device to present the specific virtual object.