Abstract: Systems, methods, and non-transitory computer readable media including instructions for extracting content from a virtual display are disclosed. Extracting content from a virtual display includes generating a virtual display via a wearable extended reality appliance, wherein the virtual display presents a group of virtual objects and is located at a first virtual distance from the wearable extended reality appliance; generating an extended reality environment via the wearable extended reality appliance including at least one additional virtual object at a second virtual distance from the wearable extended reality appliance; receiving input for causing a specific virtual object to move from the virtual display to the extended reality environment; and in response, generating a presentation of a version of the specific virtual object in the extended reality environment at a third virtual distance different from the first virtual distance and the second virtual distance.

Abstract: An integrated computational interface device may include a portable housing having a key region and a non-key region; a keyboard associated with the key region of the housing; and a holder associated with the non-key region of the housing. The holder may be configured for selective engagement with and disengagement from the wearable extended reality appliance, such that when the wearable extended reality appliance is selectively engaged with the housing via the holder, the wearable extended reality appliance is transportable with the housing.

Abstract: Disclosed are systems, methods, and non-transitory computer readable media for making virtual colored markings on objects. Instructions may include receiving an indication of an object; receiving from an image sensor an image of a hand of an individual holding a physical marking implement; detecting in the image a color associated with the marking implement; receiving from the image sensor image data indicative of movement of a tip of the marking implement and locations of the tip; determining from the image data when the locations of the tip correspond to locations on the object; and generating, in the detected color, virtual markings on the object at the corresponding locations, wherein the object is a three-dimensional virtual object, and wherein the virtual markings include markings in the detected color on two traversed surfaces of the virtual representation of the physical object.

Abstract: An integrated computational interface device may include a portable housing having a key region and a non-key region; a keyboard associated with the key region of the housing; and a holder associated with the non-key region of the housing. The holder may be configured for selective engagement with and disengagement from the wearable extended reality appliance, such that when the wearable extended reality appliance is selectively engaged with the housing via the holder, the wearable extended reality appliance is transportable with the housing.

Abstract: Methods, systems, apparatuses, and computer-readable media are provided for simulating user interactions with shared content. In one implementation, the computer-readable medium includes instructions to cause a processor to establish a communication channel for sharing content and user interactions; transmit to at least one second wearable extended reality appliance, first data, representing an object associated with first wearable extended reality appliance, enabling a virtual representation of the object to be displayed through the at least one second wearable extended reality appliance; receive image data from an image sensor associated with the first wearable extended reality appliance; detect in the image data at least one user interaction including a human hand pointing to a specific portion of the object; and transmit to the at least one second wearable extended reality appliance second data indicating an area of the specific portion of the object.

Abstract: Systems, methods, and non-transitory computer readable media for virtually extending a physical keyboard are disclosed. In one implementation, a non-transitory computer readable medium contains instructions that cause a processor to: receive image data representing a keyboard placed on a surface from an image sensor associated with a wearable extended reality appliance; determine that the keyboard is paired with the wearable extended reality appliance; receive an input for causing a display of a virtual controller with the keyboard; display, via the wearable extended reality appliance, the virtual controller in a first location on the surface, with original spatial orientation relative to the keyboard; detect a movement of the keyboard to a different location on the surface; and in response to the detected movement, present the virtual controller in a second location on the surface, with a subsequent spatial orientation relative to the keyboard that corresponds to the original spatial orientation.

Abstract: Systems, methods, and non-transitory computer readable media for selectively controlling display of virtual objects are provided. Virtual objects may be virtually presented in an environment via a wearable extended reality appliance operable in a first and second display modes. In the first display mode, positions of the virtual objects are maintained in the environment regardless of detected movements of the wearable extended reality appliance, and in the second display mode, the virtual objects move in the environment in response to detected movements of the wearable extended reality appliance. Movement of the wearable extended reality appliance may be detected. A selection of the first or second display mode may be received. Display signals configured to present the virtual objects in a manner consistent with the selected display mode may be outputted for presentation via the wearable extended reality appliance in response to the selected display mode.

Abstract: Methods, systems, apparatuses, and computer-readable media are provided for enabling collaboration between physical writers and virtual writers. In one implementation, the computer-readable medium includes instructions to cause a processor to receive, from an image sensor, image data representing a hand of a first physical writer holding a physical marking implement and engaging with a physical surface to create tangible markings. Information based on the image data is transmitted to a computing device associated with a second virtual writer, to thereby enable the second virtual writer to view the tangible markings created by the first physical writer. Annotation data are received from the computing device, and represent additional markings in relative locations with respect to the tangible markings created by the first physical writer. In response to receiving the annotation data, a wearable extended reality appliance overlays the physical surface with virtual markings in the relative locations.

Abstract: Systems, methods, and non-transitory computer readable media including instructions for selectively operating a wearable extended reality appliance are disclosed. Selectively operating the wearable extended reality appliance includes establishing a link between a wearable extended reality appliance and a keyboard device; receiving sensor data from at least one sensor associated with the wearable extended reality appliance, the sensor data being reflective of a relative orientation of the wearable extended reality appliance with respect to the keyboard device; based on the relative orientation, selecting from a plurality of operation modes a specific operation mode for the wearable extended reality appliance; identifying a user command based on at least one signal detected by the wearable extended reality appliance; and executing an action responding to the identified user command in a manner consistent with the selected operation mode.

Abstract: Methods, systems, apparatuses, and non-transitory computer-readable media are provided for tying virtual whiteboards to physical spaces. In one implementation, the computer-readable medium includes instructions to cause a processor to receive wirelessly, an indication of a location of a first wearable extended reality appliance; perform a lookup to determine that the location of the first wearable extended reality appliance corresponds to a location of a particular virtual whiteboard; transmit to the first wearable extended reality appliance, data corresponding to content of the particular virtual whiteboard; receive, during a first time period, virtual content added by a first user; receive wirelessly at a second time period an indication that a second wearable extended reality appliance is in the location of the particular virtual whiteboard; and transmit to the second wearable extended reality appliance, data corresponding to the content and the added content of the particular virtual whiteboard.

Abstract: Methods, systems, apparatuses, and non-transitory computer-readable media are provided for enabling gesture interaction with invisible virtual objects. In one implementation, the computer-readable medium includes instructions to cause a processor to receive image data captured by at least one image sensor of a wearable extended reality appliance in a field of view; display a plurality of virtual objects in a portion of the field of view; receive a selection of a specific physical object; receive a selection of a specific virtual object; dock the specific virtual object with the specific physical object; when the specific physical object and the specific virtual object are outside the portion of the field of view such that the specific virtual object is invisible to a user of the wearable extended reality appliance, receive a gesture input indicating interaction with the specific virtual object; and cause an output associated with the specific virtual object.

Abstract: Systems, methods, and non-transitory computer readable media configured for modifying the display of virtual objects docked to a movable input device are provided. In one implementation, the computer readable medium may be configured to receive image data from an image sensor, the image data representing an input device placed at a first location on a supporting surface. At least one processor may generate a presentation of at least one virtual object in proximity to the first location. Operations may include docking the at least one virtual object to the input device. The processor may determine that the input device is in a second location on the support surface. The virtual object presentation may be modified based on the second location. Operations may further include determining that the input device is in a third location removed from the support surface and modifying the virtual object presentation accordingly.

Abstract: An integrated computational interface device includes a housing, at least one image sensor, and a foldable protective cover. The housing has a key region and a non-key region, and a keyboard associated with the key region. The foldable protective cover incorporates the at least one image sensor. The protective cover is configured to be manipulated into a plurality of folding configurations, including a first folding configuration, wherein the protective cover is configured to encase the key region and at least a portion of the non-key region, and a second folding configuration, wherein the protective cover is configured to stand in a manner that causes an optical axis of the at least one image sensor to generally face a user of the integrated computational interface device while the user types on the keyboard.

Abstract: Systems, methods, and non-transitory computer readable media containing instructions for causing at least one processor to perform operations for determining a display configuration for presenting virtual content are provided. In one implementation, the processor is configured for receiving image data from an image sensor associated with a wearable extended reality appliance; analyzing the image data to detect a particular input device placed on a surface; determining a value of at least one use parameter for the particular input device; retrieving from memory default display settings associated with the particular input device; determining a display configuration for presenting virtual content based on the value of the at least one use parameter and the retrieved default display settings; and causing a presentation of the virtual content via the wearable extended reality appliance according to the determined display configuration.

Abstract: An integrated computational interface device may include a portable housing having a key region and a non-key region; a keyboard associated with the key region of the housing; and a holder associated with the non-key region of the housing. The holder may be configured for selective engagement with and disengagement from the wearable extended reality appliance, such that when the wearable extended reality appliance is selectively engaged with the housing via the holder, the wearable extended reality appliance is transportable with the housing.

Abstract: Methods, systems, apparatuses, and computer-readable media are provided for simulating user interactions with shared content. In one implementation, the computer-readable medium includes instructions to cause a processor to establish a communication channel for sharing content and user interactions; transmit to at least one second wearable extended reality appliance, first data, representing an object associated with first wearable extended reality appliance, enabling a virtual representation of the object to be displayed through the at least one second wearable extended reality appliance; receive image data from an image sensor associated with the first wearable extended reality appliance; detect in the image data at least one user interaction including a human hand pointing to a specific portion of the object; and transmit to the at least one second wearable extended reality appliance second data indicating an area of the specific portion of the object.

Abstract: Systems, methods, and non-transitory computer readable media for controlling perspective in an extended reality environment are disclosed.

Abstract: Disclosed are systems, methods, and non-transitory computer readable media for making virtual colored markings on objects. Instructions may include receiving an indication of an object; receiving from an image sensor an image of a hand of an individual holding a physical marking implement; detecting in the image a color associated with the marking implement; receiving from the image sensor image data indicative of movement of a tip of the marking implement and locations of the tip; determining from the image data when the locations of the tip correspond to locations on the object; and generating, in the detected color, virtual markings on the object at the corresponding locations.

Abstract: Systems, methods, and non-transitory computer readable media containing instructions for causing at least one processor to perform operations to enable cursor control in an extended reality space are provided. In one implementation, the processor is configured to perform operations comprising receiving from an image sensor first image data reflecting a first region of focus of a user of a wearable extended reality appliance; causing a first presentation of a virtual cursor in the first region of focus; receiving from the image sensor second image data reflecting a second region of focus of the user outside the initial field of view in the extended reality space; receiving input data indicative of a desire of the user to interact with the virtual cursor; and causing a second presentation of the virtual cursor in the second region of focus in response to the input data.

Abstract: An integrated computational interface device may include a portable housing having a key region and a non-key region; a keyboard associated with the key region of the housing; and a holder associated with the non-key region of the housing. The holder may be configured for selective engagement with and disengagement from the wearable extended reality appliance, such that when the wearable extended reality appliance is selectively engaged with the housing via the holder, the wearable extended reality appliance is transportable with the housing.