Abstract: A method performed by a virtual reality (VR) head mounted device (HMD) includes displaying, by a display of the HMD, a VR environment, obtaining, by a processor of the HMD, a video feed of an external environment from an exterior-facing camera of the HMD, and determining, by the processor, to activate one of a plurality of pass-through modes for the video feed based on at least one of a user input or a state of the external environment, wherein the plurality of pass-through modes have different transparencies, different resolutions, or both. The method further includes rendering, by the processor based on the activated pass-through mode, the video feed for overlay onto at least a portion of the VR environment, and displaying, by the display, the rendered video feed overlaid onto the portion of the VR environment.

Abstract: A method includes obtaining real-time video captured using one or more imaging sensors of an immersive headset. The method also includes processing the real-time video to identify one or more real-world objects and render the one or more real-world objects on at least one display of the immersive headset. The method further includes allowing a user of the immersive headset to select at least one of the one or more real-world objects or at least one spatial volume containing the at least one real-world object. The method still further includes displaying an extended reality view on the at least one display while overlaying, on the extended reality view, a representation of at least a portion of the at least one real-world object or the at least one spatial volume in one of multiple modes that each show the representation differently.

Abstract: A method includes rendering a semi-transparent or opaque board on a display of an XR headset, such that the board does not overlap with at least one real-world object. The method also includes receiving a first user input to open a widget library. The method also includes rendering a grid structure on the board after receiving the first user input. The method also includes receiving a second user input to select a widget from the widget library. The method also includes receiving a third user input to move the selected widget to the grid structure on the board. The method also includes placing the selected widget at a position in the grid structure on the board. The method also includes stopping rendering the grid structure, while displaying the selected widget at the position on the board, with an orientation determined based at least partly on a user's head position.

Abstract: A method includes rendering a virtual widget at a first position in an extended reality (XR) space using a head-mounted display. The method also includes detecting a hand gesture of a user at a second position in the XR space using at least one optical sensor. The second position is between the first position and the optical sensor. The method further includes determining a duration of the hand gesture and a distance between the first and second positions. The method also includes performing a first or second type of action based on the duration and/or the distance. The first type of action corresponds to a system-level control of the virtual widget, and the second type of action corresponds to a content-level control of the virtual widget. In addition, the method includes rendering a visual and/or audio feedback based on at least one of the duration or the distance.

Abstract: A system for providing an image on a display is disclosed. The system may include a scaler chip. The scaler chip may be configured to receive video data. The scaler chip may be configured to receive eye tracking data. The scaler chip may be configured to cause a display to present an image, where the image is based on the video data and the eye tracking data.

Abstract: A system for providing an image on a display is disclosed. The system may include a scaler chip. The scaler chip may be configured to receive video data. The scaler chip may be configured to receive eye tracking data. The scaler chip may be configured to cause a display to present an image, where the image is based on the video data and the eye tracking data.