Abstract: Systems for transitioning a user interface arrangement from a display of a two-dimensional image of a user to a rendering of a three-dimensional representation of the user is provided. A system can start with a UI including a rendering of a user that is based on a 2D image file. The system can receive an input that is configured to cause the system to transition the display of the rendering of the 2D image of the select user to a rendering of the three-dimensional representation of the select user. To display the rendering of the 3D representation of the select user, the system uses permission data and a three-dimensional model defining a position and orientation to display the 3D representation of the user. The system allows users to switch between viewing modes to allow users to interact with content using the most effective type of hardware.

Abstract: A computing device spatially reconstructs a virtual feature surface in a mixed reality environment. The computing device detects addition of a raycast element to a virtual user space, maps multiple feature points detected from multiple video frames of a physical user space into a virtual user space, selecting at least three feature points from the multiple feature points that satisfy selection criteria applied in the virtual user space along a raycast axis of the raycast element in the virtual user space, and defines the virtual feature surface in the virtual user space using the at least three selected feature points. At least two of the at least three feature points are detected in different video frames.

Abstract: Annotation techniques are implemented in an augmented reality environment. A user is presented with a GUI configured to place three-dimensional virtual annotations in an environment displayed via the user's computing device. The GUI presents a central GUI element that is center-locked with respect to the environment displayed via the user's computing device. The central GUI element is coplanar to a detected surface of the environment on which the central GUI element is virtually located. The annotation may be a three-dimensional arrow. While viewing the environment, a preview of the three-dimensional arrow pointing towards the central GUI element is presented to the user. Upon providing user input, the arrow is placed on the detected surface. The user may provide additional input that rotates the three-dimensional arrow around the central GUI element before placing the arrow.

Abstract: Annotation techniques are implemented in an augmented reality environment. A user is presented with a GUI configured to place three-dimensional virtual annotations in an environment displayed via the user's computing device. The GUI presents a central GUI element that is center-locked with respect to the environment displayed via the user's computing device. The central GUI element is coplanar to a detected surface of the environment on which the central GUI element is virtually located. The annotation may be a three-dimensional arrow. While viewing the environment, a preview of the three-dimensional arrow pointing towards the central GUI element is presented to the user. Upon providing user input, the arrow is placed on the detected surface. The user may provide additional input that rotates the three-dimensional arrow around the central GUI element before placing the arrow.

Abstract: A computing device spatially reconstructs a virtual feature surface in a mixed reality environment. The computing device detects addition of a raycast element to a virtual user space, maps multiple feature points detected from multiple video frames of a physical user space into a virtual user space, selecting at least three feature points from the multiple feature points that satisfy selection criteria applied in the virtual user space along a raycast axis of the raycast element in the virtual user space, and defines the virtual feature surface in the virtual user space using the at least three selected feature points.

Abstract: A computing device spatially reconstructs a virtual feature surface in a mixed reality environment. The computing device detects addition of a raycast element to a virtual user space, maps multiple feature points detected from multiple video frames of a physical user space into a virtual user space, selecting at least three feature points from the multiple feature points that satisfy selection criteria applied in the virtual user space along a raycast axis of the raycast element in the virtual user space, and defines the virtual feature surface in the virtual user space using the at least three selected feature points.

Abstract: A computing device spatially reconstructs a virtual feature surface in a mixed reality environment. The computing device detects addition of a raycast element to a virtual user space, maps multiple feature points detected from multiple video frames of a physical user space into a virtual user space, selecting at least three feature points from the multiple feature points that satisfy selection criteria applied in the virtual user space along a raycast axis of the raycast element in the virtual user space, and defines the virtual feature surface in the virtual user space using the at least three selected feature points. At least two of the at least three feature points are detected in different video frames.