Abstract: Systems for transitioning a user interface arrangement from a display of a two-dimensional image of a user to a rendering of a three-dimensional representation of the user is provided. A system can start with a UI including a rendering of a user that is based on a 2D image file. The system can receive an input that is configured to cause the system to transition the display of the rendering of the 2D image of the select user to a rendering of the three-dimensional representation of the select user. To display the rendering of the 3D representation of the select user, the system uses permission data and a three-dimensional model defining a position and orientation to display the 3D representation of the user. The system allows users to switch between viewing modes to allow users to interact with content using the most effective type of hardware.

Abstract: Systems for transitioning a user interface arrangement from a display of a two-dimensional image of a user to a rendering of a three-dimensional representation of the user is provided. A system can start with a UI including a rendering of a user that is based on a 2D image file. The system can receive an input that is configured to cause the system to transition the display of the rendering of the 2D image of the select user to a rendering of the three-dimensional representation of the select user. To display the rendering of the 3D representation of the select user, the system uses permission data and a three-dimensional model defining a position and orientation to display the 3D representation of the user. The system allows users to switch between viewing modes to allow users to interact with content using the most effective type of hardware.

Abstract: Systems for transitioning a user interface arrangement from a display of a two-dimensional image of a user to a rendering of a three-dimensional representation of the user is provided. A system can start with a UI including a rendering of a user that is based on a 2D image file. The system can receive an input that is configured to cause the system to transition the display of the rendering of the 2D image of the select user to a rendering of the three-dimensional representation of the select user. To display the rendering of the 3D representation of the select user, the system uses permission data and a three-dimensional model defining a position and orientation to display the 3D representation of the user. The system allows users to switch between viewing modes to allow users to interact with content using the most effective type of hardware.

Abstract: A method for operating a head-mounted computing device that includes displaying an image of an environment on a display of the head-mounted computing device and identifying a surface within the image that is eligible for color fill operation, based on similarities in color parameters of contiguous pixels in the captured image. The method further includes displaying an indicator prompting user input regarding color fill, receiving a color fill request via user input, the request being for a predetermined color, and performing a color fill operation on the identified surface in response to receiving the color fill request by (a) generating a fill image having the predetermined color and a shape that conforms to the shape of the identified surface, and (b) displaying the fill image in a world-locked manner so as to overlay the identified surface even when a perspective of the display changes.

Abstract: A method for operating a head-mounted computing device that includes displaying an image of an environment on a display of the head-mounted computing device and identifying a surface within the image that is eligible for color fill operation, based on similarities in color parameters of contiguous pixels in the captured image. The method further includes displaying an indicator prompting user input regarding color fill, receiving a color fill request via user input, the request being for a predetermined color, and performing a color fill operation on the identified surface in response to receiving the color fill request by (a) generating a fill image having the predetermined color and a shape that conforms to the shape of the identified surface, and (b) displaying the fill image in a world-locked manner so as to overlay the identified surface even when a perspective of the display changes.

Abstract: A method for operation a head-mounted computing device that includes capturing an image of a three-dimensional environment external to the head-mounted computing device and identifying a surface within the captured image that is eligible for color fill operation, based on similarities in color parameters of contiguous pixels in the captured image. The method further includes receiving a color fill request via user input at the head-mounted computing device, the request being for a predetermined color and performing a color fill operation on the identified surface in response to receiving the color fill request by (a) generating a fill hologram having the predetermined color and a shape that conforms to the shape of the identified surface, (b) displaying the fill hologram in a world-locked manner so as to overlay the identified surface as viewed through the see-through holographic display of the head-mounted display device.

Abstract: A method for operation a head-mounted computing device that includes capturing an image of a three-dimensional environment external to the head-mounted computing device and identifying a surface within the captured image that is eligible for color fill operation, based on similarities in color parameters of contiguous pixels in the captured image. The method further includes receiving a color fill request via user input at the head-mounted computing device, the request being for a predetermined color and performing a color fill operation on the identified surface in response to receiving the color fill request by (a) generating a fill hologram having the predetermined color and a shape that conforms to the shape of the identified surface, (b) displaying the fill hologram in a world-locked manner so as to overlay the identified surface as viewed through the see-through holographic display of the head-mounted display device.

Abstract: Examples are disclosed herein that relate to sharing of depth-referenced markup in image data. One example provides, on a computing device, a method comprising receiving image data of a real world scene and depth data of the real world scene. The method further includes displaying the image data, receiving an input of a markup to the image data, and associating the markup with a three-dimensional location in the real world scene based on the depth data. The method further comprises sending the markup and the three-dimensional location associated with the markup to another device.

Abstract: A system and method are disclosed relating to a pipeline for generating a computer model of a target user, including a hand model of the user's hands, captured by an image sensor in a NUI system. The computer model represents a best estimate of the position of a user's hand or hands and whether the hand or hand is in an open or closed state. The generated hand model may be used by a gaming or other application to determine such things as user gestures and control actions.

Abstract: A system and method are disclosed relating to a pipeline for generating a computer model of a target user, including a hand model of the user's hands and fingers, captured by an image sensor in a NUI system. The computer model represents a best estimate of the position and orientation of a user's hand or hands. The generated hand model may be used by a gaming or other application to determine such things as user gestures and control actions.

Abstract: A system and method are disclosed relating to a pipeline for generating a computer model of a target user, including a hand model of the user's hands and fingers, captured by an image sensor in a NUI system. The computer model represents a best estimate of the position and orientation of a user's hand or hands. The generated hand model may be used by a gaming or other application to determine such things as user gestures and control actions.

Abstract: A system and method are disclosed relating to a pipeline for generating a computer model of a target user, including a hand model of the user's hands, captured by an image sensor in a NUI system. The computer model represents a best estimate of the position of a user's hand or hands and whether the hand or hand is in an open or closed state. The generated hand model may be used by a gaming or other application to determine such things as user gestures and control actions.