Abstract: The described technology includes a depth ray shader stored in memory and executable to receive a depth map defining a depth in association with each pixel in a three-dimensional scene and define a color gradient between a first pixel value and a second pixel value, wherein each sequential step in the color gradient between the first pixel value and the second pixel is assigned to a corresponding depth of increasing magnitude relative to a reference point. The depth ray shader is further executable to provide an instruction to a graphics engine to cause the graphics engine to apply a depth ray layer to a select portion of the three-dimensional scene, the depth ray layer altering each pixel in the selected portion to assume a pixel value defined within the color gradient to correspond to a depth of the pixel specified by the depth map.

Abstract: A system for automatically displaying virtual objects within a mixed reality environment is described. In some embodiments, a see-through head-mounted display device (HMD) identifies a real object (e.g., a person or book) within a field of view of the HMD, detects one or more interactions associated with real object, and automatically displays virtual objects associated with the real object if the one or more interactions involve touching or satisfy one or more social rules stored in a social rules database. The one or more social rules may be used to infer a particular social relationship by considering the distance to another person, the type of environment (e.g., at home or work), and particular physical interactions (e.g., handshakes or hugs). The virtual objects displayed on the HMD may depend on the particular social relationship inferred (e.g., a friend or acquaintance).

Abstract: The described technology includes a depth ray shader stored in memory and executable to receive a depth map defining a depth in association with each pixel in a three-dimensional scene and define a color gradient between a first pixel value and a second pixel value, wherein each sequential step in the color gradient between the first pixel value and the second pixel is assigned to a corresponding depth of increasing magnitude relative to a reference point. The depth ray shader is further executable to provide an instruction to a graphics engine to cause the graphics engine to apply a depth ray layer to a select portion of the three-dimensional scene, the depth ray layer altering each pixel in the selected portion to assume a pixel value defined within the color gradient to correspond to a depth of the pixel specified by the depth map.

Abstract: The described technology includes a depth ray shader stored in memory and executable to receive a depth map defining a depth in association with each pixel in a three-dimensional scene and define a color gradient between a first pixel value and a second pixel value, wherein each sequential step in the color gradient between the first pixel value and the second pixel is assigned to a corresponding depth of increasing magnitude relative to a reference point. The depth ray shader is further executable to provide an instruction to a graphics engine to cause the graphics engine to apply a depth ray layer to a select portion of the three-dimensional scene, the depth ray layer altering each pixel in the selected portion to assume a pixel value defined within the color gradient to correspond to a depth of the pixel specified by the depth map.

Abstract: The described technology includes a depth ray shader stored in memory and executable to receive a depth map defining a depth in association with each pixel in a three-dimensional scene and define a color gradient between a first pixel value and a second pixel value, wherein each sequential step in the color gradient between the first pixel value and the second pixel is assigned to a corresponding depth of increasing magnitude relative to a reference point. The depth ray shader is further executable to provide an instruction to a graphics engine to cause the graphics engine to apply a depth ray layer to a select portion of the three-dimensional scene, the depth ray layer altering each pixel in the selected portion to assume a pixel value defined within the color gradient to correspond to a depth of the pixel specified by the depth map.

Abstract: Techniques for managing transitions in a three-dimensional environment include rendering, on the displays, a first three-dimensional scene. An indication is received that the first three-dimensional scene is to be replaced with a second three-dimensional scene. Graphics data is received that is representative of a transition to the second three-dimensional scene. The first three-dimensional scene is transitioned to the second three-dimensional scene using the graphics data. Control of rendering the second three-dimensional scene is transitioned to a process configured to render the second three-dimensional scene.

Abstract: Techniques for managing transitions in a three-dimensional environment include rendering, on the displays, a first three-dimensional scene. An indication is received that the first three-dimensional scene is to be replaced with a second three-dimensional scene. Graphics data is received that is representative of a transition to the second three-dimensional scene. The first three-dimensional scene is transitioned to the second three-dimensional scene using the graphics data. Control of rendering the second three-dimensional scene is transitioned to a process configured to render the second three-dimensional scene.

Abstract: A computing system for managing product customization is provided. The computing system includes instructions stored in memory and executable by a processor to receive, for each of a plurality of parts of a 3D product, a color selection input specifying a color selected by a user for that part, responsive to receiving the color selection inputs, generate a color histogram of the 3D product including a plurality of units, each unit being associated with one of the parts and assigned the color of that part, where the number of units allocated to each part is based on a size of the part, and display the color histogram in a graphical user interface.

Abstract: A user interface includes a virtual object having an appearance in context with a real environment of a user using a see-through, near-eye augmented reality display device system. A virtual type of object and at least one real world object are selected based on compatibility criteria for forming a physical connection like attachment, supporting or integration of the virtual object with the at least one real object. Other appearance characteristics, e.g. color, size or shape, of the virtual object are selected for satisfying compatibility criteria with the selected at least one real object. Additionally, a virtual object type and appearance characteristics of the virtual object may be selected based on a social context of the user, a personal context of the user or both.

Abstract: A computing system for managing product customization is provided. The computing system includes instructions stored in memory and executable by a processor to receive, for each of a plurality of parts of a 3D product, a color selection input specifying a color selected by a user for that part, responsive to receiving the color selection inputs, generate a color histogram of the 3D product including a plurality of units, each unit being associated with one of the parts and assigned the color of that part, where the number of units allocated to each part is based on a size of the part, and display the color histogram in a graphical user interface.

Abstract: A system and method are provided that enhances a user's experience when using a see-through near eye display device. A user interface is provided for a user to manage single or simultaneous applications in a head mounted device. Applications for the head mounted device may be activated or deactivated by the user via the user-interface. The user's total field of view (TFOV) which accounts for a complete range of rotation and translation of the user's head may be determined by tracking the user's head position and rotation relative to the user's body and an environment associated with the user. One region of the user's TFOV (e.g., the right-hand side) may display an “application menu” including a list of applications that can be launched, and another region of the user's TFOV (e.g., the left-hand side) may display an “active menu” including a list of applications currently running.

Abstract: A system for automatically displaying virtual objects within a mixed reality environment is described. In some embodiments, a see-through head-mounted display device (HMD) identifies a real object (e.g., a person or book) within a field of view of the HMD, detects one or more interactions associated with real object, and automatically displays virtual objects associated with the real object if the one or more interactions involve touching or satisfy one or more social rules stored in a social rules database. The one or more social rules may be used to infer a particular social relationship by considering the distance to another person, the type of environment (e.g., at home or work), and particular physical interactions (e.g., handshakes or hugs). The virtual objects displayed on the HMD may depend on the particular social relationship inferred (e.g., a friend or acquaintance).

Abstract: A system for automatically displaying virtual objects within a mixed reality environment is described. In some embodiments, a see-through head-mounted display device (HMD) identifies a real object (e.g., a person or book) within a field of view of the HMD, detects one or more interactions associated with real object, and automatically displays virtual objects associated with the real object if the one or more interactions involve touching or satisfy one or more social rules stored in a social rules database. The one or more social rules may be used to infer a particular social relationship by considering the distance to another person, the type of environment (e.g., at home or work), and particular physical interactions (e.g., handshakes or hugs). The virtual objects displayed on the HMD may depend on the particular social relationship inferred (e.g., a friend or acquaintance).

Abstract: A see-through head-mounted display (HMD) device provides an augmented reality image which is associated with a real-world object, such as a picture frame, wall or billboard. Initially, the object is identified by a user, e.g., based on the user gazing at the object for a period of time, making a gesture such as pointing at the object and/or providing a verbal command. The location and visual characteristics of the object are determined by a front-facing camera of the HMD device, and stored in a record. The user selects from among candidate data streams, such as a web page, game feed, video or stocker ticker. Subsequently, when the user is in the location of the object and looks at the object, the HMD device matches the visual characteristics to the record to identify the data stream, and displays corresponding augmented reality images registered to the object.

Abstract: The technology provides embodiments for providing a location-based skin for a see-through, mixed reality display device system. In many embodiments, a location-based skin includes a virtual object viewable by a see-through, mixed reality display device system which has been detected in a specific location. Some location-based skins implement an ambient effect. The see-through, mixed reality display device system is detected to be present in a location and receives and displays a skin while in the location in accordance with user settings. User data may be uploaded and displayed in a skin in accordance with user settings. A location may be a physical space at a fixed position and may also be a space defined relative to a position of a real object, for example, another see-through, mixed reality display device system. Furthermore, a location may be a location within another location.

Abstract: A system for automatically displaying virtual objects within a mixed reality environment is described. In some embodiments, a see-through head-mounted display device (HMD) identifies a real object (e.g., a person or book) within a field of view of the HMD, detects one or more interactions associated with real object, and automatically displays virtual objects associated with the real object if the one or more interactions involve touching or satisfy one or more social rules stored in a social rules database. The one or more social rules may be used to infer a particular social relationship by considering the distance to another person, the type of environment (e.g., at home or work), and particular physical interactions (e.g., handshakes or hugs). The virtual objects displayed on the HMD may depend on the particular social relationship inferred (e.g., a friend or acquaintance).