Abstract: Examples disclosed herein relate to providing a location-based holographic experience. One example provides a head-mounted display device comprising a see-through display, one or more position sensors, a logic subsystem, and a storage subsystem comprising instructions executable by the logic subsystem to obtain data representing a plurality of holographic objects, acquire sensor data via the one or more position sensors to monitor a position of the head-mounted display device along a path of a holographic experience, detect that the position of the head-mounted display device meets a first position-based condition regarding a first holographic object, and display the first holographic object at a corresponding location for the first holographic object.

Abstract: In various embodiments, methods and systems for rendering augmented reality objects based on user heights are provided. Height data of a user of an augmented reality device can be determined. The height data relates to a viewing perspective from an eye level of the user. Placement data for a first augmented reality object is generated based on the user height data. The first augmented reality object is rendered based on the user height data, and a second augmented reality object is excluded from rendering based on the user height data.

Abstract: A wearable, head-mounted display system includes a near-eye display to display an augmented reality object perceivable at an apparent real world depth and an apparent real world location by a wearer of the head-mounted display system, and a controller to adjust the apparent real world location of the augmented reality object as a function of a field of view (FOV) of the wearer. The function is based on a bounding region of the augmented reality object and one or more overlap parameters between the bounding region of the augmented reality object and the FOV of the wearer.

Abstract: A head-mounted display (HMD) device may include an at least partially see-through display, one or more location sensors, a communication unit, and a processor. The HMD device may determine at least a location of the one or more location sensors in a physical environment. The communication unit may receive peer location data from at least one peer HMD device in the physical environment. The processor of the HMD device may determine a field of view of the HMD device, identify a display position at which the augmented reality image can be displayed and viewed in the physical environment by the HMD device and the at least one peer HMD device, and display the augmented reality image at the display position on the at least partially see-through display of the HMD device.

Abstract: Content from a user computing device may be transmitted to at least one recipient computing device. A plurality of avatars is displayed that each represent different recipients associated with recipient computing devices. A group communication session is established among the user computing device and the recipient computing devices. During the group communication session: initial content is transmitted from the user computing device to each recipient computing device; based on determining that the user is gazing at a selected avatar, a private communication session is established between the user computing device and the recipient computing device associated with the selected avatar. During the private communication session, subsequent content is transmitted from the user computing device to such recipient computing device, and is not transmitted to the other recipient computing devices.

Abstract: Examples are disclosed herein that relate to displaying image data configured to appear behind a real-world surface. One example provides, on a computing device including a display, a method including obtaining depth data representing a real-world scene, identifying a real-world surface of the real-world scene via the depth data, obtaining volumetric image data and surface image data, the volumetric image data configured to appear as being located in a volume behind the real-world surface, receiving a user input configured to remove an area of surface image data corresponding spatially to the real-world surface, and displaying at least a portion of the volumetric image data in a region in which the area of surface image data was removed.

Abstract: Disclosed is a self-contained, pluggable tracking system that monitors six degree of freedom (“6DoF”) without external apparatus, e.g., visual tracking or magnetic. The tracking core can communicate with a host device and with an external computing device. The external computing device can display a virtual (“VR”) or augmented reality (“AR”) world. The VR or AR world may be supplemented by overlay displays positioned according to the shape of the host device as tracked by the tracking core.

Abstract: A head-mounted display (HMD) device may include an at least partially see-through display, one or more location sensors, a communication unit, and a processor. The HMD device may determine at least a location of the one or more location sensors in a physical environment. The communication unit may receive peer location data from at least one peer HMD device in the physical environment. The processor of the HMD device may determine a field of view of the HMD device, identify a display position at which the augmented reality image can be displayed and viewed in the physical environment by the HMD device and the at least one peer HMD device, and display the augmented reality image at the display position on the at least partially see-through display of the HMD device.

Abstract: A head mounted display device and method for contextual cursors comprising a camera configured to capture a series of images, a display, and a processor configured to: display, to a user of the head mounted display device, a virtual cursor on display so as to appear at a location in a three dimensional environment, determine whether motion of a hand of the user in the images is trackable, and in response to at least determining that motion of the hand is trackable, modify a visual appearance of the virtual cursor to indicate that motion of the hand is trackable, and in response to at least determining that motion of the hand is not trackable, modify the visual appearance of the virtual cursor to indicate that motion of the hand is not trackable.

Abstract: A head-mounted display (HMD) device may include an at least partially see-through display, one or more location sensors, a communication unit, and a processor. The HMD device may determine at least a location of the one or more location sensors in a physical environment. The communication unit may receive peer location data from at least one peer HMD device in the physical environment. The processor of the HMD device may determine a field of view of the HMD device, identify a display position at which the augmented reality image can be displayed and viewed in the physical environment by the HMD device and the at least one peer HMD device, and display the augmented reality image at the display position on the at least partially see-through display of the HMD device.

Abstract: Examples disclosed herein relate to providing a location-based holographic experience. One example provides a head-mounted display device comprising a see-through display, one or more position sensors, a logic subsystem, and a storage subsystem comprising instructions executable by the logic subsystem to obtain data representing a plurality of holographic objects, acquire sensor data via the one or more position sensors to monitor a position of the head-mounted display device along a path of a holographic experience, detect that the position of the head-mounted display device meets a first position-based condition regarding a first holographic object, and display the first holographic object at a corresponding location for the first holographic object.

Abstract: In various embodiments, methods and systems for rendering augmented reality objects based on user heights are provided. Height data of a user of an augmented reality device can be determined. The height data relates to a viewing perspective from an eye level of the user. Placement data for a first augmented reality object is generated based on the user height data. The first augmented reality object is rendered based on the user height data, and a second augmented reality object is excluded from rendering based on the user height data.

Abstract: Examples disclosed herein relate to providing a location-based holographic experience. One example provides a head-mounted display device comprising a see-through display, one or more position sensors, a logic subsystem, and a storage subsystem comprising instructions executable by the logic subsystem to obtain data representing a plurality of holographic objects, acquire sensor data via the one or more position sensors to monitor a position of the head-mounted display device along a path of a holographic experience, detect that the position of the head-mounted display device meets a first position-based condition regarding a first holographic object, and display the first holographic object at a corresponding location for the first holographic object.

Abstract: In various embodiments, methods and systems for implementing integrated free space and surface inputs are provided. An integrated free space and surface input system includes a mixed-input pointing device for interacting and controlling interface objects using free space inputs and surface inputs, trigger buttons, pressure sensors, and haptic feedback associated with the mixed-input pointing device. Free space movement data and surface movement data are tracked and determined for the mixed-input pointing device. An interface input is detected for the mixed-input pointing device transitioning from a first input to a second input, such as, from a free space input to a surface input or from the surface input to the free space input. The interface input is processed based on accessing the free space movement data and the surface movement data. An output for the interface input is communicated from the mixed-input pointing device to interact and control an interface.

Abstract: A method for operating a head-mounted computing device that includes displaying an image of an environment on a display of the head-mounted computing device and identifying a surface within the image that is eligible for color fill operation, based on similarities in color parameters of contiguous pixels in the captured image. The method further includes displaying an indicator prompting user input regarding color fill, receiving a color fill request via user input, the request being for a predetermined color, and performing a color fill operation on the identified surface in response to receiving the color fill request by (a) generating a fill image having the predetermined color and a shape that conforms to the shape of the identified surface, and (b) displaying the fill image in a world-locked manner so as to overlay the identified surface even when a perspective of the display changes.

Abstract: In various embodiments, methods and systems for rendering augmented reality objects based on user heights are provided. Height data of a user of an augmented reality device can be determined. The height data relates to a viewing perspective from an eye level of the user. Placement data for an augmented reality object is generated based on a constraint configuration that is associated with the augmented reality object for user-height-based rendering. The constraint configuration includes rules that support generating placement data for rendering augmented reality objects based on the user height data. The augmented reality object is rendered based on the placement data. Augmented reality objects are rendered in a real world scene, such that, the augmented reality object is personalized for each user during an augmented reality experience. In shared experiences, with multiple users viewing a single augmented reality object, the object can be rendered based on a particular user's height.

Abstract: A conferencing system includes a display device that displays video received from a remote communication device of a communication partner. An audio stream is transmitted to the remote communication device. The audio stream includes real-world sounds produced by one or more real-world audio sources captured by a microphone array and virtual sounds produced by one or more virtual audio sources. A relative volume of sounds in the audio stream is selectively adjusted based, at least in part, on real-world positioning of corresponding audio sources, including real-world and/or virtualized audio sources.

Abstract: Examples of providing feedback regarding a scan of a three-dimensional object are described. In one example, a method of computer modeling a three-dimensional object includes computer-tracking a three-dimensional pose of a scanning device relative to the three-dimensional object as the three-dimensional pose of the scanning devices changes to measure different contours of the three-dimensional object from different vantage points, and assessing a sufficiency of contour measurements from one or more of the different vantage points based on measurements received from the scanning device. The example method further includes providing haptic feedback, via a haptic output device, indicating the sufficiency of contour measurements corresponding to a current three-dimensional pose of the scanning device.

Abstract: Disclosed is a self-contained, pluggable tracking system that monitors six degree of freedom (“6DoF”) without external apparatus, e.g., visual tracking or magnetic. The tracking core can communicate with a host device and with an external computing device. The external computing device can display a virtual (“VR”) or augmented reality (“AR”) world. The VR or AR world may be supplemented by overlay displays positioned according to the shape of the host device as tracked by the tracking core.

Abstract: A method for operating a computing device is described herein. The method includes determining a user's gaze direction based on a gaze input, determining an intersection between the user's gaze direction and an identified environmental surface in a 3-dimensional environment, and generating a drawing surface based on the intersection within a user interface on a display.