Abstract: Content from a user computing device may be transmitted to at least one recipient computing device. A plurality of avatars is displayed that each represent different recipients associated with recipient computing devices. A group communication session is established among the user computing device and the recipient computing devices. During the group communication session: initial content is transmitted from the user computing device to each recipient computing device; based on determining that the user id gazing at a selected avatar, a private communication session is established between the user computing device and the recipient computing device associated with the selected avatar. During the private communication session, subsequent content is transmitted from the user computing device to such recipient computing device, and is not transmitted to the other recipient computing devices.

Abstract: Examples of providing feedback regarding a scan of a three-dimensional object are described. In one example, a method of computer modeling a three-dimensional object includes computer-tracking a three-dimensional pose of a scanning device relative to the three-dimensional object as the three-dimensional pose of the scanning devices changes to measure different contours of the three-dimensional object from different vantage points, and assessing a sufficiency of contour measurements from one or more of the different vantage points based on measurements received from the scanning device. The example method further includes providing haptic feedback, via a haptic output device, indicating the sufficiency of contour measurements corresponding to a current three-dimensional pose of the scanning device.

Abstract: In various embodiments, methods and systems for implementing integrated free space and surface inputs are provided. An integrated free space and surface input system includes a mixed-input pointing device for interacting and controlling interface objects using free space inputs and surface inputs, trigger buttons, pressure sensors, and haptic feedback associated with the mixed-input pointing device. Free space movement data and surface movement data are tracked and determined for the mixed-input pointing device. An interface input is detected for the mixed-input pointing device transitioning from a first input to a second input, such as, from a free space input to a surface input or from the surface input to the free space input. The interface input is processed based on accessing the free space movement data and the surface movement data. An output for the interface input is communicated from the mixed-input pointing device to interact and control an interface.

Abstract: In various embodiments, methods and systems for rendering augmented reality objects based on user heights are provided. Height data of a user of an augmented reality device can be determined. The height data relates to a viewing perspective from an eye level of the user. Placement data for an augmented reality object is generated based on a constraint configuration that is associated with the augmented reality object for user-height-based rendering. The constraint configuration includes rules that support generating placement data for rendering augmented reality objects based on the user height data. The augmented reality object is rendered based on the placement data. Augmented reality objects are rendered in a real world scene, such that, the augmented reality object is personalized for each user during an augmented reality experience. In shared experiences, with multiple users viewing a single augmented reality object, the object can be rendered based on a particular user's height.

Abstract: A head-mounted display (HMD) device may include an at least partially see-through display, one or more location sensors, a communication unit, and a processor. The HMD device may determine at least a location of the one or more location sensors in a physical environment. The communication unit may receive peer location data from at least one peer HMD device in the physical environment. The processor of the HMD device may determine a field of view of the HMD device, identify a display position at which the augmented reality image can be displayed and viewed in the physical environment by the HMD device and the at least one peer HMD device, and display the augmented reality image at the display position on the at least partially see-through display of the HMD device.

Abstract: A head-mounted display includes a visible-light camera configured to collect a visible-light image of a physical space, a surface sensor configured to measure one or more surface parameters of the physical space, a see-through display configured to visually present an augmentation image while light from the physical space passes through the see-through display to a user eye, and an augmented-reality engine. The augmented-reality engine may be configured to identify a surface of the physical space from the one or more measured surface parameters, compose a mixed-reality image that includes the augmentation image overlaid on the visible-light image, and visually present, via the see-through display, the mixed-reality image in alignment with the identified surface.

Abstract: Examples disclosed herein relate to providing a location-based holographic experience. One example provides a head-mounted display device comprising a see-through display, one or more position sensors, a logic subsystem, and a storage subsystem comprising instructions executable by the logic subsystem to obtain data representing a plurality of holographic objects, acquire sensor data via the one or more position sensors to monitor a position of the head-mounted display device along a path of a holographic experience, detect that the position of the head-mounted display device meets a first position-based condition regarding a first holographic object, and display the first holographic object at a corresponding location for the first holographic object.

Abstract: A user device for generating a scene, the user device comprising: an object determiner configured to determine an object for the scene, the object being associated with at least one audio signal; a relative position/orientation determiner configured to determine a relative position/orientation between the user device's user and the object; an audio position processor configured to spatially audio signal process the at least one audio signal to generate at least two channel audio signal based on the relative position/orientation.

Abstract: A method for operating a head-mounted computing device that includes displaying an image of an environment on a display of the head-mounted computing device and identifying a surface within the image that is eligible for color fill operation, based on similarities in color parameters of contiguous pixels in the captured image. The method further includes displaying an indicator prompting user input regarding color fill, receiving a color fill request via user input, the request being for a predetermined color, and performing a color fill operation on the identified surface in response to receiving the color fill request by (a) generating a fill image having the predetermined color and a shape that conforms to the shape of the identified surface, and (b) displaying the fill image in a world-locked manner so as to overlay the identified surface even when a perspective of the display changes.

Abstract: A method for operation a head-mounted computing device that includes capturing an image of a three-dimensional environment external to the head-mounted computing device and identifying a surface within the captured image that is eligible for color fill operation, based on similarities in color parameters of contiguous pixels in the captured image. The method further includes receiving a color fill request via user input at the head-mounted computing device, the request being for a predetermined color and performing a color fill operation on the identified surface in response to receiving the color fill request by (a) generating a fill hologram having the predetermined color and a shape that conforms to the shape of the identified surface, (b) displaying the fill hologram in a world-locked manner so as to overlay the identified surface as viewed through the see-through holographic display of the head-mounted display device.

Abstract: A conferencing system includes a display device that displays video received from a remote communication device of a communication partner. An audio stream is transmitted to the remote communication device. The audio stream includes real-world sounds produced by one or more real-world audio sources captured by a microphone array and virtual sounds produced by one or more virtual audio sources. A relative volume of sounds in the audio stream is selectively adjusted based, at least in part, on real-world positioning of corresponding audio sources, including real-world and/or virtualized audio sources.

Abstract: Examples are disclosed herein that relate to displaying image data configured to appear behind a real-world surface. One example provides, on a computing device including a display, a method including obtaining depth data representing a real-world scene, identifying a real-world surface of the real-world scene via the depth data, obtaining volumetric image data and surface image data, the volumetric image data configured to appear as being located in a volume behind the real-world surface, receiving a user input configured to remove an area of surface image data corresponding spatially to the real-world surface, and displaying at least a portion of the volumetric image data in a region in which the area of surface image data was removed.

Abstract: A conferencing system includes a near-eye display device that displays video received from a remote communication device of a communication partner. An audio stream is transmitted to the remote communication device. The audio stream includes real-world sounds produced by one or more real-world audio sources captured by a spatially-diverse microphone array and virtual sounds produced by one or more virtual audio sources. A relative volume of background sounds in the audio stream is selectively reduced based, at least in part, on real-world positioning of corresponding audio sources, including real-world and/or virtualized audio sources.

Abstract: A head mounted display device and method for contextual cursors comprising a camera configured to capture a series of images, a display, and a processor configured to: display, to a user of the head mounted display device, a virtual cursor on display so as to appear at a location in a three dimensional environment, determine whether motion of a hand of the user in the images is trackable, and in response to at least determining that motion of the hand is trackable, modify a visual appearance of the virtual cursor to indicate that motion of the hand is trackable, and in response to at least determining that motion of the hand is not trackable, modify the visual appearance of the virtual cursor to indicate that motion of the hand is not trackable.

Abstract: A head-mounted display includes a visible-light camera configured to collect a visible-light image of a physical space, a surface sensor configured to measure one or more surface parameters of the physical space, a see-through display configured to visually present an augmentation image while light from the physical space passes through the see-through display to a user eye, and an augmented-reality engine. The augmented-reality engine may be configured to identify a surface of the physical space from the one or more measured surface parameters, compose a mixed-reality image that includes the augmentation image overlaid on the visible-light image, and visually present, via the see-through display, the mixed-reality image in alignment with the identified surface.

Abstract: A method for operation a head-mounted computing device that includes capturing an image of a three-dimensional environment external to the head-mounted computing device and identifying a surface within the captured image that is eligible for color fill operation, based on similarities in color parameters of contiguous pixels in the captured image. The method further includes receiving a color fill request via user input at the head-mounted computing device, the request being for a predetermined color and performing a color fill operation on the identified surface in response to receiving the color fill request by (a) generating a fill hologram having the predetermined color and a shape that conforms to the shape of the identified surface, (b) displaying the fill hologram in a world-locked manner so as to overlay the identified surface as viewed through the see-through holographic display of the head-mounted display device.

Abstract: A conferencing system includes a near-eye display device that displays video received from a remote communication device of a communication partner. An audio stream is transmitted to the remote communication device. The audio stream includes real-world sounds produced by one or more real-world audio sources captured by a spatially-diverse microphone array and virtual sounds produced by one or more virtual audio sources. A relative volume of background sounds in the audio stream is selectively reduced based, at least in part, on real-world positioning of corresponding audio sources, including real-world and/or virtualized audio sources.

Abstract: A method for operating a computing device is described herein. The method includes determining a user's gaze direction based on a gaze input, determining an intersection between the user's gaze direction and an identified environmental surface in a 3-dimensional environment, and generating a drawing surface based on the intersection within a user interface on a display.

Abstract: A user device has a display, a user interface and a network interface. The network interface receive a video data stream from another user interface. A user of the user device is able to pause the video stream. The paused image of the video stream and the video stream are both displayed on the display. The user is able to annotate the paused image.

Abstract: A wearable, head-mounted display system includes a near-eye display to display an augmented reality object perceivable at an apparent real world depth and an apparent real world location by a wearer of the head-mounted display system, and a controller to adjust the apparent real world location of the augmented reality object as a function of a field of view (FOV) of the wearer. The function is based on a bounding region of the augmented reality object and one or more overlap parameters between the bounding region of the augmented reality object and the FOV of the wearer.