Abstract: A device has a display, a first camera, a second camera and a virtual gesture application. The first camera generates an image that depicts a physical object. The second camera tracks a position of a stare of a user. The virtual gesture application identifies the physical object using the image, generates a virtual object corresponding to the identified physical object, renders the virtual object in the display based a position of the display relative to the physical object, identifies an area in the display corresponding to the position of the stare of the user, determines that an interactive feature of the virtual object is located inside the area, and performs at least one action on the interactive feature in response to determining that the interactive feature is located inside the area.

Abstract: A head-mounted display (HMD) system includes an HMD device worn on a head of a user. The HMD device incorporates electroencephalography (EEG) interfaces for monitoring the brain of the human subject during interaction with the HMD device. Fluctuations in electrical potential that are observed via the EEG interfaces may be used to detect event-related potentials (ERPs). The HMD system may programmatically perform one or more operations in response to detecting ERPs.

Abstract: An optical device includes a range of angularly selective reflectors are contained within an optical waveguide substrate and substantially optimized according to their reflector order within the sequence of reflectors. This configuration of reflectors ensures that the required angular information is passed through to the correct reflector within the sequence. The angular response in addition reduces or eliminates formation of secondary images carried to successive reflectors, resulting in undesired artefacts.

Abstract: Interface-based modeling and design of three dimensional spaces using two dimensional representations are provided herein. An example method includes converting a three dimensional space into a two dimensional space using a map projection schema, where the two dimensional space is bounded by ergonomic limits of a human, and the two dimensional space is provided as an ergonomic user interface, receiving an anchor position within the ergonomic user interface that defines a placement of an asset relative to the three dimensional space when the two dimensional space is re-converted back to a three dimensional space, and re-converting the two dimensional space back into the three dimensional space for display along with the asset, within an optical display system.

Abstract: An augmented reality (AR) display application generates mapped visualization content overlaid on a real world physical environment. The AR display application receives sensor feeds, location information, and orientation information from wearable devices within the environment. A tessellation surface is visually mapped to surfaces of the environment based on a depth-based point cloud. A texture is applied to the tessellation surface and the tessellation may be viewed overlaying the surfaces of the environment via a wearable device.

Abstract: An optical device includes a range of angularly selective reflectors are contained within an optical waveguide substrate and substantially optimized according to their reflector order within the sequence of reflectors. This configuration of reflectors ensures that the required angular information is passed through to the correct reflector within the sequence. The angular response in addition reduces or eliminates formation of secondary images carried to successive reflectors, resulting in undesired artefacts.

Abstract: Interface-based modeling and design of three dimensional spaces using two dimensional representations are provided herein. An example method includes converting a three dimensional space into a two dimensional space using a map projection schema, where the two dimensional space is bounded by ergonomic limits of a human, and the two dimensional space is provided as an ergonomic user interface, receiving an anchor position within the ergonomic user interface that defines a placement of an asset relative to the three dimensional space when the two dimensional space is re-converted back to a three dimensional space, and re-converting the two dimensional space back into the three dimensional space for display along with the asset, within an optical display system.

Abstract: An augmented reality display device (such as a head mounted device) includes a partially transparent and partially reflective lens, a laser light source, a radio frequency source, a display controller, an acousto-optical modulator, and a microelectromechanical (MEMS) device. The laser light source generates light. The radio frequency (RF) source generates a RF signal. The display controller generates a synchronization signal. The acousto-optical modulator receives at least a portion of the light, modulates the light based on the RF signal, and provides modulated light. The MEMS device receives the synchronization signal from the display controller and reflects the modulated light towards the partially transparent and partially reflective lens.

Abstract: A first display device determines a first device configuration of the first display device and a first context of a first AR application operating on the first display device. The first display device detects a second display device that comprises a head up display (HUD) system of a vehicle. A second device configuration of the second display device and a second context of a second AR application operating on the second display device are determined. The first display device generates a first collaboration configuration for the first display device and a second collaboration configuration for the second display device. A task of the first AR application is allocated to the second AR application based on the first collaboration configuration. The second display device performs the allocated task based on the second collaboration configuration.

Abstract: A wearable computing device includes various biometric sensors for recording biometric measurements of a user wearing the wearable computing device. The wearable computing device is further configured to interpret the biometric measurements as commands to be performed. The wearable computing device also includes modules and logic that determine whether the biometric measurements were voluntary or involuntary movements by the user, which indicate whether the user intended such biometric measurements to be input to the wearable computing device. Where the biometric measurements indicate that the user's movements and/or gestures were voluntary, the wearable computing device is configured to further classify and analyze the biometric measurements. This classification and analysis yields the different types of actions and objects the user was engaged in or acting on at the time the biometric measurements were obtained.

Abstract: An optical device includes a range of angularly selective reflectors are contained within an optical waveguide substrate and substantially optimized according to their reflector order within the sequence of reflectors. This configuration of reflectors ensures that the required angular information is passed through to the correct reflector within the sequence. The angular response in addition reduces or eliminates formation of secondary images carried to successive reflectors, resulting in undesired artefacts.

Abstract: An augmented-reality device comprises an optical sensor and a transparent display. The augmented-reality device detects, using the optical sensor, a first physical display located within a display distance of the augmented-reality device. The first physical display is connected to a computer. The augmented-reality device generates a virtual display configured to operate as a second physical display. The computer controls the second physical display. The augmented-reality device displays the virtual display in the transparent display. The virtual display appears adjacent to the first physical display.

Abstract: A device for multi-spectrum segmentation for computer vision is described. A first optical sensor operates within a first spectrum range and generates first image data corresponding to a first image captured by the first optical sensor. A second optical sensor operates within a second spectrum range different from the first spectrum range and generates second image data corresponding to a second image captured by the second optical sensor. The device identifies a first region in the first image, maps a first portion of the first image to a second portion of the second image data, provides the second portion of the second image data to a server that generates augmented reality content based on the second portion of the second image data. The device displays the augmented reality content.

Abstract: A first augmented-reality (AR) device comprises an optical sensor, a geographic location sensor, an orientation sensor, and a display. The first AR device accesses a first geographic location of the first AR device and an orientation of the first AR device and generates a picture taken at the first geographic location of the first AR device and associated with the orientation of the first AR device. The first AR device retrieves, from a server, transportation information from a second AR device in a vehicle. The server assigns the second AR device to the first AR device. The first AR device forms transportation AR content based on the transportation information and displays the transportation AR content in the display based on the first geographic location and orientation of the first AR device, the transportation information, and the picture generated at the first geographic location of the first AR device.

Abstract: Techniques of augmented reality device calibration are disclosed. In some example embodiments, a system calibrates a visual inertial navigation (VIN) camera of a head mounted display (HMD) device with at least one eye camera of the HMD device to generate multi-camera calibration parameters, calibrating the at eye camera(s) with a display module of the HMD to generate display calibration parameters, calibrating the IMU with the VIN camera to generate VIN calibration parameters, and calibrating the IMU to the display module using the multi-camera calibration parameters, the display calibration parameters, and the VIN calibration parameters.

Abstract: A mobile device identifies a user task provided by an augmented reality application at a mobile device. The mobile device identifies a first physical tool valid for performing the user task from a tool compliance library based on the user task. The mobile device detects and identifies a second physical tool present at the mobile device. The mobile device determines whether the second physical tool matches the first physical tool. The mobile device display augmented reality content that identifies at least one of a missing physical tool, an unmatched physical tool, or a matched physical tool based on whether the second physical tool matches the first physical tool.

Abstract: A contextual local image recognition module of a device retrieves a primary content dataset from a server and then generates and updates a contextual content dataset based on an image captured with the device. The device stores the primary content dataset and the contextual content dataset. The primary content dataset comprises a first set of images and corresponding virtual object models. The contextual content dataset comprises a second set of images and corresponding virtual object models retrieved from the server.

Abstract: An augmented-reality (AR) device detects a physical device located within a first predefined distance of the augmented-reality device. The AR device detects, using an optical sensor, a physical object located within a second predefined distance of the physical device, the physical object being electronically unconnected to the physical device. The AR device determines that the physical object is associated with the physical device and identifies a command based on an identification of both the physical object and the physical device. The physical device is configured to operate the command and display, in the display, virtual content as an overlay to the physical object.

Abstract: A remote expert application identifies a manipulation of virtual objects displayed in a first wearable device. The virtual objects are rendered based a physical object viewed with a second wearable device. A manipulation of the virtual objects is received from the first wearable device. A visualization of the manipulation of the virtual objects is generated for a display of the second wearable device. The visualization of the manipulation of the virtual objects is communicated to the second wearable device.