Abstract: Visual gestures in a device allow a user to select and activate features in a display of the device. A visual reference on a physical object is identified. A visualization of a virtual object engaged with an image of the physical object is generated in a display of a device. The virtual object corresponds to the visual reference. A rendering of the visualization of the virtual object is based a position of the display relative to the visual reference. A focus area in the display and a feature of the object are determined. A state of the feature is changed when the feature is in the focus area of the display.

Abstract: A system and method for segmentation of content delivery is described. A virtual object model is divided into a plurality of segments. An order of the plurality of segments is arranged in a delivery queue. Each segment of the virtual object model is delivered in the order of the delivery queue to a device that is configured to recognize a physical object that is associated with the virtual object model.

Abstract: Techniques of active surface projection correction are disclosed. In some embodiments, a computer-implemented method comprises determining that a current position of a display surface of a head-mounted display device is determined to satisfy a predetermined condition for displaying virtual content on the display surface, with the display surface being configured to be adjusted between positions that do not satisfy the predetermined condition and positions that do satisfy the predetermined condition, determining display surface position data based on the current position of the display surface, determining a display location for the virtual content based on the display surface position data, and displaying the virtual content at the display location on the display surface.

Abstract: A head mounted device includes a helmet and a substantially arc-shaped visor. The helmet has an augmented reality device disposed in a housing of the helmet. A first set of magnets is embedded and disposed along a periphery of a front portion of the helmet. The substantially arc-shaped visor has a top part and a bottom part. The top part is removably attached to the front portion of the helmet. A second set of magnets is embedded and disposed along a periphery of the top part of the visor to match the first set of magnets.

Abstract: A head mounted device includes a helmet, an ambient light sensor, a pupil dimension sensor, a lighting element, and a dynamic lighting system. The ambient light sensor is disposed in an outside surface of the helmet and measures ambient light outside the helmet. The pupil dimension sensor is disposed in a housing of the helmet and measures a size of a pupil of a wearer of the helmet. The lighting element is disposed in the outside surface of the helmet. The dynamic lighting system controls the lighting element and adjusts an intensity of the lighting element based on the ambient light and the pupil size of the wearer of the helmet.

Abstract: A system and method for extracting data for augmented reality content are described. A device identifies a sensing device using an image captured with at least one camera of the device. Visual data are extracted from the sensing device. The device generates an AR content based on the extracted visual data and maps and displays the AR content in the display to form a layer on the sensing device.

Abstract: Techniques of head mounted display calibration are disclosed. In some example embodiments, corresponding intrinsic calibration procedures are performed for each component in a plurality of components of a head mounted display, with each intrinsic calibration procedure comprising determining one or more intrinsic calibration parameters for the corresponding component, and a plurality of extrinsic calibration procedures are performed among the plurality of components, with each extrinsic calibration procedure comprising determining one or more extrinsic calibration parameters. An augmented reality function of the head mounted display is configured based on the determined intrinsic calibration parameters and the determined extrinsic calibration parameters, with the configured augmented reality function being configured to cause the display of virtual content on the head mounted display using the determined intrinsic and extrinsic calibration parameters in conjunction with the plurality of components.

Abstract: Techniques of providing digitized interactions with identified objects are disclosed. In some embodiments, sensor data of an object can be received. The sensor data may have been captured by a computing device of a user. A category of the object can be identified based on at least one characteristic of the object from the sensor data. A characterizing feature of the category of the object can be determined. Virtual content can be generated based on the characterizing feature. The virtual content can be caused to be displayed concurrently with a view of the object on a display screen of the computing device.

Abstract: A system and method for visual inertial navigation for augmented reality are described. In some embodiments, at least one camera of a wearable device generates a plurality of video frames. At least one inertial measurement unit (IMU) sensors of the wearable device generates IMU data. Features in the plurality of video frames for each camera are tracked. The plurality of video frames for each camera are synchronized and aligned based on the IMU data. A dynamic state of the wearable device is computed based on the synchronized plurality of video frames with the IMU data for each camera. Augmented reality content is generated and positioned in a display of the wearable device based on the dynamic state of the wearable device.

Abstract: A system and method for manipulating a virtual object based on intent is described. A reference identifier from a physical object is captured. The reference identifier is communicated via a network to a remote server. The remote server includes virtual object data associated with the reference identifier. The virtual object data is received at the computing device. The virtual image is displayed in a virtual landscape using the virtual object data. In response to relative movement between the computing device and the physical object caused by a user, the virtual image is modified. Brain activity data of the user is received. A state of the virtual object in the virtual landscape is changed based on the brain activity data.

Abstract: A server for content creation is described. A content creation tool of the server receives, from a first device, a content identifier of a physical object, a virtual object content, and a selection of a template corresponding to an interactive feature for the virtual object content. The content creation tool generates a content dataset based on the content identifier of the physical object, the virtual object content, and the selected template.

Abstract: A system and method for offloading augmented reality processing is described. A first sensor of a server generates a first set of sensor data corresponding to a location and an orientation of a display device. The server receives a request from the display device to offload a combination of at least one of a tracking process and a rendering process from the display device. The server generates offloaded processed data based on a combination of at least one of the first set of sensor data and a second set of sensor data. The second set of sensor data is generated by a second sensor at the display device. The server streams the offloaded processed data to the display device.

Abstract: A system and method for manipulating a virtual object based on thought is described. A reference identifier from a physical object is captured. Brain activity data of a user is received to obtain a brain activity data. The reference identifier and the brain activity data are communicated via a network to a remote server. The remote server selects a virtual object based on the reference identifier and the brain activity data. A communication from the server identifying the virtual object is received. The virtual object is displayed in a virtual landscape.

Abstract: A head mounted device includes a helmet with a guide, a lens frame, at least one display surface mounted to the lens frame. The guide extends from a cavity of the helmet. The lens frame is moveably connected to the guide and moves along an axis of the guide between a first position within the cavity of the helmet and a second position outside the cavity of the helmet. The display surface is transparent and configured to display augmented reality content.

Abstract: A system and method for offloading augmented reality processing is described. A sensor external to a viewing device of a user tracks a location and an orientation of the viewing device. The location and orientation are defined relative to predefined references of a physical environment local to the user. A server receives a request from the viewing device to offload at least one of a tracking process and an augmented reality rendering process. The augmented reality rendering process is based on an augmented reality database. The server generates offloaded processed data based on the request and the location and the orientation of the viewing device. The offloaded processed data is streamed to the viewing device. A visualization of the offloaded processed data is generated in the viewing device.

Abstract: A server for content creation is described. A content creation tool of the server generates an experience content dataset using a template to process a content identifier and virtual object content. An experience generator of the server provides the experience content dataset to a device that recognizes the content identifier, to generate an interactive experience with the virtual object content at the device.

Abstract: A server for campaign optimization is described. An experience content dataset is generated for an augmented reality application of a device based on analytics results. The analytics results are generated based on analytics data received from the device. The experience content dataset is provided to the device. The device recognizes a content identifier of the experience content dataset and generates an interactive experience with a presentation of virtual object content that is associated with the content identifier.

Abstract: Techniques of active parallax correction are disclosed. In some embodiments, a first gaze direction of at least one eye of a user is determined. A determination about virtual content can then be made based on the first gaze direction, and the virtual content can be caused to be presented to the user based on the determination. In some embodiments, making the determination comprises determining a first location on a display surface at which to display the virtual content. In some embodiments, the virtual content can be caused to be displayed on the display surface at the first location.

Abstract: A contextual local image recognition module of a device retrieves a primary content dataset from a server and then generates and updates a contextual content dataset based on an image captured with the device. The device stores the primary content dataset and the contextual content dataset. The primary content dataset comprises a first set of images and corresponding virtual object models. The contextual content dataset comprises a second set of images and corresponding virtual object models retrieved from the server.