Abstract: Methods and devices for presenting a virtual reality image may include receiving head motion information from a positional tracking system that tracks a position and orientation of a head of a user and receiving virtual motion information independent from the head motion information for a virtual reality simulation. The methods and devices may include generating a first scene of the virtual reality simulation based on the virtual motion information and the head motion information. The methods and devices may also include generating a set of visual cues based on the head motion information and rendering a frame including the set of visual cues and the first scene of the virtual reality simulation. The methods and devices may include transmitting the frame of the virtual reality simulation for presentation on a display device.

Abstract: Methods and devices for presenting a virtual reality image may include receiving head motion information from a positional tracking system that tracks a position and orientation of a head of a user and receiving virtual motion information independent from the head motion information for a virtual reality simulation. The methods and devices may include generating a first scene of the virtual reality simulation based on the virtual motion information and the head motion information. The methods and devices may also include generating a set of visual cues based on the head motion information and rendering a frame including the set of visual cues and the first scene of the virtual reality simulation. The methods and devices may include transmitting the frame of the virtual reality simulation for presentation on a display device.

Abstract: Examples described herein generally relate to prioritizing portions of images for rendering in a computing device. A probability field for prioritizing portions of an image of a scene for processing can be determined, where the probability field includes a set of values each corresponding to a likelihood of a rendering parameter acquiring an altered value between a render time at which at least a portion of the image is rendered and a display time at which the image is displayed. A shaped probability field can be generated based at least in part on applying the probability field to an original target shape associated with a display. The shaped probability field can be provided to a downstream node for prioritizing, based at least in part on one or more of the set of values in the probability field, a portion of the image in processing the image.

Abstract: Methods and devices for presenting a virtual reality image may include receiving head motion information from a positional tracking system that tracks a position and orientation of a head of a user and receiving virtual motion information independent from the head motion information for a virtual reality simulation. The methods and devices may include generating a first scene of the virtual reality simulation based on the virtual motion information and the head motion information. The methods and devices may also include generating a set of visual cues based on the head motion information and rendering a frame including the set of visual cues and the first scene of the virtual reality simulation. The methods and devices may include transmitting the frame of the virtual reality simulation for presentation on a display device.

Abstract: Examples described herein generally relate to prioritizing portions of images for rendering in a computing device. A probability field for prioritizing portions of an image of a scene for processing can be determined, where the probability field includes a set of values each corresponding to a likelihood of a rendering parameter acquiring an altered value between a render time at which at least a portion of the image is rendered and a display time at which the image is displayed. A shaped probability field can be generated based at least in part on applying the probability field to an original target shape associated with a display. The shaped probability field can be provided to a downstream node for prioritizing, based at least in part on one or more of the set of values in the probability field, a portion of the image in processing the image.

Abstract: Methods and devices for presenting a virtual reality image may include receiving head motion information from a positional tracking system that tracks a position and orientation of a head of a user and receiving virtual motion information independent from the head motion information for a virtual reality simulation. The methods and devices may include generating a first scene of the virtual reality simulation based on the virtual motion information and the head motion information. The methods and devices may also include generating a set of visual cues based on the head motion information and rendering a frame including the set of visual cues and the first scene of the virtual reality simulation. The methods and devices may include transmitting the frame of the virtual reality simulation for presentation on a display device.

Abstract: Example embodiments of the present disclosure provide techniques for receiving measurements from one or more inertial sensors (i.e. accelerometer and angular rate gyros) attached to a device with a camera or other environment capture capability. In one embodiment, the inertial measurements may be combined with pose estimates obtained from computer vision algorithms executing with real time camera images. Using such inertial measurements, a system may more quickly and efficiently obtain higher accuracy orientation estimates of the device with respect to an object known to be stationary in the environment.

Abstract: Example embodiments of the present disclosure provide techniques for receiving measurements from one or more inertial sensors (i.e. accelerometer and angular rate gyros) attached to a device with a camera or other environment capture capability. In one embodiment, the inertial measurements may be combined with pose estimates obtained from computer vision algorithms executing with real time camera images. Using such inertial measurements, a system may more quickly and efficiently obtain higher accuracy orientation estimates of the device with respect to an object known to be stationary in the environment.

Abstract: Example embodiments of the present disclosure provide techniques for receiving measurements from one or more inertial sensors (i.e. accelerometer and angular rate gyros) attached to a device with a camera or other environment capture capability. In one embodiment, the inertial measurements may be combined with pose estimates obtained from computer vision algorithms executing with real time camera images. Using such inertial measurements, a system may more quickly and efficiently obtain higher accuracy orientation estimates of the device with respect to an object known to be stationary in the environment.

Abstract: Systems and methods for unifying coordinate systems in an augmented reality application or system are disclosed. User devices capture an image of a scene, and determine a location based on the scene image. The scene image may be compared to cartography data or images to determine the location. User devices may propose an origin and orientation or transformation data for a common coordinate system and exchange proposed coordinate system data to agree on a common coordinate system. User devices may also transmit location information to an augmented reality system that then determines an a common coordinate system and transmits coordinate system data such as transformation matrices to the user devices. Images presented to users may be adjusted based on user device locations relative to the coordinate system.

Abstract: A method and apparatus for rendering the lighting of virtual objects in an augmented reality display. The method includes determining local and ambient light sources based on data provided by one or more light sensors. The light in the physical lighting environment is accounted for by attributing the light to local light sources and/or ambient light sources. A synthesized physical lighting environment is constructed based on the light characteristics of the local and/or ambient light sources, and is used in properly rendering virtual objects in the augmented reality display.

Abstract: The following discloses antialiasing systems and methods. Information about one or more fragments or primitives in a pixel area may be dynamically stored. The stored information may include, for example, depth, color, location and coverage. The coverage and depth information may be tracked at a higher frequency across the pixel than the number of fragments or primitives. Fragments or primitives that enter into a pixel area may be compared with fragments or primitives that have been stored. The comparisons may be based on depth and coverage. Either the incoming fragment or the stored fragment may be deleted based on the comparisons. Information associated with fragments that are preserved may be sampled at any location associated with their coverage area of a pixel. Fragments or primitives that are not discarded may be preserved for a final resolve process, which may incorporate information available from neighboring pixel areas.

Abstract: Systems and methods are disclosed for generating an image for a user based on an image captured by a scene-facing camera or detector. The user's position relative to a component of the system is determined, and the image captured by the scene-facing detector is modified based on the user's position. The resulting image represents the scene as seen from the perspective of the user. The resulting image may be further modified by augmenting the image with additional images, graphics, or other data.

Abstract: Systems and methods are disclosed for generating an image for a user based on an image captured by a scene-facing camera or detector. The user's position relative to a component of the system is determined, and the image captured by the scene-facing detector is modified based on the user's position. The resulting image represents the scene as seen from the perspective of the user. The resulting image may be further modified by augmenting the image with additional images, graphics, or other data.

Abstract: Systems and methods are disclosed for generating an image for a user based on an image captured by a scene-facing camera or detector. The user's position relative to a component of the system is determined, and the image captured by the scene-facing detector is modified based on the user's position. The resulting image represents the scene as seen from the perspective of the user. The resulting image may be further modified by augmenting the image with additional images, graphics, or other data.

Abstract: Systems and methods for unifying coordinate systems in an augmented reality application or system are disclosed. User devices capture an image of a scene, and determine a location based on the scene image. The scene image may be compared to cartography data or images to determine the location. User devices may propose an origin and orientation or transformation data for a common coordinate system and exchange proposed coordinate system data to agree on a common coordinate system. User devices may also transmit location information to an augmented reality system that then determines an a common coordinate system and transmits coordinate system data such as transformation matrices to the user devices. Images presented to users may be adjusted based on user device locations relative to the coordinate system.

Abstract: Example embodiments of the present disclosure provide techniques for capturing and analyzing information gathered by a mobile device equipped with one or more sensors. Recognition and tracking software and localization techniques may be used to extrapolate pertinent information about the surrounding environment and transmit the information to a service that can analyze the transmitted information. In one embodiment, when a user views a particular object or landmark on a device with image capture capability, the device may be provided with information through a wireless connection via a database that may provide the user with rich metadata regarding the objects in view. Information may be presented through rendering means such as a web browser, rendered as a 2D overlay on top of the live image, and rendered in augmented reality.

Abstract: The following discloses antialiasing systems and methods. Information about one or more fragments or primitives in a pixel area may be dynamically stored. The stored information may include, for example, depth, color, location and coverage. The coverage and depth information may be tracked at a higher frequency across the pixel than the number of fragments or primitives. Fragments or primitives that enter into a pixel area may be compared with fragments or primitives that have been stored. The comparisons may be based on depth and coverage. Either the incoming fragment or the stored fragment may be deleted based on the comparisons. Information associated with fragments that are preserved may be sampled at any location associated with their coverage area of a pixel. Fragments or primitives that are not discarded may be preserved for a final resolve process, which may incorporate information available from neighboring pixel areas.

Abstract: Four predefined vertices define an icosahedron used for constructing a geodesic dome. Each section of the icosahedron, including the top, center, and bottom, is sequentially processed to construct a plurality of vertices and a plurality of indices of triangles on the surface of the geodesic dome. One of the inputs defines the order of the geodesic dome, which determines the number of vertices. A plurality of transformation matrices are employed to rotate a three-dimensional vector about a selected axis through a predefined angle to generate the vertices. The indices for the triangles are constructed as either triangle strips or triangle lists, for each of the three sections of the icosahedron. Vertices are stored in a vertex buffer and indices in an index buffer. The vertices are selected to form a plurality of edges disposed at an equal distance from the center of the icosahedron.

Abstract: Representing source data with predefined data patterns, or identifying predefined data patterns in source data, where each data pattern includes a unique combination of pattern elements, without comparing every pattern element of each data pattern to the source data. A hierarchical structure of relationships between the data patterns is predetermined in an initialization stage by comparing the data patterns to identify identical pattern elements among groups of the data patterns. Selected node elements in a resulting relationship tree are compared to the source data to determined deviations. The deviations are propagated and accumulated throughout the relationship structure of the tree, and data patterns having the minimum deviation are selected to represent corresponding source data cells. A graphics pipeline preferably is used to determine the deviations and select data patterns in real time.