Abstract: Example embodiments of the present disclosure provide techniques for receiving measurements from one or more inertial sensors (i.e. accelerometer and angular rate gyros) attached to a device with a camera or other environment capture capability. In one embodiment, the inertial measurements may be combined with pose estimates obtained from computer vision algorithms executing with real time camera images. Using such inertial measurements, a system may more quickly and efficiently obtain higher accuracy orientation estimates of the device with respect to an object known to be stationary in the environment.

Abstract: Example embodiments of the present disclosure provide techniques for receiving measurements from one or more inertial sensors (i.e. accelerometer and angular rate gyros) attached to a device with a camera or other environment capture capability. In one embodiment, the inertial measurements may be combined with pose estimates obtained from computer vision algorithms executing with real time camera images. Using such inertial measurements, a system may more quickly and efficiently obtain higher accuracy orientation estimates of the device with respect to an object known to be stationary in the environment.

Abstract: Example embodiments of the present disclosure provide techniques for receiving measurements from one or more inertial sensors (i.e. accelerometer and angular rate gyros) attached to a device with a camera or other environment capture capability. In one embodiment, the inertial measurements may be combined with pose estimates obtained from computer vision algorithms executing with real time camera images. Using such inertial measurements, a system may more quickly and efficiently obtain higher accuracy orientation estimates of the device with respect to an object known to be stationary in the environment.

Abstract: Systems and methods for unifying coordinate systems in an augmented reality application or system are disclosed. User devices capture an image of a scene, and determine a location based on the scene image. The scene image may be compared to cartography data or images to determine the location. User devices may propose an origin and orientation or transformation data for a common coordinate system and exchange proposed coordinate system data to agree on a common coordinate system. User devices may also transmit location information to an augmented reality system that then determines an a common coordinate system and transmits coordinate system data such as transformation matrices to the user devices. Images presented to users may be adjusted based on user device locations relative to the coordinate system.

Abstract: A method and apparatus for rendering the lighting of virtual objects in an augmented reality display. The method includes determining local and ambient light sources based on data provided by one or more light sensors. The light in the physical lighting environment is accounted for by attributing the light to local light sources and/or ambient light sources. A synthesized physical lighting environment is constructed based on the light characteristics of the local and/or ambient light sources, and is used in properly rendering virtual objects in the augmented reality display.

Abstract: The following discloses antialiasing systems and methods. Information about one or more fragments or primitives in a pixel area may be dynamically stored. The stored information may include, for example, depth, color, location and coverage. The coverage and depth information may be tracked at a higher frequency across the pixel than the number of fragments or primitives. Fragments or primitives that enter into a pixel area may be compared with fragments or primitives that have been stored. The comparisons may be based on depth and coverage. Either the incoming fragment or the stored fragment may be deleted based on the comparisons. Information associated with fragments that are preserved may be sampled at any location associated with their coverage area of a pixel. Fragments or primitives that are not discarded may be preserved for a final resolve process, which may incorporate information available from neighboring pixel areas.

Abstract: Systems and methods are disclosed for generating an image for a user based on an image captured by a scene-facing camera or detector. The user's position relative to a component of the system is determined, and the image captured by the scene-facing detector is modified based on the user's position. The resulting image represents the scene as seen from the perspective of the user. The resulting image may be further modified by augmenting the image with additional images, graphics, or other data.

Abstract: Systems and methods are disclosed for generating an image for a user based on an image captured by a scene-facing camera or detector. The user's position relative to a component of the system is determined, and the image captured by the scene-facing detector is modified based on the user's position. The resulting image represents the scene as seen from the perspective of the user. The resulting image may be further modified by augmenting the image with additional images, graphics, or other data.

Abstract: Systems and methods for unifying coordinate systems in an augmented reality application or system are disclosed. User devices capture an image of a scene, and determine a location based on the scene image. The scene image may be compared to cartography data or images to determine the location. User devices may propose an origin and orientation or transformation data for a common coordinate system and exchange proposed coordinate system data to agree on a common coordinate system. User devices may also transmit location information to an augmented reality system that then determines an a common coordinate system and transmits coordinate system data such as transformation matrices to the user devices. Images presented to users may be adjusted based on user device locations relative to the coordinate system.

Abstract: Example embodiments of the present disclosure provide techniques for capturing and analyzing information gathered by a mobile device equipped with one or more sensors. Recognition and tracking software and localization techniques may be used to extrapolate pertinent information about the surrounding environment and transmit the information to a service that can analyze the transmitted information. In one embodiment, when a user views a particular object or landmark on a device with image capture capability, the device may be provided with information through a wireless connection via a database that may provide the user with rich metadata regarding the objects in view. Information may be presented through rendering means such as a web browser, rendered as a 2D overlay on top of the live image, and rendered in augmented reality.

Abstract: The following discloses antialiasing systems and methods. Information about one or more fragments or primitives in a pixel area may be dynamically stored. The stored information may include, for example, depth, color, location and coverage. The coverage and depth information may be tracked at a higher frequency across the pixel than the number of fragments or primitives. Fragments or primitives that enter into a pixel area may be compared with fragments or primitives that have been stored. The comparisons may be based on depth and coverage. Either the incoming fragment or the stored fragment may be deleted based on the comparisons. Information associated with fragments that are preserved may be sampled at any location associated with their coverage area of a pixel. Fragments or primitives that are not discarded may be preserved for a final resolve process, which may incorporate information available from neighboring pixel areas.