Abstract: A system and method using light sources as spatial anchors is provided. Augmented reality (AR) requires precise and instant overlay of digital information onto everyday objects. Embodiments disclosed herein provide a new method for displaying spatially-anchored data, also referred to as LightAnchors. LightAnchors takes advantage of pervasive point lights—such as light emitting diodes (LEDs) and light bulbs—for both in-view anchoring and data transmission. These lights are blinked at high speed to encode data. An example embodiment includes an application that runs on a mobile operating system without any hardware or software modifications, which has been demonstrated to perform well under various use cases.

Abstract: An interactive and responsive presentation of spatially-associated information related to a user's environment based on the user's context is provided. Aspects of a 3D audio cloud system extract information about entities in the user's environment, and generate and provide the user with a 3D audio cloud that presents a spatial audio representation of entities in the user's environment that gives the user cues as to where the entities are located with respect to the user. An entity can be represented in a descriptive manner that provides the user with various types of information about the entity (e.g., shape, size, color, others' opinions, actions, emotions). Further, aspects of the 3D audio cloud system dynamically update the 3D audio cloud based on the user's location, position, or orientation, receive selection input from the user associated with the 3D audio cloud, and retrieve and present additional information as requested by the user.

Abstract: An apparatus and method for audibly identifying an object indicated by a hand includes an electronic imager and an audio device. A processing system coupled to the imager and the audio device is configured to cause the imager to capture an image including the hand and the object. The processing system is also configured to process the captured image to identify and track the hand to identify the object indicated by the hand, to contextual assistance data with respect to the indicated object, to generate audio data describing the contextual assistance data, and to provide the generated audio data to the audio device.

Abstract: An interactive and responsive presentation of spatially-associated information related to a user's environment based on the user's context is provided. Aspects of a 3D audio cloud system extract information about entities in the user's environment, and generate and provide the user with a 3D audio cloud that presents a spatial audio representation of entities in the user's environment that gives the user cues as to where the entities are located with respect to the user. An entity can be represented in a descriptive manner that provides the user with various types of information about the entity (e.g., shape, size, color, others' opinions, actions, emotions). Further, aspects of the 3D audio cloud system dynamically update the 3D audio cloud based on the user's location, position, or orientation, receive selection input from the user associated with the 3D audio cloud, and retrieve and present additional information as requested by the user.