Abstract: An augmented reality environment allows interaction between virtual and real objects and enhances an unstructured real-world environment. An object datastore comprising attributes of an object within the environment may be built and/or maintained from sources including manufacturers, retailers, shippers, and users. This object datastore may be local, cloud based, or a combination thereof. Applications may interrogate the object datastore to provide user functionality.

Abstract: Systems and techniques for providing feedback to users within an environment that interact with user interfaces (UIs) that are projected within the environment. For instance, the systems and techniques may project a UI that includes one or more selectable portions, such as keys, icons, sliders, dials, or any other type of control. After projecting the UI, the systems and techniques may identify the user attempting to interact with the UI. In response, the systems and techniques may provide feedback to the user indicating that the user has engaged the UI. For instance, the systems and techniques may visually alter the projected UI, may output a sound via one or more speakers within the environment, or may provide the feedback in any other manner.

Abstract: An augmented reality environment allows interaction between virtual and real objects. Various surfaces within the environment such as walls, tables, countertop, chairs, floor, ceiling, and so forth may be used as projection surfaces. Qualified projection surfaces are determined, and an initial projection surface is selected for use from these. This selection may take into account user preferences, user orientation, types of image to be projected, and so forth. Other qualified projection surfaces may have visual indicators projected thereon, indicating relative suitability for use as a projection surface.

Abstract: The location of a sound within a given spatial volume may be used in applications such as augmented reality environments. An artificial neural network processes time-difference-of-arrival data (TDOA) from a known microphone array to determine a spatial location of the sound. The neural network may be located locally or available as a cloud service. The artificial neural network is trained with perturbed and non-perturbed TDOA data.

Abstract: Devices and techniques are described for automatically calibrating a projector system. The projector system undergoing calibration is coupled to a computing device and an automated positioning platform coupled to a target structure. The computing device acquires images using a calibrated camera of one or more patterns projected by the projector onto the target structure when the target structure is in a plurality of repeatable poses. From these acquired images, intrinsic projector parameters may be determined. Once determined, the parameters may be used to correct images produced by the projector or acquired by the camera which include a projected pattern or portion thereof.

Abstract: Devices and techniques are described for automatically calibrating a camera system. The camera system undergoing calibration is coupled to a computing device and an automated positioning platform coupled to a target structure. The computing device acquires images from the camera of the target structure in a plurality of repeatable poses. From these acquired images, intrinsic camera parameters may be determined. Once determined, the parameters may be used to correct images acquired by the camera system.

Abstract: An augmented reality environment allows interaction between virtual and real objects. Beamforming techniques are applied to signals acquired by an array of microphones to allow for simultaneous spatial tracking and signal acquisition from multiple users. Localization information such as from other sensors in the environment may be used to select a particular set of beamformer coefficients and resulting beampattern focused on a signal source. Alternately, a series of beampatterns may be used iteratively to localize the signal source in a computationally efficient fashion. The beamformer coefficients may be pre-computed.