Abstract: A system and method enabling an Augmented Reality (AR) capable system to manage the displaying of AR overlays in ways that prevent possible AR user distractions, respect AR user's privacies and prevent interference or conflict with other AR overlays that may appear in an AR user's field of view.

Abstract: A system and method of interaction with one or more applications running on a mobile device. The system maps the visual output of one or more applications running on the mobile device onto one or more virtual surfaces located within a user defined coordinate system, the mobile device being within this coordinate system, the coordinate system being attach to an arbitrary scene. The system estimates the pose of the mobile device within the coordinate system and according to this pose displays an interactive view of the virtual surfaces. The displayed view enables interaction with the one or more applications running on the mobile device.