Abstract: A system and a method are disclosed for a user interface for an augmented reality system to provide directions and control to virtual content. The position of the system is determined and a ray is determined from the graphical information inlaid on the user interface. The intersection of the ray with a 3D model representing real world content is made. The intersection indicates a location to direct movement of virtual content.

Abstract: A system and a method are disclosed for capturing real world objects and reconstructing a three-dimensional representation of real world objects. The position of the viewing system relative to the three-dimensional representation is calculated using information from a camera and an inertial motion unit. The position of the viewing system and the three-dimensional representation allow the viewing system to move relative to the real objects and enables virtual content to be shown with collision and occlusion with real world objects.