Abstract: A user to control the functionality associated with a physical input object for an augmented reality (AR) application. A state control element of a user interface can be displayed through the AR application, and motions of the input object analyzed with respect to element. This can comprise swiping in a first or second direction to cause the physical object to function, or not to function, as a cursor for the user interface. In this way, interactions of the physical object with AR elements will only be analyzed when the object is functioning as a cursor. Foveated rendering or other AR elements can be used during a selection period to provide an indication that an element of the UI interface is in the process of being selected. The user can maintain the position to perform the selection action is intended, or can change the position to cancel the selection.

Abstract: Parts of the body of a user can be used as surfaces for rendering content, such as augmented reality (AR) content. A computing device executing an AR application can detect body parts in an augmented reality view, such as a hand within a field of view of a camera capturing image data for the application. A type of content to be displayed can be determined based on the type and orientation of the body part, in addition to the location and orientation of the device. The content can vary with changes in the orientation of the body part or motion to cause another body part to be visible. A user can make a selection or input for the content by contacting the surface of the body part onto which the content is projected, providing tactile feedback to the user as well as a determinable action for the device.