Abstract: A head-mounted display (HMD) device to be worn by a user in a physical environment (PE) is controlled. A 3D virtual environment (VE) is modeled to include a virtual controllable object subject to virtual control input. Motion of the position, head, and hands of the user is monitored in the PE, and a physical surface in the PE is detected. A virtual user interface (vUI) is placed in the VE relative to a virtual perspective of the user. The vUI includes an information display and at least one virtual touch control to produce the virtual control input in response to virtual manipulation of the virtual touch control. The vUI's placement is determined to coincide with the physical surface in the PE relative to the position of the user in the PE.

Abstract: Various systems and methods for providing a mechanism for multi-modal user authentication are described herein. An authentication system for multi-modal user authentication includes a memory including image data captured by a camera array, the image data including a hand of a user; and an image processor to: determine a hand geometry of the hand based on the image data; determine a palm print of the hand based on the image data; determine a gesture performed by the hand based on the image data; and determine a bio-behavioral movement sequence performed by the hand based on the image data; and an authentication module to construct a user biometric template using the hand geometry, palm print, gesture, and bio-behavioral movement sequence.