Abstract: An apparatus for remotely controlling the movements of a vehicle includes a user input means, such as a gamepad with a plurality of joystick-controlled and button-controlled outputs, a tracker, and optional sliding foot pedals; a processor for running a control mapping algorithm; and a remote vehicle controller. A control mapping algorithm maps the outputs to the remote-controlled vehicle's course, heading, displacement, and camera view, with the joysticks mapped to provide open loop directional control over the vehicle's course and heading, the tracker providing open loop control over the camera view, and the optional sliding foot pedals providing open loop control over the vehicle's displacement. The remote vehicle controller sends commands to on-board controls to direct the vehicle's movement. A video stream from an on-board camera is transmitted back to the operator station for viewing on a computer desktop display or a head mountable display.

Abstract: An apparatus for interfacing 3D movements of a user to control the locomotion of an avatar in a virtual environment includes a position tracker for tracking the position of a user's feet, with the foot motions including swinging and stroking; a computer programmed for (i) computing a direction and extent of motion of a reference in the virtual environment based on the foot positions and (ii) providing an avatar corresponding to the computed direction and extent of motion; and a display for displaying the avatar in the virtual environment. The apparatus accordingly uses the gestural motion of the user's feet while seated to simulate natural human locomotion. The gestural motions of stroking and swinging include translational and rotating movements, and are chosen to correspond to the actions of the feet and legs during natural human locomotion, providing natural control of virtual locomotion. The apparatus is also designed for controlling the locomotion of a remote vehicle.

Abstract: An apparatus for controlling the movements of an avatar in a virtual environment includes a user input means, such as a gamepad with a plurality of joystick-controlled and button-controlled outputs, a tracker, and optional sliding foot pedals; a processor for running virtual environment (VE) software that includes an avatar moving through the VE; and a control mapping algorithm. The algorithm maps the gamepad, tracker, and optional sliding foot pedal outputs to the avatar's course, heading, displacement, and view, with the joysticks mapped to provide open loop directional control over the course and heading of the avatar, the tracker providing open loop control over the view, and the optional sliding foot pedals providing open loop control over displacement. The operator-controlled movement of the avatar in the virtual environment is displayed to the operator on a computer desktop display or a head mounted display.

Abstract: A method and apparatus for interfacing locomotive 3D movements of a user to a reference in a virtual or remote environment are provided. Initially, a 3D motion of a body portion of a user is sensed as the user takes a gestural pace. This sensing includes the determining of a beginning and an end of the gestural pace taken by the user, the determining of a 3D direction characteristic of the body portion motion during the gestural pace, and the determining of a 3D extent characteristic of the body portion motion during the gestural pace. Next, a 3D direction and extent of motion in the environment corresponding to the determined direction and extent characteristics of the gestural pace is computed. Finally, the computed 3D motion is used to move the reference in the environment.

Abstract: A method and apparatus for interfacing locomotive 3D movements of a user to a reference in a virtual or remote environment are provided. Initially, a 3D motion of a body portion of a user is sensed as the user takes a gestural pace. This sensing includes the determining of a beginning and an end of the gestural pace taken by the user, the determining of a 3D direction characteristic of the body portion motion during the gestural pace, and the determining of a 3D extent characteristic of the body portion motion during the gestural pace. Next, a 3D direction and extent of motion in the environment corresponding to the determined direction and extent characteristics of the gestural pace is computed. Finally, the computed 3D motion is used to move the reference in the environment.