Abstract: A method and apparatus are provided for providing user-directed operation of a virtual manipulator, such as a simulated hand or claw (30) within a computer-generated virtual environment. The environment comprises one or more objects (32) which may be held, released or impelled by the manipulator under user control. Movement of the virtual manipulator is directed by a suitable hand held device operated by a user, with a simple control directing opening or closing of the claw (30). In operation, actions such as throwing, catching or punching an object (32) are partially automated, with the decision as to the action initiated being determined by the separation (D) between object and manipulator, and the current and previous states of each as recorded in the form of respective state variables. A method for the derivation of an applied velocity for the object acted upon is also described.

Abstract: An apparatus is provided for modelling and interacting with a virtual environment. An image of the environment, and a representation of the user's presence therein, is generated by a CPU (12) based on data from memories (14,16) and supplied to the user by a stereoscopic display (10). The user is provided with a hand-held unit (18) which has a single control button (20). When the button (20) is not pressed, the user's movements of the control (18) are replicated by a modelled icon (such as a virtual hand) within the virtual environment to enable interaction. When the button (20) is actuated, the user's movements of control device (18) are instead converted to navigational commands shifting the location of the user's virtual presence around the virtual environment.