FREE STANDING JOYSTICK
A free standing joystick that is unrestricted in terms of its DOF of movement is disclosed, which can detect and represent all of the linear and rotational movements that can be made with a user's hand. As one example, a free standing joystick is disclosed, which includes a hand-held fixture and eight accelerometers attached to the fixture. The accelerometers are mounted on the fixture so as to detect and distinguish the six freedoms of movement, linear motion along the X, Y, and Z axes, and rotations about those axes. The fixture is unencumbered by mechanical attachment and can be moved freely by the user. The accelerometers detect acceleration on the six degrees of freedom and can provide those movements to other entities such as a computer for use in games, space, and any application that may require input in multiple axes of freedom. The result is a computer input device that is more intuitive, more flexible, and can be produced at a lower cost than heretofore possible.
Latest Honeywell International Inc. Patents:
- INERTIAL CAMERA SCENE MOTION COMPENSATION
- DECENTRALIZED NETWORK DISCOVERY FOR INDUSTRIAL CONTROL SYSTEMS
- HUMAN MACHINE INTERFACE FOR PROVIDING INFORMATION TO AN OPERATOR OF AN INDUSTRIAL PRODUCTION FACILITY
- Avionic System and Method for Selectively Preventing and Enhanced Ground Proximity Warning System Alert Mode from Generating an Alert
- Method and system for using a plurality of motion sensors to control a pan-tilt-zoom camera
The present invention relates generally to the field of computer input devices, and more specifically, but not exclusively, to a free standing joystick with an unrestricted 6 degrees of freedom (6DOF) that can detect and represent all of the movements made with a user's hand.
BACKGROUND OF THE INVENTIONA joystick is a computer input device that translates the motion (e.g., force) of a user's hand into electronic information that a computer can process. At its inception, the joystick presented a significant improvement over the computer mouse, because the joystick provided an input device that more closely represented users' movements in the real world. Nevertheless, a significant problem with today's joysticks is that they are mechanically mounted to a physical base and also to the measurement devices that the joysticks employ. Consequently, the existing joysticks are significantly restricted in terms of their degrees of freedom of movement, and thus limited in their ability to detect all of the natural movements that can be made with a hand.
For example, U.S. Pat. No. 5,854,622 to Brannon (1998) discloses a 6DOF joystick that converts the force of hand movements into electrical output signals. However, the technical advantages of this joystick are not fully realizable, because the physical structure of the device allows it to be moved in only two dimensions. Also, this joystick's use of force as the primary input parameter is an approach that can be improved. For example, if a user desires to input an upward movement, the user must apply an upward force to the joystick and maintain that force for a significant period of time. The user does not actually move the joystick a significant distance. This approach could be improved by allowing the user to actually move the joystick upward so as to represent the input desired. However, such an improvement would be very complex, because it would require the use of up to eight mechanical devices, along with associated connecting hardware and multiple electrical connections. As such, the relatively high parts count and complex assembly processes needed for such an improvement to this approach would result in excessive design and manufacturing costs. Furthermore, such a large parts count and significant number of moving mechanical joints would create an increased risk of failure and attendant cost of repair.
In summary, there are numerous different joystick approaches described in the art, but no joystick currently exists that is unrestricted in terms of degrees of freedom of movement, and can detect and represent all of the movements that can be made with a user's hand. Therefore, a pressing need exists for a free standing joystick that is unrestricted in terms of degrees of freedom of movement, and can detect and represent all of the movements that can be made with a user's hand. As described in detail below, the present invention provides such a free standing joystick, which resolves the above-described joystick problems and other related problems.
SUMMARY OF THE INVENTIONThe present invention provides a free standing joystick that is unrestricted in terms of its DOF of movement, which can detect and represent all of the linear and rotational movements that can be made with a user's hand. In accordance with a preferred embodiment of the present invention, a free standing joystick is provided, which includes a hand-held fixture and eight Micro-electromechanical Systems (MEMS) accelerometers attached to the fixture. Two of the MEMS accelerometers are paired and mounted on the fixture in order to detect roll and X axis acceleration on the Y axis of the apparatus, with their axis of sensitivity along the X axis. One of that pair of accelerometers is mounted on one side of the center of rotation of the fixture, and the second accelerometer of that pair is mounted on the other side. If the fixture is moved and accelerated along its X axis, the two accelerometers will detect accelerations in the same direction. If the fixture is rotated about the X axis, the two accelerometers will detect accelerations in opposite directions. Movements consisting of combinations of linear and rotational movement will result in the sensing of the appropriate ratio of accelerations between the two sensors. Analysis of the data from the two accelerometers can extract and separate the two motions (linear and rotational) and make them available for further use. A second pair of MEMS accelerometers is mounted on the fixture in order to detect positive and negative pitch and Y axis accelerations, and a third pair of accelerometers is mounted on the fixture to detect positive and negative Z axis accelerations. A fourth pair of MEMS accelerometers is mounted on the fixture to detect positive and negative yaw accelerations. Consequently, the joystick can detect and output measurements of linear and rotational accelerations with 6DOF. The output of the apparatus can be conveyed to a computer over a wireless data link, which provides a joystick with essentially unrestricted movement that can output measurements of linear and rotational movement with 6DOF.
BRIEF DESCRIPTION OF THE DRAWINGSThe novel features believed characteristic of the invention are set forth in the appended claims. The invention itself, however, as well as a preferred mode of use, further objectives and advantages thereof, will best be understood by reference to the following detailed description of an illustrative embodiment when read in conjunction with the accompanying drawings, wherein:
The present invention provides a human controlled device used to input up to 6DOF information to a computer or other type of computing device. The term “6DOF” refers to the conventional six types of motion. These 6DOF include three DOF in rotation and three DOF in linear motion. The rotational movements are commonly known as yaw, pitch, and roll. A nautical definition can be used for linear motion, and the movements described in reference to a ship at sea. The term “surge” refers to forward and backwards motion (e.g., motion along the Y axis), “heave” means up and down motion (e.g., motion along the Z axis), and “sway” means left and right motion (e.g., motion along the X axis).
In accordance with principles of the present invention, an embodiment of an apparatus used to input 6DOF information into a computer may be constructed to include two primary components: 1) a fixture; and 2) a plurality of acceleration sensors. In one example embodiment of the present invention, the fixture is a physical device that a user can hold for manipulation, which also serves as a mounting device for a plurality of acceleration sensors (e.g., retained in specified positions in relationship to each other). In a second example embodiment, the fixture can be a physical device that can be attached to a user's body (e.g. head, torso, etc.), so that the apparatus can detect 6DOF motion of the user's head, body, etc. and input or report the 6DOF data to a computer.
With reference now to the figures,
Notably, for a preferred embodiment of the present invention, accelerometers 204a and 204b (e.g., and all of the accelerometers 104a-104h in
Referring now to
In operation, for this example embodiment, a user can grasp fixture 102 and move it in any direction with 6DOF. The accelerometers 104a-104h attached to fixture 102 can sense that motion and output suitable signals as positive and negative accelerations. The acceleration information signals are transmitted to an external receiver, and the acceleration information is provided to a computer or computing device to analyze and quantify the 6DOF motion involved. The computer or computing device can translate the raw data from the accelerometers into other suitable forms as may be desired. In a preferred embodiment, the accelerations are recorded and translated into velocity with respect to the various axes involved. The velocities can be translated into positional displacements, and the positional displacements can be translated into actual position information. As such, the resulting units of information, acceleration, velocity, displacement, and position may be utilized as desired. It should be noted that all, some, or none of the positional computations can be done by devices attached directly to the fixture.
In accordance with principles of the present invention, the arrangement of accelerometers 104a-104h on fixture 102 (e.g., as shown in the example embodiment of
As another example, a pitch movement can be used to typify rotational acceleration. A typical rotational acceleration is a forward pitch rotation, whereby the YP top accelerometer 104a is accelerated forward along its axis of sensitivity (e.g., at the rate of 200 mm per second squared). The YP bottom accelerometer 104g, which is located on the opposite side of the center of gravity of fixture 102, and also the opposite side of the center of rotation of fixture 102, is accelerated towards the rear (e.g., at the rate of 200 mm per second squared). In this case, the YP top accelerometer 104a senses a positive acceleration, and the YP bottom accelerometer 104g senses a negative acceleration. Notably, the fact that the acceleration polarities are different indicates that the acceleration is rotational instead of linear. A generalized and simplified relationship for rotational acceleration rate is (YP bottom-YP- top)/2=rotational acceleration. Thus, for a typical rate of 200 mm per second squared, the result would be ((−200)−(+200))/2=rotational acceleration in mm per second squared, or −200 mm per second squared. This measurement value indicates that fixture 102 is experiencing a negative rotational acceleration, and that YP top accelerometer 104a and YP bottom accelerometer 104g are accelerating along the circumference of their mounting circle at the rate of 200 mm per second squared. The rate of rotation in degrees can be calculated from these values, and the acceleration value can be integrated into velocity and position information. Given this information, the pitch angle of fixture 102 can be tracked and known at any given instant. Notably, the above-described example typifies fundamental attitude sensing without the need for gyroscopic information for assistance.
For this example embodiment, linear and rotational acceleration information can be separated in the following manner. If the above-described typified forward linear acceleration along the Y-axis is processed using the above-described rotational relationship, the results are as follows. The linear acceleration results in the accelerometers measuring the same rates with the same polarity. Thus, (YP bottom-YP top)/2=rotational acceleration, or ((+200)−(+200))/2=0. In other words, the rotational acceleration rate in this case is zero. This result demonstrates that using the difference in the two acceleration rates removes the linear component of acceleration, which leaves only the rotational component.
Rotational acceleration results in values with opposite signs. For example, if the above-described typified rotational acceleration is processed using the above-described linear equation, the results are as follows: (YP bottom+YP-top)/2=forward acceleration, or ((−200)+(+200))/2=0. In other words, the rotational acceleration rate is zero. This result demonstrates that using the average of the two acceleration rates removes the rotational component of acceleration, which leaves only the linear component. As such, these calculations show that the present invention can separate linear acceleration from rotational acceleration. Thus, linear acceleration can be derived by averaging the sum of the two accelerometers involved, and rotational acceleration can be derived by averaging the difference between the two accelerometers involved.
Additionally, for this example embodiment, accelerometers XR top 104b and XR bottom 104h sense linear acceleration along the X-axis (left and right) and also roll. Accelerometers Z right 104d and Z left 104c sense linear acceleration up and down, and accelerometers Yaw front 104e and Yaw back 104f sense yaw acceleration. The calculations for each of these pairs of accelerometers can use the same relationships as those described above for the YP top and YP bottom pair, by substitution of the specific accelerometers being used.
It should be noted that the present invention is not intended to be limited to orthogonal configurations and encompasses within its scope accelerometers that can be mounted in suitable non-orthogonal configurations so as to reduce the sensor count and/or provide redundancy. As such, the above-described use of an orthogonal configuration is provided solely for illustrative purposes and ease of description.
It should be noted that while the described embodiment is implemented with accelerometers, it is not intended to be restricted to accelerometers. A paired accelerometer configuration as described here effectively synthesizes a gyroscope. As technology advances, MEMS gyroscopes or other types of gyroscopes may be incorporated into this design. The fundamental concept remains: attach motion and position sensing devices to a fixture for the purpose of sensing the motions and positions of that fixture and communicating these motions and positions to other devices for use, and further that this fixture may itself be or remain unattached to other devices providing unfettered movement for the convenience of the user.
It should be further noted that such fixtures as described here are not restricted to hand-held uses. Such devices may take other forms and may be mounted to hands, feet, heads, and other bodily parts. They may be further mounted to various parts of other living entities, or mechanical and biological devices.
In this regard,
For this example embodiment, sensors 304a (top) and 304g (bottom) are oriented as X acceleration sensors that sense sway and roll, and their axes of sensitivity are to the right and left in
An example of the operation and use of a 6DOF joystick structured in accordance with the second preferred embodiment of the present invention is now described. For clarity, the following assumptions can be made. For this example embodiment, it may be assumed that joystick 300 in
A user can start the program and initialize it to the point where it displays the spacecraft and is ready to accept inputs from the joystick involved. For this example embodiment, the user grasps handle 302 by hand, so that the user's wrist is free to rotate in the vertical and horizontal planes. The user may press trigger input switch 308 on handle 302 to calibrate joystick 300. This calibration could be used to indicate to the computer that joystick 300 is now at the center of its movement range. For example, while joystick 300 is in this centered position, the program would make no changes in the attitude or velocity of the spaceship being displayed. Thus, if the spaceship is moving forward, it will continue to move forward at the current velocity and direction. This centered position of joystick 300 can be referred to as the rest position. All user movements can be interpreted by the computer program with respect to this rest position.
Next, for this example, it may be assumed that the user views the spaceship on the computer display, and decides to move the spaceship forward. To accomplish this function, the user simply moves the hand that is grasping handle 302 directly forward away from the rest position. The Y-Pitch acceleration sensors 304b, 304h located at the top and bottom of ring 306, sense this linear acceleration and provide that information for transmission to the computer program. The program analyzes the inputs from joystick 300 and determines that it has been moved forward. The program determines the amount that joystick 300 has been moved, and causes the spaceship in the program to accelerate forward. The rate of acceleration is dependent on the distance the user has moved joystick 300 from the rest position. The further the distance joystick 300 has been moved, the higher the rate of acceleration. At some point, the user determines that the spaceship's forward velocity is sufficient and returns joystick 300 to its rest position. As a result, the spaceship stops accelerating and continues to move forward at its current velocity. The program can be created to evaluate the speed at which the user moves the fixture, and incorporate that into movements of the spaceship.
If the user determines that the desired location of the spaceship within the computer's virtual environment will soon be reached, the user can pull joystick 300 backwards from its rest position by a certain amount. As described above, the movement of joystick 300 is analyzed by the computer program, which begins to slow the movement of the spaceship. In other words, the computer program applies a negative acceleration. When the spaceship's velocity is zero, the user can move joystick 300 to the rest position, and the spaceship will remain in its current position with no velocity.
The user can repeat the above-described operations, but this time the user pulls joystick 300 backward rather than pushing it forward to initiate motion. If the ensuing user events are substantially identical to the above-described forward events but in reverse, the spaceship will perform the same operations in a backwards direction instead of a forward direction. Similar operations can be repeated by the user for left, right, up, and down motions with the expected logical results.
If the user wishes the spaceship to turn right, the user simply rotates joystick 300 to the right. For this example embodiment, the YAW acceleration sensors 304e and 304f sense this motion. In a manner similar to that described above for linear acceleration, as the user rotates fixture 302 further away from the rest position, the computer program responds by rotating the spaceship faster. In any event, one of ordinary skill should be able to understand these movement relationships. All combinations of linear and rotational movements can be sensed by the acceleration sensors attached to joystick 300 and this information conveyed to the computer involved, and all of these linear and rotational movements of joystick 300 can be translated by the computer's program into movements of the spaceship being displayed.
It is important to note that while the present invention has been described in the context of a fully functioning free standing joystick, those of ordinary skill in the art will appreciate that the processes of the present invention are capable of being distributed in the form of a computer readable medium of instructions and a variety of forms and that the present invention applies equally regardless of the particular type of signal bearing media actually used to carry out the distribution. Examples of computer readable media include recordable-type media, such as a floppy disk, a hard disk drive, a RAM, CD-ROMs, DVD-ROMs, and transmission-type media, such as digital and analog communications links, wired or wireless communications links using transmission forms, such as, for example, radio frequency and light wave transmissions. The computer readable media may take the form of coded formats that are decoded for actual use in a particular free standing joystick.
The description of the present invention has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art. These embodiments were chosen and described in order to best explain the principles of the invention, the practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.
Claims
1. A motion sensing apparatus, comprising:
- a fixture; and
- a plurality of acceleration sensors attached to said fixture, said plurality of acceleration sensors adapted to sense a first plurality of positive and negative linear movements of said fixture and a second plurality of rotational movements of said fixture.
2. The motion sensing apparatus of claim 1, wherein said fixture and said plurality of acceleration sensors comprise a joystick.
3. The motion sensing apparatus of claim 1, wherein said fixture comprises three rod-like sections attached together at a common centerline and arranged mutually perpendicular.
4. The motion sensing apparatus of claim 1, wherein said fixture comprises a handle and a spherically-shaped device attached to each end of said handle.
5. The motion sensing apparatus of claim 1, wherein said plurality of acceleration sensors comprises a plurality of MEMS devices.
6. The motion sensing apparatus of claim 1, wherein said plurality of acceleration sensors comprises four pairs of acceleration sensors, a first acceleration sensor of each of said four pair is operable to sense a positive acceleration, and a second acceleration sensor of each said pair is operable to sense a negative acceleration.
7. The motion sensing apparatus of claim 1, wherein said plurality of accelerations sensors comprises at least one pair of sensors operable to sense linear motion and rotational motion by analyzing the sum and difference of the sensed information.
8. The motion sensing apparatus of claim 1, wherein at least one pair of said plurality of acceleration sensors comprises a first accelerometer with an axis of sensitivity oriented perpendicular to an axis of sensitivity of a second accelerometer.
9. The motion sensing apparatus of claim 1, wherein said plurality of acceleration sensors comprises a Y-pitch positive acceleration sensor, a Y-pitch negative acceleration sensor, an X-roll positive acceleration sensor, an X-roll negative acceleration sensor, a right Z positive acceleration sensor, a left Z negative acceleration sensor, a front yaw positive acceleration sensor, and a back yaw negative acceleration sensor.
10. The motion sensing apparatus of claim 1, wherein said fixture is adapted to move in synchronization with movement of a user's head.
11. The motion sensing apparatus of claim 1, wherein said fixture is adapted to move with or be moved by a person, animal or machine.
12. The motion sensing apparatus of claim 1, wherein said plurality of acceleration sensors are arranged in at least one of an orthogonal configuration and a non-orthogonal configuration including a plurality of sensors such that a movement along or about six degrees of freedom can be sensed, categorized, or made available for analysis or use.
13. A motion sensing apparatus, comprising:
- means for conveying movement in a three dimensional space; and
- means, attached to said means for conveying, for sensing a first plurality of positive and negative linear movements of said means for conveying, and a second plurality of rotational movements of said means for conveying.
14. The motion sensing apparatus of claim 13, wherein said means for conveying movement and said means for sensing comprise a joystick.
15. The motion sensing apparatus of claim 13, wherein said means for conveying comprises three rod-like sections attached together at a common centerline and arranged mutually perpendicular.
16. The motion sensing apparatus of claim 13, wherein said means for conveying movement comprises a ring-shaped structure, and said means for sensing comprises a plurality of accelerometers attached to said ring-shaped structure.
17. The motion sensing apparatus of claim 13, wherein said means for sensing comprises a plurality of MEMS devices.
18. A method for sensing movement, comprising the steps of:
- attaching a plurality of acceleration sensors to a fixture;
- a first plurality of said plurality of acceleration sensors sensing positive and negative linear movements of said fixture; and
- a second plurality of said plurality of acceleration sensors sensing positive and negative rotational movements of said fixture.
19. The method of claim 18, wherein the attaching step comprises the steps of:
- attaching three rod-like sections together at a common centerline; and
- orienting said rod-like sections perpendicular to each other.
20. The method of claim 18, wherein the fixture comprises a handle and a ring structure attached to said handle.
Type: Application
Filed: Apr 12, 2006
Publication Date: Oct 18, 2007
Applicant: Honeywell International Inc. (Morristown, NJ)
Inventor: Michael Kelly (Safety Harbor, FL)
Application Number: 11/279,493
International Classification: G09G 5/08 (20060101);