PHYSICAL FEEDBACK CHANNEL FOR ENTERTAINMENT OR GAMING ENVIRONMENTS
A physical feedback system for computer gaming environments including a computing device for executing an application software program, the computing device having an interface for transmitting feedback signals generated by the application software program, and a wearable receiver having means for receiving the feedback signals from the computing device and actuator means designed to enter physical feedback sensations to the body and/or head of a user using the skin of the user as an interface.
This application is a Continuation of and claims the benefit priority from U.S. Ser. No. 10/995,001, filed Nov. 22, 2004, the entire contents of each of which are incorporated herein by reference, which claims the benefit of priority from European Patent Application No. 03026896.5, filed Nov. 24, 2003.
FIELD AND BACKGROUND OF THE INVENTIONThe present invention generally relates to the field of providing physical feedback to the user of an application, such as f.e. a computer game or other entertainment application software.
BRIEF DESCRIPTION OF THE PRESENT STATE OF THE ARTTo understand the proposed idea of the present invention, it is necessary to briefly describe the main features, advantages and problems of haptic interfaces and tactile communication systems according to the state of the art.
Haptic interfaces represent an interesting alternative to conventional human-machine interfaces and feature a wide variety of applications. Examples include virtual-reality (VR) applications for immersive simulation, teleoperated master-slave robot systems, and robotic surgery. A haptic interface according to the state of the art comprises a special input/output device (e.g. a force-feedback joystick, a haptic mouse, or an exoskeleton), a real-time controller, and a real-time simulation of a virtual environment. The controller thereby collects information from integrated sensors of the input/output device (e.g. position, velocity, force or torque sensors), which are then used as input information to the simulation. The simulation estimates the forces a user should feel based on this input information and the internal state of the simulation itself. The simulation outputs are then used by the controller to drive the input/output device's actuators, which allows said user to touch, feel, and manipulate virtual environments.
WO 01/41636 A1 refers to a tactile communication system enabling remotely control of tactile output devices, e.g. motor actuators, which are used for a sensory/tactile stimulation of human muscles, limbs, and body joints by vibrations, warmth electromagnetic pulses, etc.
WO 98/14860 pertains to a method for transmitting the touch of a sensor array via a computer or computer network and a corresponding system for transmitting perceptible feelings, which comprises at least one computer, a sensor array for detecting touches from a person and providing sensor signals, an actuator array for generating physically perceptible pressure signals, and a control unit linking the sensor array and the actuator array to the computer.
In EP 0 875 821 A2, a communication terminal device with a tactile feedback is described. The device comprises a pen-input tablet, a microphone, an acceleration sensor and a number of pressure sensors.
A computerized system including a touch/pressure-sensitive transducer and a computer responsive thereto for producing a sentic cycle and recording touch expression is disclosed in U.S. Pat. No. 5,305,423.
PROBLEMS OF PRIOR-ART SOLUTIONSToday, entertainment and gaming software such as e.g. adventure games are getting more and more realistic due to a more and more enhanced graphical resolution and frame rate. Modern game console platforms are also used in combination with hand-held controller devices providing a haptic force-feedback function. However, these force-feedback controller devices according to the state of the art do not provide a realistic way of feeling tactile sensations in virtual game scenarios.
OBJECT OF THE PRESENT INVENTIONIn view of the explanations mentioned above, it is the object of the present invention to provide a controlling device which allows a more realistic (intuitive) feedback.
This object is achieved by means of the features of the independent claims. Advantageous features are defined in the subordinate claims. Further objects and advantages of the invention are apparent in the detailed description which follows.
SUMMARY OF THE INVENTIONA system providing realistic physical feedback in a computer gaming environment according can comprise:
-
- a computing device for executing an application software program,
the computing device having an interface for transmitting feedback signals generated by the application software program, and - a wearable receiver having means for receiving the feedback signals from the computing device and actuator means designed to enter physical feedback sensations to the body and/or head of a user using the skin of the user as an interface.
- a computing device for executing an application software program,
The wearable receiver can be integrated in a piece of garment.
A display can be integrated into the piece of garment.
The wearable receiver can comprise a controller for controlling an array of actuators according to an operational pattern depending on any feedback signal received.
The system furthermore can comprise a channel for transmitting signals representing biological data from the user to the computing device hosting the application software program.
The application software can be an entertainment or game-type software.
The feedback signals can be generated depending on a background scene and/or a virtual actor of a game-type software.
The application software can be divided into several logical parts, wherein each part is associated with a channel of the feedback signals and each channel is associated with a respective subgroup of the actuator means.
The actuator means can comprise means for generating vibrational, tactile and/or heat.
The wearable receiver can comprise means for adjusting manually operational parameters of the actuator means.
According to another aspect of the present invention, a method for providing physical feedback sensations to the body of a user of an application software program can comprise the following steps:
-
- generating feedback signals in an application software program,
- transmitting the feedback signals to a wearable receiver, and
- entering, based on the received feedback signals, physical feedback sensations to the body and/or head of a user using the skin of the user as an interface.
Another aspect relates to computer program product, a computer game console and a wearable game accessory respectively supporting such a method.
Further advantages and conceivable applications of the present invention result from the subordinate claims as well as from the following description of one embodiment of the invention as depicted in the following drawings:
In the following, different embodiments of the present invention as depicted in
The present invention particularly refers to a piece of clothing or wearable accessory 101 equipped with at least one wearable computing device 100, wherein the computing device is connected to the central controlling unit 109″ e.g. of a game console application or any type of application software running on an external controlling device 109 over a wireless or wirebound link 199. It comprises means (100C) for receiving (S202′) and processing (S202′) e.g. digitally encoded control information representing physical feedback signals from the external controlling device 109, actuating means 106a-d placed on or close to the body of a person wearing said piece of clothing or wearable accessory 101, which generate multi-sensorial feedback e.g. from a virtual gaming scene by generating (S104′) visual, auditive, tactile, gustatoric and/or olfactoric stimuli, particularly stimuli using the skin of a user as an interface, as well as means for activating, controlling and deactivating (S104) these actuating means 106a-d according to said control information.
The central controlling unit can be connected operatively with a monitor device, as it is well known f.e. from game consoles, to transmit and eventually receive signals from the monitor device.
According to a further aspect of the invention, said device 100 features a tactile interface which comprises different sensing means 105a-c for detecting tactile input information when being touched by a user and/or a number of actuating means 106a-d for generating (S104′) tactile stimuli, which provides said user with sensoric feedback f.e. from a virtual gaming scene according to said control information.
According to a first embodiment of the invention as depicted in
As shown in
There are usually different types of visual or audio information conveyed to the user. Possible categories are:
(1) information regarding the atmosphere, e.g. via the rhythm of music indicating danger,
(2) information about what the main character in a virtual game scenario shown on the monitor is doing (e.g. jumping or firing), and
(3) information related to other characters such as enemies and partners of the main character. These different categories of information (background, main and foreground information) can be conveyed by different types of actuators (acoustic, optical, haptic actuators or special actuators that generate signals stimulating a player's gustatoric or olfactoric sense) to represent different levels of information to the user. For each category, the intensity of a signal can be varied.
The controlling unit 100C of a wearable computing device 100 integrated into the player's clothes thereby acts as a wireless or wired link between the actuators 106a-d and the game console platform 109. Besides conventional wireless standards such as Bluetooth, ZigBee or IEEE 802.11b WLAN technology, high-speed fixed network connections such as Ethernet, USB or 1394 can also be supported.
A second embodiment of the present invention as depicted in
A third embodiment of the present invention is directed to an interactive tactile communication scenario, wherein wearable computing devices of at least two players, each wearing a piece of clothing as described above and having a communication platform (i.e. a game console or PC) with the appropriate interfaces and application software, are interconnected via a wireless or wired network link. Thereby, a number of biometric (110c) and/or environmental signals (110c′) indicating the physical condition, emotional states and/or states of mind of a first person wearing a first piece of clothing 101 equipped with a first wearable computing device 100 and/or tactile sensations perceived by said first person are continuously (or intermittently) sensed and monitored (S100).
After having extracted (S101) a number of features from said biometric (110c) and/or environmental signals (100c′), these features are analyzed (S102) and mapped (S103) to a number of emotional patterns (meta information), that are stored in an integrated read access memory (RAM) for further processing. This meta information is then transmitted (S201) to a second person wearing a second piece of clothing 101′ equipped with at least one further wearable computing device 100′ for receiving (S202) and reproducing (S104) tactile sensations perceived and/or physical affection expressed by said first person. The application software thereby allows a “remote touch” by opening an e.g. Internet-based “tactile remote control” connection between the two players. Each player can alternatively select to control the distant wearable device of his/her counterpart or his/her own wearable device. Therefore, the application software provides predefined patterns for a mutual tactile stimulation and also enables the users to create their own individual “remote touch” patterns or sequences. In case of an online connection, real-time entertaining is available; for non-real-time operation the provision of an email interface to drive the “remote touch” scenario is also possible. Finally, it should be mentioned that this embodiment can advantageously be combined with said first and/or said second embodiment described above.
In addition to the haptic interface, a user can also wear a piece of clothing 300a/b (e-g. a shirt) that comprises optical fibers and/or any other type of wearable optical displays 102, 102′ or 102″. These displays can e.g.
-
- show the name and/or logo of an interactive network game or display the current high-score rank of a player participating in said game and/or any other game-related information (cf.
FIG. 3 a), - show a simulated heavy violation by using integrated optical fibers for coloring parts of said shirt red (cf.
FIG. 3 b), or - display relaxing images, images reflecting emotional states of a user wearing said piece of clothing—e.g. in the form of emoticons (“smileys”, e.g. “:-)”, “:-|”, or “:-(”, etc.) or other symbols and signs—or any other type of visual information.
- show the name and/or logo of an interactive network game or display the current high-score rank of a player participating in said game and/or any other game-related information (cf.
According to a further aspect of the invention, the haptic interface additionally comprises actuators 106a-d which are used for generating low-frequency vibrations or acoustic signals making the player feeling tired, stressed or unconcentrated and simulating physical strain.
Claims
1. A system comprising:
- a first wearable device including sensors configured to receive biological data from a first user and a channel configured to transmit signals representing the biological data;
- a computing device configured to receive the signals and to execute an application software program, the computing device having an interface configured to transmit feedback signals generated by the application software program based on the received signals; and
- a second wearable device including a receiver configured to receive the feedback signals from the computing device and an actuator configured to produce physical feedback sensations to a body and/or head of a second user using skin of the second user as an interface.
2. The system according to claim 1, wherein at least one of the first wearable device and the second wearable device is integrated in a piece of garment.
3. The system according to claim 2, wherein a display is integrated into the piece of garment, and the display is configured to react to the feedback signals from the computing device.
4. The system according to claim 1, wherein the second wearable device includes a controller configured to control an array of actuators according to an operational pattern depending on any feedback signal received.
5. The system according to claim 1, wherein the application software is an entertainment or game-type software.
6. The system according to claim 5, wherein the feedback signals are generated depending on a user or application context.
7. The system according to claim 6, wherein the feedback signals are generated depending on at least one of a background scene, defined virtual objects, sounds, colors and a virtual actor generated by a game-type software.
8. The system according to claim 1, wherein the application software is designed to display scenes on the monitor, and different elements of the scenes displayed are respectively associated with a channel of the feedback signals and each channel is associated with a respective subgroup of the actuator.
9. The system according to claim 1, wherein the actuator is configured to produce at least one of vibrational stimuli, tactile stimuli and heat stimuli.
10. The system according to claim 1, wherein the first wearable device and the second wearable device each include means for manually adjusting operational parameters of the actuator.
11. A method for providing physical feedback sensations to a body of a second user of an application software program, the method comprising:
- receiving biological data of a first user from sensors of a first wearable device;
- transmitting signals representing the biological data to an application software program;
- receiving the signals in the application software program;
- generating feedback signals in the application software program based on the received signals;
- transmitting the feedback signals to a second wearable device; and
- producing, based on the received feedback signals, physical feedback sensations to a body and/or head of the second user using skin of the second user as an interface.
12. The method according to claim 11, wherein an array of actuators is controlled according to an operational pattern depending on any feedback signal.
13. The method according to claim 11, wherein signals representing biological data from the first user are transmitted to the computing device hosting the application software program for further processing.
14. The method according to claim 11, wherein the feedback signals are generated depending on at least one of a background scene, defined virtual objects, sounds, colors and a virtual actor generated by a game-type software.
15. The method according to claim 11, wherein the application software is divided into several logical parts, and each part is associated with a channel of the feedback signals and each channel is associated with a respective subgroup of an actuator.
16. The method according to claim 11, wherein the at least one of producing vibrational stimuli, tactile stimuli and heat stimuli to a user.
17. A computer readable storage medium in which a program is recorded, said program executing a method comprising:
- receiving biological data of a first user from sensors of a first wearable device;
- transmitting signals representing the biological data to an application software program;
- receiving the signals in the application software program;
- generating feedback signals in the application software program based on the received signals;
- transmitting the feedback signals to a second wearable device; and
- producing, based on the received feedback signals, physical feedback sensations to a body and/or head of the second user using skin of the second user as an interface.
18. A computer game console in which a program is executed, said program executing a method comprising:
- receiving biological data of a first user from sensors of a first wearable device;
- transmitting signals representing the biological data to an application software program;
- receiving the signals in the application software program;
- generating feedback signals in the application software program based on the received signals;
- transmitting the feedback signals to a second wearable device; and
- producing, based on the received feedback signals, physical feedback sensations to a body and/or head of the second user using skin of the second user as an interface.
19. A wearable game accessory including a controller in which a method is executed, said method comprising:
- receiving biological data of a first user from sensors of a first wearable device;
- transmitting signals representing the biological data to an application software program;
- receiving the signals in the application software program;
- generating feedback signals in the application software program based on the received signals;
- transmitting the feedback signals to a second wearable device; and
- producing, based on the received feedback signals, physical feedback sensations to a body and/or head of the second user using skin of the second user as an interface.
Type: Application
Filed: Jan 21, 2009
Publication Date: May 21, 2009
Inventors: Peter BUCHNER (Kirchheim/Tech), Ulrich Clanget (St. Ingbert), Jorg Treiner (Berlin), Sophie Boucher (Paris)
Application Number: 12/357,184
International Classification: A63F 9/24 (20060101);