System and Method for Controlling a Virtual Reality Environment by an Actor in the Virtual Reality Environment
A motion capture environment includes at least one sensor-tracker for tracking a location of a tracked object within the motion capture environment and one or more computers collectively operable to generate a virtual reality environment including a virtual control panel having a virtual control that, when actuated, effects a predetermined result in the virtual reality environment; determine a virtual location of the tracked object within the virtual reality environment; and determine when the virtual location of the tracked object coincides with the location of the virtual control to actuate the virtual control. The motion capture environment further includes a display device for displaying the virtual reality environment to an actor within the motion capture environment.
The present invention relates to the control of virtual environments.
DESCRIPTION OF THE PRIOR ARTVirtual reality is a technology which allows a user or “actor” to interact with a computer-simulated environment, be it a real or imagined one. Most current virtual reality environments are primarily visual experiences, displayed either on a computer screen or through special stereoscopic displays. An actor can interact with a virtual reality environment or a virtual artifact within the virtual reality environment either through the use of standard input devices, such as a keyboard and mouse, or through multimodal devices, such as a wired glove.
One particular shortcoming of conventional virtual reality environments is that an operator, who is outside of the virtual environment, operates the virtual reality environment. The actor cannot control the virtual reality environment independently from the outside operator.
There are ways of controlling virtual reality environments well known in the art; however, considerable shortcomings remain.
The novel features believed characteristic of the invention are set forth in the appended claims. However, the invention itself, as well as a preferred mode of use, and further objectives and advantages thereof, will best be understood by reference to the following detailed description when read in conjunction with the accompanying drawings, in which the leftmost significant digit(s) in the reference numerals denote(s) the first figure in which the respective reference numerals appear, wherein:
While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof have been shown by way of example in the drawings and are herein described in detail. It should be understood, however, that the description herein of specific embodiments is not intended to limit the invention to the particular forms disclosed, but on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the appended claims.
DESCRIPTION OF THE PREFERRED EMBODIMENTIllustrative embodiments of the invention are described below. In the interest of clarity, not all features of an actual implementation are described in this specification. It will of course be appreciated that in the development of any such actual embodiment, numerous implementation-specific decisions must be made to achieve the developer's specific goals, such as compliance with system-related and business-related constraints, which will vary from one implementation to another. Moreover, it will be appreciated that such a development effort might be complex and time-consuming but would nevertheless be a routine undertaking for those of ordinary skill in the art having the benefit of this disclosure.
In the specification, reference may be made to the spatial relationships between various components and to the spatial orientation of various aspects of components as the devices are depicted in the attached drawings. However, as will be recognized by those skilled in the art after a complete reading of the present application, the devices, members, apparatuses, etc. described herein may be positioned in any desired orientation. Thus, the use of terms such as “above,” “below,” “upper,” “lower,” or other like terms to describe a spatial relationship between various components or to describe the spatial orientation of aspects of such components should be understood to describe a relative relationship between the components or a spatial orientation of aspects of such components, respectively, as the device described herein may be oriented in any desired direction.
Referring to
A virtual representation of studio 111 exists in motion capture environment 113, which hosts the virtual reality environment. The one or more actors 101 use display devices, for example, headset viewers, such as a headset viewer 201 of
Physical objects, such as physical objects 103 and 105, that are disposed within studio 111 and that are moved by the one or more actors 101, are tracked using motion capture environment 113. These “tracked objects” may be tracked by a variety of sensor methodologies, including, but not limited to, reflectors, such as reflectors 123 and 125 and reflector 203 of
Tracker-sensors, such as tracker sensors 119, interface with motion capture environment 113 and determine where a tracked object, such as physical objects 103 and 105, is located within the physical space of the studio. Such tracker-sensors may comprise a single unit or a plurality of units. The tracker-sensors may be attached to a framework, such as framework 117, which defines the physical limits of the studio or may be attached to the tracked objects, or both. While tracker-sensors may utilize various methodologies for tracking tracked objects, certain tracker-sensors use inertial acceleration with subsequent integration to provide rate and displacement information, ultrasonic measurement, optical measurement, near infrared measurement, as well as methods that use other bands of radiation within the electromagnetic spectrum.
Referring now to
Moreover, virtual control panel 127 may include one or more means for providing information from motion capture environment 113 to actor 101. For example, virtual control panel 127 may provide information relating to a simulation being performed to actor 101, such as a color scale or graph 315 representing certain parameter levels or a textual display 316 providing other such information. Moreover, virtual control panel 127 may comprise other tools which can be utilized by actor 101 in the virtual reality environment. For example, virtual control panel 127 may provide a virtual ruler 317, which can be used by actor 101 to measure virtual artifacts, distances between virtual artifacts, or the like.
It should be noted that the virtual control panel is able to “float” in virtual space at a location specified by actor 101 and may be moved from one place in the virtual environment to another place in the virtual environment by actor 101. The controls may be manipulated by actor 101's virtual hand, defined by a glove, such as glove 207, best shown in
In one embodiment, actor 101 in studio 111 manipulates a virtual hand in the virtual reality environment by wearing and physically moving glove 207, best shown in
In
Virtual control panel 127 is preferably positioned at some starting location within the virtual reality environment or may be opened and displayed at any convenient location within the virtual reality environment when actor 101 issues a command “summoning” virtual control panel 127. Tracker-sensors 119 track the location of glove 207, best shown in
Virtual control panel 127 provides many advantages to a virtual reality experience. For example, virtual control panel 127 can be configured to operate motion capture environment 113 and, thus, the virtual reality environment. Actor 101 can operate the virtual reality environment from within the environment. An external observer or operator is not required to operate the virtual reality environment.
Moreover, virtual control panel 127 can grow and shrink in size and capability without limit. Furthermore, virtual control panel 127 can be made to disappear or reappear at the will of actor 101, without interfering with the scene in the virtual reality environment. Virtual control panel 127 is able to float at any location and orientation desired by actor 101.
It should be noted that motion capture environment 113 comprises one or more computers, such as computer 115, executing software embodied in a computer-readable medium that is operable to produce and control the virtual reality environment. The scope of the invention encompasses, among other things, motion capture environment, such as motion capture environment 113 of
The particular embodiments disclosed above are illustrative only, as the invention may be modified and practiced in different but equivalent manners apparent to those skilled in the art having the benefit of the teachings herein. Furthermore, no limitations are intended to the details of construction or design herein shown, other than as described in the claims below. It is therefore evident that the particular embodiments disclosed above may be altered or modified and all such variations are considered within the scope and spirit of the invention. Accordingly, the protection sought herein is as set forth in the claims below. It is apparent that an invention with significant advantages has been described and illustrated. Although the present invention is shown in a limited number of forms, it is not limited to just these forms, but is amenable to various changes and modifications without departing from the spirit thereof.
Claims
1. A motion capture environment, comprising:
- at least one sensor-tracker for tracking a location of a tracked object within the motion capture environment;
- one or more computers collectively operable to: generate a virtual reality environment including a virtual control panel having a virtual control that, when actuated, effects a predetermined result in the virtual reality environment; determine a virtual location of the tracked object within the virtual reality environment; and determine when the virtual location of the tracked object coincides with the location of the virtual control to actuate the virtual control; and
- a display device for displaying the virtual reality environment to an actor within the motion capture environment.
2. The motion capture environment, according to claim 1, wherein the one or more computers are collectively operable to provide information to the actor via the virtual control panel.
3. The motion capture environment, according to claim 2, wherein the information concerns a computer-generated simulation.
4. The motion capture environment, according to claim 2, wherein the information is textual.
5. The motion capture environment, according to claim 2, wherein the information is graphical.
6. The motion capture environment, according to claim 1, wherein the virtual control is a virtual button.
7. The motion capture environment, according to claim 1, wherein the virtual control is a virtual knob.
8. The motion capture environment, according to claim 1, wherein the virtual control is a virtual switch.
9. The motion capture environment, according to claim 1, wherein the one or more computers are collectively operable to generate a virtual ruler for measuring distances in the virtual reality environment.
10. The motion capture environment, according to claim 1, wherein the tracked object is attachable to the actor.
11. The motion capture environment, according to claim 1, wherein the tracked object is a portion of a glove.
12. A method for controlling a virtual reality environment by an actor in the virtual reality environment, the method comprising:
- generating a virtual reality environment including a virtual control panel having a virtual control that, when actuated, effects a predetermined result in the virtual reality environment;
- displaying the virtual reality environment to an actor participating in the virtual reality environment;
- determining a virtual location of a tracked object within the virtual reality environment; and
- determining when the virtual location of the tracked object coincides with the location of the virtual control to actuate the virtual control.
13. The method, according to claim 12, further comprising:
- providing information to the actor via the virtual control panel.
14. The method, according to claim 13, wherein the information concerns a computer-generated simulation.
15. The method, according to claim 13, wherein providing information to the actor is accomplished by providing textual information to the actor.
16. The method, according to claim 13, wherein providing information to the actor is accomplished by providing graphical information to the actor.
17. The method, according to claim 12, wherein the virtual control is a virtual button.
18. The method, according to claim 12, wherein the virtual control is a virtual knob.
19. The method, according to claim 12, wherein the virtual control is a virtual switch.
20. The method, according to claim 12, further comprising:
- generating a virtual ruler for measuring distances in the virtual reality environment.
21. The method, according to claim 12, wherein determining the virtual location of the tracked object within the virtual reality environment is accomplished by tracking an object operably associated with the actor.
22. The method, according to claim 12, wherein the object operably associated with the actor is a portion of a glove.
23. Software for generating a virtual reality environment, the software embodied in a computer-readable medium and when executed operable to:
- generate a virtual reality environment including a virtual control panel having a virtual control that, when actuated, effects a predetermined result in the virtual reality environment;
- display the virtual reality environment to an actor participating in the virtual reality environment;
- determine a virtual location of a tracked object within the virtual reality environment; and
- determine when the virtual location of the tracked object coincides with the location of the virtual control to actuate the virtual control.
24. The software, according to claim 23, further operable to provide information to the actor via the virtual control panel.
Type: Application
Filed: Jan 22, 2008
Publication Date: Feb 18, 2010
Patent Grant number: 9013396
Inventors: George Steven Lewis (Alvarado, TX), Christopher Michael Bothwell (Grapevine, TX), John Valentino (Hurst, TX)
Application Number: 12/522,568
International Classification: G09G 5/00 (20060101); G06F 3/048 (20060101);