Simulator utilizing a high resolution visual display
A simulator comprising a projection surface, a line-of-sight detection apparatus for detecting the orientation of a trainee's head, a projection system for projecting a high-resolution image and a low resolution image on to the projection surface, and at least one mask for merging the high-resolution image and the low-resolution image in an area that is substantially in the trainee's line-of-sight.
This application claims the benefit of U.S. Provisional Application No. 60/697,652.
TECHNICAL FIELDThe present invention relates generally to simulators. More particularly, the present invention relates to simulators that provide a high resolution display.
BACKGROUND OF THE INVENTIONTo obtain a realistic simulation, many flight simulators, particularly those for fighter and attack aircraft, use visual systems. These visual systems typically combine an image generation system (e.g., a computer image generator) with an image display subsystem, (e.g., cathode ray tubes or a digital panel projector and screen.)
For maximum training capability, these visual systems should allow a trainee to see a wide field of view. Further, the trainee should be able to search for hidden targets and other objects within the field of view, and discriminate one object from another. In effect, the ideal visual system would provide a high detail scene throughout the entire field of view.
While today's technology would allow a system to provide a high detail scene throughout the entire field of view, customers are not willing to pay the excessive cost associated with such a system. Thus, a visual system that has these capabilities is economically unfeasible.
In trying to develop an economical visual system that displays a high detail scene, prior art visual systems have had a major deficiency in that they conspicuously define or present an object within the field of view. In these prior art systems, if a particular scene is presented with a superior resolution with respect to the surrounding low detail background, then this variation will catch the trainee's attention in an unrealistic fashion and prevent him from discriminating objects. These particular objects thus “stand out” in an unrealistic fashion and result in negative training.
Thus, a need exists for an improved visual system that provides the desired realism that allows a trainee to interpret various visual cues without resulting in negative training.
SUMMARY OF THE INVENTIONIn light of the foregoing, it is a first aspect of the present invention to provide a simulator utilizing a high-resolution visual display.
It is another aspect of the present invention to provide a simulator that includes a projection surface; a line-of-sight detection apparatus for detecting the orientation of a trainee's head; a projection system for projecting a high-resolution image and a low resolution image; and at least one mask for merging the high-resolution image and the low-resolution image in an area that is substantially in the trainee's line-of-sight on the projection surface.
BRIEF DESCRIPTION OF THE DRAWINGSFor a complete understanding of the objects, techniques and structure of the invention, reference should be made to the following detailed description and accompanying drawings, wherein:
The present concept is best understood by referring to the drawings. Although the drawings are generally tailored towards a flight simulator, aspects of the present concept are equally applicable to land-vehicle simulators, water-vehicle simulators, or other various simulation environments.
As shown in
The projection surface 50 may be any surface that is suitable for displaying a projected image. The shape of the projection surface 50 may include, but is not limited to: a planar surface; a cylindrical surface; a spherical surface; a non-spherical, but generally continuous surface; or a faceted surface that is made up of either flat and/or curved surfaces. The projection surface 50 may include several types of discontinuities, for example: projector holes 52 or a door aperture or other means for entering and/or leaving the simulator. The projection surface 50 may be composed of any suitable material including, but not limited to: fiberglass, aluminum, foam, or any other naturally occurring or synthetic substance. The projection surface 50 may include one or more layers.
The floor platform 100 may be attached to and/or intersect the projection surface 50. In various embodiments, hydraulics and other mechanical apparatus may be attached to the underside of the floor platform 150. These motor or hydraulic controlled mechanical parts cause the simulator to pitch, roll, incline, decline, rotate, or otherwise move about. These parts may offer a more realistic simulation experience.
Other various embodiments will not include these mechanical parts. In these other embodiments, the underside of the floor platform may rest directly on a floor of a building or other structure. Embodiments that do not include the additional mechanical parts may be particularly desirable for customers who desire an affordable simulator that may fit into a relatively small space. In particular, when the floor platform rests directly on the floor of a building or other structure and the projection surface is non-spherical, customers may receive a particularly compact simulator.
The simulator 10 may include a mock instrumentation apparatus 150, which may also be referred to as a cockpit, that is generally positioned upon and supported by the floor platform 100. Although the drawings are generally tailored towards a mock instrumentation apparatus 150 relating to a flight simulator, aspects of the present concept are equally applicable to land-vehicle simulators, water-vehicle simulators, or other various simulation environments. A goal of the mock instrumentation apparatus 150 is to provide a user or trainee with realistic simulation controls and a realistic simulation environment.
The mock instrumentation apparatus 150 may include a skeletal canopy 152 and an instrumentation panel 154. The instrumentation panel 154 may generally attempt to emulate the controls and display of a particular aircraft. The instrumentation panel 154 may include lights, dials, gauges, LCD or CRT screens, speakers, or any other type of output device commonly found in aircraft or vehicle instrument panels; as well as levers, buttons, keyboards, switches, microphones, or any other type of input device known in this or other arts.
To make the simulation as realistic as possible, trainees may wear a head-mounted assembly 200. The head mounted assembly may be best understood with reference to
The heads-up graphics generator 204 may be included in or on the helmet shell 202. The heads-up graphics generator 204 generally provides the trainee with additional information, including, but not limited to: a plane's speed, remaining fuel, proximity of various targets, or any other relevant data. In one embodiment, the heads-up graphics generator 204 may include one or more projectors that are mounted on the exterior of the helmet shell 202. In other embodiments, the heads-up graphics generator 204 may be one or more projectors mounted inside the helmet shell. In still other embodiments, the heads-up graphics generator 204 may include Liquid-Crystal-Displays (LCDs) or other devices in the visor itself. In any event, the additional information is projected onto or otherwise generated to appear on a heads-up display surface.
In various embodiments, the heads-up graphics generator 204 may be a stereoscopic display. Such displays often include two projectors—one corresponding to each of the trainee's eyes. A common technique used in such displays is to polarize light in one direction for the right eye and to polarize light in another director for the left eye. Filters positioned proximal either the generator or the display aid the trainee in viewing the images.
The visor 206 is configured to allow the trainee to see at least a portion of the projection surface 50. As shown in
In various embodiments, the heads-up display surface is the outer surface 212 of the visor 206. One such embodiment is where a heads-up graphics generator 204 is located on the outside of the helmet shell 202 and projects an image onto the outer surface 212 of the visor 206.
In other embodiments, the heads-up display surface is the inner surface 210 of the visor 206. An example of this type of embodiment is where a heads-up graphics generator 204 is located on the inside of the helmet and projects the image onto the inner surface 210 of the visor 206. In still other embodiments, the heads-up display surface is found between the visor's outer surface 212 and the inner surface 210. An example of this embodiment might include a heads-up graphics generator 204 made up of LCDs that are located in the visor 206 itself. In other embodiments, the heads-up display surface will not be found on the visor 206, but will be found in another region of the simulator 10. For example, the heads-up display surface may be mounted on the mock instrumentation apparatus 150.
The head mounted assembly 200 also includes a line-of-sight detection apparatus 208, as shown in
The line-of-sight detection apparatus 208 may be an off-the-shelf system, in which case the line-of-sight information 214 is likely transmitted from the line-of-sight detection apparatus 208 via a bus or a wireless signal. In other embodiments, the line-of-sight detection apparatus 208 may be more closely integrated into the simulator, in which case the line-of-sight information 214 may be utilized by high-level software routines. Indeed, the line-of-sight information 214 may be stored in various arrays, then utilized by a host-processor or other digital processing engine in combination with various memory units and hardware peripherals. In various embodiments, the line-of-sight detection apparatus 208 detects the position and orientation of a trainee's head. The terms “position and orientation” and/or “line-of-sight” may include information relating to: pitch, roll, and/or yaw of the trainee's head; and/or movement of the trainee's head in the x, y, and/or z directions. Thus, one line-of-sight detection apparatus may include, for example, a series of accelerometers, microprocessors, memory, software, and other components that output data that is representative of the trainee's head position and orientation.
In an alternative embodiment, the line-of-sight detection apparatus 208 detects the position and orientation of the trainee's eye using eye-tracking techniques. These techniques generally use light or other electromagnetic radiation to determine where the trainee is looking. This embodiment may include for example, microprocessors, memory, software, and other components that output data that is representative of where the trainee is looking.
The information in the line-of-sight information 214 may be used in various ways. For example,
In various embodiments, the mock instrumentation apparatus 150 may utilize the line-of-sight information 214 to determine the cockpit lighting intensity and/or lighting intensity of the instrumentation panel 152 (see
The line-of-sight information 214 may also be transmitted to the image generator 216 and/or the projection system 250. As discussed in detail further herein, the image generator 216 and/or the projection system 250 may utilize the line-of-sight information 214 to aid in integrating a relatively high-resolution scene into a relatively low-resolution background scene, which will both be projected onto the projection surface 50 to form a final image. Note that in various embodiments, the line-of-sight information 214 need not enter the projection system 250 directly from the line-of-sight detection apparatus 208. In these embodiments, the image generator 216 may send the projection system 250 one or more image information signals 218 that include both image and control information.
The projection system is adapted to generate images that are compatible with the capabilities of the human eye. The central portion of the human eye has a greater density of light receptors than the non-central regions of the eye. Standard “low-resolution” projectors do not display images that have sufficient information to saturate the light receptors in the central (foveal) portion of the eye. Thus, in an area directly in the center of their field of view, many trainees could discern finer detail than a standard “low-resolution” projector can display. However, these same “low-resolution” projectors can display images that contain enough detail to saturate the non-central portion of the eye. Therefore, a goal of the present projection system is to provide a final image that: (1) gives the central portion of the eye the maximum level of detail that it can detect, and (2) keeps computing and other technology costs relatively low.
Referring again to
The background projector(s) 252 project a low-resolution image. Ideally, the background projector(s) 252 are collectively arranged to minimize shadowing due to the trainee and the mock instrumentation apparatus 200. Generally, the background projector(s) may have a typical effective resolution that ranges from about 20 arc-minutes/optical line pair to about 3 arc-minutes/optical line pair. In a particular embodiment, the background projector(s) have an effective resolution of approximately 4 arc-minutes/optical line pair.
The scene projector(s) 254 collectively project a high-resolution image of a scene.
In one or more embodiments, the scene projector 254 may be mounted on the mock instrumentation apparatus 150 above and behind the trainee's head. In other embodiments, the scene projector 254 may be located anywhere that allows it to directly or indirectly project an image onto the projection surface 50. Typical scene projectors may have an effective resolution that ranges from about 1 arc-minutes/optical line pair to about 4 arc-minutes/optical line pair. In a particular embodiment, the scene projector has a resolution of approximately 2 arc-minutes/optical line pair, which corresponds to a generally accepted resolution for the foveal portion of the human eye.
The scene projector(s) 254 may utilize a stereoscopic display. Stereoscopic displays often display two images—one corresponding to each of the trainee's eyes. A common technique used in such displays is to circularly polarize light in one direction for the right eye and to circularly polarize light in another director for the left eye. A filter, which is incorporated into the visor 206, is then used to aid the trainee in viewing the images. Often, the stereoscopic display makes it appear to the trainee that he or she is viewing a three-dimensional image.
In various embodiments, the scene projector 254 may be positioned to direct its light towards a mirror 256. The scene projector's light may then reflect off the mirror 256 and onto the projection surface 50. In such an embodiment, line-of-sight information 210 (see
Generally, the mirror 256 may exist anywhere that it may reflect the scene projector's light onto the projection surface 50. In a particular embodiment, the mirror 256 may, for example, be mounted on scaffolding extending from the mock instrumentation apparatus 150. In a very particular embodiment, the mirror 256 may pivot independently about a first axis and the scaffolding may rotate about a second axis.
The background image 272 and the scene image 276 are merged on the projection surface 50 to form a final image. In a particular embodiment, the background image 272 has a circular region with lower intensity than the remainder of the background image. In this embodiment, the scene image 276 is circular and is displayed in the low-intensity, circular region in the background. In other words, a circular scene-image 276 may be aligned with a low-intensity, circular background image to form a final image. This may be accomplished when the image generator 216 uses the line-of-sight information 214 to align the scene-image 276 with where the trainee is looking.
As shown in
Similarly, the scene imaging module 280 may generally include hardware and software components. The scene imaging module receives input from the image library 258 and the cockpit control 260 and creates a scene-image signal 288. The inverse mask 284 then receives the scene-image signal 288.
The mask 284, which will also be described in detail, modifies the scene-image signal 288 so that only the required signal information is sent on to the scene projector 254. In the embodiment shown
Either of the systems shown in
The transparency mask 282 and inverse mask 284 may exist in several embodiments and are best understood with reference to
Still referring to
While
As illustrated in
Based on the foregoing description, it will be appreciated that a number of advantages are realized. Foremost, the simulator 10 allows for movement of a high resolution area that is always positioned so that the focus of the trainee's vision is centered on the moving area. The simulator is also advantageous in that a transparency mask and an inverse mask are used to blend the centered high resolution area which is surrounded by the low resolution area. This blending is essentially seamless and prevents, or at least significantly reduces, negative training. Another advantage of the simulator 10 is that it allows for changes in the perceived cockpit lighting intensity based upon line of sight information associated with the pilot's head. And still another advantage of the present invention is that it allows for use of different models of the same image from an image library, such as an enemy fighter, depending upon whether the image is the high resolution area or the low resolution area. Accordingly, a high resolution simulator can be realized with relatively low-cost system components.
Thus, it can be seen that the objects of the invention have been satisfied by the structure and its method for use presented above. While in accordance with the Patent Statutes, only the best mode and preferred embodiment has been presented and described in detail, it is to be understood that the invention is not limited thereto and thereby. Accordingly, for an appreciation of the true scope and breadth of the invention, reference should be made to the following claims.
Claims
1. A simulator comprising:
- a projection surface;
- a line-of-sight detection apparatus for detecting the orientation of a trainee's head;
- a projection system for projecting a high-resolution image and a low resolution image on to the projection surface; and
- at least one mask for merging the high-resolution image and the low-resolution image in an area that is substantially in the trainee's line-of-sight based upon said trainee's head orientation.
2. The simulator of claim 1, wherein:
- the at least one mask includes a transparency mask that reduces the light intensity of a background image in an area that is substantially in the trainee's line-of-sight.
3. The simulator of claim 2, wherein the transparency mask includes:
- a central region that provides a relatively low light intensity;
- edge regions outside the central region that provide for a relatively high light intensity; and
- wherein the light intensity of the background image is continuous between the central region and the edge regions.
4. The simulator of claim 2, wherein the transparency mask includes:
- a central region that provides a relatively low light intensity;
- edge regions outside the central region that provide for a relatively high light intensity; and
- wherein the light intensity of the background image has at least one inflection point that exists between the central region and the edge regions.
5. The simulator of claim 1, wherein said projection system comprises:
- a background projector which generates said low resolution image; and
- a scene projector which generates said high resolution image.
6. The simulator according to claim 6, wherein said scene projector generates a first circularly polarized light in a first direction and a second circularly polarized light in a second direction opposite said first direction.
7. The simulator according to claim 6, further comprising:
- a head-mounted assembly worn by the trainee which has a visor with a filter incorporated therein so that the trainee visualizes a three-dimensional image.
8. The simulator of claim 1, wherein:
- the one or more masks includes an inverse mask that reduces the light intensity of a scene image in an area that is substantially in the trainee's line-of-sight.
9. The simulator of claim 1, further comprising:
- a mock instrumentation apparatus oriented with respect to said projection surface, wherein an intensity of the high-resolution image is increased when said line-of-sight detection apparatus determines that the trainee's head orientation is directed toward said mock instrumentation apparatus.
10. The simulator of claim 1, further comprising:
- an image generator for generating said high-resolution image and said low-resolution image, said line-of-sight detection apparatus providing line-of-sight information to said image generator to assist in determining boundaries of said high resolution image.
11. The simulator of claim 10, further comprising:
- an image library providing image information to said image generator for the purpose of generating said high and low resolution images.
Type: Application
Filed: Jul 7, 2006
Publication Date: Jun 21, 2007
Inventors: Edward Quinn (Uniontown, OH), Randall Wallace (Uniontown, OH), Michael Vogel (Stow, OH), Jason Seeliger (Akron, OH)
Application Number: 11/483,310
International Classification: F41G 3/26 (20060101);