Head mounted projection display with a wide field of view
A ultra-wide field of view head mounted display has been realized by integrating an ARC display component having a greater than about 70 degrees field of retro-reflection with an optical tiling display which provides a greater than about 80 degrees horizontal field of view by about 50 degrees vertical field of view whereby an overall binocular horizontal field of view greater than about 120 degrees is realized with a greater resolution than about 2 arc minutes. There is also taught a method of providing a wide field of view head mounted display by the steps of: combining an ARC display component and an optical tiling display; and, integrating said component and said tiling display whereby an overall field of view greater than about 120 degrees is realized.
Latest University of Central Florida Research Foundation, Inc. Patents:
- Phloem-based delivery of therapeutics
- Self-supervised privacy preservation action recognition system
- High altitude laser optical sensor
- Methods, systems and compositions for functional in vitro cellular models of mammalian systems
- METHOD OF APPLYING ATOMICALLY THIN LAYERS OF METAL OXIDES ON ACTIVE PHARMACEUTICAL INGREDIENTS FOR THEIR DELAYED AND TARGETED RELEASE AND ACTIVE PHARMACEUTICAL INGREDIENTS PREPARED BY SAID METHOD
This invention claims the benefit of priority to U.S. Provisional Patent Application 60/449,722 filed Feb. 24, 2003 and has been funded in part from contracts ONR/VIRTE N00140210261 and ONR/VIRTE STTR N00014-02-M-0229.
FIELD OF INVENTIONThis invention relates to a head mounted projection display (HMPD), and in particular to a HMPD based on the integration of an Artificial Reality Center (ARC) display component and an optical tiling head mounted display (HMD), whereby a wide field of view is realized, and a method of providing a wide field of view to a head mounted display.
BACKGROUND AND PRIOR ARTNetworked virtual environments allow users at remote locations to use a telecommunication link to coordinate work and social interaction. Teleconferencing systems and virtual environments that use 3D computer graphics displays and digital video recording systems allow remote users to interact with each other, to view virtual work objects such as text, engineering models, medical models, play environments and other forms of digital data, and to view each other's physical environment.
A number of teleconferencing technologies support collaborative virtual environments which allow interaction between individuals in local and remote sites. For example, video-teleconferencing systems use simple video screens and wide screen displays to allow interaction between individuals in local and remote sites. However, wide screen displays are disadvantageous because virtual 3D objects presented on the screen are not blended into the environment of the room of the users. In such an environment, local users cannot have a virtual object between them. This problem applies to representation of remote users as well. The location of the remote participants cannot be anywhere in the room or the space around the user, but is restricted to the screen.
Head-mounted displays (HMDs) have been widely used for 3D visualization tasks such as surgical planning, medical training, or engineering design. The main issues of the conventional eyepiece-based HMD technology include tradeoffs between resolution and field-of-view (FOV), and between compactness and eye clearance, the presence of large distortion for wide FOV designs, the conflict of accommodation and convergence, the occlusion contradiction between virtual and real objects, the challenge of highly precise registration, and often the brightness conflict with bright background illumination. The concept of head-mounted projective displays (HMPDs) is an emerging technology that can be thought to lie on the boundary of conventional HMDs, and projective displays such as the CAVE technology.
The basic HMPD concept of projection head-mounted display was first patented by Fisher Nov. 5, 1996, in U.S. Pat. No. 5,572,229. On Apr. 15, 1997, a U.S. Pat. No. 5,621,572 was also issued to Ferguson on the conceptual idea of a display, i.e. optical, system for head mounted display using retro-reflector and method of displaying an image.
Common to all teleconferencing systems is the use of lenses of various configurations and weights with distortions, lack of clarity and smearing of the televised images. Representative of lenses that might at first glance appear to be useful in the teleconferencing systems are also shown in:
U.S. Pat. No. 5,526,183 by Chen who teaches the use of a lens combining diffractive elements of both glass and plastics to reduce the weight and size of the lens which lens within a conventional helmet mounted display;
U.S. Pat. No. 5,173,272 by Aoki which discloses a four element high aperture lens with glass elements making it too heavy for helmet mounting;
U.S. Pat. No. 4,753,522 by Nishina et al which lens features all 4 plastic elements and is fully symmetrical which latter property is imposed by its restricted application—a copy machine lens; and,
U.S. Pat. No. 4,669,810 by Wood which shows a head-mounted display with many (more than 4) optical elements in the relay optics.
There is a need for a HMPD reality display that mitigates the above mentioned disadvantages and has the capability to provide a widened field of view (FOV), i.e., greater than 120 degrees. Lightweight and compactness are always of basic importance and/or highly desirable for head-mounted devices but of even greater importance is those that display a wider FOV with high resolution.
SUMMARY OF THE INVENTIONA first objective of the present invention is to provide a head mounted projection display (HMPD) and method of enhanced field of view.
A second objective of this invention is to provide a HMPD and method of enhanced field of view with high resolution.
A third objective of this invention is to provide a HMPD and method having a field of view greater than about 120 degrees.
Another objective of this invention is to provide a HMD and method having a field of view greater than about 120 degrees and a resolution of greater than about 2 arc min.
A preferred embodiment of the invention encompasses a head mounted projection display (HMPD) and method of providing a wide field of view having an ARC display component having a greater than about 70 degrees field of retro-reflection integrated with an optical tiling display which provides a greater than about 80 degrees FOV per eye whereby an overall binocular FOV greater than about 120 degrees is realized.
Further objects and advantages of this invention will be apparent from the following detailed description of the presently preferred embodiments which are illustrated schematically in the accompanying drawings.
Before explaining the disclosed embodiment of the present invention in detail, it is to be understood that the invention is not limited in its applications to the details of the particular arrangements shown since the invention is capable of other embodiments. Also, the terminology used herein is for the purpose of description and not of limitation.
It would be useful to discuss the meanings of some words used herein and their applications before discussing the compact lens assembly of the invention including:
HMPD—helmet mounted projection display;
ARC display—an artificial reality center, composed of a curved retro-reflective screen for HMPD, the curved screen can span up to 360 degrees;
EFL—effective focal length;
F#—f-number;
OAL—overall length;
FOV—field of view (given in degrees for the diagonal of the display);
EPD—entrance pupil diameter; and,
Tiling display—A display consists of multiple sub-displays tiled together
Referring now to
For use in a HMPD, the weight of the lens, its FOV, its lack of smear and high resolution are of extreme importance. A highly useful lens for HMPD applications is disclosed in co-pending U.S. patent application Ser. No. 10/090,070 filed Mar. 1, 2002 and of common assignee with the instant invention and fully incorporated herein by reference thereto, to be a double-Gauss lens which has a FOV of about 52 degrees with an effective focal length of 35 mm. The specification of the preferred compact lens system which is mounted in the HMPD of
An extremely useful compact lens of reduced weight and exceptional suitability for HMPD with a FOV greater than approximately 70 degrees is the subject matter of U.S. patent application Ser. No. 10/285,855 which was filed in November 2002 and of common assignee with the instant Application and fully incorporated herein by reference thereto and disclosed therein to be a double-Gauss plastic-glass lens with an effective focal length of 23.92 mm. The specification of the preferred compact lens system for mounting in the HMPD has the following characteristics: EFL=23.92 mm; F#=2.39; OAL=13.36 mm; FOV=70.0°; EPD=10 mm; weight=6.0 g.
The ARC display component is made of a large retro-reflective screen warped on a curved surface, which can extend up to 360 deg. around a set of users, to display 3 D images/objects in a large field of view provided by the head mounted projection displays worn by the users (HMPD). For the current retro-reflective material, there is a limitation of about ±35° (70°) angle limitation i.e. 70° about for reflective rays hitting a flat retro-reflective screen. With the help of the ARC screen which is curved, one can go beyond 70° field of retro-reflection and present 3D images/objects with our novel HMPD.
It is in
As shown in
The optical tiling system for the left eye of the user has the symmetrical settings in the configuration shown in
The images projected from 801 and 805 are superimposed in visual space at surface 809. Each projection lens in
The head-mounted projecting display (HMD) can be based on novel innovative technology of integrating the ARC display component with an optical tiling component to realize a field of view in excess of about 120 degrees with excellent resolution. The optical tiling component, i.e. the space x-prism, provides a FOV greater than about 70 degrees. The ARC component provides a curved display that can be either remote or clip on to the helmet allowing a greater than about +/−35 degrees retroreflective angle. The novel HMPD of the invention has the property of a resolution of about 2.3 arc minutes at the eye and demonstrates a FOV of about 120 degrees horizontal and about 50 degrees vertical FOV. Furthermore this novel HMPD has the dual capability for both immersive and see-through applications.
Applications of this disclosed invention are many including use for the military both in training and combat, entertainment, training of medical personnel, and also in a science such as geophysics, and the like, where three dimensional viewing is desired.
While the invention has been described, disclosed, illustrated and shown in various terms of certain embodiments or modifications which it has presumed in practice, the scope of the invention is not intended to be, nor should it be deemed to be, limited thereby and such other modifications or embodiments as may be suggested by the teachings herein are particularly reserved especially as they fall within the breadth and scope of the claims here appended.
Claims
1. A method of providing a wide field of view (FOV) to a head mounted display comprising the steps of:
- (a) combining an Artificial Reality Center (ARC) display component and an optical tiling component; and,
- (b) integrating said display component and said optical tiling component produce a left projected image and a right projected image said integrating step comprising: providing optical tiling component for a left eye of the user; and providing optical tiling component for a right eye of the user, wherein said optical tiling for the left eye and said optical tiling for said right eye provides an overall binocular field of view (FOV) greater than about 80 degrees is realized from the left projected image tiled with the right projected image.
2. The method of claim 1 whereby an overall binocular FOV greater than about 120 degrees is realized.
3. The method of claim 1 wherein the combining step also includes a compact lens when the distance between the ARC display component and said optical tiling component is less than approximately 150 mm.
4. The method of claim 3 wherein said compact lens is a Fresnel lens.
5. The method of claim 1 wherein said integrating step further includes:
- projecting a left and a right top image; and
- projecting a left and a right side image, wherein said left and said right top image is tiled with a corresponding one of said left and said right side image to produce a left and a right tiled optical image.
6. The method of claim 5 wherein said left and said right tiled optical image overlap.
7. The method of claim 1, wherein said optical tiling for the left eye and said optical tiling for said right eye provides said overall binocular horizontal FOV greater than approximately 120 degrees.
8. An optical projection system comprising:
- an optical tiling system for producing a tiled projected image, wherein said optical tiling component comprises: a side projection system for projecting a side image; a top projection system for projecting a top image; and an optical tiling component having an optical cube and an optical wedge connected with said optical cube for receiving said side image and said top image, wherein said optical cube and said optical wedge reflect said side image and said top image.
9. The system of claim 8 wherein said optical wedge deflects said side image to achieve optical tiling in a horizontal direction.
10. The system of claim 8 wherein said optical tiling system includes:
- a left and a right optical tiling system for producing a left and a right tiled projected image, wherein said left and said right tiled projected image covers a greater than approximately 80 degrees field of view per side.
11. The system of claim 10 wherein said left and said right tiled projected image overlap to provide said tiled projected image covering a horizontal field of view greater than approximately 70 degrees.
12. The system of claim 11 wherein the overlapped left and right tiled projected optical image provide greater than approximately 50 degree vertical field of view.
13. The system of claim 10 wherein each of said left and said right optical tiling system comprise:
- a side projector for projecting a side image;
- a top projector for projecting a top image; and
- an optical tiling component for receiving and reflecting said side image and said top image to produce said tiled projected image at said reflective surface for viewing.
14. The system of claim 13 wherein said tiled projected optical image covers greater than approximately 120 degree horizontal field of view.
15. The system of claim 8, wherein said retroreflective surface is an Artificial Reality Center (ARC) display component having a greater than approximately 70 degrees field of retroreflection.
16. The system of claim 15 wherein said ARC display component is located at a distance greater than approximately one-half meter from said optical tiling system.
17. The system of claim 15 wherein the optical projection system is used with a helmet to provide a head mounted projection display.
18. The system of claim 17 wherein said ARC display component is located at a distance approximately 100 mm from the head mounted projection display, said system including:
- a compact lens located between said optical projection system and said retroreflective surface.
19. A head mounted projection display (HMPD) comprising:
- an optical tiling system for producing and tiling a left and a right projected image to produce a tiled projected image, wherein the optical tiling system includes a left and a right optical tiling system comprising: a top projection system for projecting a top image; a side projection system for projecting a side image; and an optical tiling component for receiving and reflecting said top and said side image to produce said tiled projected image; and
- an artificial reality center display having a greater than approximately 70 degrees field of retroreflection for receiving and retro-reflecting said tiled projected image to a user.
4669810 | June 2, 1987 | Wood |
4753522 | June 28, 1988 | Nishina et al. |
4863251 | September 5, 1989 | Herloski |
5172272 | December 15, 1992 | Aoki |
5172275 | December 15, 1992 | DeJager |
5418584 | May 23, 1995 | Larson |
5526183 | June 11, 1996 | Chen |
5572229 | November 5, 1996 | Fisher |
5621572 | April 15, 1997 | Fergason |
5625495 | April 29, 1997 | Moskovich |
5818632 | October 6, 1998 | Stephenson |
6028606 | February 22, 2000 | Kolb et al. |
6097543 | August 1, 2000 | Rallison et al. |
6198577 | March 6, 2001 | Kedar et al. |
6271972 | August 7, 2001 | Kedar et al. |
6301062 | October 9, 2001 | Ohmori et al. |
6404562 | June 11, 2002 | Ota et al. |
6543899 | April 8, 2003 | Covannon et al. |
20030137731 | July 24, 2003 | Takahashi et al. |
- “An Ultra-Light and Compact Design and Implementation of Head-Mounted Projective Displays,” Hong Hua, et al., 2001, pp. 175-182.
- “Innovative Diffractive Eyepiece for Helmet-Mounted Display,” J. Bunkenburg, Jul. 1998, pp. 41-49.
- “Diffractive Apochromatic Double-Gauss Lens,” Hideki Ogawa, Oct. 1999, pp. 43-45.
Type: Grant
Filed: Feb 20, 2004
Date of Patent: Oct 10, 2006
Assignee: University of Central Florida Research Foundation, Inc. (Orlando, FL)
Inventors: Jannick Rolland (Orlando, FL), Yonggang Ha (Orlando, FL), Larry D. Davis, Jr. (Winter Park, FL)
Primary Examiner: Alicia M Harrington
Attorney: Law Offices of Brian S. Steinberger, P.A.
Application Number: 10/783,178
International Classification: G02B 27/14 (20060101); G09G 5/00 (20060101);