Radiation conditioning system
A radiation conditioning system is presented as comprising a radiation source for generating radiation, a spatial light modulator receptive of the radiation from the radiation source, a control signal for addressing the spatial light modulator, and a radiation conditioning device of the radiation field from the spatial light modulator for conditioning the radiation field.
Latest ACTUALITY SYSTEMS, INC. Patents:
This application claims the benefit of U.S. Provisional Patent Application Ser. No. 60/341,901, filed Dec. 19, 2001, which is incorporated herein by reference thereto as if set forth at length.
This application claims the benefit of U.S. Provisional Patent Application Ser. No. 60/407,904, filed Sep. 3, 2002, which is incorporated herein by reference thereto as if set forth at length.
BACKGROUNDThis disclosure relates generally to electronic display technology and more specifically to multi-view three-dimensional parallax displays.
It is known that it is possible to create a three-dimensional image by approximating the wavefronts that emanate from three-dimensional (3-D) scenes. One such class of displays contains “parallax displays,” which project the appearance of a 3-D scene from multiple viewpoints. Parallax displays generally allow a viewer to move his head horizontally and/or vertically to inspect the 3-D scene from different viewpoints.
In
There are several specific ways to construct parallax displays. One approach utilizes a lens sheet, such as a lenticular lens array or a holographic optical element of similar function, to map a field of interdigitated images to their corresponding nearest viewpoints. In this way, a user walking around the parallax display will see a series of images that approximate the scene's appearance from the corresponding viewpoints. In
A widely known embodiment of a lenticular lens array is a lenticular lens sheet. It includes a sheet with a plurality of adjacent, parallel, elongated, and partially cylindrical lenses and multiple (e.g. two) interleaved lenses on the sheet. In general, the plurality of lenses enables the multiple interleaved images to be displayed on the underlying sheet but only one of the images will be visible from any given vantage point above the sheet.
The underlying principle which explains this is illustrated in
If a person views the sheet from location “A”, lens element 54(1), because of its focusing ability, allows that person to see light from pixel 56a. That is, of the light which lens element 54(1) collects, it only sends toward the person at location “A” that light which is collected from pixel element 56a. The rest of the light which lens element 54(1) collects from other locations under the lens is sent off in other directions and will not be seen by a person at location “A”. For similar reasons, a person at location “B” only sees light emanating from pixel 56b, but does not see light emanating from other locations under lens element 54(1).
In U.S. Pat. No. 5,172,251, Benton and Kollin disclose a three dimensional display system. More recently, Eichenlaub et al (Proc. SPIE, 3639, p. 110-121, 1999) disclosed a discrete light field display, which produces up to 24 discrete viewing zones, each with a different or pre-stored image. As each of the observer's eyes transitions from one zone to another, the image appears to jump to the next zone.
In practice, parallax displays are problematic. In general, there is significant noticeable light emitted in inappropriate directions, causing imagery from wrong viewpoints to be visible. Furthermore, image realism is reduced because practical constraints limit the number of views that can be handled by each lens element. For example, the pixel density and the number of viewpoints are bounded by diffraction effects and brightness requirements. Also, many known lenticular sheet parallax displays produce undesirable dark bands as the viewer transitions between viewpoints. Therefore a parallax display with a large (i.e., 100+) number of viewpoints, high resolution, high brightness, and smooth transition between view zones is desired.
It is necessary to more closely approximate the light field generated by a 3D scene than by using lenticular sheets. A subset of the parallax display set contains holographic displays and holographic stereograms. A holographic video (“holovideo”) system creates 3D imagery that looks realistic, appears to float inside or outside of a viewing zone or panel, and exhibits motion parallax. Holovideo provides the monocular and binocular depth cues of shading, motion parallax, and viewer-position-dependent reflection and hidden-surface removal.
One group of systems was created at the Massachusetts Institute of Technology (MIT) Media Laboratory that in general creates holographic video by scanning the image of an acousto-optic scanner over a vertical diffuser. This is illustrated in
An idealized holographic stereogram emits light from each holographic pixel (or “hogel”) in a way that allows a horizontally-moving viewer to see a continuous range of perspectives. See
Existing synthetic holographic stereograms sample the parallax views. Sampled parallax is shown in
Two things are needed to generate a holographic stereogram in this fashion: a set of N images that describe scene parallax, and a diffraction pattern that relays them in N different directions. In the case of the MIT Media Laboratory's holographic video system, a set of N diffractive elements, called basis fringes, are computed. When illuminated, these fringes redirect light into the view zone as shown in
There are several ways to infer what basis fringes are required to generate a 3D scene. A typical method is to capture a scene using computer-graphic methods from N different directions. This method is illustrated in
Once N parallax views have been generated, the MIT group combines them with the N pre-computed basis fringes to assemble a holographic stereogram. In practice, this scene reconstruction is achieved using the apparatus illustrated in
As described, the handful of existing systems decompose a synthetic hologram plane into spectrally-homogenous regions called hogels, each of which is “projected” in its entirety by a spatial light modulator (SLM) or acousto-optical modulator. An acousto-optical modulator is a device which, in one mode of operation, can diffract light when an ultrasonic sound wave propagates through it. Because holograms may require 1000 line pairs per millimeter, the imagery is usually small, or of low resolution.
It is well known that computational techniques enable the creation of synthetic holograms. Typical holograms require roughly 300 to 2000 lines per mm (ten million samples per square millimeter) for practical diffraction of visible light. This has been a difficult obstacle.
It is computationally difficult to generate the AOM inputs that result in the desired light field. Furthermore, the system uses components such as acousto-optic scanners and galvanometric scanners which are financially prohibitive. This type of system is shown in
Another method of holographic video uses groups of SLM pixels as holographic fringes. One embodiment of this is described in C. Slinger, B. Bannister, C. Cameron, S. Coomber, I. Cresswell, P. Hallett, J. Hughes, V. Hui, C. Jones, R. Miller, V. Minter, D. Pain, D. Scattergood, D. Sheerin, M. Smith, and M. Stanley, “Progress and prospects for practical electro-holography systems,” in Practical Holography XV and Holographic Materials VII, Stephen A. Benton, Sylvia H. Stevenson, and T. John Trout, eds., Proceedings of SPIE v. 4296 (2001). This is depicted in
In summary, many existing holographic video systems can be schematically illustrated as shown in
The systems described above suffer from low resolution, demanding computational requirements, and the utilization of costly optical and mechanical components. A system made of volume-reproducable components and existing computational infrastructure is desired which is capable of high-resolution imagery and the ability to better approximate 3D light fields.
SUMMARY OF THE INVENTIONThe system described here exploits human persistence of vision in a different way than other known systems. Here, we previously encode a set of basis fringes into a rotating diffractive optical element (DOE). A basis fringe is an elemental fringe pattern computed to contain a particular spectral profile. Linear summations of basis fringes are used to diffract light. This name is analogous to mathematical basis functions. The DOE is addressed optically by a 2D SLM at the appropriate times. As a result, over a time window of about 0.05 sec, the holographic plane is formed by summation over time.
A multi-view parallax display according to this disclosure utilizes a high-resolution 2D image generator (SLM) in which each directional field is generated in its entirety, allowing the resolution of the hologram plane to theoretically equal the SLM resolution. A periodic image scanner, such as a rotating holographic optical element, scans a sequence of directional fields across a range of exit angles. Therefore, a 3D light field is synthesized at high spatial and angular resolution using what is termed spectral multiplexing, since a sequence of angular (or spectral) components is projected in time sequence. Human persistence of vision integrates the sequence of spectral components into a visible image. The system engineer is given flexibility in using the sequence of directional fields as a set of distinct viewpoints, or as components of a more precisely-computed generalized light field using known techniques.
In general, the approach occurs in several steps:
1. Spectral decomposition of the scene: a database of ray trajectories (e.g. point of origin, the angle of the trajectory, the intensity and color) that exit a hologram plane is generated. One method renders or records the scene from multiple viewpoints, such as from a camera moving along a horizontal track, and assigns each snapshot to a different projection time. Another method examines the light field of a 3-D scene and computes the trajectories of the constituent rays that would exit the hologram plane to generate that light field. This is illustrated in
2. Elemental image projection. A high-speed 2D projector projects the spectrally-classified (sorted by ray angle) data in a rapid sequence of 5,000-10,000 frames per second. Typically, the holographic video refresh rate equals this projector rate divided by the total number of ray angles (or, equivalently, the number of perspective viewpoints.) The imagery is projected on or through a scanning element, preferably a rotating diffractive optical element (DOE).
3. View zone scanning. In
The system described here utilizes the viewer's persistence of vision to sum the basis fringes. Also, it uses the concept of “spectral multiplexing” which gives the system engineer flexibility in how the view zone is scanned, decreases the cost and complexity of fringe generation, and greatly increases system resolution by densely mapping individual projector pixels to hologram plane regions. This is illustrated in
Other features and advantages of the invention will be apparent from the following detailed description, and from the claims.
BRIEF DESCRIPTION OF THE DRAWINGS
Holographic video requires the generation of arbitrary three-dimensional (3D) light fields. A 3D light field can be generated by decomposing the field computationally into components—such as an ensemble of beams with various trajectories and profiles—and projecting these components by a projector whose light is modulated by a multi-region light-shaping element with time-varying properties.
In
First, a database of ray origins and trajectories is created. That is, the output of each hogel can correspond to the images taken by a set of cameras arranged on a line, or can be inferred by backwards ray-tracing from each element of a 3D scene.
See
The beam steering is performed by a diffractive optical element (DOE) which may be linear (rectangular) or circular. A typical DOE for this purpose is the spinning-disc diffractive optical element illustrated in
f=A sin(theta)+B, (1)
where f is the spatial frequency of the diffraction grating, A is a scaling factor that determines the ratio of maximum to minimum diffraction grating frequencies 465 and 454, theta is an angular dimension and B is an offset which may be considered to be an angular carrier frequency. The purpose of the disc-shaped DOE 455 is that it causes incident light, such as a laser beam 450, to sweep back-and-forth through a variety of exit angles if the DOE is rotated about the axis that is normal to the plane of the DOE and intersects the center of the DOE. The rotation of the DOE thus provides for a time varying property in the DOE. The coefficients A and B are chosen such that visible light is able to make a maximum excursion of 30° from the angle of incidence. Here theta is a rotational angle measured from a reference angle in the plane of the DOE.
The DOE 455 allows spectral multiplexing to occur. The DOE 455 acts as the optical equivalent to a lookup table, a device which is typically used in computer programs or electronics in order to speed up calculation. Here, an optical device (the DOE) is encoded with a set of fringes that can be optically addressed when needed. This is better than other techniques (described earlier) in which the illumination source is modulated to create diffraction patterns, wasting resolution. In our case, we modulate the illumination source to address diffraction patterns. The diffraction patterns (the optical lookup table) can take any of a number of forms. It can be previously encoded on a DOE, or can be a predictable set of inputs to an AOM, or can be a galvanometric mirror sweeping back and forth.
Please see
The system that generates the 3D light fields can be used to serve purposes other than visual display. For example, it may be desired to illuminate a moving target. Existing algorithms in the field of computer vision are able to detect the three-dimensional position of a target. One approach of illuminating the target would be to use a spotlight under mechanical control, as directed by the computer vision algorithm. However, it may be undesirable to have large mechanical components, such as a set of two galvanometric scanning mirrors. The system disclosed in this application can be used to replace the spotlight's mechanical mirrors. Given the target's location, an SLM will allow light to pass through the regions of a DOE which result in steering the output beam to illuminate the target. As the target moves, the SLM will again couple the input illumination to the appropriate region of the DOE to illuminate the target. For example,
Therefore, the system disclosed here can also be used as a varifocal projector. Assume the radiation-shaping element 455 contains a series of lenslets with different focal lengths. For example, it is able to focus 2D imagery onto a surface whose distance varies with time. This might be useful as an office projector that is self-focusing. After well-known circuitry detects the distance of a projection screen, a 2D SLM projects a 2D image through the radiation-shaping element at only those times in which the appropriate lenslet is in the beam path from the SLM to the projection screen.
As seen in
Other DOE patterns are possible to optimize, for example, resolution in a particular zone, or the range of viewing angles. The diffraction frequency of a disc-shaped DOE is mapped directly to its rotational angle. The DOE can alternatively incorporate a different scanning function than sin theta; can include a focusing or diffusing capability; or can utilize a scan angle that is a function of both radius and angle, which may reduce the perception of image flicker. The DOE or scanning element can contain vertical or horizontal diffusing capability. It is usually desirable to incorporate some horizontal diffusion into the DOE so that the viewer sees a continuous transition between view zones (beam trajectories.) The optical-lookup table can be implemented by a scanning mirror, AOM with periodic input, or other elements. Color imagery may be created by using colored illumination, such as red, green, and blue components from a standard projector engine. Dispersion compensation can be performed computationally. Furthermore, animated imagery can be created by software.
For the purposes of this document, “radiation-shaping” or “radiation conditioning” and “light-shaping” or “light conditioning” should be defined to include radiation—(and thus light-) shaping, steering, profile-shaping, focusing, diffusion, and all other types of modulating radiation.
Any reference to first, second, etc., or front or back, right or left, top or bottom, upper or lower, horizontal or vertical, or any other phrase indicating the relative position of one object, quantity or variable with respect to another is, unless otherwise noted, intended for the convenience of description, and does not limit the present invention or its components to any one positional, spatial or temporal orientation. All dimensions of the components in the attached Figures can vary with a potential design and the intended use of an embodiment without departing from the scope of the invention.
Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. Although methods and materials similar or equivalent to those described herein can be used in the practice or testing of the present disclosure, suitable methods and materials are described below. All publications, patent applications, patents, and other references mentioned herein are incorporated by reference thereto in their entirety. In case of conflict, the present specification, including definitions, will control. In addition, the materials, methods, and examples are illustrative only and not intended to be limiting.
While the invention has been described with reference to several embodiments thereof, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the invention without departing from the essential scope thereof. Therefore, it is intended that the invention not be limited to the particular embodiments disclosed as the best mode contemplated for carrying out this invention, but that the invention will include all embodiments falling within the scope of the appended claims.
Claims
1-26. (canceled)
27. A radiation conditioning system comprising:
- a radiation source for generating radiation;
- a spatial light modulator receptive of the radiation from the radiation source and a control signal for addressing the spatial light modulator, thereby projecting a radiation field from the spatial light modulator; and
- a radiation conditioning device receptive of the radiation field from the spatial light modulator for conditioning the radiation field;
- wherein the radiation conditioning device includes a plurality of radiation conditioning regions.
28. The radiation conditioning system as set forth in claim 27 wherein the radiation conditioning device comprises a diffractive optical element.
29. The radiation conditioning system as set forth in claim 28 wherein the diffractive optical element comprises a diffraction grating.
30. The radiation conditioning system as set forth in claim 29 wherein the diffraction grating comprises a set of basis fringes.
31. The radiation conditioning system as set forth in claim 29 wherein the diffraction grating comprises grating pattern having a spatial frequency defined by the mathematical equation: f=A sin(θ)+B wherein f is the spatial frequency of the grating pattern, A is scaling factor that determines the ratio of maximum to minimum diffraction grating frequencies, θ is a spatial dimension and B is a carrier frequency offset factor.
32. The radiation conditioning system as set forth in claim 30 wherein the diffractive optical element comprises a disc.
33. The radiation conditioning system as set forth in claim 28 wherein the diffractive optical element comprises an acousto-optic modulator.
34. The radiation conditioning system set forth in claim 27 wherein the radiation conditioning device comprises a set of lenslets.
35. The radiation conditioning system set forth in claim 27 wherein the set of lenslets comprise an array.
36. The radiation conditioning system set forth in claim 27 wherein the set of lenslets are arranged in a rectangular host.
37. The radiation conditioning system set forth in claim 27 wherein the rectangular host is in reciprocating motion.
38. The radiation conditioning system set forth in claim 27 wherein the radiation conditioning device comprises a spatial light modulator.
39. The radiation conditioning system set forth in claim 38 wherein the spatial light modulator comprises an optically addressable spatial light modulator.
40. The radiation conditioning system set forth in claim 39 wherein the optically addressable spatial light modulator includes a material having properties depending upon a first illumination frequency and is read out at a second frequency.
41. A radiation conditioning device comprising:
- a diffractive optical element including a diffraction grating comprising a set of basis fringes.
42. The radiation conditioning device as set forth in claim 41 wherein the diffraction grating comprises grating pattern having a spatial frequency defined by the mathematical equation: f=A sin(θ)+B wherein f is the spatial frequency of the grating pattern, A is scaling factor that determines the ratio of maximum to minimum diffraction grating frequencies, θ is a spatial dimension and B is a carrier frequency offset factor.
43. A method of conditioning a radiation field, the method comprising:
- conditioning the radiation field by scanning the radiation field with a radiation conditioning device comprising a set of basis fringes.
44. The method as set forth in claim 43 further comprising decomposing the radiation field into a set of components.
45. The method as set forth in claim 43 wherein the radiation conditioning device comprises a diffractive optical element.
46. The method as set forth in claim 43 wherein conditioning the radiation field comprises scanning the radiation field with a diffraction grating having a grating pattern defined by the mathematical equation: f=A sin(θ)+B wherein f is the spatial frequency of the grating pattern, A is scaling factor that determines the ratio of maximum to minimum diffraction grating frequencies, θ is a spatial dimension and B is a carrier frequency offset factor.
47. The method as set forth in claim 45 wherein scanning the radiation field comprises rotating the radiation conditioning device through a prescribed angular distance.
48. The method as set forth in claim 45 wherein scanning the radiation field comprises rotating the diffraction grating through a prescribed angular distance.
49. A method of conditioning a radiation field, the method comprising:
- conditioning the radiation field by scanning the radiation field with a radiation conditioning device having time varying properties.
50. A radiation conditioning system comprising:
- a radiation projector for projecting a radiation field; and
- a radiation conditioning device receptive of the radiation field from the radiation projector for conditioning the radiation field;
- wherein the radiation conditioning device includes a plurality of radiation conditioning regions.
51. The system as set forth in claim 50 wherein the radiation conditioning device comprises a set of basis fringes.
52. A radiation conditioning device comprising:
- a diffractive optical element comprising a diffraction grating comprising a set of basis fringes;
- wherein the diffraction grating comprises a grating pattern having a spatial frequency defined by the mathematical equation:
- f=A sin(θ)+B
- and wherein f is the spatial frequency of the grating pattern, A is a scaling factor that determines a ratio of maximum to minimum diffraction grating frequencies, θ is a spatial dimension and B is a carrier frequency offset factor.
Type: Application
Filed: Oct 25, 2004
Publication Date: May 5, 2005
Applicant: ACTUALITY SYSTEMS, INC. (Burlington, MA)
Inventors: Gregg Favalora (Arlington, MA), Joshua Napoli (Winchester, MA), David-Henry Oliver (Brookline, MA)
Application Number: 10/972,955