Method and System for Shaped Glasses and Viewing 3D Images
Shaped glasses have curved surface lenses and spectrally complementary filters disposed on the curved surface lenses configured to compensate for wavelength shifts occurring due to viewing angles and other sources. The spectrally complementary filters include guard bands to prevent crosstalk between spectrally complementary portions of a 3D image viewed through the shaped glasses. In one embodiment, the spectrally complementary filters are disposed on the curved lenses with increasing layer thickness towards edges of the lenses. The projected complementary images may also be pre-shifted to compensate for subsequent wavelength shifts occurring while viewing the images.
Latest Dolby Labs Patents:
A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
BACKGROUND OF THE INVENTION
Field of Invention
The present invention relates viewing systems and products for viewing spectrally separated 3D images. The invention is also related to viewing systems used in a Digital Cinema (D-Cinema) Theatre and improves current methods for projecting a 3D stereoscopic movie.
Discussion of Background
Methods for 3D stereoscopic projection include Anaglyph, Linear Polarization, Circular Polarization, Shutter Glasses, and Spectral Separation. Anaglyph is the oldest technology, and provides left/right eye separation by filtering the light through a two color filter, commonly red for one eye, and cyan for the other eye. At the projector, the left eye image is (commonly) filtered through a red filter, and the right image filtered through a cyan filter. The eyewear consists of a red filter for the left eye, and a cyan filter for the right eye. This method works best for black and white original images, and is not well suited for color images.
Linear Polarization 3D provides separation at the projector by filtering the left eye through a linear polarizer (commonly) oriented vertically, and filtering the right eye image through a linear polarizer oriented horizontally. The eyewear consists of a vertically oriented linear polarizer for the left eye and a horizontally oriented polarizer for the right eye. The projection screen must be of the polarization preserving type, commonly referred to as a “silver screen” because of its distinctive color. Linear Polarization allows a full color image to be displayed with little color distortion. It has several problems, these include the need for a silver screen which is expensive, fragile, and not uniform. Another problem is that the viewer must keep his head oriented vertically to avoid crosstalk from one eye to another.
Circular Polarization 3D was invented to address the problem of requiring the viewer to keep his head oriented vertically. Circular Polarization provides separation at the projector by filtering the left eye image through a (commonly) left handed circular polarizer, and filtering the right eye image through a right handed circular polarizer. The eyewear consists of a left handed circular polarizer for the left eye and a right handed circular polarizer for the right eye. A silver screen is also needed for this approach.
Shutter Glasses provides separation by multiplexing the left and right images in time. A filter for separation at the projector is not required. The eyewear consists of Shutter Glasses. These are active glasses that electronically shutter the lens in synchrony with the projector frame rate. The left eye image is first displayed, followed by the right eye image etc. Since having a direct wired connection to the Glasses in a theatre is impractical, a wireless or infrared signaling method is used to provide a timing reference for the left/right eye shuttering. This method requires an IR or RF transmitter in the auditorium. The Shutter Glasses are expensive and hard to clean, require batteries that must be frequently replaced, and are limited in their switching rate. Shutter glasses are only practical for use with D-Cinema or other electronic projection systems since very few film projectors provide the signal required to synchronize the shutter glasses with the frame rate. The method does not require a silver screen.
Spectral Separation provides separation at the projector by filtering the left and right eye spectrally. The system differs from anaglyph in that the filters for the left and right eye each pass a portion of the red, green, and blue spectrum, providing for a full color image. The band pass spectrum of the left eye filter is complementary to the band pass spectrum of the right eye filter. The eyewear consists of filters with the same general spectral characteristics as are used in the projector. While this method provides a full color image, it requires color compensation to make the colors in the left and right eye match the colors that were present in the original image, and there is a small reduction in the color gamut compared to the gamut of the projector.
All of the above methods for providing left/right eye separation for a 3D Stereoscopic presentation can be used with either two projectors (one for the left eye and one for the right eye), or may be used with a single D-Cinema projector system. In the dual projection system, the projection filter is usually static, and is located in front of the projection lens. In a single D-Cinema projector system, the left and right images are time multiplexed. Except for the Shutter Glasses case where no projection filters are required, this means that the projection filters must change at the L/R multiplex frequency. This can be done with either a filter wheel in the projector synchronized to the multiplex frequency, or with an electronically switched filter.
SUMMARY OF THE INVENTION
The present inventors have realized the need for improvements in spectrally separated viewing devices and systems. The invention provides several techniques to remove and compensate for blue shift that occurs when viewing images through filters at off-axis (other than normal) angles. The blue shift is undesirable because it can result in crosstalk between left and right images in a 3D image presentation.
Generally described, in one embodiment, the present invention provides a pair of 3D spectral separation filters (eye filters), disposed on left and right lenses of a pair of viewing glasses, the eye filters comprising a combination of increased (and proportional to wavelength) guard bands, and appropriately curved lenses to reduce crosstalk, color shift, and reflections at the edge of the field of view. A blue shifted color filter in a projector that projects images for viewing through the glasses may also be utilized. Although the present invention encompasses a combination of improvements to viewing glasses and preparation of images for viewing (e.g., image projection), the invention may be practiced with less than all the improvements in combination.
In one embodiment, the present invention provides spectral separation viewing glasses, comprising, a first lens having a first spectral filter, and a second lens having a second spectral filter complementary to the first spectral filter, wherein the first lens and the second lens are each curved to reduce the wavelength shift that occurs when viewing an image at other than an angle normal to a filter through which the image is being viewed. An amount of curvature of the lenses (and hence the filters) is calculated such that viewing angles across a viewing screen are closer to normal angles through the lenses. The curvature is implemented, for example, as a spherical curve.
In another embodiment, the invention is embodied as spectral separation viewing glasses, comprising, a first lens comprising a first spectral filter, and a second lens comprising a second spectral filter complementary to the first spectral filter, wherein the first spectral filter and the second spectral filter have at least one guard band between adjacent portions of spectrum of the spectral filters. The guard band has a bandwidth sufficient to remove crosstalk of spectrally separated images viewed through the glasses, and, for example, is calculated based on an amount of wavelength shift occurring when viewing portions of the spectrally separated images at an angle through the filters.
In one embodiment, the present invention provides a spectral separation viewing system, comprising, viewing glasses having both curved lenses and increased guard bands, and a projection system configured to project first and second spectrally separated images wherein the images are wavelength pre-shifted to compensate for wavelength shifts occurring during display and/or viewing of the images. Such systems are preferably implemented in a commercial movie theater, but are also applicable to large screen televisions, computers, virtual reality systems, and other display devices.
The present invention includes a method, comprising the steps of, projecting first and second spectrally separated images onto a display screen, viewing the projected images through a pair of glasses having a first lens having a first spectral filter matching the first spectrally separated image and a second lens having a second spectral filter matching the second spectrally separated image, wherein the spectral filters are configured to have a varying amount of wavelength shift effect depending upon a viewing angle through the lens.
In one embodiment, the present invention is a 3D viewing system, comprising, means for projecting spectrally separated images, means for viewing the spectrally separated images through different ocular channels, and means for compensating for wavelength shifts occurring due to viewing angles to portions of the images. The means for compensating may include, for example, means for adjusting an amount of spectral filtering performed on different portions of the image based on viewing angle. The means for compensating includes, for example, means for producing a wavelength mismatch between projector filters and eye filters that compensates for an amount of wavelength shift that occurs in the eye filters due to viewing angle.
The present invention may also be described as shaped glasses, comprising a pair of spectrally complementary filters disposed on curved lenses of the glasses. The spectrally complementary filters may include guard bands between adjacent spectrums of the spectrally complementary filters. In one embodiment, the thickness of dielectric layers of the spectrally complementary filters increases toward edges of the lenses.
The present invention includes a method, comprising the steps of, distributing shaped glasses to audience viewers, and projecting first and second spectrally complementary images on a display screen within view of the audience members, wherein the shaped glasses comprise first and second shaped lenses having first and second spectrally complementary filters respectively disposed thereon. In one embodiment, the first and second spectrally complementary filters respectively correspond in bandwidth to the projected first and second spectrally complementary images. However, the filters are not necessarily required to correspond exactly with the projected images of the filters. The shaped glasses comprise, for example, spherically shaped lenses.
The present invention includes a storage medium having at least a visual performance stored thereon, that, when loaded into a media player coupled to a display device, causes the media player to transmit the visual performance for display to the display device; wherein the visual performance as displayed on the display device is configured for viewing through a pair of shaped glasses. The storage medium is, for example, prepackaged with at least one pair of shaped glasses and available for purchase via a retail outlet.
In yet another embodiment, the present invention is a system for viewing 3D images, comprising, serving 3D content over a network to a receiving electronic device, and displaying the 3D content, wherein the 3D content comprises spectrally complementary images intended to be viewed with spectrally separated shaped glasses. The receiving electronic device is, for example, a display system located at a movie theater.
Portions of the invention may be conveniently implemented in programming on a general purpose computer, or networked computers, and the results may be displayed on an output device connected to any of the general purpose, networked computers, or transmitted to a remote device for output or display. In particular, the invention includes the utilization of software that implements color processing separately on each ocular channel. Any components of the present invention represented in a computer program, data sequences, and/or control signals may be embodied as an electronic signal broadcast (or transmitted) at any frequency in any medium including, but not limited to, wireless broadcasts, and transmissions over copper wire(s), fiber optic cable(s), and co-axial cable(s), etc.
BRIEF DESCRIPTION OF THE DRAWINGS
A more complete appreciation of the invention and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein:
DESCRIPTION OF THE PREFERRED EMBODIMENTS
This invention addresses some of the problems with the Spectral Separation method for projecting 3D images, specifically this invention aims to improve the off-axis filter characteristics when thin film dielectric (interference) filters (e.g., right eye and left eye filters) are used to implement eyewear (e.g., glasses) for viewing spectrally separated images.
When light passes through an interference filter at a non-normal angle, the filter characteristics (response shapes, not to be confused with the physical shape of the filter) are changed, and the entire spectral filter response is shifted toward shorter wavelengths (toward the blue). The filter characteristic response shapes are also adversely affected at larger angles. This is a fundamental attribute of interference filters, and can be compensated for by designing the filter for a specific angle if all of the rays are parallel. In cases where the light bundle is not parallel, as in the case with the use of 3-D glasses, solutions involving only design of the filter characteristics are less practical.
Glasses currently used for spectral separation consist of flat interference filters located about 2 cm in front of the viewer's eyes. In a 3D Cinema theatre (e.g., 3D D-Cinema) the light from the screen does not pass through the interference filters at a single angle. For a viewer located center and one screen width back, when viewing the image at the center of the screen, the light from the center of the screen would pass through the interference filters of the glasses at a normal (perpendicular) angle (assuming the viewer's head is positioned such that the plane of the interference filters is parallel to the plane of the screen). Under similar conditions, light from the edge of the screen would pass through the interference filters at an angle of about 26 degrees.
This viewing position is reasonably close to the screen, but is not abnormal; many of the seats in a common auditorium are located closer, and angles of 40 degrees are possible. A 26 degree angle from the edge of the screen would have the effect of shifting the filter response toward the blue by about 14 nanometers (nm), and would somewhat distort the filter shape. The resulting 3D image appears to have noticeable color shift and increased left/right eye crosstalk towards the edges of the screen.
The invention uses a combination of several techniques to reduce the effects of the blue shift, and to reduce the blue shift occurring from non-normal viewing angles. It should be remembered that the blue shift at the interference filters (e.g., lenses of the glasses having filters disposed thereon) is primarily important because it causes a mismatch between spectral characteristics of the projector filter (e.g., a filter wheel or electronically switched filter) and the glasses, or more precisely, a mismatch between the spectra of light forming the images (from whatever source) and the characteristics of the glasses at a given viewing angle.
Referring now to the drawings, wherein like reference numerals designate identical or corresponding parts, and more particularly to
One effect of the blue shift of light viewed at the edge of the screen (e.g., light 1130) is to introduce crosstalk in the image. This can be reduced by increasing the guard bands between left eye and right eye filter characteristics.
As can be seen in
Another approach is to pre-blue shift characteristics of the projector filter, or red shift the eye filters, such that for viewing at a normal angle of incidence through the eye filters, the filter characteristics are red shifted with respect to the projector filter. This increases the crosstalk and color shift for normal (on axis) viewing, but this can be tuned such that for on axis viewing the crosstalk and color shift is not objectionable. For the off axis case, the performance is improved since the difference between the projector filters and the blue shifted (off-axis) eye filters is lower.
Applying this to the case described earlier, the shift of 14 nm at the edges of the screen could be reduced to an effective shift of 11 nm if the projector filter were shifted blue 3 nm. There would be a “red shift” of 3 nm at the center of the screen.
Another approach is to curve the filters, which can be implemented, for example, by disposing the eye filters on curved lenses of viewing glasses. This has the advantage that it has the potential of actually reducing the blue shift.
The curvatures of the lenses so implemented are distinguished from prescription glasses in that the implemented curvatures are not to correct vision. Nevertheless, in one embodiment, the curvature of the invention may be implemented over or in addition to other lens characteristics intended to fulfill a viewer's prescription needs.
The curved lens solution still has some limitations. First, the radius of curvature of 30 mm resulting from the geometry described above appears very “bug-eyed,” and would be esthetically unpleasing. Second, this curvature would produce glasses whose weight would be centered well in front of the nosepiece, and they would be poorly balanced. Third, this radius may be too short to allow uniform coating of an interference filter.
Fourth, the interpupillary distance of eyes varies significantly, and this would mean that glasses designed for the mean would be improperly curved for someone with other than the mean distance. For example, with a child the situation may result in an angle of about 10 degrees for viewing of the center of the screen. As shown in
Even considering the limitations associated with curving the lenses and/or filters, this technique is valuable. Although in general cases or productions for mass audiences, it may not make sense to attempt to have the radius of curvature centered directly at the entrance pupil of the eye. By making the lenses spherical but with a radius of curvature centered behind the entrance of the pupil of the eye, much of the problems are removed (e.g., bringing the center of gravity back toward the viewer, and a less “bug-eyed” appearance) and the advantages are significantly retained.
In one alternative, the lenses may use a non-spherical curvature, such as a cylindrical curvature where the lenses are only curved from left to right, and there is no curvature in the vertical direction. This is possible because the screens always have an aspect ratio such that the horizontal extent (e.g., width) is about twice the vertical extent (e.g., height). Another alternative is to use a curvature that is non spherical in either direction, such as a multiple radius surface, or one that follows a specific mathematical function. These have advantages for allowing a greater interpupillary variation. An additional advantage of curved lenses includes the reduction of reflections from bright surfaces behind the viewer, since these reflections are not directed toward the eye.
A final approach involves the design of the interference filters. This approach requires changing the thickness of the dielectric layers as a function of the distance from the center of each eye filter. If the thicknesses of the dielectric layers are increased at the edges of the filters such that they cause a red shift in the filter characteristics, this can be used to compensate for the blue shift caused by the angle change at the edges of the field of view through the filters.
If the filters are implemented on flat glass, the thickening of the dielectric layers may increase manufacturing costs due to difficulty in implementing the increased thicknesses at different points on the flat glass. However, when coating on a curved surface, some thickening occurs during the coating process. This approach therefore becomes a practical adjunct to the curved lens solution.
The best method for achieving high performance with interference filters incorporates the four techniques described above in the following manner. First, the guard bands between left and right eye filters should be greater than approximately 2% (e.g., 2.2%) of the wavelength of that filter band. For example, for a filter with a left/right crossover at 640 nm, the guard band should be approximately 14 nm. Second, the projector filter should be designed to be blue shifted (with respect to the eye glass filters) greater than 0.6% of the wavelength of the filter band. In the same example, the center of the guard band for the projector filter would be 640−3.8=636.2 nm. The combination of these allow nominally manufactured lenses and eye filters (when used with a nominally manufactured projector lens and projector filters) to be tilted such that a blue shift of 18 nm occurs before serious degradation of the image occurs.
However, the combined manufacturing tolerance from the projector filters and the eye filters reduces this to about 9 nm. The 9 nm guard band that remains can be used for accommodating the blue shift caused by the light going through the left and right eye filters at an angle. The angle through the left and right eye filters that causes a 9 nm shift is about 20 degrees. If the curvature of the eye filters (e.g., curvature of lenses upon which the eye filters are disposed or incorporated) is adjusted to allow the light from the edge of the eye filters to pass through to the eye at a maximum of 20 degrees relative to the normal of the eye filters at the edge, then serious degradation of the image at the edge of the eye filters will not occur.
For a simple sphere, and with the eye looking straight at the center of the screen (e.g., a primary gaze normal to a tangent of the lens), the radius of curvature needed to achieve this is approximately 50 mm. As shown in
Although spherically shaped lenses are preferred, non-spherical lenses do have some advantages.
A more important advantage is that reflections from behind the viewer are reduced by the curvature. This is important because the interference filters disposed on the eyeglass lenses reflect light that is not transmitted, and are therefore quite reflective. Without the curve, the audience behind the viewer is visible across much of the back side of the lens. With the curve, only a portion (or none) of the lens has a reflection from behind the viewer.
Further optimization of the techniques discussed can be achieved by accommodating interpupillary distance variation among the population. In general, interpupillary spacing is directly related to head width and girth. Adults have larger width and girth, and wider interpupillary spacing, while children are smaller in these dimensions. Ideally, a viewer would wear glasses with the left and right eye filters disposed on corresponding left and right lenses of the glasses where the interocular spacing of the lenses is optimized for the viewer's particular interpupillary distances.
In a theatre or other large volume application, it is cumbersome to stock different sized glasses. As an optimization to the curved glasses it is possible to incorporate a feature into the design of the frame of the glasses that automatically adjusts a dihedral angle between the curved lenses to accommodate wider and narrower interpupillary spacing. Adjusting the dihedral angle insures a close to normal light incidence when viewing the screen with a primary gaze. This adjustment is done by exploiting the flexibility and bending strength properties of molded thermoplastic frames, or other frames having similar properties of strength and flexibility (e.g., metals, fiberglass, composites, etc).
In this design there is an outward convexity to the shape of the frames, which creates a dihedral angle between the lenses. In one embodiment, the bridge of the glasses is designed to flex slightly with head size variation due to pressure on the frame (e.g., pressure exerted on the temple portion of the frames). This flexing results in dihedral angle changes. As shown in
Position 900B, is similar to that when worn by a child with a relatively smaller sized head, and the interpupillary distance of the child is represented by X. The bridge 910 is less flexed because the temple or “around the ear” spacing is reduced to X′ which results in a smaller dihedral angle between the lenses. The smaller dihedral angle accommodates the child's smaller interpupillary spacing as described above.
When worn by a child (or person with a relatively smaller sized head), an amount of flex of the bridge of the glasses cause lenses 1030 and 1020 to decrease in dihedral as illustrated by 1050 for the left eye (consistent with
The lenses shown in
In describing preferred embodiments of the present invention illustrated in the drawings, specific terminology is employed for the sake of clarity. However, the present invention is not intended to be limited to the specific terminology so selected, and it is to be understood that each specific element includes all technical equivalents which operate in a similar manner.
For example, when describing a dielectric layer, any other material used as filter and exhibiting a substantive wavelength shift (e.g., nano-material coatings), whether used alone or in combination with others so as to have an equivalent function or capability, whether or not listed herein, may be substituted therewith. In another example, a flexible bridge piece may be substituted with any mechanism suitable to adjust a dihedral angle of the lens, including a ratchet mechanism, spring loaded stops, etc.
In yet another example, lenses according to the present invention may be constructed of glass, plastic, or any other such material providing the appropriate shapes as described above.
Furthermore, the inventors recognize that newly developed technologies not now known but having a similar structure or functionality may also be substituted for the described parts and still not depart from the scope of the present invention. All other described items, including, but not limited to lenses, layers, filters, wheels, screens, display devices, etc should also be considered in light of any and all available equivalents.
Portions of the present invention may be conveniently implemented using a conventional general purpose or a specialized digital computer or microprocessor programmed according to the teachings of the present disclosure, as will be apparent to those skilled in the computer art (e.g., controlling an electronically switched pre-blue shift projection filter).
The present invention includes a computer program product which is a storage medium (media) that includes, but is not limited to, any type of disk including floppy disks, mini disks (MD's), optical discs, DVD, HD-DVD, Blue-ray, CD-ROMS, micro-drive, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory devices (including flash cards, memory sticks), magnetic or optical cards, SIM cards, MEMS, nanosystems (including molecular memory ICs), RAID devices, remote data storage/archive/warehousing, or any type of media or device suitable for storing instructions and/or data. The present invention includes software for controlling aspects of the present invention including, for example, switching of pre-blue shifted filters or performance of color correction stored on any computer readable medium (media).
In addition, such media may include or exclusively contain content prepared or ready for display according to the present invention. Such content is, for example, read from the media and then transmitted electronically over a network, broadcast over the air, or transmitted by wire, cable or any other mechanism. Ultimately, the content of such media may be provided to a display device and then viewed in accordance with one or more aspects of the invention. The content is, for example, prepared or optimized so as to project images having bandwidths optimized for the display and viewing processes described herein. Such media may also be packaged with glasses and/or filters prepared according to one or more of the various aspects of the invention as described above.
The present invention may suitably comprise, consist of, or consist essentially of, any of element (the various parts or features of the invention, e.g., shaped lenses, varying dielectric layer thicknesses, pre-shifting projected or displayed images, etc., and/or any equivalents. Further, the present invention illustratively disclosed herein may be practiced in the absence of any element, whether or not specifically disclosed herein. Obviously, numerous modifications and variations of the present invention are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims, the invention may be practiced otherwise than as specifically described herein.
1. 3D viewing glasses, comprising:
- a first eye lens filter operative to pass wavelengths of light of a first channel of a 3D image and block wavelengths of light of a second channel of the 3D image; and
- a second eye filter operative to pass wavelengths of light of the second channel of the 3D image and block wavelengths of light of the first channel of the 3D image;
- wherein for at least one lens filter among the first and second eye lens filters, a spectral property varies across the lens filter such that spectral property at a center of the lens filter is different from that spectral property toward an edge of the lens filter, so that the spectral property of the lens filter is shifted toward longer wavelengths relative to wavelengths of light which the lens filter is intended to be operative.
2. The 3D viewing glasses of claim 1, wherein the spectral property of the lens filter increasingly shifts red from a center to an edge of the lens filter.
3. The 3D viewing glasses of claim 1, wherein the lens filter comprises a plurality of spectral property changes across the lens filter operative to compensate for spectral property shifts of the lens filter due to viewing angle.
4. The 3D viewing glasses of claim 1, wherein the shift toward longer wavelengths is pronounced toward edges of the lens filter.
5. The 3D viewing glasses of claim 1, wherein the lens filter is curved and the spectral property of the lens filter varies across the lens filter in a manner such that the combined effect of the shifted filter property, variation of filter property across the lens filter, and curvature of the lens filter essentially eliminates crosstalk between the first and second channels for an at least 20 degree viewing angle.
6. The 3D viewing glasses of claim 1, wherein the eye lens filters have an amount of curvature such that viewing angles across a viewing screen are closer to normal angles through the filters, the curvature having a radius of curvature greater than 50 mm centered behind an entrance of a pupil of a user's eye.
7. The 3D viewing glasses of claim 1, wherein the eye lens filters have a non-spherical curvature.
8. The 3D viewing glasses of claim 1, wherein the eye lens filters comprise a multiple radius surface.
9. The 3D viewing glasses of claim 1, wherein the 3D viewing glasses are configured to be utilized in viewing projections comprising first and second images each projected in blue, green and red wavelengths of light and at least one of the wavelengths for at least one of the images is shorter than the corresponding pass areas of the corresponding eye lens filter in an amount greater than 0.6%*W, wherein W is a wavelength of a filter band.