HOLOGRAPHIC DISPLAY SYSTEM FOR A MOTOR VEHICLE
A holographic display system for a motor vehicle includes a light source for generating a beam of coherent light and a spatial light modulator (SLM) having a two-dimensional pixel array. The two-dimensional pixel array modulates the beam of coherent light for generating a plurality of subframes, with each subframe being associated with one of a plurality of partial fields of view. The system further includes a scanner for directing the subframes onto associated sections of a display surface. The system further includes a computer having a memory including instructions, such that a processor is programmed to control the two-dimensional pixel array of the SLM for generating the subframes. The processor is further programmed to control the scanner for directing the subframes onto associated sections of the display surface and displaying a reconstructed image within a full field of view, which includes each of the partial fields of view.
The present disclosure relates to holographic display systems for motor vehicles, and more particularly to a holographic display system controlling a spatial light modulator for enhancing the resolution of reconstructed images and enlarging an associated eyebox size.
Car manufacturers are continuously investigating improvements to the resolution and eyebox size of Augmented Reality (AR) Head-Up-Displays (HUD). The eyebox of the AR HUDs is the area in which the driver is able to view the entire display. Modern luxury or premium vehicles can include AR HUDs with spatial light modulators (SLMs) that modulate light according to a fixed resolution or spatial (pixel) pattern. SLMs are typically used to control incident light in amplitude-only, phase-only or a combination thereof. SLMs generate images by diffraction or redistribution of light, instead of blocking light via conventional projection systems. SLMs operate in both reflection modes, e.g., liquid crystal on silicon (LCoS), and transmissive modes, e.g., glass-on-glass. Still in other examples, the SLMs can be a MEMS mirror SLM or other suitable SLMs. SLMs can provide a high-speed phase or amplitude modulation, a high-efficiency operation, and a user-friendly graphical software interface.
The traditional solution for increasing the resolution of AR HUDs and increasing the associated eyebox size is to increase the resolution of the SLM. Based on performance requirements for the field of view and the eyebox, it can be desirable to have an SLM with more than 4k resolution to provide commensurate resolution for the AR HUD. The use of multiple SLMs has also been proposed to increase the viewing zone angle and screen size of holographic display systems. However, increasing the resolution of the SLM and using multiple SLMs can increase the cost, weight, and complexity of the AR HUDs.
Thus, while existing holographic display systems achieve their intended purpose, there is a need for a new and improved holographic display system that addresses these issues.
SUMMARYAccording to several aspects of the present disclosure, a holographic display system is provided for a motor vehicle. The system includes a light source for generating a beam of coherent light and a spatial light modulator (SLM) including a two-dimensional pixel array with an SLM resolution, which encoded with holograms diffracts the coherent light. The two-dimensional pixel array modulates the beam of coherent light for generating a plurality of subframes, with each of the subframes being associated with one of a plurality of partial fields of view. The system further includes a display surface having a plurality of sections. The system further includes a computer having a processor coupled to the light source and the SLM. The computer further includes a memory having instructions, such that the processor is programmed to control at least the two-dimensional pixel array of the SLM for generating the subframes for displaying a reconstructed image within a full field of view, where the full field of view includes each of the partial fields of views.
In one aspect, the reconstructed image on the display surface has a total image resolution, and the total image resolution is higher than the SLM resolution.
In another aspect, the processor is further programmed to control at least the SLM to direct the subframes onto the sections, such that the subframes are tiled adjacent to one another without overlapping one another.
In another aspect, the total image resolution is equal to the SLM resolution multiplied by a number of the sections displaying the subframes.
In another aspect, the two-dimensional pixel array of the SLM has an SLM eyebox size, and the display surface has a display surface eyebox size, which is equal to the SLM eyebox size multiplied an inverse of the ratio between the partial field of view of one of the sections and the full field of view.
In another aspect, the system further includes a scanner for directing the subframes onto an associated one of the sections of the display surface. The processor is coupled to the SLM and programmed to control the scanner to direct the subframes onto an associated one of the sections of the display surface for displaying the reconstructed image within the full field of view, where the full field of view includes each of the partial fields of view. The processor is further programmed to control at least one of the scanner and the SLM for directing the subframes onto the sections, with the sections being arranged in a plurality of rows and a plurality of columns on the display surface.
In another aspect, the processor is further programmed to control the SLM to angularly dither the subframes onto the sections, such that each of the subframes has an enhanced portion, and the enhanced portions of the subframes overlap one another on the display surface. The enhanced portions of the associated subframes have a perceived resolution, which is higher than the SLM resolution.
According to several aspects of the present disclosure, a motor vehicle includes a body that defines a passenger cabin and a plurality of glass panels that surrounds the passenger cabin. The glass panels include at least one of a front windshield, a rear windshield, a sunroof, and a plurality of windows surrounding the passenger cabin. The motor vehicle further includes a holographic display system coupled to the body. The system includes a light source for generating a beam of coherent light and a spatial light modulator (SLM) having a two-dimensional pixel array with an SLM resolution, which encoded with holograms diffracts the coherent light. The two-dimensional pixel array modulates the beam of coherent light for generating a plurality of subframes, with each of the subframes being associated with one of a plurality of partial fields of view. The system further includes a display surface having a plurality of sections. The system further includes a computer having a processor coupled to the light source, the SLM, and the scanner. The computer further includes a memory having instructions such that the processor is programmed to control the two-dimensional pixel array of the SLM for generating the subframes. The processor is further programmed to control the scanner to direct the subframes onto associated sections of the display surface for displaying a reconstructed image within a full field of view, which includes each of the partial fields of view.
In one aspect, the display surface is a portion of at least one of the front windshield, the rear windshield, the sunroof, and the windows.
In another aspect, the system further includes a combiner glass disposed within the passenger cabin, and the display surface is a portion of the combiner glass.
In another aspect, the light source is a LASER, and the SLM is one of a liquid crystal on silicon (LCOS) SLM and a MEMS mirror SLM.
In another aspect, the reconstructed image on the display surface has a total image resolution, and the total image resolution is higher than the SLM resolution.
In another aspect, the processor is further programmed to control at least the SLM to direct the subframes onto the sections, such that the subframes are tiled adjacent to one another without overlapping one another.
In another aspect, the total image resolution is equal to the SLM resolution multiplied by a number of the sections displaying the subframes.
In another aspect, the two-dimensional pixel array of the SLM has an SLM eyebox size. The display surface has a display surface eyebox size, which is equal to the SLM eyebox size multiplied an inverse of the ratio between the partial field of view of one of the sections and the full field of view generated by the SLM.
In another aspect, the system further includes a scanner for directing the subframes onto an associated one of the sections of the display surface. The processor is coupled to the scanner and programmed to control the scanner to direct the subframes onto an associated one of the sections of the display surface for displaying the reconstructed image within the full field of view, where the full field of view includes each of the partial fields of view. The processor is further programmed to control the scanner to direct the subframes onto the sections, with the sections being arranged in a plurality of rows and a plurality of columns on the display surface.
In another aspect, the processor is further programmed to control the SLM to angularly dither the subframes onto the sections, such that each of the subframes has an enhanced portion. The enhanced portions of the subframes overlap one another on the display surface, where the enhanced portions of the associated subframes have a perceived resolution that is higher than the SLM resolution.
According to several aspects of the present disclosure, a method is provided for operating a holographic display system for a motor vehicle. The system includes a light source and a spatial light modulator (SLM) having a two-dimensional pixel array with an SLM resolution, which encoded with holograms diffracts the coherent light. The system further includes a display surface having a plurality of sections, a scanner, and a computer having a processor and a memory. The method includes the light source generating a beam of coherent light. The method further includes the SLM modulating the beam of coherent light to generate a plurality of subframes, such that each of the subframes is associated with one of a plurality of partial fields of view. The method further includes at least the SLM directing the subframes onto an associated one of the sections of the display surface. The method further includes the processor controlling the two-dimensional pixel array of the SLM to generate the subframes. The method further includes the processor controlling the scanner to direct the subframes onto an associated one of the sections of the display surface for displaying a reconstructed image within a full field of view, such that the full field of view includes each of the partial fields of view.
In one aspect, the method further includes displaying the reconstructed image on the display surface, such that the reconstructed image has a total image resolution that is higher than the SLM resolution.
In another aspect, the method further includes the processor controlling at least one of the SLM and the scanner to direct the subframes onto the sections, such that the subframes are overlapping one another or are tiled adjacent to one another without overlapping one another.
Further areas of applicability will become apparent from the description provided herein. It should be understood that the description and specific examples are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure.
The drawings described herein are for illustration purposes only and are not intended to limit the scope of the present disclosure in any way.
The following description is merely exemplary in nature and is not intended to limit the present disclosure, application, or uses.
The present disclosure describes one example of a motor vehicle having a holographic display system (system) 100. One non-limiting example of the system includes an Augmented Reality (AR) Head-Up Display (HUD) that can blend holographic display elements with other display elements or environmental characteristics to make holographic images appear in relation to the physical world. As described in detail below, the system 100 includes a spatial light modulator (SLM) 102 with a two-dimensional pixel array 104. The two-dimensional pixel array 104 has an associated resolution, an eyebox, and a pitch, and the two-dimensional pixel array 104 uses an encoded hologram to generate subframes for associated partial fields of view. The system further includes a computer for controlling the SLM to display a reconstructed image, which is formed from each of the partial fields of view and has a maximum field of view based on the pitch of the SLM. The reconstructed image has a resolution that is higher than the resolution of the SLM and has an eyebox size that is larger than the eyebox size of the SLM. As described in in one non-limiting example below, the subframes can be stitched to one another where the subframes are displayed and/or positioned adjacent to one another on the display surface to form full frames with the full field of view. The total perceived image would be the result of stitching the subframes to increase total resolution. In another example, the subframes are angularly dithered such that portions of the subframes overlap one another on common sections of the display surface. The perceived resolution of the overlapping portions on the common section is higher than the resolution of the SLM. The system may be used as part of any land, sea, or air vehicle. In other non-limiting examples, the system may be used as part of a stationary or mobile power plant, a robot, or a platform. For illustrative consistency, an application of the system as an integral part of the motor vehicle will be described hereinafter without limiting the present disclosure to such an implementation.
Referring to
As best shown in
Referring back to
The system 100 further includes the spatial light modulator (SLM) 102 having the two-dimensional pixel array 104 with an SLM resolution and an SLM eyebox. The two-dimensional pixel array 104 modulates the beam of coherent light for generating a plurality of subframes 130 (
In the non-limiting example illustrated in
Referring to
Referring back to
The processor 146 may be communicatively coupled to, e.g., via the vehicle communications module, more than one local processor, e.g., included in electronic processor units (ECUs) or the like included in the vehicle 100 for monitoring and/or controlling various vehicle components. The processor 146 is generally arranged for communications on the vehicle communications module via an internal wired and/or wireless network, e.g., a bus or the like in the vehicle 106, such as a controller area network (CAN) or the like, and/or other wired and/or wireless mechanisms. Via the vehicle communications module, the processor 146 may transmit messages to various devices in the vehicle 106 and/or receive messages from the various devices, e.g., vehicle sensors, actuators, vehicle components, a human machine interface (HMI), etc. Alternatively or additionally, in cases where the processor comprises a plurality of devices, the vehicle communications network may be used for communications between devices represented as the computer 144 in this disclosure. Further, as mentioned below, various processors and/or vehicle sensors may provide data to the computer 144. The processor 146 can receive and analyze data from sensors substantially continuously and/or periodically. Further, object classification or identification techniques can be used, e.g., in a processor 146 based on lidar sensor, camera sensor, etc., data, to identify the lane markings, a type of object, e.g., vehicle, person, rock, pothole, bicycle, motorcycle, etc., as well as physical features of objects.
The computer 144 further has a memory 148 including one or more forms of computer readable media, and stores instructions executable by the processor 146 for performing various operations, including as disclosed herein. The memory 148 includes instructions such that the processor 146 is programmed to control the two-dimensional pixel array 104 of the SLM 102 to generate the subframes 130 (
Referring to
Referring to
Referring to
Referring to
At block 304, the processor 146 generates a first actuation signal for controlling the two-dimensional pixel array of the SLM 102 to generate the subframes 130. The two-dimensional pixel array 104 of the SLM 102 modulates the beam of coherent light to generate the subframes 130, such that each of the subframes 130 is associated with one of a plurality of partial fields of view, in response to the SLM 102 receiving the first actuation signal from the processor 146.
At block 306, the processor 146 generates a second actuation signal that controls the scanner 142 to direct the subframes 130 onto an associated one of the sections 124 of the display surface 122. The scanner 142 directs the subframes 130 onto the associated sections 124 of the display surface 122 for displaying the reconstructed image within the full field of view, such that the full field of view includes each of the partial fields of view, in response to the scanner receiving the second actuation signal from the processor 146. In one non-limiting example, where the processor engages in a stitching mode, the processor 146 controls the scanner 142 to direct the subframes 130 onto the sections 124, such that the subframes 130 are tiled adjacent to one another without overlapping one another. In another non-limiting example, where the processor engages in a dithering mode, the processor 146 controls the scanner 142 to angularly dither the subframes 130 onto the sections 124, such that the subframes 130 are overlapping one another.
At block 308, the reconstructed image 160 is displayed on the display surface 122, such that the reconstructed image has a total image resolution that is higher than the SLM resolution and an eyebox size that is larger than the eyebox size of the SLM 102.
Computers and computing devices generally include computer executable instructions, where the instructions may be executable by one or more computing devices such as those listed above. Computer executable instructions may be compiled or interpreted from computer programs created using a variety of programming languages and/or technologies, including, without limitation, and either alone or in combination, JAVA, C, C++, MATLAB, SIMULINK, STATEFLOW, VISUAL BASIC, JAVA SCRIPT, PERL, HTML, TENSORFLOW, PYTORCH, KERAS, etc. Some of these applications may be compiled and executed on a virtual machine, such as the JAVA VIRTUAL MACHINE, the DALVIK virtual machine, or the like. In general, a processor (e.g., a microprocessor) receives instructions, e.g., from a memory, a computer readable medium, etc., and executes these instructions, thereby performing one or more processes, including one or more of the processes described herein. Such instructions and other data may be stored and transmitted using a variety of computer readable media. A file in a computing device is generally a collection of data stored on a computer readable medium, such as a storage medium, a random-access memory, etc.
Memory may include a computer readable medium (also referred to as a processor readable medium) that includes any non-transitory (e.g., tangible) medium that participates in providing data (e.g., instructions) that may be read by a computer (e.g., by a processor of a computer). Such a medium may take many forms, including, but not limited to, non-volatile media and volatile media. Non-volatile media may include, for example, optical or magnetic disks and other persistent memory. Volatile media may include, for example, dynamic random-access memory (DRAM), which typically constitutes a main memory. Such instructions may be transmitted by one or more transmission media, including coaxial cables, copper wire and fiber optics, including the wires that comprise a system bus coupled to a processor of an ECU. Common forms of computer readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD ROM, DVD, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, an EPROM, a FLASH EEPROM, any other memory chip or cartridge, or any other medium from which a computer can read.
Databases, data repositories or other data stores described herein may include various kinds of mechanisms for storing, accessing, and retrieving various kinds of data, including a hierarchical database, a set of files in a file system, an application database in a proprietary format, a relational database management system (RDBMS), etc. Each such data store is generally included within a computing device employing a computer operating system such as one of those mentioned above, and are accessed via a network in any one or more of a variety of manners. A file system may be accessible from a computer operating system, and may include files stored in various formats. An RDBMS generally employs the Structured Query Language (SQL) in addition to a language for creating, storing, editing, and executing stored procedures, such as the PL/SQL language mentioned above.
In some examples, system elements may be implemented as computer readable instructions (e.g., software) on one or more computing devices (e.g., servers, personal computers, etc.), stored on computer readable media associated therewith (e.g., disks, memories, etc.). A computer program product may comprise such instructions stored on computer readable media for carrying out the functions described herein.
With regard to the media, processes, systems, methods, heuristics, etc. described herein, it should be understood that, although the steps of such processes, etc. have been described as occurring according to a certain ordered sequence, such processes may be practiced with the described steps performed in an order other than the order described herein. It further should be understood that certain steps may be performed simultaneously, that other steps may be added, or that certain steps described herein may be omitted. In other words, the descriptions of processes herein are provided for the purpose of illustrating certain embodiments, and should in no way be construed so as to limit the claims.
Accordingly, it is to be understood that the above description is intended to be illustrative and not restrictive. Many embodiments and applications other than the examples provided would be apparent to those of skill in the art upon reading the above description. The scope of the invention should be determined, not with reference to the above description, but should instead be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled. It is anticipated and intended that future developments will occur in the arts discussed herein, and that the disclosed systems and methods will be incorporated into such future embodiments. In sum, it should be understood that the invention is capable of modification and variation and is limited only by the following claims.
All terms used in the claims are intended to be given their plain and ordinary meanings as understood by those skilled in the art unless an explicit indication to the contrary in made herein. In particular, use of the singular articles such as “a,” “the,” “said,” etc. should be read to recite one or more of the indicated elements unless a claim recites an explicit limitation to the contrary.
The description of the present disclosure is merely exemplary in nature and variations that do not depart from the gist of the present disclosure are intended to be within the scope of the present disclosure. Such variations are not to be regarded as a departure from the spirit and scope of the present disclosure.
Claims
1. (canceled)
2. The holographic display system of claim 21 wherein the reconstructed image on the display surface has a total image resolution, and the total image resolution is higher than the SLM resolution.
3. The holographic display system of claim 2 wherein the processor is further programmed to control at least the SLM to direct the subframes onto the sections, such that the subframes are tiled adjacent to one another without overlapping one another.
4. The holographic display system of claim 3 wherein the total image resolution is equal to the SLM resolution multiplied by a number of the sections displaying the subframes.
5. The holographic display system of claim 4 wherein the two-dimensional pixel array of the SLM has an SLM eyebox size, and the display surface has a display surface eyebox size that is equal to the SLM eyebox size multiplied an inverse of the ratio between the partial field of view of one of the sections and the full field of view.
6.-7. (canceled)
8. A motor vehicle comprising:
- a body defining a passenger cabin;
- a plurality of glass panels surrounding the passenger cabin, with the glass panels including at least one of a front windshield, a rear windshield, a sunroof, and a plurality of windows surrounding the passenger cabin; and
- a holographic display system coupled to the body and comprising: a light source for generating a beam of coherent light; a spatial light modulator (SLM) comprising a two-dimensional pixel array that has an SLM resolution, and the two-dimensional pixel array is encoded with holograms for diffracting the coherent light and modulating the beam of coherent light to generate a plurality of subframes, with each of the subframes being associated with one of a plurality of partial fields of view; a display surface comprising a plurality of sections; and
- a computer comprising: a processor coupled to the light source and the SLM; and a memory including instructions such that the processor is programmed to control at least the two-dimensional pixel array of the SLM to generate the subframes for displaying a reconstructed image within a full field of view, where the full field of view includes each of the partial fields of view.
9. The motor vehicle of claim 8 wherein the display surface comprises a portion of at least one of the front windshield, the rear windshield, the sunroof, and the windows.
10. The motor vehicle of claim 9 wherein the holographic display system further comprises a combiner glass disposed within the passenger cabin, and the display surface is a portion of the combiner glass.
11. The motor vehicle of claim 10 wherein the light source comprises a LASER, and the SLM comprises one of a liquid crystal on silicon (LCOS) SLM and a MEMS mirror SLM.
12. The motor vehicle of claim 11 wherein the reconstructed image on the display surface has a total image resolution, and the total image resolution is higher than the SLM resolution.
13. The motor vehicle of claim 12 wherein the processor is further programmed to control at least the SLM to direct the subframes onto the sections, such that the subframes are tiled adjacent to one another without overlapping one another.
14. The motor vehicle of claim 13 wherein the total image resolution is equal to the SLM resolution multiplied by a number of the sections displaying the subframes.
15. The motor vehicle of claim 14 wherein the two-dimensional pixel array of the SLM has an SLM eyebox size, and the display surface has a display surface eyebox size that is equal to the SLM eyebox size multiplied an inverse of the ratio between the partial field of view of one of the sections and the full field of view generated by the SLM.
16. The motor vehicle of claim 15 wherein the system further comprises a scanner for directing the subframes onto an associated one of the sections of the display surface;
- wherein the processor is coupled to the scanner and programmed to control the scanner to direct the subframes onto an associated one of the sections of the display surface for displaying the reconstructed image within the full field of view, where the full field of view includes each of the partial fields of view;
- wherein the processor is further programmed to control the scanner to direct the subframes onto the sections, with the sections being arranged in a plurality of rows and a plurality of columns on the display surface.
17. The motor vehicle of claim 16 wherein the processor is further programmed to control the SLM to angularly dither the subframes onto the sections, such that each of the subframes has an enhanced portion and the enhanced portions of the subframes overlap one another on the display surface, where the enhanced portions of the associated subframes have a perceived resolution that is higher than the SLM resolution.
18.-20. (canceled)
21. A holographic display system for a motor vehicle, the holographic display system comprising:
- a light source for generating a beam of coherent light;
- a spatial light modulator (SLM) comprising a two-dimensional pixel array having an SLM resolution, and the two-dimensional pixel array is encoded with holograms for diffracting the coherent light and modulating the beam of coherent light to generate a plurality of subframes, with each of the subframes being associated with one of a plurality of partial fields of view;
- a display surface comprising a plurality of sections;
- a computer comprising: a processor coupled to the light source and the SLM; and a memory including instructions such that the processor is programmed to control at least the two-dimensional pixel array of the SLM to generate the subframes for displaying a reconstructed image within a full field of view, where the full field of view includes each of the partial fields of views; and
- a scanner for directing the subframes onto an associated one of the sections of the display surface;
- wherein the processor is coupled to the SLM and controls the scanner to direct the subframes onto an associated one of the sections of the display surface for displaying the reconstructed image within the full field of view, where the full field of view includes each of the partial fields of view; and
- wherein the processor is programmed to control at least one of the scanner and the SLM to direct the subframes onto the sections, with the sections being arranged in a plurality of rows and a plurality of columns on the display surface.
22. A holographic display system for a motor vehicle, the holographic display system comprising:
- a light source for generating a beam of coherent light;
- a spatial light modulator (SLM) comprising a two-dimensional pixel array having an SLM resolution, and the two-dimensional pixel array is encoded with holograms for diffracting the coherent light and modulating the beam of coherent light to generate a plurality of subframes, with each of the subframes being associated with one of a plurality of partial fields of view;
- a display surface comprising a plurality of sections; and
- a computer comprising: a processor coupled to the light source and the SLM; and a memory including instructions such that the processor is programmed to control at least the two-dimensional pixel array of the SLM to generate the subframes for displaying a reconstructed image within a full field of view, where the full field of view includes each of the partial fields of views;
- wherein the processor is further programmed to control the SLM to angularly dither the subframes onto the sections, such that each of the subframes has an enhanced portion and the enhanced portions of the subframes overlap one another on the display surface, where the enhanced portions of the associated subframes have a perceived resolution that is higher than the SLM resolution.
23. The holographic display system of claim 22 wherein the reconstructed image on the display surface has a total image resolution, and the total image resolution is higher than the SLM resolution.
Type: Application
Filed: May 3, 2021
Publication Date: Nov 3, 2022
Inventors: Kai-Han Chang (Madison Heights, MI), Thomas A. Seder (Fraser, MI)
Application Number: 17/306,081