SYSTEMS, DEVICES, AND METHODS FOR OPTICAL WAVEGUIDES
Systems, devices, and methods for optical waveguides that are well-suited for use in wearable heads-up displays (WHUDs) are described. An optical device comprises an optical waveguide including a volume of optically transparent material having a first longitudinal surface positioned opposite a second longitudinal surface across a width of the volume, an in-coupler, a liquid crystal out-coupler, and a controller to modulate a refractive index of the liquid crystal out-coupler. Light is in-coupled into the waveguide and is propagated along a length of the waveguide by total internal reflection between the longitudinal surfaces before being out-coupled by the liquid crystal out-coupler on a path that is dependent on the modulated refractive index of the liquid crystal out-coupler. In this way, light signals can be steered to create an image and/or to move an exit pupil of an image. WHUDs that employ such optical waveguides are also described.
The present systems, devices, and methods generally relate to steering light by optical waveguides, and particularly relate to systems, devices, and methods that employ such in wearable heads-up displays.
BACKGROUND Description of the Related Art Wearable Heads-Up DisplaysA head-mounted display is an electronic device that is worn on a user's head and, when so worn, secures at least one electronic display within a viewable field of at least one of the user's eyes, regardless of the position or orientation of the user's head. A wearable heads-up display is a head-mounted display that enables the user to see displayed content but also does not prevent the user from being able to see their external environment. The “display” component of a wearable heads-up display is either transparent or at a periphery of the user's field of view so that it does not completely block the user from being able to see their external environment. The “combiner” component of a wearable heads-up display is the physical structure where display light and environmental light merge as one within the user's field of view. The combiner of a wearable heads-up display is typically transparent to environmental light but includes some optical routing mechanism to direct display light into the user's field of view.
Examples of wearable heads-up displays include: the Google Glass®, the Optinvent Ora®, the Epson Moverio®, and the Microsoft Hololens® just to name a few.
Optical Waveguides in Wearable Heads-Up DisplaysA majority of currently available wearable heads-up displays employ optical waveguide systems in the transparent combiner. An optical waveguide operates under the principle of total internal reflection (TIR). TIR occurs when light remains in a first medium upon incidence at a boundary with a second medium because the refractive index of the first medium is greater than the refractive index of the second medium and the angle of incidence of the light at the boundary is above a specific critical angle that is a function of those refractive indices. Optical waveguides employed in wearable heads-up displays like those mentioned above consist of rectangular prisms of material with a higher refractive index then the surrounding medium, usually air (Google Glass®, Optinvent Ora®, Epson Moverio®) or a planar lens (Microsoft Hololens®). Light input into the prism will propagate along the length of the prism as long as the light continues to be incident at boundaries between the prism and the surrounding medium at an angle above the critical angle. Optical waveguides employ in-coupling and out-coupling to ensure that light follows a specific path along the optical waveguide and then exits the optical waveguide at a specific location and on a specific path in order to create an image that is visible to the user.
The optical performance of a wearable heads-up display is an important factor in its design. When it comes to face-worn devices, however, users also care a lot about aesthetics. This is clearly highlighted by the immensity of the eyeglass (including sunglass) frame industry. Independent of their performance limitations, many of the aforementioned examples of wearable heads-up displays have struggled to find traction in consumer markets because, at least in part, they lack fashion appeal. Visibility requirements of the displays of these current wearable heads-up displays necessitate larger display creation components. Most wearable heads-up displays presented to date appear very bulky and unnatural on a user's face compared to the more sleek and streamlined look of typical curved eyeglass and sunglass lenses. There is a need in the art for components which allow wearable heads-up displays to achieve the form factor and fashion appeal expected of the eyeglass frame industry while creating a large, high quality display.
BRIEF SUMMARYAn optical device may be summarized as including: an optical waveguide comprising volume of optically transparent material to propagate light signals by total internal reflection, wherein the volume of optically transparent material has a first longitudinal surface and a second longitudinal surface, the second longitudinal surface opposite the first longitudinal surface across a width of the volume of optically transparent material; an in-coupler; a liquid crystal out-coupler to tunably steer light signals; and a controller communicatively coupled to the liquid crystal out-coupler, wherein a refractive index of the liquid crystal out-coupler is modulatable in response to signals from the controller. The liquid crystal out-coupler may comprise a single modulatable region or at least two distinct, independently modulatable regions.
The out-coupler may be a liquid crystal out-coupler communicatively coupled to the controller and a refractive index of the out-coupler is modulatable in response to signals from the controller to tunably steer the light signals. The liquid crystal out-coupler may comprise a single modulatable region or at least two distinct, independently modulatable regions.
The optical device may further comprise a processor communicatively coupled to the controller to modulate the output signals from the controller.
A method of operating an optical device comprising an optical waveguide including a volume of optically transparent material having a first longitudinal surface and a second longitudinal surface, the second surface positioned opposite the first surface across a width of the volume of optically transparent material, an in-coupler, and a liquid crystal out-coupler, and a controller communicatively coupled to the liquid crystal out-coupler, may be summarized as including: in-coupling a first set of light signals by the in-coupler; propagating the first set of light signals along a length of the volume of optically transparent material by total internal reflection between the first longitudinal surface and the second longitudinal surface; modulating a refractive index of the liquid crystal out-coupler to a first refractive index by the controller; out-coupling the first set of light signals by the liquid crystal out-coupler, wherein the first set of light signals are output on a path that is dependent on the refractive index of the liquid crystal out-coupler. The method may further comprise: in-coupling the second set of light signals by the in-coupler; propagating the second set of light signals along a length of the volume of optically transparent material by total internal reflection between the first longitudinal surface and the second longitudinal surface; modulating a refractive index of the liquid crystal out-coupler to a second refractive index by the controller; out-coupling the second set of light signals by the liquid crystal out-coupler region, wherein the second set of light signals are output on a path that is dependent on the refractive index of the liquid crystal out-coupler.
A wearable heads-up display (WHUD) may be summarized as including: a support structure that in use is worn on the head of a user; a projector to generate light signals, the projector comprising at least one light source; an optical waveguide comprising a volume of optically transparent material to propagate light signals by total internal reflection, wherein the volume of optically transparent material has a first longitudinal surface and a second longitudinal surface, the second longitudinal surface opposite the first longitudinal surface across a width of the volume of optically transparent material; an in-coupler; a liquid crystal out-coupler to tunably steer light signals; and a controller communicatively coupled to the liquid crystal out-coupler, wherein a refractive index of the liquid crystal out-coupler is modulatable in response to signals from the controller. The liquid crystal out-coupler may comprise a single modulatable region or at least two distinct, independently modulatable regions.
The out-coupler may be a liquid crystal out-coupler and wherein a refractive index of the out-coupler is modulatable in response to signals from the controller to tunably steer the light signals. The liquid crystal out-coupler may comprise a single modulatable region or at least two distinct, independently modulatable regions.
The WHUD may further comprise a processor communicatively coupled to the projector to modulate the generation of light signals and communicatively coupled to the controller to modulate the output of signals from the controller.
The WHUD may further comprise a processor communicatively coupled to the projector to modulate the generation of light signals.
The WHUD may further comprise a processor communicatively coupled to the controller to modulate the output of signals from the controller.
A method of operating a wearable heads-up display (WHUD) comprising a support structure that in use is worn on the head of a user, a projector with at least one light source, an optical waveguide including a volume of optically transparent material having a first longitudinal surface opposite a second longitudinal surface across a width of the volume of optically transparent material, an in-coupler, a liquid crystal out-coupler, and a controller communicatively coupled to the liquid crystal out-coupler, may be summarized as including: generating a first set of light signals by the at least one light source of the projector; in-coupling the second set of light signals into the volume of optically transparent material by the in-coupler; propagating the second set of light signals along a length of the volume of optically transparent material by total internal reflection between the first longitudinal surface and the second longitudinal surface; modulating a refractive index of the liquid crystal out-coupler to a second refractive index by the controller; out-coupling the second set of light signals by the liquid crystal out-coupler, wherein the second set of light signals are output on a path that is dependent on the refractive index of the liquid crystal out-coupler. The method may further comprise: generating a second set of light signals by the at least one light source of the projector; in-coupling the second set of light signals into the volume of optically transparent material by the in-coupler; propagating the second set of light signals along a length of the volume of optically transparent material by total internal reflection between the first longitudinal surface and the second longitudinal surface; modulating a refractive index of the liquid crystal out-coupler to a second refractive index by the controller; out-coupling the second set of light signals by the liquid crystal out-coupler, wherein the second set of light signals are output on a path that is dependent on the refractive index of the liquid crystal out-coupler.
In the drawings, identical reference numbers identify similar elements or acts. The sizes and relative positions of elements in the drawings are not necessarily drawn to scale. For example, the shapes of various elements and angles are not necessarily drawn to scale, and some of these elements are arbitrarily enlarged and positioned to improve drawing legibility. Further, the particular shapes of the elements as drawn are not necessarily intended to convey any information regarding the actual shape of the particular elements, and have been solely selected for ease of recognition in the drawings.
In the following description, certain specific details are set forth in order to provide a thorough understanding of various disclosed embodiments. However, one skilled in the relevant art will recognize that embodiments may be practiced without one or more of these specific details, or with other methods, components, materials, etc. In other instances, well-known structures associated with portable electronic devices and head-worn devices, have not been shown or described in detail to avoid unnecessarily obscuring descriptions of the embodiments.
Unless the context requires otherwise, throughout the specification and claims which follow, the word “comprise” and variations thereof, such as, “comprises” and “comprising” are to be construed in an open, inclusive sense, that is as “including, but not limited to.”
Reference throughout this specification to “one embodiment” or “an embodiment” means that a particular feature, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” include plural referents unless the content clearly dictates otherwise. It should also be noted that the term “or” is generally employed in its broadest sense, that is as meaning “and/or” unless the content clearly dictates otherwise.
Throughout this specification the terms “in-coupler,” “out-coupler” “liquid crystal in-coupler,” “liquid crystal out-coupler,” “non-liquid crystal in-coupler”, and non-liquid crystal out-coupler” are used. The generic terms “in-coupler” and “out-coupler” may include any structure or optic that respectively in-couples or out-couples light, including but not limited to: a hologram, a holographic optical element, a volume diffraction grating, a surface relief grating, a transmission grating, a reflection grating, or a liquid crystal element, liquid crystal cell or liquid crystal stack. The terms “liquid crystal in-coupler” and liquid crystal out-coupler” refer to a modulatable liquid crystal element, modulatable liquid crystal cell or modulatable liquid crystal stack that in use respectively in-couples light to or out-couples light from an optical waveguide or slab. The terms “non-liquid crystal in-coupler” and “non-liquid crystal out-coupler” may include any element or optic that respectively in-couples light to or out-couples light from an optical waveguide or slab that does not include modulatable liquid crystal material, and may refer to: a hologram, a holographic optical element, a volume diffraction grating, a surface relief grating, a transmission grating, or a reflection grating.
“In-coupling” and “out-coupling” of light signals into and out of a waveguide does not solely refer to light signals entering and exiting the interior of the waveguide but also includes directing the light signals into and out of the waveguide on paths that enable the light signals to create the desired pattern upon exiting the waveguide. That is, an in-coupler or out-coupler does not only act to, respectively, input or output light signals while maintaining the current path of the light signals, but instead may alter the direction of any or all light signals from the path of incidence on the in-coupler or out-coupler.
The propagation of light within the waveguides discussed throughout this specification is by total internal reflection (TIR). TIR occurs when light remains in a first medium (the waveguide) upon incidence at a boundary with a second medium because the refractive index of the first medium is greater than the refractive index of the second medium and the angle of incidence of the light at the boundary is above a specific critical angle that is a function of those refractive indices. Throughout this specification when light signals are referred to as propagating down the length of a waveguide it is meant that these light signals are propagated by total internal reflection and that the light signals have met the boundary between the material of the waveguide and the medium external to the waveguide at or above the critical angle.
The headings and Abstract of the Disclosure provided herein are for convenience only and do not interpret the scope or meaning of the embodiments.
Liquid crystal is a substance that exists between a liquid and a solid state. The molecules of a solid substance are generally aligned while molecules in a liquid substance have no order. Molecules of a liquid crystal may have some order but it is not uniform over the entire substance. Under external stimulation, e.g. an electric or magnetic field, the molecules of a liquid crystal can become ordered, which can result in changes to the optical properties of the liquid crystal. This phenomenon provides a method of altering the refractive index of a liquid crystal element.
Optical device 100a operates as follows. A first set of light signals 150a is incident on liquid crystal in-coupler 120a (all arrows represent the first set of light signals; only the first arrow in the set of arrows is labelled to reduce clutter). First set of light signals 150a may be a single light signal or may be multiple light signals which are incident on liquid crystal in-coupler 120a simultaneously. In
Second set of light signals 150b is incident on liquid crystal in-coupler 120b (all arrows represent the second set of light signals; only the first arrow in the set of arrows is labelled to reduce clutter). Second set of light signals 150b may be a single light signal or may be multiple light signals which are incident on liquid crystal in-coupler 120b simultaneously. In
Third set of light signals 150c is incident on liquid crystal in-coupler 120c (all arrows represent the third set of light signals; only the first arrow in the set of arrows is labelled to reduce clutter). Third set of light signals 150c may be a single light signal or may be multiple light signals which are incident on liquid crystal in-coupler 120c simultaneously. In
Throughout this specification and in the drawings, liquid crystal in-couplers or in-coupler are shown and discussed as being located parallel to the first longitudinal surface and the second longitudinal surface of the volume of optically transparent material of the waveguide. However, light signals may enter the volume of optically transparent material at an “end” of the volume of optically transparent material, i.e., at a surface that is not along a length of the optical waveguide, and therefore the liquid crystal in-coupler or in-coupler may also be perpendicular to the length of the waveguide.
A first set of light signals 250a is incident on non-liquid crystal in-coupler 260 (all arrows represent the first set of light signals; only the first arrow in the set of arrows is labelled to reduce clutter). First set of light signals 250a may be a single light signal or may be multiple light signals which are incident on non-liquid crystal in-coupler 260 simultaneously. First set of light signals 250a are in-coupled into volume of optically transparent material 210 by non-liquid crystal in-coupler 260. The path that first set of light signals 250a follows within volume of optically transparent material 210 may be dependent on the wavelength of the light signal(s), the angle of incidence of the light signal(s) on non-liquid crystal in-coupler 260, and/or the location of incidence of the light signal(s) on non-liquid crystal in-coupler 260. First set of light signals 250a are propagated down the length of volume of optically transparent material 210 by total internal reflection between first longitudinal surface 211 and second longitudinal surface 212. First set of light signals 250a are out-coupled by liquid crystal out-coupler 270a upon incidence of first set of light signals 250a on liquid crystal out-coupler 270a. In
A second set of light signals 250b is incident on non-liquid crystal in-coupler 260 (all arrows represent the second set of light signals; only the first arrow in the set of arrows is labelled to reduce clutter). Second set of light signals 250b may be a single light signal or may be multiple light signals which are incident on non-liquid crystal in-coupler 260 simultaneously. Second set of light signals 250b are in-coupled into volume of optically transparent material 210 by non-liquid crystal in-coupler 260. The path that second set of light signals 250b follows within volume of optically transparent material 210 may be dependent on the wavelength of the light signal(s), the angle of incidence of the light signal(s) on non-liquid crystal in-coupler 260, and/or the location of incidence of the light signal(s) on non-liquid crystal in-coupler 260. Second set of light signals 250b are propagated down the length of volume of optically transparent material 210 by total internal reflection between first longitudinal surface 211 and second longitudinal surface 212. Second set of light signals 250b are out-coupled by liquid crystal out-coupler 270b upon incidence of second set of light signals 250b on liquid crystal out-coupler 270b. In
A third set of light signals 250c is incident on non-liquid crystal in-coupler 260 (all arrows represent the first set of light signals; only the first arrow in the set of arrows is labelled to reduce clutter). Third set of light signals 250c may be a single light signal or may be multiple light signals which are incident on non-liquid crystal in-coupler 260 simultaneously. Third set of light signals 250 care in-coupled into volume of optically transparent material 210 by non-liquid crystal in-coupler 260. The path that third set of light signals 250c follows within volume of optically transparent material 210 may be dependent on the wavelength of the light signal(s), the angle of incidence of the light signal(s) on non-liquid crystal in-coupler 260, and/or the location of incidence of the light signal(s) on non-liquid crystal in-coupler 260. Third set of light signals 250c are propagated down the length of volume of optically transparent material 210 by total internal reflection between first longitudinal surface 211 and third longitudinal surface 212. Third set of light signals 250c are out-coupled by liquid crystal out-coupler 270c upon incidence of third set of light signals 250c on liquid crystal out-coupler 270c. In
A first set of light signals 350a is incident on liquid crystal in-coupler 320a (all arrows represent the first set of light signals; only the first arrow in the set of arrows is labelled to reduce clutter). First set of light signals 350a may be a single light signal or may be multiple light signals which are incident on liquid crystal in-coupler 320a simultaneously. In
A second set of light signals 350b is incident on liquid crystal in-coupler 320b (all arrows represent the second set of light signals; only the first arrow in the set of arrows is labelled to reduce clutter). Second set of light signals 350b may be a single light signal or may be multiple light signals which are incident on liquid crystal in-coupler 320b simultaneously. In
A third set of light signals 350c is incident on liquid crystal in-coupler 320c (all arrows represent the third set of light signals; only the first arrow in the set of arrows is labelled to reduce clutter). Third set of light signals 350c may be a single light signal or may be multiple light signals which are incident on liquid crystal in-coupler 320c simultaneously. In
A fourth set of light signals 350d is incident on liquid crystal in-coupler 320d (all arrows represent the fourth set of light signals; only the first arrow in the set of arrows is labelled to reduce clutter). Fourth set of light signals 350d may be a single light signal or may be multiple light signals which are incident on liquid crystal in-coupler 320d simultaneously. In
Light signals 451 (solid line arrows), 452 (dashed line arrows) and 453 (dashed and dotted line arrows) are incident on liquid crystal in-coupler 420 (only the first arrow for each light signal is labelled to reduce clutter). Liquid crystal in-coupler 420 has three independently modulatable regions. Each of light signals 451, 452, and 453 are incident on a respective one of modulatable regions 421, 422, and 423 of liquid crystal in-coupler 420. In
In other implementations, a liquid crystal out-coupler with a single modulatable region or individual modulatable regions of a liquid crystal out-coupler like liquid crystal out-coupler 470 may be modulated by controller 430 to be opaque. By modulating a region of the liquid crystal out-coupler to be opaque, a light signal or multiple light signals when incident on the opaque region will reflect back into the volume of optically transparent material and propagate further down the waveguide before being out-coupled. In the case of a single region liquid crystal out-coupler, the liquid crystal out-coupler would need to be modulated from opaque to transmissive before the second incidence of the light signal on the out-coupler. In the case of a liquid crystal out-coupler with multiple independently modulatable regions, the region where the incidence first occurs will be modulated to opaque while the region where the second incidence occurs will be modulated to be transmissive (depending on the size of the regions, the regions of first and second incidence may be the same region or different regions).
In other implementations, each of liquid crystal in-coupler 420 and liquid crystal out-coupler 470 may be modulated by a distinct controller instead of the same controller.
At 501, a refractive index of the liquid crystal in-coupler is modulated to a first refractive index by the controller. The controller may modulate the refractive index of the liquid crystal in-coupler by altering a voltage (or another modulating signal) applied to the liquid crystal in-coupler. The liquid crystal may operate in a positive mode wherein a higher voltage results in a higher opacity, or a negative mode wherein a higher voltage results in a lower opacity. The liquid crystal in-coupler may comprise multiple independently modulatable regions which may be modulated by the controller to each have a respective first refractive index, wherein the refractive index of each respective region may be different from or the same as the refractive indices of the other regions. The controller may be communicatively coupled to a processor which modulates the output of signals from the controller. The processor may be communicatively coupled to a non-transitory processor-readable storage medium and the processor may execute data and/or instruction from the non-transitory processor readable storage medium to modulate the controller. Notably, the modulation of the refractive index of the liquid crystal in-coupler can occur just before or during incidence of light signals, and will in many instances be concurrent or even simultaneous.
At 502, a first set of light signals is in-coupled into the volume of optically transparent material of the waveguide, wherein a path (or paths) of the first set of light signals within the volume of optically transparent material is dependent on the first refractive index of the liquid crystal in-coupler. That is, the path of the light signals is altered (or remains unaltered) in response to the refractive index of the liquid crystal in-coupler, resulting in the light signals being steered by the liquid crystal in-coupler. The path of an individual light signal may also be dependent on the wavelength of the light signal, the location of incidence of the light signal on the liquid crystal in-coupler, and/or the angle of incidence of the light signal on the liquid crystal in-coupler. The light signals are in-coupled on a path that will eventually result in a desired image or part of an image at the desired location, for example at an eye of a user. If the liquid crystal in-coupler comprises multiple independently modulatable regions the path of an individual light signal is dependent on the modulatable region upon which the individual light signal is incident. The liquid crystal in-coupler may be present on the exterior of the volume of optically transparent material or may be located inside the volume of optically transparent material. If located inside the volume of optically transparent material, the liquid crystal in-coupler may be at or proximate the first longitudinal surface of the second longitudinal surface, or may be embedded within the volume of optically transparent material not at or proximate a surface.
At 503, the first set of light signals are propagated along a length of the volume of optically transparent material by total internal reflection between the first longitudinal surface and the second longitudinal surface.
At 504, the first set of light signals are output from the waveguide by the out-coupler. The first set of light signals are output from the optical waveguide on a path that creates the desired image or part of an image at the desired location. The output path of an individual light signal may depend on the wavelength of the light signal, the location of incidence of the light signal on the out-coupler, and/or the angle of incidence of the light signals on the out-coupler. The out-coupler may be at or proximate the first longitudinal surface and may out-couple the first set of light signals by reflection or the out-coupler may be at or proximate the second longitudinal surface and may out-couple the first set of light signals by transmission.
Method 500 may further include repeating acts 501, 502, 503, 504, and 505 with a second set of light signals, wherein the controller modulates the liquid crystal in-coupler to have a second refractive index, or if the liquid crystal in-coupler has multiple independently modulatable regions, a second set of refractive indices. This may be repeated for other sets of light signals. If each set of light signals is a single light signal, an image or other desired pattern of light may be created by modulating the refractive index of the liquid crystal in-coupler to steer further sets of light signals as they are generated over time. That is, the refractive index of the liquid crystal in-coupler may enable “scanning” of subsequent single light signals to create an image (e.g. raster scanning). If each set of light signals comprises multiple light signals, modulating the refractive index of the liquid crystal in-coupler may steer an exit pupil of an image (or portion of an image) or other desired pattern created by the multiple light signals.
In some implementations, the out-coupler may be a liquid crystal out-coupler which is communicatively coupled to the controller (or may be communicatively coupled to a second, distinct controller) and the method may further include modulating the refractive index of the liquid crystal out-coupler to a third refractive index (the third refractive index may be the same as either the first or second refractive index and may be different from both the first or second refractive index) and out-coupling a set of light signals on output path(s) which are dependent on the refractive index of the liquid crystal out-coupler. The output paths of the light signals may also be dependent on the wavelength of the light signals, the location of incidence of the light signals on the liquid crystal out-coupler, and/or the angle of incidence of the light signals on the liquid crystal out-coupler.
At 601, a first set of light signals are in-coupled into the waveguide by the in-coupler. That is, the first set of light signals are in-coupled into the volume of optically transparent material on the desired path to eventually create a desired image or part of an image at a desired location, for example an eye of a user. The path of an individual light signal may depend on the wavelength of the light signal, the location of incidence of the light signal on the in-coupler, and/or the angle of incidence of the light signals on the in-coupler. The in-coupler may be at or proximate the first longitudinal surface and may in-couple the first set of light signals by reflection or the in-coupler may be at or proximate the second longitudinal surface and may in-couple the first set of light signals by transmission.
At 602, the first set of light signals are propagated along a length of the volume of optically transparent material by total internal reflection between the first longitudinal surface and the second longitudinal surface.
At 603, a refractive index of the liquid crystal out-coupler is modulated to a first refractive index by the controller. The controller may modulate the refractive index of the liquid crystal out-coupler by altering a voltage (or another modulating signal) applied to the liquid crystal in-coupler. The liquid crystal may operate in a positive mode wherein a higher voltage results in a higher opacity, or a negative mode wherein a higher voltage results in a lower opacity. The liquid crystal out-coupler may comprise multiple independently modulatable regions which may be modulated by the controller to each have a respective first refractive index, wherein the refractive index of each respective region may be different from or the same as the refractive indices of the other regions. The controller may be communicatively coupled to a processor which modulates the output of signals from the controller. The processor may be communicatively coupled to a non-transitory processor-readable storage medium and the processor may execute data and/or instruction from the non-transitory processor readable storage medium to modulate the controller.
At 604, the first set of light signals is output, for example towards the eye of the user, by the liquid crystal out-coupler, wherein an output path of the first set of light signals is dependent on the refractive index of the liquid crystal out-coupler. That is, the path of the light signals is altered (or remains unaltered) in response to the refractive index of the liquid crystal out-coupler, resulting in the light signals being steered by the liquid crystal out-coupler. The path of an individual light signal may also be dependent on the wavelength of the light signal, the location of incidence of the light signal on the liquid crystal out-coupler, and/or the angle of incidence of the light signal on the liquid crystal out-coupler. The light signals are output on a path that will result in a desired image or part of an image at a desired location, for example at the eye of the user. If the liquid crystal out-coupler comprises multiple independently modulatable regions, the path of an individual light signal is dependent on the modulatable region upon which the individual light signal is incident. The liquid crystal out-coupler may be at or proximate the first longitudinal surface and may out-couple the first set of light signals by reflection, or the liquid crystal out-coupler may be at or proximate the second longitudinal surface and may out-couple the first set of light signals by transmission.
Method 600 may further include repeating acts 601, 602, 603, 604, and 605 with a second set of light signals, wherein the controller modulates the liquid crystal in-coupler to have a second refractive index, or if the liquid crystal in-coupler has multiple independently modulatable regions, a second set of refractive indices. This may be repeated for other sets of light signals. If each set of light signals is a single light signal, an image or other desired pattern of light may be created by modulating the refractive index of the liquid crystal in-coupler to steer further sets of light signals as they are generated over time. That is, the refractive index of the liquid crystal in-coupler may enable “scanning” of subsequent single light signals to create an image (e.g., raster scanning). If each of light signals comprises multiple light signals, modulating the refractive index of the liquid crystal in-coupler may steer an exit pupil of an image (or portion of an image) or other desired pattern created by the multiple light signals.
Alternatively, a waveguide may include both a liquid crystal in-coupler and a liquid crystal out-coupler, wherein both the liquid crystal in-coupler and the liquid crystal out-coupler are communicatively coupled to a controller (either the same controller or two distinct controllers). The method for operating such an optical device would include modulating the refractive indices of both the liquid crystal in-coupler and the liquid crystal out-coupler by the respective controllers to steer both the in-coupling paths of light signals and the out-coupling paths of light signals to create an image or part of an image.
The at least one light source of projector 782 generates a first set of light signals. The first set of light signals may be a single beam of light or may be multiple light signals. The first set of light signals is directed towards and is incident on liquid crystal in-coupler 720. The first set of light signals may be directed towards liquid crystal in-coupler 720 by a scanner, such as a MEMS mirror. Liquid crystal in-coupler 720 is modulated to have a first refractive index by controller 730 (this modulation may before generation of the light signals or incidence of the light signals on liquid crystal in-coupler 730). The first set of light signals are in-coupled into the volume of optically transparent material by liquid crystal in-coupler 720. That is, the path of the first set of light signals is altered (or remains unaltered) in response to the refractive index of liquid crystal in-coupler 720, resulting in the light signals being steered by liquid crystal in-coupler 720. The first set of light signals is in-coupled on a path that will eventually result in a desired image or part of an image at the eye of a user. The path of an individual light signal may be dependent on the wavelength of the light signal, the location of incidence of the light signal on liquid crystal in-coupler 720, and/or the angle of incidence of the light signal on liquid crystal in-coupler 720. If liquid crystal in-coupler 720 comprises multiple independently modulatable regions the path of an individual light signal is dependent on the modulatable region upon which the individual light signal is incident. The first set of light signals is propagated down a length of volume of optically transparent material 710 by total internal reflection between a first longitudinal surface of volume of optically transparent material 710 and a second longitudinal surface of volume of optically transparent material 710. Upon incidence of the first set of light signals on liquid crystal out-coupler 770, the first set of light signals it output from the waveguide towards an eye of the user. That is, the path of the first set of light signals is altered (or remains unaltered) in response to the refractive index of liquid crystal out-coupler 770, resulting in the first set of light signals being steered by liquid crystal out-coupler 770. The first set of light signals is output on a path that will result in a desired image or part of an image at the eye of the user. The path of an individual light signal may be dependent on the wavelength of the light signal, the location of incidence of the light signal on the liquid crystal out-coupler, and/or the angle of incidence of the light signal on the liquid crystal out-coupler. If liquid crystal out-coupler 770 comprises multiple independently modulatable regions the path of an individual light signal is dependent on the modulatable region upon which the individual light signal is incident. The projector then generates a second set of light signals which are in-coupled into volume of optically transparent material 710 and out-coupled out of the waveguide in the same manner as the first set of light signals but wherein the controller modulates the refractive indices of liquid crystal in-coupler 720 and liquid crystal out-coupler 770 to create the desired image or portion of an image at the eye of the user. This process can be repeated n times, where n is any positive integer. When a first set of light signals displays an entire image at the eye of the user, repeating the process n times may result in displaying several images at the eye of the user over time and may be used to steer the exit pupil of the display. An eyetracker may be used to determine how the refractive indices of liquid crystal in-coupler 720 and liquid crystal out-coupler 770 may be modulated to steer the exit pupil. When a first set of light signals only displays a portion of an image at the eye of the user and subsequent sets of light signals display respective different portions of the same image, repeating the process n times may result in displaying portions of an image to create a total image at the eye of the user. WHUD 700 is shown with display apparatus (projector and waveguide) on only one side but could, for example, have a display for each eye of the user. Images provide to each side may differ from one another to, for instance, create a sense of depth.
The operation of WHUD 800 is similar to the operation of optical device 400 which the addition of projector 882 and an eye of a user 890. Projector 882 generates a first set of light signals which are directed towards liquid crystal in-coupler 820. Light signals 851, 852, and 853 follow the same path through liquid crystal in-coupler 820, volume of optically transparent material 810, and liquid crystal out-coupler 870 as light signals 451, 452, and 453 in
At 901, at least one light source of the projector generates a first set of light signals. The first set of light signals may be a single light signal or may be multiple light signals. The light signals may be directed away from the projector via scanning by the scanner (e.g., MEMS scan mirror, rotating mirror, pivoting mirror).
At 902, a refractive index of the liquid crystal in-coupler is modulated to a first refractive index by the controller. The controller may modulate the refractive index of the liquid crystal in-coupler by altering a voltage (or another modulating signal) applied to the liquid crystal in-coupler. The liquid crystal may operate in a positive mode wherein a higher voltage results in a higher opacity, or a negative mode wherein a higher voltage results in a lower opacity. The liquid crystal in-coupler may comprise multiple independently modulatable regions which may be modulated by the controller to each have a respective first refractive index, wherein the refractive index of each respective region may be different from or the same as the refractive indices of the other regions. The controller may be communicatively coupled to a processor (e.g., microprocessor) which modulates the output of signals from the controller. The processor may be communicatively coupled to a non-transitory processor-readable storage medium (e.g., memory circuits such as ROM, RAM, FLASH, EEPROM, memory registers, magnetic disks, optical disks, other storage) and the processor may execute data and/or instruction from the non-transitory processor readable storage medium to modulate the controller.
At 903, the first set of light signals is in-coupled into the volume of optically transparent material of the waveguide, wherein a path (or paths) of the first set of light signals within the volume of optically transparent material is dependent on the first refractive index of the liquid crystal in-coupler. That is, the path of the light signals is altered (or remains unaltered) in response to the refractive index of the liquid crystal in-coupler, resulting in the light signals being steered by the liquid crystal in-coupler. The path of an individual light signal may also be dependent on the wavelength of the light signal, the location of incidence of the light signal on the liquid crystal in-coupler, and/or the angle of incidence of the light signal on the liquid crystal in-coupler. The light signals are in-coupled on a path that will eventually result in a desired image or part of an image at the eye of a user. If the liquid crystal in-coupler comprises multiple independently modulatable regions the path of an individual light signal is dependent on the modulatable region upon which the individual light signal is incident. The liquid crystal in-coupler may be present on the exterior of the volume of optically transparent material or may be located inside the volume of optically transparent material. If located inside the volume of optically transparent material, the liquid crystal in-coupler may be at or proximate the first longitudinal surface of the second longitudinal surface, or may be embedded within the volume of optically transparent material not at or proximate a surface.
At 904, the first set of light signals are propagated along a length of the volume of optically transparent material by total internal reflection between the first longitudinal surface and the second longitudinal surface.
At 905, the first set of light signals are output from the waveguide towards an eye of the user by the out-coupler. The first set of light signals are output from the waveguide on a path that creates the desired image or part of an image at the eye of the user. The output path of an individual light signal may depend on the wavelength of the light signal, the location of incidence of the light signal on the out-coupler, and/or the angle of incidence of the light signals on the out-coupler. The out-coupler may be at or proximate the first longitudinal surface and may out-couple the first set of light signals by reflection or the out-coupler may be at or proximate the second longitudinal surface and may out-couple the first set of light signals by transmission.
Method 900 may further include repeating acts 901, 902, 903, 904, and 905 with a second set of light signals, wherein the controller modulates the liquid crystal in-coupler to have a second refractive index, or if the liquid crystal in-coupler has multiple independently modulatable regions, a second set of refractive indices. This may be repeated for other sets of light signals. If each set of light signals is a single light signal, an image or other desired pattern of light may be created by modulating the refractive index of the liquid crystal in-coupler to steer further sets of light signals as they are generated over time. That is, the refractive index of the liquid crystal in-coupler may enable “scanning” of subsequent single light signals to create an image (e.g., raster scanning). If each set of light signals comprises multiple light signals, modulating the refractive index of the liquid crystal in-coupler may steer an exit pupil of an image (or portion of an image) or other desired pattern created by the multiple light signals. In some implementations, the out-coupler may be a liquid crystal out-coupler which is communicatively coupled to the controller (or may be communicatively coupled to a second, distinct controller) and the method may further include modulating the refractive index of the liquid crystal out-coupler to a third refractive index (the third refractive index may be the same as either the first or second refractive index and may be different from both the first or second refractive index) and out-coupling a set of light signals on output path(s) which are dependent on the refractive index of the liquid crystal out-coupler. The output paths of the light signals may also be dependent on the wavelength of the light signals, the location of incidence of the light signals on the liquid crystal out-coupler, and/or the angle of incidence of the light signals on the liquid crystal out-coupler.
At 1001, at least one light source of the projector generates a first set of light signals. The first set of light signals may be a single light signal or may be multiple light signals. The light signals may be directed away from the projector via scanning by the scanner (e.g., MEMS scan mirror, rotating mirror, pivoting mirror).
At 1002, the first set of light signals are in-coupled into the volume of optically transparent material by the in-coupler. That is, the first set of light signals are in-coupled into the volume of optically transparent material on the desired path to eventually create a desired image or part of an image at the eye of the user. The path of an individual light signal may depend on the wavelength of the light signal, the location of incidence of the light signal on the out-coupler, and/or the angle of incidence of the light signals on the out-coupler. The in-coupler may be at or proximate the first longitudinal surface and may in-couple the first set of light signals by reflection or the in-coupler may be at or proximate the second longitudinal surface and may in-couple the first set of light signals by transmission.
At 1003, the first set of light signals are propagated along a length of the volume of optically transparent material by total internal reflection between the first longitudinal surface and the second longitudinal surface.
At 1004, a refractive index of the liquid crystal out-coupler is modulated to a first refractive index by the controller. The controller may modulate the refractive index of the liquid crystal out-coupler by altering a voltage (or another modulating signal) applied to the liquid crystal in-coupler. The liquid crystal may operate in a positive mode wherein a higher voltage results in a higher opacity, or a negative mode wherein a higher voltage results in a lower opacity. The liquid crystal out-coupler may comprise multiple independently modulatable regions which may be modulated by the controller to each have a respective first refractive index, wherein the refractive index of each respective region may be different from or the same as the refractive indices of the other regions. The controller may be communicatively coupled to a processor (e.g., microprocessor) which modulates the output of signals from the controller. The processor may be communicatively coupled to a non-transitory processor-readable storage medium (e.g., memory circuits such as ROM, RAM, FLASH, EEPROM, memory registers, magnetic disks, optical disks, other storage) and the processor may execute data and/or instruction from the non-transitory processor readable storage medium to modulate the controller.
At 1005, the first set of light signals is output towards the eye of the user by the liquid crystal out-coupler, wherein an output path of the first set of light signals is dependent on the refractive index of the liquid crystal out-coupler. That is, the path of the light signals is altered (or remains unaltered) in response to the refractive index of the liquid crystal out-coupler, resulting in the light signals being steered by the liquid crystal out-coupler. The path of an individual light signal may be dependent on the wavelength of the light signal, the location of incidence of the light signal on the liquid crystal out-coupler, and/or the angle of incidence of the light signal on the liquid crystal out-coupler. The light signals are output on a path that will result in a desired image or part of an image at the eye of the user. If the liquid crystal out-coupler comprises multiple independently modulatable regions the path of an individual light signal is dependent on the modulatable region upon which the individual light signal is incident. The liquid crystal out-coupler may be at or proximate the first longitudinal surface and may out-couple the first set of light signals by reflection, or the liquid crystal out-coupler may be at or proximate the second longitudinal surface and may out-couple the first set of light signals by transmission.
Method 1000 may further include repeating acts 1001, 1002, 1003, 1004, and 1005 with a second set of light signals, wherein the controller modulates the liquid crystal in-coupler to have a second refractive index, or if the liquid crystal in-coupler has multiple independently modulatable regions, a second set of refractive indices. This may be repeated for other sets of light signals. If each set of light signals is a single light signal, an image or other desired pattern of light may be created by modulating the refractive index of the liquid crystal in-coupler to steer further sets of light signals as they are generated over time. That is, the refractive index of the liquid crystal in-coupler may enable “scanning” of subsequent single light signals to create an image (e.g., raster scanning). If each set of light signals comprises multiple light signals, modulating the refractive index of the liquid crystal in-coupler may steer an exit pupil of an image (or portion of an image) or other desired pattern created by the multiple light signals.
Alternatively, a WHUD may include both a liquid crystal in-coupler and a liquid crystal out-coupler, wherein both the liquid crystal in-coupler and the liquid crystal out-coupler are communicatively coupled to a controller (either the same controller or two distinct controllers). The method for operating such an waveguide would include modulating the refractive indices of both the liquid crystal in-coupler and the liquid crystal out-coupler by the respective controllers to steer both the in-coupling paths of light signals and the out-coupling paths of light signals to create an image or part of an image at the eye of a user.
Throughout this specification and the drawings various in-coupling and out-coupling paths are discussed and shown. These paths are meant to be exemplary and are not meant to show any actual paths or to represent achievable ranges of directions which light signals can travel in upon in-coupling or out-coupling.
The various embodiments described herein provide systems, devices, and methods for steering light with waveguides. Such are particularly well-suited for use as or in the transparent combiner of wearable heads-up displays (“WHUDs”) in order to enable the WHUDs to adopt more aesthetically-pleasing styles and to increase the relative size of the display. Examples of WHUD systems, devices, and methods that are particularly well-suited for use in conjunction with the present systems, devices, and methods for curved lenses with optical waveguides are described in, for example, U.S. Non-Provisional patent application Ser. No. 15/167,458, U.S. Non-Provisional patent application Ser. No. 15/167,472, and U.S. Non-Provisional patent application Ser. No. 15/167,484.
In some implementations, an optical waveguide may terminate at the out-coupling optical grating because there is no desire to propagate light within the optical waveguide beyond that point. However, this can result in a visible seam within or upon the eyeglass lens where the optical waveguide ends. In order to avoid this seam, in some implementations, an optical waveguide may be extended beyond the out-coupling optical grating to the far edge of an eyeglass lens even though there is no intention to propagate light within the optical waveguide beyond the out-coupling optical grating.
In some implementations, an optical waveguide may have cladding on the exterior of the waveguide at the first and second longitudinal surfaces, except where the in-coupler and out-coupler are located, wherein the cladding has a refractive index which enables total internal reflection within the waveguide.
Some of the optical waveguides described herein (particularly those that employ curvature) may introduce optical distortions in displayed images. In accordance with the present systems, devices, and methods, such optical distortions may be corrected (i.e., compensated for) in the software that drives the display engine. For example, the geometrical output of the transparent combiner may be measured without any compensation measure in place and a reverse transform of such output may be applied in the generation of light by the display light source.
The relative positions of optical waveguides within lenses/combiners shown herein are used for illustrative purposes only. In some implementations, it may be advantageous for an optical waveguide to be positioned centrally within a combiner, whereas in other implementations it may be advantageous for an optical waveguide to be positioned off-center. In particular, it may be advantageous for an optical waveguide to couple to the corner of the support structure/glasses frame where the temple of the glasses frame meets the rims, because this is an advantageous location to route display light from a scanning laser projector or microdisplay with minimal impact on form factor.
The various embodiments described herein generally reference and illustrate a single eye of a user (i.e., monocular applications), but a person of skill in the art will readily appreciate that the present systems, devices, and methods may be duplicated in a WHUD in order to provide scanned laser projection and scanned laser eye tracking for both eyes of the user (i.e., binocular applications).
The WHUDs described herein may include one or more sensor(s) (e.g., microphone, camera, thermometer, compass, and/or others) for collecting data from the user's environment. For example, one or more camera(s) may be used to provide feedback to the processor of the wearable heads-up display and influence where on the transparent display(s) any given image should be displayed.
The WHUDs described herein may include one or more on-board power sources (e.g., one or more battery(ies)), a wireless transceiver for sending/receiving wireless communications, and/or a tethered connector port for coupling to a computer and/or charging the one or more on-board power source(s). Throughout this specification and the appended claims the term “communicative” as in “communicative pathway,” “communicative coupling,” and in variants such as “communicatively coupled,” is generally used to refer to any engineered arrangement for transferring and/or exchanging information. Exemplary communicative pathways include, but are not limited to, electrically conductive pathways (e.g., electrically conductive wires, electrically conductive traces), magnetic pathways (e.g., magnetic media), and/or optical pathways (e.g., optical fiber), and exemplary communicative couplings include, but are not limited to, electrical couplings, magnetic couplings, and/or optical couplings.
Throughout this specification and the appended claims, infinitive verb forms are often used. Examples include, without limitation: “to detect,” “to provide,” “to transmit,” “to communicate,” “to process,” “to route,” and the like. Unless the specific context requires otherwise, such infinitive verb forms are used in an open, inclusive sense, that is as “to, at least, detect,” to, at least, provide,” “to, at least, transmit,” and so on.
The above description of illustrated embodiments, including what is described in the Abstract, is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed. Although specific embodiments of and examples are described herein for illustrative purposes, various equivalent modifications can be made without departing from the spirit and scope of the disclosure, as will be recognized by those skilled in the relevant art. The teachings provided herein of the various embodiments can be applied to other portable and/or wearable electronic devices, not necessarily the exemplary wearable electronic devices generally described above.
For instance, the foregoing detailed description has set forth various embodiments of the devices and/or processes via the use of block diagrams, schematics, and examples. Insofar as such block diagrams, schematics, and examples contain one or more functions and/or operations, it will be understood by those skilled in the art that each function and/or operation within such block diagrams, flowcharts, or examples can be implemented, individually and/or collectively, by a wide range of hardware, software, firmware, or virtually any combination thereof. In one embodiment, the present subject matter may be implemented via Application Specific Integrated Circuits (ASICs). However, those skilled in the art will recognize that the embodiments disclosed herein, in whole or in part, can be equivalently implemented in standard integrated circuits, as one or more computer programs executed by one or more computers (e.g., as one or more programs running on one or more computer systems), as one or more programs executed by on one or more controllers (e.g., microcontrollers) as one or more programs executed by one or more processors (e.g., microprocessors, central processing units, graphical processing units), as firmware, or as virtually any combination thereof, and that designing the circuitry and/or writing the code for the software and or firmware would be well within the skill of one of ordinary skill in the art in light of the teachings of this disclosure.
When logic is implemented as software and stored in memory, logic or information can be stored on any processor-readable medium for use by or in connection with any processor-related system or method. In the context of this disclosure, a memory is a processor-readable medium that is an electronic, magnetic, optical, or other physical device or means that contains or stores a computer and/or processor program. Logic and/or the information can be embodied in any processor-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions associated with logic and/or information.
In the context of this specification, a “non-transitory processor-readable medium” can be any element that can store the program associated with logic and/or information for use by or in connection with the instruction execution system, apparatus, and/or device. The processor-readable medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device. More specific examples (a non-exhaustive list) of the computer readable medium would include the following: a portable computer diskette (magnetic, compact flash card, secure digital, or the like), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM, EEPROM, or Flash memory), a portable compact disc read-only memory (CDROM), digital tape, and other non-transitory media.
The various embodiments described above can be combined to provide further embodiments. To the extent that they are not inconsistent with the specific teachings and definitions herein, all of the U.S. patents, U.S. patent application publications, U.S. patent applications, foreign patents, foreign patent applications and non-patent publications referred to in this specification and/or listed in the Application Data Sheet which are owned by Thalmic Labs Inc., including but not limited to: U.S. Non-Provisional patent application Ser. No. 15/167,458, U.S. Non-Provisional patent application Ser. No. 15/167,472, U.S. Non-Provisional patent application Ser. No. 15/167,484, U.S. patent application Ser. No. 15/381,883, US Patent Application Publication No. 2017-0068095, U.S. Provisional Application Ser. No. 62/557,551, and U.S. Provisional Application Ser. No. 62/557,554, are incorporated herein by reference, in their entirety. Aspects of the embodiments can be modified, if necessary, to employ systems, circuits and concepts of the various patents, applications and publications to provide yet further embodiments.
These and other changes can be made to the embodiments in light of the above-detailed description. In general, in the following claims, the terms used should not be construed to limit the claims to the specific embodiments disclosed in the specification and the claims, but should be construed to include all possible embodiments along with the full scope of equivalents to which such claims are entitled. Accordingly, the claims are not limited by the disclosure.
Claims
1. A method of operating a wearable heads-up display (WHUD) comprising a support structure that in use is worn on the head of a user, a projector with at least one light source, an optical waveguide including a volume of optically transparent material having a first longitudinal surface opposite a second longitudinal surface across a width of the volume of optically transparent material, an in-coupler, a liquid crystal out-coupler, and a controller communicatively coupled to the liquid crystal out-coupler, the method comprising:
- generating a first set of light signals by the at least one light source of the projector;
- in-coupling the second set of light signals into the volume of optically transparent material by the in-coupler;
- propagating the second set of light signals along a length of the volume of optically transparent material by total internal reflection between the first longitudinal surface and the second longitudinal surface;
- modulating a refractive index of the liquid crystal out-coupler to a second refractive index by the controller;
- out-coupling the second set of light signals by the liquid crystal out-coupler, wherein the second set of light signals are output on a path that is dependent on the refractive index of the liquid crystal out-coupler.
2. The method of claim 1 further comprising:
- generating a second set of light signals by the at least one light source of the projector;
- in-coupling the second set of light signals into the volume of optically transparent material by the in-coupler;
- propagating the second set of light signals along a length of the volume of optically transparent material by total internal reflection between the first longitudinal surface and the second longitudinal surface;
- modulating a refractive index of the liquid crystal out-coupler to a second refractive index by the controller;
- out-coupling the second set of light signals by the liquid crystal out-coupler, wherein the second set of light signals are output on a path that is dependent on the refractive index of the liquid crystal out-coupler.
Type: Application
Filed: Sep 11, 2018
Publication Date: Mar 14, 2019
Inventors: Stefan Alexander (Elmira), Douglas Raymond Dykaar (Waterloo), John Otto Vieth (Waterloo), Timothy Paul Bodiya (Toronto)
Application Number: 16/128,114