Abstract: A display subsystem for a virtual image generation system for use by an end user comprises a planar waveguide apparatus, an optical fiber, at least one light source configured for emitting light from a distal end of the optical fiber, and a collimation element mounted to a distal end of the optical fiber for collimating light from the optical fiber. The virtual image generation system further comprises a mechanical drive assembly to which the optical fiber is mounted to the drive assembly. The mechanical drive assembly is configured for displacing the distal end of the optical fiber, along with the collimation element, in accordance with a scan pattern. The virtual image generation system further comprises an optical waveguide input apparatus configured for directing the collimated light from the collimation element down the planar waveguide apparatus, such that the planar waveguide apparatus displays image frames to the end user.

Abstract: This disclosure describes a head-mounted display with a display assembly configured to display content to most or all of a user's field of view. The display assembly can be configured to display content in far-peripheral regions of the user's field of view differently than content upon which a user can focus. For example, spatial resolution, color resolution, refresh rate and intensity (i.e. brightness) can be adjusted to save resources and/or to bring attention to virtual content positioned within a far-peripheral region. In some embodiments, these changes can save processing resources without detracting from the user's overall experience.

Abstract: Systems and methods are disclosed for operating a head-mounted display system based on user perceptibility. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes by presenting the content with different amounts of wavefront divergence. Some embodiments include obtaining an image captured by an imaging device of the display system. Whether a threshold measure or more of motion blur is determined to be exhibited in one or more regions of the image. Based on a determination that the threshold measure or more of motion blur is exhibited in one or more regions of the image, one or more operating parameters of the wearable display are adjusted. Example operating parameter adjustments comprise adjusting the depth plane on which content is presented (e.g., by switching from a first depth plane to a second depth plane), adjusting a rendering quality, and adjusting power characteristics of the system.

Abstract: The systems and methods described can include approaches to calibrate head-mounted displays for improved viewing experiences. Some methods include receiving data of a first target image associated with an undeformed state of a first eyepiece of a head-mounted display device; receiving data of a first captured image associated with deformed state of the first eyepiece of the head-mounted display device; determining a first transformation that maps the first captured image to the image; and applying the first transformation to a subsequent image for viewing on the first eyepiece of the head-mounted display device.

Abstract: A dynamically actuable diffractive optical element (DOE) includes a substrate and a diffraction grating disposed on a first region of a surface of the substrate. The DOE further includes a quantity of a fluid disposed on a second region of the surface of the substrate, a fluid displacer disposed adjacent the second region of the surface of the substrate, and a drive signal source configured to send an electric signal to the fluid displacer. The fluid displacer is configured to, upon receiving the electric signal in a first state, causing a portion of the quantity of the fluid to be displaced from the second region of the surface into grooves of the diffraction grating, and upon receiving the electric signal in a second state, causing the portion of the quantity of the fluid to retract from the grooves of the diffraction grating to the second region of the surface.

Abstract: A display subsystem for a virtual image generation system comprises a planar waveguide apparatus, an optical fiber, at least one light source configured for emitting light from a distal end of the optical fiber, and a mechanical drive assembly to which the optical fiber is mounted as a fixed-free flexible cantilever. The drive assembly is configured for displacing a distal end of the optical fiber about a fulcrum in accordance with a scan pattern, such that the emitted light diverges from a longitudinal axis coincident with the fulcrum. The display subsystem further comprises an optical modulation apparatus configured for converging the light from the optical fiber towards the longitudinal axis, and an optical waveguide input apparatus configured for directing the light from the optical modulation apparatus down the planar waveguide apparatus, such that the planar waveguide apparatus displays one or more image frames to an end user.

Abstract: A display subsystem for a virtual image generation system for use by an end user comprises a planar waveguide apparatus, an optical fiber, at least one light source configured for emitting light from a distal end of the optical fiber, and a collimation element mounted to a distal end of the optical fiber for collimating light from the optical fiber. The virtual image generation system further comprises a mechanical drive assembly to which the optical fiber is mounted to the drive assembly. The mechanical drive assembly is configured for displacing the distal end of the optical fiber, along with the collimation element, in accordance with a scan pattern. The virtual image generation system further comprises an optical waveguide input apparatus configured for directing the collimated light from the collimation element down the planar waveguide apparatus, such that the planar waveguide apparatus displays image frames to the end user.

Abstract: Examples of a light field metrology system for use with a display are disclosed. The light field metrology may capture images of a projected light field, and determine focus depths (or lateral focus positions) for various regions of the light field using the captured images. The determined focus depths (or lateral positions) may then be compared with intended focus depths (or lateral positions), to quantify the imperfections of the display. Based on the measured imperfections, an appropriate error correction may be performed on the light field to correct for the measured imperfections. The display can be an optical display element in a head mounted display, for example, an optical display element capable of generating multiple depth planes or a light field display.

Abstract: An augmented reality (AR) device is described with a display system configured to adjust an apparent distance between a user of the AR device and virtual content presented by the AR device. The AR device includes a first tunable lens that change shape in order to affect the position of the virtual content. Distortion of real-world content on account of the changes made to the first tunable lens is prevented by a second tunable lens that changes shape to stay substantially complementary to the optical configuration of the first tunable lens. In this way, the virtual content can be positioned at almost any distance relative to the user without degrading the view of the outside world or adding extensive bulk to the AR device. The augmented reality device can also include tunable lenses for expanding a field of view of the augmented reality device.

Abstract: Techniques are disclosed for performing localization of a handheld device with respect to a wearable device. At least one sensor mounted to the handheld device, such as an inertial measurement unit (IMU), may obtain handheld data indicative of movement of the handheld device with respect to the world. An imaging device mounted to either the handheld device or the wearable device may capture a fiducial image containing a number of fiducials affixed to the other device. The number of fiducials contained in the image are determined. Based on the number of fiducials, at least one of a position and an orientation of the handheld device with respect to the wearable device are updated based on the image and the handheld data in accordance with a first operating state, a second operating state, or a third operating state.

Abstract: A virtual image generation system for use by an end user comprises a projection subsystem configured for generating a collimated light beam, and a display configured emitting light rays in response to the collimated light beam to display a pixel of an image frame to the end user. The pixel has a location encoded with angles of the emitted light rays. The virtual image generation system further comprises a sensing assembly configured for sensing at least one parameter indicative of at least one of the emitted light ray angles, and a control subsystem configured for generating image data defining a location of the pixel, and controlling an angle of the light beam relative to the display based on the defined location of the pixel and the sensed parameter(s).

Abstract: An eyepiece for projecting an image to an eye of a viewer includes a first planar waveguide positioned in a first lateral plane, a second planar waveguide positioned in a second lateral plane adjacent the first lateral plane, and a third planar waveguide positioned in a third lateral plane adjacent the second lateral plane. The first planar waveguide includes a first diffractive optical element (DOE) coupled thereto and disposed at a first lateral position. The second planar waveguide includes a second DOE coupled thereto and disposed at a second lateral position. The third planar waveguide includes a third DOE coupled thereto and disposed at the second lateral position. The eyepiece further includes an optical filter positioned between the second planar waveguide and the third planar waveguide at the second lateral position.

Abstract: A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment vary for different users and may change over time (e.g., as a given user moves around or as the HMD slips or otherwise becomes displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.

Abstract: This disclosure describes a head-mounted display with a display assembly configured to display content to most or all of a user's field of view. The display assembly can be configured to display content in far-peripheral regions of the user's field of view differently than content upon which a user can focus. For example, spatial resolution, color resolution, refresh rate and intensity (i.e. brightness) can be adjusted to save resources and/or to bring attention to virtual content positioned within a far-peripheral region. In some embodiments, these changes can save processing resources without detracting from the user's overall experience.

Abstract: A display subsystem for a virtual image generation system comprises a planar waveguide apparatus, an optical fiber, at least one light source configured for emitting light from a distal end of the optical fiber, and a mechanical drive assembly to which the optical fiber is mounted as a fixed-free flexible cantilever. The drive assembly is configured for displacing a distal end of the optical fiber about a fulcrum in accordance with a scan pattern, such that the emitted light diverges from a longitudinal axis coincident with the fulcrum. The display subsystem further comprises an optical modulation apparatus configured for converging the light from the optical fiber towards the longitudinal axis, and an optical waveguide input apparatus configured for directing the light from the optical modulation apparatus down the planar waveguide apparatus, such that the planar waveguide apparatus displays one or more image frames to an end user.

Abstract: A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment vary for different users and may change over time (e.g., as a given user moves around or as the HMD slips or otherwise becomes displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.

Abstract: A virtual image generation system for use by an end user comprises a projection subsystem configured for generating a collimated light beam, and a display configured emitting light rays in response to the collimated light beam to display a pixel of an image frame to the end user. The pixel has a location encoded with angles of the emitted light rays. The virtual image generation system further comprises a sensing assembly configured for sensing at least one parameter indicative of at least one of the emitted light ray angles, and a control subsystem configured for generating image data defining a location of the pixel, and controlling an angle of the light beam relative to the display based on the defined location of the pixel and the sensed parameter(s).

Abstract: Techniques are disclosed for performing localization of a handheld device with respect to a wearable device. At least one sensor mounted to the handheld device, such as an inertial measurement unit (IMU), may obtain handheld data indicative of movement of the handheld device with respect to the world. An imaging device mounted to either the handheld device or the wearable device may capture a fiducial image containing a number of fiducials affixed to the other device. The number of fiducials contained in the image are determined. Based on the number of fiducials, at least one of a position and an orientation of the handheld device with respect to the wearable device are updated based on the image and the handheld data in accordance with a first operating state, a second operating state, or a third operating state.

Abstract: An augmented reality (AR) device is described with a display system configured to adjust an apparent distance between a user of the AR device and virtual content presented by the AR device. The AR device includes a first tunable lens that change shape in order to affect the position of the virtual content. Distortion of real-world content on account of the changes made to the first tunable lens is prevented by a second tunable lens that changes shape to stay substantially complementary to the optical configuration of the first tunable lens. In this way, the virtual content can be positioned at almost any distance relative to the user without degrading the view of the outside world or adding extensive bulk to the AR device. The augmented reality device can also include tunable lenses for expanding a field of view of the augmented reality device.

Abstract: An eyepiece for projecting an image to an eye of a viewer includes a first planar waveguide positioned in a first lateral plane, a second planar waveguide positioned in a second lateral plane adjacent the first lateral plane, and a third planar waveguide positioned in a third lateral plane adjacent the second lateral plane. The first waveguide includes a first diffractive optical element (DOE) coupled thereto and disposed at a lateral position. The second waveguide includes a second DOE coupled thereto and disposed at the lateral position. The third waveguide includes a third DOE coupled thereto and disposed at the lateral position. The eyepiece further includes a first optical filter disposed between the first waveguide and the second waveguide at the lateral position, and a second optical filter positioned between the second waveguide and the third waveguide at the lateral position.