Abstract: A display system includes a head-mounted display configured to project light, having different amounts of wavefront divergence, to an eye of a user to display virtual image content appearing to be disposed at different depth planes. The wavefront divergence may be changed in discrete steps, with the change in steps being triggered based upon whether the user is fixating on a particular depth plane. The display system may be calibrated for switching depth planes for a main user. Upon determining that a guest user is utilizing the system, rather than undergoing a full calibration, the display system may be configured to switch depth planes based on a rough determination of the virtual content that the user is looking at. The virtual content has an associated depth plane and the display system may be configured to switch to the depth plane of that virtual content.

Abstract: An eyepiece for projecting an image to an eye of a viewer includes a first planar waveguide positioned in a first lateral plane, a second planar waveguide positioned in a second lateral plane adjacent the first lateral plane, and a third planar waveguide positioned in a third lateral plane adjacent the second lateral plane. The first waveguide includes a first diffractive optical element (DOE) coupled thereto and disposed at a lateral position. The second waveguide includes a second DOE coupled thereto and disposed at the lateral position. The third waveguide includes a third DOE coupled thereto and disposed at the lateral position. The eyepiece further includes a first optical filter disposed between the first waveguide and the second waveguide at the lateral position, and a second optical filter positioned between the second waveguide and the third waveguide at the lateral position.

Abstract: Embodiments of the present disclosure relate to continuous and/or binocular time warping methods to account for head movement of the user without having to re-render a displayed image. Continuous time warping allows for transformation of an image from a first perspective to a second perspective of the viewer without having to re-render the image from the second perspective. Binocular time warp refers to the late-frame time warp used in connection with a display device including a left display unit for the left eye and a right display unit for the right eye where the late-frame time warp is performed separately for the left display unit and the right display unit. Warped images are sent to the left and the right display units where photons are generated and emitted toward respective eyes of the viewer, thereby displaying an image on the left and the right display units at the same time.

Abstract: Techniques are disclosed for performing localization of a handheld device with respect to a wearable device. At least one sensor mounted to the handheld device, such as an inertial measurement unit (IMU), may obtain handheld data indicative of movement of the handheld device with respect to the world. An imaging device mounted to either the handheld device or the wearable device may capture a fiducial image containing a number of fiducials affixed to the other device. The number of fiducials contained in the image are determined. Based on the number of fiducials, at least one of a position and an orientation of the handheld device with respect to the wearable device are updated based on the image and the handheld data in accordance with a first operating state, a second operating state, or a third operating state.

Abstract: A display subsystem for a virtual image generation system used by an end user, comprises first and second waveguide apparatuses, first and second projection subassemblies configured for introducing first and second light beams respectively into the first and second waveguide apparatuses, such that at least a first light ray and at least a second light ray respectively exit the first and second waveguide apparatuses to display first and second monocular images as a binocular image to the end user, and a light sensing assembly configured for detecting at least one parameter indicative of a mismatch between the displayed first and second monocular images as the binocular image.

Abstract: A head-mounted display system is configured to project light to an eye of a user wearing the head-mounted display system to display content in a vision field of said user. The head-mounted display system comprises at least one diffusive optical element, at least one out-coupling optical element, at least one mask comprising at least one mask opening, at least one illumination in-coupling optical element configured to in-couple light from at least one illumination source into a light-guiding component, an image projector configured to in-couple an image and an at least one illumination source is configured to in-couple light into at least one illumination in-coupling optical element, an eyepiece, a curved light-guiding component, a light-guiding component comprising a portion of a frame, and/or two light-guiding components disposed on opposite sides of at least one out-coupling optical element.

Abstract: A virtual image generation system for use by an end user comprises a projection subsystem configured for generating a collimated light beam, and a display configured emitting light rays in response to the collimated light beam to display a pixel of an image frame to the end user. The pixel has a location encoded with angles of the emitted light rays. The virtual image generation system further comprises a sensing assembly configured for sensing at least one parameter indicative of at least one of the emitted light ray angles, and a control subsystem configured for generating image data defining a location of the pixel, and controlling an angle of the light beam relative to the display based on the defined location of the pixel and the sensed parameter(s).

Abstract: A display subsystem for a virtual image generation system comprises a planar waveguide apparatus, an optical fiber, at least one light source configured for emitting light from a distal end of the optical fiber, and a mechanical drive assembly to which the optical fiber is mounted as a fixed-free flexible cantilever. The drive assembly is configured for displacing a distal end of the optical fiber about a fulcrum in accordance with a scan pattern, such that the emitted light diverges from a longitudinal axis coincident with the fulcrum. The display subsystem further comprises an optical modulation apparatus configured for converging the light from the optical fiber towards the longitudinal axis, and an optical waveguide input apparatus configured for directing the light from the optical modulation apparatus down the planar waveguide apparatus, such that the planar waveguide apparatus displays one or more image frames to an end user.

Abstract: Systems and methods are disclosed for operating a head-mounted display system based on user perceptibility. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes by presenting the content with different amounts of wavefront divergence. Some embodiments include obtaining an image captured by an imaging device of the display system. Whether a threshold measure or more of motion blur is determined to be exhibited in one or more regions of the image. Based on a determination that the threshold measure or more of motion blur is exhibited in one or more regions of the image, one or more operating parameters of the wearable display are adjusted. Example operating parameter adjustments comprise adjusting the depth plane on which content is presented (e.g., by switching from a first depth plane to a second depth plane), adjusting a rendering quality, and adjusting power characteristics of the system.

Abstract: An eyepiece for projecting an image to an eye of a viewer includes a first planar waveguide positioned in a first lateral plane, a second planar waveguide positioned in a second lateral plane adjacent the first lateral plane, and a third planar waveguide positioned in a third lateral plane adjacent the second lateral plane. The first waveguide includes a first diffractive optical element (DOE) coupled thereto and disposed at a lateral position. The second waveguide includes a second DOE coupled thereto and disposed at the lateral position. The third waveguide includes a third DOE coupled thereto and disposed at the lateral position. The eyepiece further includes a first optical filter disposed between the first waveguide and the second waveguide at the lateral position, and a second optical filter positioned between the second waveguide and the third waveguide at the lateral position.

Abstract: A virtual image generation system for use by an end user comprises a projection subsystem configured for generating a collimated light beam, and a display configured emitting light rays in response to the collimated light beam to display a pixel of an image frame to the end user. The pixel has a location encoded with angles of the emitted light rays. The virtual image generation system further comprises a sensing assembly configured for sensing at least one parameter indicative of at least one of the emitted light ray angles, and a control subsystem configured for generating image data defining a location of the pixel, and controlling an angle of the light beam relative to the display based on the defined location of the pixel and the sensed parameter(s).

Abstract: Methods and systems for depth-based foveated rendering in the display system are disclosed. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergence. Some embodiments include determining a fixation point of a user's eyes. Location information associated with a first virtual object to be presented to the user via a display device is obtained. A resolution-modifying parameter of the first virtual object is obtained. A particular resolution at which to render the first virtual object is identified based on the location information and the resolution-modifying parameter of the first virtual object. The particular resolution is based on a resolution distribution specifying resolutions for corresponding distances from the fixation point. The first virtual object rendered at the identified resolution is presented to the user via the display system.

Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system images the user's eye and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye. The display system may render virtual image content with a render camera positioned at the determined position of the center of rotation of said eye.

Abstract: An eyepiece for projecting an image to an eye of a viewer includes a first planar waveguide positioned in a first lateral plane, a second planar waveguide positioned in a second lateral plane adjacent the first lateral plane, and a third planar waveguide positioned in a third lateral plane adjacent the second lateral plane. The first waveguide includes a first diffractive optical element (DOE) coupled thereto and disposed at a lateral position. The second waveguide includes a second DOE coupled thereto and disposed at the lateral position. The third waveguide includes a third DOE coupled thereto and disposed at the lateral position. The eyepiece further includes a first optical filter disposed between the first waveguide and the second waveguide at the lateral position, and a second optical filter positioned between the second waveguide and the third waveguide at the lateral position.

Abstract: A virtual image generation system for use by an end user comprises a projection subsystem configured for generating a collimated light beam, and a display configured emitting light rays in response to the collimated light beam to display a pixel of an image frame to the end user. The pixel has a location encoded with angles of the emitted light rays. The virtual image generation system further comprises a sensing assembly configured for sensing at least one parameter indicative of at least one of the emitted light ray angles, and a control subsystem configured for generating image data defining a location of the pixel, and controlling an angle of the light beam relative to the display based on the defined location of the pixel and the sensed parameter(s).

Abstract: A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment vary for different users and may change over time (e.g., as a given user moves around or as the HMD slips or otherwise becomes displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.

Abstract: A display subsystem for a virtual image generation system comprises a planar waveguide apparatus, an optical fiber, at least one light source configured for emitting light from a distal end of the optical fiber, and a mechanical drive assembly to which the optical fiber is mounted as a fixed-free flexible cantilever. The drive assembly is configured for displacing a distal end of the optical fiber about a fulcrum in accordance with a scan pattern, such that the emitted light diverges from a longitudinal axis coincident with the fulcrum. The display subsystem further comprises an optical modulation apparatus configured for converging the light from the optical fiber towards the longitudinal axis, and an optical waveguide input apparatus configured for directing the light from the optical modulation apparatus down the planar waveguide apparatus, such that the planar waveguide apparatus displays one or more image frames to an end user.

Abstract: An augmented reality head mounted display system an eyepiece having a transparent emissive display. The eyepiece and transparent emissive display are positioned in an optical path of a user's eye in order to transmit light into the user's eye to form images. Due to the transparent nature of the display, the user can see an outside environment through the transparent emissive display. The transmissive emissive display comprising a plurality of emitters configured to emit light into the eye of the user. A first variable focus optical element is positioned between the transparent emissive display and the user's eye and is configured to modify emitted light to provide the appropriate amount of divergence for image information to be interpreted by the user as being on a particular depth plane.

Abstract: A display subsystem for a virtual image generation system. The display subsystem comprises a planar waveguide apparatus, and an optical fiber having a distal tip affixed relative to the planar waveguide apparatus, and an aperture proximal to the distal tip. The display subsystem further comprises at least one light source coupled the optical fiber and configured for emitting light from the aperture of the optical fiber, and a mechanical drive assembly to which the optical fiber is mounted to the drive assembly. The mechanical drive assembly is configured for displacing the aperture of the optical fiber in accordance with a scan pattern. The display subsystem further comprises an optical waveguide input apparatus configured for directing the light from the aperture of the optical fiber down the planar waveguide apparatus, such that the planar waveguide apparatus displays one or more image frames to the end user.

Abstract: Embodiments of the present disclosure relate to continuous and/or binocular time warping methods to account for head movement of the user without having to re-render a displayed image. Continuous time warping allows for transformation of an image from a first perspective to a second perspective of the viewer without having to re-render the image from the second perspective. Binocular time warp refers to the late-frame time warp used in connection with a display device including a left display unit for the left eye and a right display unit for the right eye where the late-frame time warp is performed separately for the left display unit and the right display unit. Warped images are sent to the left and the right display units where photons are generated and emitted toward respective eyes of the viewer, thereby displaying an image on the left and the right display units at the same time.