Abstract: An eye tracking system includes a pair of glasses including two frames; a light scanning projector coupled to the pair of glasses and operable to scan a beam of light to project an image frame including a plurality of pixels; an eyepiece mounted in one of the two frames and optically coupled to the light scanning projector; one or more photodetectors coupled to one of the two frames and operable to detect time-varying reflected signals; and a processor coupled to the light scanning projector and the photodetectors. The eyepiece includes an exit pupil expander operable to direct a portion of the beam of light towards an eye of a user. Each of the time-varying reflected signals is associated with the plurality of pixels. The processor is operable to correlate the time-varying reflected signals with the plurality of pixels and determine a first eye orientation.

Abstract: A waveguide display includes a first diffractive input waveguide operable to receive input data from a first projector and diffract image data associated with the first projector at a first angular offset and a second diffractive input waveguide operable to receive input data from a second projector and diffract image data associated with the second projector at a second angular offset. The waveguide display also includes a diffractive output waveguide optically coupled to the first diffractive input waveguide and the second diffractive input waveguide. The diffractive output waveguide receives the image data associated with the first projector and image data associated with the second projector and is operable to direct image data associated with the first projector toward a first field of view and direct image data associated with the second projector toward a second field of view.

Abstract: A virtual image generation system comprises a planar optical waveguide having opposing first and second faces, an in-coupling (IC) element configured for optically coupling a collimated light beam from an image projection assembly into the planar optical waveguide as an in-coupled light beam, a first orthogonal pupil expansion (OPE) element associated with the first face of the planar optical waveguide for splitting the in-coupled light beam into a first set of orthogonal light beamlets, a second orthogonal pupil expansion (OPE) element associated with the second face of the planar optical waveguide for splitting the in-coupled light beam into a second set of orthogonal light beamlets, and an exit pupil expansion (EPE) element associated with the planar optical waveguide for splitting the first and second sets of orthogonal light beamlets into an array of out-coupled light beamlets that exit the planar optical waveguide.

Abstract: A virtual image generation system comprises a planar optical waveguide having opposing first and second faces, an in-coupling (IC) element configured for optically coupling a collimated light beam from an image projection assembly into the planar optical waveguide as an in-coupled light beam, a first orthogonal pupil expansion (OPE) element associated with the first face of the planar optical waveguide for splitting the in-coupled light beam into a first set of orthogonal light beamlets, a second orthogonal pupil expansion (OPE) element associated with the second face of the planar optical waveguide for splitting the in-coupled light beam into a second set of orthogonal light beamlets, and an exit pupil expansion (EPE) element associated with the planar optical waveguide for splitting the first and second sets of orthogonal light beamlets into an array of out-coupled light beamlets that exit the planar optical waveguide.

Abstract: A multi-element fiber scanner for scanning electromagnetic imaging radiation includes a base having a base plane and a longitudinal axis orthogonal to the base plane and a fiber link passing through the base in a direction parallel to the longitudinal axis. The fiber link is operatively coupled to at least one electromagnetic radiation source. The multi-element fiber scanner also includes a retention collar disposed a predetermined distance along the longitudinal axis from the base and a first set and a second set of piezoelectric tubes. First and second piezoelectric tubes of the first set are joined to the base and extends from the base and first and second piezoelectric tubes of the second set are joined to the retention collar and extend from the retention collar.

Abstract: A method of fabricating a variable diameter fiber includes providing a fiber optic cable, focusing a laser beam at a predetermined location inside the fiber optic cable, and creating a damage site at the predetermined location. The method also includes focusing the laser beam at a series of additional predetermined locations inside the fiber optic cable and creating a plurality of additional damage sites at the additional predetermined locations. The damage site and the additional damage sites define a variable diameter profile. The method further includes exposing the fiber optic cable to an etchant solution, preferentially etching the damage site and the plurality of additional damage sites, and separating a portion of the fiber optic cable to release the variable diameter fiber.

Abstract: An eye tracking system includes a pair of glasses including two frames and a light scanning projector coupled to the pair of glasses and operable to scan a beam of light. The eye tracking system also includes an eyepiece mounted in one of the two frames and optically coupled to the light scanning projector. The eyepiece includes an exit pupil expander operable to direct at least a portion of the beam of light towards an eye of a user. The eye tracking system further includes one or more photodetectors coupled to the pair of glasses and a processor coupled to the light scanning projector and the one or more photodetectors.

Abstract: A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.

Abstract: A method for generating virtual content for presentation in an AR system includes, under control of a hardware processor included in the AR system, analyzing pose data to identify a pose of a user of the AR system. The method also includes identifying a physical object in a 3D physical environment of the user based at least partly on the pose. The method further includes responsive to detecting a first gesture, presenting a first type of virtual content in a display of the AR system. Moreover, the method includes responsive to detecting a second gesture, presenting a pod user interface virtual construct comprising a navigable menu. In addition, the method includes responsive to detecting a selection of an application through the navigable menu, rendering, in the display of the AR system, within the pod user interface virtual construct, the particular application in a 3D view to the user.

Abstract: A method of rendering virtual content comprises capturing an image of a field of view of a user, extracting a set of map points based on the captured image, recognizing an object based on the extracted set of map points, retrieving semantic data associated with the recognized object and attaching the semantic data to object data associated with the recognized object, and inserting the recognized object data and the semantic data attached thereto into a virtual world model such that virtual content, when rendered at a user device of the user, is displayed in relation to the recognized object.

Abstract: A waveguide display includes a first diffractive input waveguide operable to receive input data from a first projector and diffract image data associated with the first projector at a first angular offset and a second diffractive input waveguide operable to receive input data from a second projector and diffract image data associated with the second projector at a second angular offset. The waveguide display also includes a diffractive output waveguide optically coupled to the first diffractive input waveguide and the second diffractive input waveguide. The diffractive output waveguide receives the image data associated with the first projector and image data associated with the second projector and is operable to direct image data associated with the first projector toward a first field of view and direct image data associated with the second projector toward a second field of view.

Abstract: A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.

Abstract: A multi-element fiber scanner for scanning electromagnetic imaging radiation includes a base having a base plane and a longitudinal axis orthogonal to the base plane and a fiber link passing through the base in a direction parallel to the longitudinal axis. The fiber link is operatively coupled to at least one electromagnetic radiation source. The multi-element fiber scanner also includes a retention collar disposed a predetermined distance along the longitudinal axis from the base and a first set and a second set of piezoelectric tubes. First and second piezoelectric tubes of the first set are joined to the base and extends from the base and first and second piezoelectric tubes of the second set are joined to the retention collar and extend from the retention collar.

Abstract: A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparatus may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.

Abstract: A fiber optic element of a fiber scanning system includes a motion actuator having longitudinal side members, an internal orifice, a first support region, a central region, and a second support region. The fiber optic element also includes a first fiber optic cable passing through the internal orifice and having a first fiber joint as well as a second fiber optic cable passing through the internal orifice. The second fiber optic cable has a second fiber joint disposed in the central region and spliced to the first fiber joint, a second coupling region, a light delivery region, and a light emission tip. The light delivery region is characterized by a first diameter and the light emission tip is characterized by a second diameter less than the first diameter.

Abstract: A multi-element fiber scanner for scanning electromagnetic imaging radiation includes a base having a base plane and a longitudinal axis orthogonal to the base plane and a first fiber link passing through the base in a direction parallel to the longitudinal axis. The first fiber link is operatively coupled to at least one electromagnetic radiation source. The multi-element fiber scanner also includes a plurality of additional links joined to the base and extending from the base and a retention collar disposed a predetermined distance along the longitudinal axis from the base. The first fiber link and the plurality of fiber links are joined to the retention collar.

Abstract: A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.

Abstract: A waveguide display disposed in glasses includes a first pupil expander assembly operable to project a first image defined by a first field of view and a second pupil expander assembly disposed adjacent the first pupil expander assembly and operable to project a second image defined by a second field of view different from the first field of view.

Abstract: A method and system determining texture data at least by performing fiducial point registration with a triggerable texture source and generating virtual objects and texture data based at least in part upon a fiducial point. Fiducial point registration textures a desired point with one or more projectors in response to the identification of a desired point in space, generates data with one or more projected patterns, determines a final location or depth of a point using the generated data, and registers the point as a fiducial point by groom a data structure based on a registration requirement pertaining to a distribution of fiduciary points and a requirement pertaining to machine recognition of physical objects. Virtual objects are generated relative to a real-world scene and the generated texture data-based at least in part upon the final location or depth of a fiducial point.

Abstract: A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.