Abstract: Examples of the disclosure describe systems and methods for estimating acoustic properties of an environment. In an example method, a first audio signal is received via a microphone of a wearable head device. An envelope of the first audio signal is determined, and a first reverberation time is estimated based on the envelope of the first audio signal. A difference between the first reverberation time and a second reverberation time is determined. A change in the environment is determined based on the difference between the first reverberation time and the second reverberation time. A second audio signal is presented via a speaker of a wearable head device, wherein the second audio signal is based on the second reverberation time.

Abstract: The present invention comprises a compact optical see-through head-mounted display capable of combining, a see-through image path with a virtual image path such that the opaqueness of the see-through image path can be modulated and the virtual image occludes parts of the see-through image and vice versa.

Abstract: Techniques are disclosed for operating a time-of-flight (TOF) sensor. The TOF may be operated in a low power mode by repeatedly performing a low power mode sequence, which may include performing a depth frame by emitting light pulses, detecting reflected light pulses, and computing a depth map based on the detected reflected light pulses. Performing the low power mode sequence may also include performing an amplitude frame at least one time by emitting a light pulse, detecting a reflected light pulse, and computing an amplitude map based on the detected reflected light pulse. In response to determining that an activation condition is satisfied, the TOF may be switched to operate in a high accuracy mode by repeatedly performing a high accuracy mode sequence, which may include performing the depth frame multiple times.

Abstract: A display assembly suitable for use with a virtual or augmented reality headset is described and includes the following: an input coupling grating; a scanning mirror configured to rotate about two or more different axes of rotation; an optical element; and optical fibers, each of which have a light emitting end disposed between the input coupling grating and the scanning mirror and oriented such that light emitted from the light emitting end is refracted through at least a portion of the optical element, reflected off the scanning mirror, refracted back through the optical element and into the input coupling grating. The scanning mirror can be built upon a MEMS type architecture.

Abstract: A method of presenting an audio signal to a user of a mixed reality environment is disclosed, the method comprising the steps of detecting a first audio signal in the mixed reality environment, where the first audio signal is a real audio signal; identifying a virtual object intersected by the first audio signal in the mixed reality environment; identifying a listener coordinate associated with the user; determining, using the virtual object and the listener coordinate, a transfer function; applying the transfer function to the first audio signal to produce a second audio signal; and presenting, to the user, the second audio signal.

Abstract: The disclosure relates to systems and methods for authorization of a user in a spatial 3D environment. The systems and methods can include receiving a request from an application executing on a mixed reality display system to authorize the user with a web service, displaying to the user an authorization window configured to accept user input associated with authorization by the web service and to prevent the application or other applications from receiving the user input, communicating the user input to the web service, receiving an access token from the web service, in which the access token is indicative of successful authorization by the web service, and communicating the access token to the application for authorization of the user. The authorization window can be a modal window displayed in an immersive mode by the mixed reality display system.

Abstract: A method of executing a gesture command includes identifying a hand centroid of a hand. The method also includes identifying a first finger tip of a first finger on the hand. The method further includes identifying a thumb tip of a thumb on the hand. Moreover, the method includes determining a surface normal relationship between the hand centroid, the first fingertip and the thumb tip.

Abstract: An augmented reality (AR) system includes a handheld device comprising handheld fiducials affixed to the handheld device. The AR system also includes a wearable device comprising a display operable to display virtual content and an imaging device mounted to the wearable device and having a field of view that at least partially includes the handheld fiducials and a hand of a user. The AR system also includes a computing apparatus configured to receive hand pose data associated with the hand based on an image captured by the imaging device and receive handheld device pose data associated with the handheld device based on the image captured by the imaging device. The computing apparatus is also configured to determine a pose discrepancy between the hand pose data and the handheld device pose data and perform an operation to fuse the hand pose data with the handheld device pose data.

Abstract: An optical projection system includes a source of collimated light, a first microelectromechanical system mirror positioned to receive collimated light from the source, and an optical relay system positioned to receive collimated light from the first microelectromechanical system mirror. The optical relay system includes a single-pass relay having a first component, a second component, and a third component. The optical projection system also includes a second microelectromechanical system mirror positioned to receive collimated light from the optical relay system and an eyepiece positioned to receive light reflected from the second microelectromechanical system mirror.

Abstract: An optical scanner includes a base region and a cantilevered silicon beam protruding from the base region. The optical scanner also includes a waveguide disposed on the base region and the cantilevered silicon beam and a transducer assembly comprising one or more piezoelectric actuators coupled to the cantilevered silicon beam and configured to induce motion of the cantilevered silicon beam in a scan pattern.

Abstract: Systems and methods for depth plane selection in display system such as augmented reality display systems, including mixed reality display systems, are disclosed. A display(s) may present virtual image content via image light to an eye(s) of a user. The display(s) may output the image light to the eye(s) of the user, the image light to have different amounts of wavefront divergence corresponding to different depth planes at different distances away from the user. A camera(s) may capture images of the eye(s). An indication may be generated based on obtained images of the eye(s), indicating whether the user is identified. The display(s) may be controlled to output the image light to the eye(s) of the user, the image light to have the different amounts of wavefront divergence based at least in part on the generated indication indicating whether the user is identified.

Abstract: An electronic device is disclosed. The electronic device comprises a first clock configured to operate at a frequency. First circuitry of the electronic device is configured to synchronize with the first clock. Second circuitry is configured to determine a second clock based on the first clock. The second clock is configured to operate at the frequency of the first clock, and is further configured to operate with a phase shift with respect to the first clock. Third circuitry is configured to synchronize with the second clock.

Abstract: This disclosure relates to the use of variable-pitch light-emitting devices for display applications, including for displays in augmented reality, virtual reality, and mixed reality environments. In particular, it relates to small (e.g., micron-size) light emitting devices (e.g., micro-LEDs) of variable pitch to provide the advantages, e.g., of compactness, manufacturability, color rendition, as well as computational and power savings. Systems and methods for emitting multiple lights by multiple panels where a pitch of one panel is different than pitch(es) of other panels are disclosed. Each panel may comprise a respective array of light emitters. The multiple lights may be combined by a combiner.

Abstract: Diffraction gratings provide optical elements in head-mounted display systems to, e.g., incouple light into or outcouple light out of a waveguide. These diffraction gratings may be configured to have reduced polarization sensitivity. Such gratings may, for example, incouple or outcouple light of different polarizations, or polarized and unpolarized light, with a similar level of efficiency. The diffraction gratings and waveguides may include a transmissive layer and a metal layer. The diffraction grating may comprise a blazed grating.

Abstract: A method of displaying an image to a viewer includes operating a fiber scanning projector to produce a scanned light beam incident on an incoupling diffractive optical element (DOE) coupled to a waveguide. A portion of the light beam is reflected via a reflective back surface of the incoupling DOE. The reflected portion of the scanned light beam is incident on a reflective optical element, which reflects the light beam back to the incoupling DOE. The returning light beam is then diffracted by the incoupling DOE to produce a second pass first diffracted light beam. The second pass first diffracted light beam is propagated within the planar waveguide via total internal reflection (TIR) to an outcoupling DOE, which directs a portion of the second pass first diffracted light beam toward an eye of a viewer to display the image to the user.

Abstract: A two-dimensional scanning micromirror device includes a base, a first platform coupled to the base by first support flexures, and a second platform including a reflector and coupled to the first platform by second support flexures. The first platform is oscillatable about a first axis and the second platform is oscillatable about a second axis orthogonal to the first axis. The first platform, the second platform, and the second support flexures together exhibit a first resonance having a first frequency, the first resonance corresponds to oscillatory motion of at least the first platform, the second platform, and the second support flexures about the first axis. The first platform, the second platform, and the second support flexures together exhibit a second resonance having a second frequency, and the second resonance corresponds to oscillatory motion of at least the second platform about the second axis.

Abstract: A cross reality system that renders virtual content generated by executing native mode applications may be configured to render web-based content using components that render content from native applications. The system may include a Prism manager that provides Prisms in which content from executing native applications is rendered. For rendering web based content, a browser, accessing the web based content, may be associated with a Prism and may render content into its associated Prism, creating the same immersive experience for the user as when content is generated by a native application. The user may access the web application from the same program launcher menu as native applications. The system may have tools that enable a user to access these capabilities, including by creating for a web location an installable entity that, when processed by the system, results in an icon for the web content in a program launcher menu.

Abstract: Techniques are described for operating an optical system. In some embodiments, light associated with a world object is received at the optical system. Virtual image light is projected onto an eyepiece of the optical system. A portion of a system field of view of the optical system to be at least partially dimmed is determined based on information detected by the optical system. A plurality of spatially-resolved dimming values for the portion of the system field of view may be determined based on the detected information. The detected information may include light information, gaze information, and/or image information. A dimmer of the optical system may be adjusted to reduce an intensity of light associated with the world object in the portion of the system field of view according to the plurality of dimming values.

Abstract: In some embodiments, a display device includes one or more waveguides having a vapor deposited light absorbing film on edges of the waveguide to mitigate ghost images. In some embodiments, the film is formed directly on the edge of the waveguide by a vapor deposition, such as an evaporative deposition process. In some embodiments, the light absorbing films may comprise carbon, for example carbon in the form of one or more allotropes of carbon, such as fullerenes, or black silicon.