Abstract: Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. For each sound source of a plurality of sound sources in the virtual environment, a respective first intermediate audio signal corresponding to the input audio signal is determined, based on a location of the respective sound source in the virtual environment, and the respective first intermediate audio signal is associated with a first bus. For each of the sound sources of the plurality of sound sources in the virtual environment, a respective second intermediate audio signal is determined. The respective second intermediate audio signal corresponds to a reverberation of the input audio signal in the virtual environment.

Abstract: A multi-element fiber scanner for scanning electromagnetic imaging radiation includes a base having a base plane and a longitudinal axis orthogonal to the base plane and a fiber link passing through the base in a direction parallel to the longitudinal axis. The fiber link is operatively coupled to at least one electromagnetic radiation source. The multi-element fiber scanner also includes a retention collar disposed a predetermined distance along the longitudinal axis from the base and a first set and a second set of piezoelectric tubes. First and second piezoelectric tubes of the first set are joined to the base and extends from the base and first and second piezoelectric tubes of the second set are joined to the retention collar and extend from the retention collar.

Abstract: An example apparatus includes an optical fiber, an actuator, and a joint mechanically coupling the actuator to the optical fiber. The joint includes a neck extending along an axis. The optical fiber is threaded through an aperture extending along the axis through the neck. The optical fiber is attached to the joint at a surface of the neck facing the axis. The joint also includes a collar extending along the axis. The actuator is mechanically attached to the joint at an inner surface of the collar facing the axis. The joint also includes a flexural element extending radially from the neck to the collar. During operation, the joint couples a force from the actuator to the optical fiber to vary an orientation of a portion of the optical fiber extending from the neck with respect to the axis.

Abstract: A wearable system can comprise a display system configured to present virtual content in a three-dimensional space, a user input device configured to receive a user input, and one or more sensors configured to detect a user's pose. The wearable system can support various user interactions with objects in the user's environment based on contextual information. As an example, the wearable system can adjust the size of an aperture of a virtual cone during a cone cast (e.g., with the user's poses) based on the contextual information. As another example, the wearable system can adjust the amount of movement of virtual objects associated with an actuation of the user input device based on the contextual information.

Abstract: Disclosed is an improved diffraction structure for 3D display systems. The improved diffraction structure includes an intermediate layer that resides between a waveguide substrate and a top grating surface. The top grating surface comprises a first material that corresponds to a first refractive index value, the underlayer comprises a second material that corresponds to a second refractive index value, and the substrate comprises a third material that corresponds to a third refractive index value.

Abstract: A virtual or augmented reality display system that controls power inputs to the display system as a function of image data. Image data itself is made of a plurality of image data frames, each with constituent color components of, and depth planes for displaying on, rendered content. Light sources or spatial light modulators to relay illumination from the light sources may receive signals from a display controlled to adjust a power setting to the light source or spatial light modulator based on control information embedded in an image data frame.

Abstract: A head-mounted augmented reality (AR) device can include a hardware processor programmed to receive different types of sensor data from a plurality of sensors (e.g., an inertial measurement unit, an outward-facing camera, a depth sensing camera, an eye imaging camera, or a microphone); and determining an event of a plurality of events using the different types of sensor data and a hydra neural network (e.g., face recognition, visual search, gesture identification, semantic segmentation, object detection, lighting detection, simultaneous localization and mapping, relocalization).

Abstract: An imaging lens includes one or more lens elements configured to receive and focus light in a first wavelength range reflected off of one or more first objects onto an image plane, and to receive and focus light in a second wavelength range reflected off of one or more second objects onto the image plane. The imaging lens further includes an aperture stop and a filter positioned at the aperture stop. The filter includes a central region and an outer region surrounding the central region. The central region of the filter is characterized by a first transmission band in the first wavelength range and a second transmission band in the second wavelength range. The outer region of the filter is characterized by a third transmission band in the first wavelength range and substantially low transmittance values in the second wavelength range.

Abstract: A computer implemented method for warping virtual content includes generating warped virtual content by transforming source virtual content. The method also includes determining whether a memory location corresponding to an X, Y location of the warped virtual content in an output frame of reference is occupied by pre-existing virtual content. The method further includes storing the warped virtual content in the memory location if the memory location is not occupied. Moreover, the method includes comparing respective Z locations of the warped virtual content and the pre-existing virtual content to identify virtual content with a Z location closer to a viewing location if the memory location is occupied. The method also includes storing the warped virtual content in the memory location corresponding to the X, Y location if a Z location of warped virtual content is closer to the viewing location than a pre-existing Z location of pre-existing virtual content.

Abstract: Techniques for resolving hemisphere ambiguity are disclosed. One or more magnetic fields are emitted at a handheld controller. The one or more magnetic fields are detected by one or more sensors positioned relative to a headset. Movement data corresponding to the handheld controller or the headset is detected. During a first time interval, a first position and a first orientation of the handheld controller within a first hemisphere are determined based on the detected one or more magnetic fields, and a first discrepancy is calculated based on the first position, the first orientation, and the movement data. During a second time interval, a second position and a second orientation of the handheld controller within a second hemisphere are determined based on the detected one or more magnetic fields, and a second discrepancy is calculated based on the second position, the second orientation, and the movement data.

Abstract: An eyepiece for projecting an image to an eye of a viewer includes a waveguide configured to propagate light in a first wavelength range, and a grating coupled to a back surface of the waveguide. The grating is configured to diffract a first portion of the light propagating in the waveguide out of a plane of the waveguide toward a first direction, and to diffract a second portion of the light propagating in the waveguide out of the plane of the waveguide toward a second direction opposite to the first direction. The eyepiece furthers include a wavelength-selective reflector coupled to a front surface of the waveguide. The wavelength selective reflector is configured to reflect light in the first wavelength range and transmit light outside the first wavelength range, such that the wavelength-selective reflector reflects at least part of the second portion of the light back toward the first direction.

Abstract: A method of merging 3D meshes includes receiving a first mesh and a second mesh; performing spatial alignment to register the first mesh and the second mesh in a common world coordinate system; performing mesh clipping on the first mesh and the second mesh to remove redundant mesh vertices; performing geometry refinement around a clipping seam to close up mesh concatenation holes created by mesh clipping; and performing texture blending in regions adjacent the clipping seam to obtain a merged mesh.

Abstract: An approach for projecting light may be implemented using a acousto-optical depth switch that uses surface acoustic waves produced along a substrate to guide image light to different areas. The surface acoustic waves may be generated on a substrate using a transducer. Surface acoustic waves of different frequencies can guide image light onto different optical elements at different physical positions. The optical elements may be configured to show objects in an image at different distances from a viewer.

Abstract: A virtual image generation system for use by an end user comprises memory, a display subsystem, an object selection device configured for receiving input from the end user and persistently selecting at least one object in response to the end user input, and a control subsystem configured for rendering a plurality of image frames of a three-dimensional scene, conveying the image frames to the display subsystem, generating audio data originating from the at least one selected object, and for storing the audio data within the memory.

Abstract: A method of fabricating a variable diameter fiber includes providing a fiber optic cable, focusing a laser beam at a predetermined location inside the fiber optic cable, and creating a damage site at the predetermined location. The method also includes focusing the laser beam at a series of additional predetermined locations inside the fiber optic cable and creating a plurality of additional damage sites at the additional predetermined locations. The damage site and the additional damage sites define a variable diameter profile. The method further includes exposing the fiber optic cable to an etchant solution, preferentially etching the damage site and the plurality of additional damage sites, and separating a portion of the fiber optic cable to release the variable diameter fiber.