Abstract: A peripheral device that is used with a mixed reality system that is thrown by the user of the mixed reality system and captures scene and mapping data of the area the peripheral is thrown into. Upon capturing the scene and mapping data, the peripheral transmits the data (in some embodiments, including processed results of evaluation of the data) to the mixed reality system. The mixed reality system displays a visual representation of the scene and mapping data on a near eye display. In some embodiments, the visual representation appears in real space enabling an effect where the user of the mixed reality system can see through walls or other obstructions. In some embodiments, the peripheral is configured to detonate upon the satisfaction of a variable set of conditions.

Abstract: Disclosed herein is a mixed reality application to use a multi-channel audio input to identify a character and origin of a given sound, then present a visual representation of the given sound on a near eye display. The visual representation including a vector to the source of the sound. The visual representation further including graphical elements that describe various attributes of the given sound including the magnitude, directionality, source, and threat level. Where the source of the given sound is moving, the visual representation shifts to illustrate the movement.

Abstract: A peripheral device that is used with a mixed reality system is thrown by the user of the mixed reality system and captures scene and mapping data of the area the peripheral is thrown into. Upon capturing the scene and mapping data, the peripheral transmits the data (in some embodiments, including processed results of evaluation of the data) to the mixed reality system. The mixed reality system displays a visual representation of the scene and mapping data on a near eye display. In some embodiments, the visual representation appears in real space enabling an effect where the user of the mixed reality system can see through walls or other obstructions. In some embodiments, the peripheral is configured to detonate upon the satisfaction of a variable set of conditions.

Abstract: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise a lens assembly comprising two transmissive plates, a first of the two transmissive plates comprising a first surface sag based at least in part on a cubic function, and a DOE to direct image information to a user's eye; wherein the DOE is placed in between the two transmissive plates of the lens assembly, and wherein the DOE is encoded with the inverse of the cubic function corresponding to the surface sag of the first transmissive plate; such that a wavefront created by the encoded DOE is compensated by the wavefront created by the first transmissive plate, thereby collimating light rays associated with virtual content delivered to the DOE.

Abstract: A sensory eyewear system for a mixed reality device can facilitate user's interactions with the other people or with the environment. As one example, the sensory eyewear system can recognize and interpret a sign language, and present the translated information to a user of the mixed reality device. The wearable system can also recognize text in the user's environment, modify the text (e.g., by changing the content or display characteristics of the text), and render the modified text to occlude the original text.

Abstract: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise a lens assembly comprising two transmissive plates, a first of the two transmissive plates comprising a first surface sag based at least in part on a cubic function, and a DOE to direct image information to a user's eye; wherein the DOE is placed in between the two transmissive plates of the lens assembly, and wherein the DOE is encoded with the inverse of the cubic function corresponding to the surface sag of the first transmissive plate; such that a wavefront created by the encoded DOE is compensated by the wavefront created by the first transmissive plate, thereby collimating light rays associated with virtual content delivered to the DOE.

Abstract: An eyepiece waveguide for an augmented reality. The eyepiece waveguide can include a transparent substrate with an input coupler region, a first orthogonal pupil expander (OPE) region, and an exit pupil expander (EPE) region. The input coupler region can couple an input light beam that is externally incident on the input coupler region into at least a first guided light beam that propagates inside the substrate. The first OPE region can divide the first guided beam into a plurality of replicated, spaced-apart beams. The EPE region can re-direct the replicated beams from the first OPE region such that they exit the substrate. The EPE region can have an amount of optical power.

Abstract: An eyepiece waveguide for an augmented reality. The eyepiece waveguide can include a transparent substrate with an input coupler region, first and second orthogonal pupil expander (OPE) regions, and an exit pupil expander (EPE) region. The input coupler region can be positioned between the first and second OPE regions and can divide and re-direct an input light beam that is externally incident on the input coupler region into first and second guided light beams that propagate inside the substrate, with the first guided beam being directed toward the first OPE region and the second guided beam being directed toward the second OPE region. The first and second OPE regions can respectively divide the first and second guided beams into a plurality of replicated, spaced-apart beams. The EPE region can re-direct the replicated beams from both the first and second OPE regions such that they exit the substrate.

Abstract: An eyepiece waveguide for an augmented reality. The eyepiece waveguide can include a transparent substrate with an input coupler region, first and second orthogonal pupil expander (OPE) regions, and an exit pupil expander (EPE) region. The input coupler region can be positioned between the first and second OPE regions and can divide and re-direct an input light beam that is externally incident on the input coupler region into first and second guided light beams that propagate inside the substrate, with the first guided beam being directed toward the first OPE region and the second guided beam being directed toward the second OPE region. The first and second OPE regions can respectively divide the first and second guided beams into a plurality of replicated, spaced-apart beams. The EPE region can re-direct the replicated beams from both the first and second OPE regions such that they exit the substrate.

Abstract: A sensory eyewear system for a mixed reality device can facilitate user's interactions with the other people or with the environment. As one example, the sensory eyewear system can recognize and interpret a sign language, and present the translated information to a user of the mixed reality device. The wearable system can also recognize text in the user's environment, modify the text (e.g., by changing the content or display characteristics of the text), and render the modified text to occlude the original text.