Abstract: A sensory eyewear system for a mixed reality device can facilitate user's interactions with the other people or with the environment. As one example, the sensory eyewear system can recognize and interpret a sign language, and present the translated information to a user of the mixed reality device. The wearable system can also recognize text in the user's environment, modify the text (e.g., by changing the content or display characteristics of the text), and render the modified text to occlude the original text.

Abstract: An eyepiece for an augmented reality display system. The eyepiece can include a waveguide substrate. The waveguide substrate can include an input coupler grating (ICG), an orthogonal pupil expander (OPE) grating, a spreader grating, and an exit pupil expander (EPE) grating. The ICG can couple at least one input light beam into at least a first guided light beam that propagates inside the waveguide substrate. The OPE grating can divide the first guided light beam into a plurality of parallel, spaced-apart light beams. The spreader grating can receive the light beams from the OPE grating and spread their distribution. The spreader grating can include diffractive features oriented at approximately 90° to diffractive features of the OPE grating. The EPE grating can re-direct the light beams from the first OPE grating and the first spreader grating such that they exit the waveguide substrate.

Abstract: A peripheral device that is used with a mixed reality system that is thrown by the user of the mixed reality system and captures scene and mapping data of the area the peripheral is thrown into. Upon capturing the scene and mapping data, the peripheral transmits the data (in some embodiments, including processed results of evaluation of the data) to the mixed reality system. The mixed reality system displays a visual representation of the scene and mapping data on a near eye display. In some embodiments, the visual representation appears in real space enabling an effect where the user of the mixed reality system can see through walls or other obstructions. In some embodiments, the peripheral is configured to detonate upon the satisfaction of a variable set of conditions.

Abstract: A sensory eyewear system for a mixed reality device can facilitate user's interactions with the other people or with the environment. As one example, the sensory eyewear system can recognize and interpret a sign language, and present the translated information to a user of the mixed reality device. The wearable system can also recognize text in the user's environment, modify the text (e.g., by changing the content or display characteristics of the text), and render the modified text to occlude the original text.

Abstract: Disclosed herein is a mixed reality application to use a multi-channel audio input to identify a character and origin of a given sound, then present a visual representation of the given sound on a near eye display. The visual representation including a vector to the source of the sound. The visual representation further including graphical elements that describe various attributes of the given sound including the magnitude, directionality, source, and threat level. Where the source of the given sound is moving, the visual representation shifts to illustrate the movement.

Abstract: A sensory eyewear system for a mixed reality device can facilitate user's interactions with the other people or with the environment. As one example, the sensory eyewear system can recognize and interpret a sign language, and present the translated information to a user of the mixed reality device. The wearable system can also recognize text in the user's environment, modify the text (e.g., by changing the content or display characteristics of the text), and render the modified text to occlude the original text.

Abstract: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise a lens assembly comprising two transmissive plates, a first of the two transmissive plates comprising a first surface sag based at least in part on a cubic function, and a DOE to direct image information to a user's eye; wherein the DOE is placed in between the two transmissive plates of the lens assembly, and wherein the DOE is encoded with the inverse of the cubic function corresponding to the surface sag of the first transmissive plate; such that a wavefront created by the encoded DOE is compensated by the wavefront created by the first transmissive plate, thereby collimating light rays associated with virtual content delivered to the DOE.

Abstract: A peripheral device that is used with a mixed reality system that is thrown by the user of the mixed reality system and captures scene and mapping data of the area the peripheral is thrown into. Upon capturing the scene and mapping data, the peripheral transmits the data (in some embodiments, including processed results of evaluation of the data) to the mixed reality system. The mixed reality system displays a visual representation of the scene and mapping data on a near eye display. In some embodiments, the visual representation appears in real space enabling an effect where the user of the mixed reality system can see through walls or other obstructions. In some embodiments, the peripheral is configured to detonate upon the satisfaction of a variable set of conditions.

Abstract: Disclosed herein is a mixed reality application to use a multi-channel audio input to identify a character and origin of a given sound, then present a visual representation of the given sound on a near eye display. The visual representation including a vector to the source of the sound. The visual representation further including graphical elements that describe various attributes of the given sound including the magnitude, directionality, source, and threat level. Where the source of the given sound is moving, the visual representation shifts to illustrate the movement.

Abstract: A peripheral device that is used with a mixed reality system that is thrown by the user of the mixed reality system and captures scene and mapping data of the area the peripheral is thrown into. Upon capturing the scene and mapping data, the peripheral transmits the data (in some embodiments, including processed results of evaluation of the data) to the mixed reality system. The mixed reality system displays a visual representation of the scene and mapping data on a near eye display. In some embodiments, the visual representation appears in real space enabling an effect where the user of the mixed reality system can see through walls or other obstructions. In some embodiments, the peripheral is configured to detonate upon the satisfaction of a variable set of conditions.

Abstract: Disclosed herein is a mixed reality application to use a multi-channel audio input to identify a character and origin of a given sound, then present a visual representation of the given sound on a near eye display. The visual representation including a vector to the source of the sound. The visual representation further including graphical elements that describe various attributes of the given sound including the magnitude, directionality, source, and threat level. Where the source of the given sound is moving, the visual representation shifts to illustrate the movement.

Abstract: Disclosed herein is a mixed reality application to use a multi-channel audio input to identify a character and origin of a given sound, then present a visual representation of the given sound on a near eye display. The visual representation including a vector to the source of the sound. The visual representation further including graphical elements that describe various attributes of the given sound including the magnitude, directionality, source, and threat level. Where the source of the given sound is moving, the visual representation shifts to illustrate the movement.

Abstract: A peripheral device that is used with a mixed reality system that is thrown by the user of the mixed reality system and captures scene and mapping data of the area the peripheral is thrown into. Upon capturing the scene and mapping data, the peripheral transmits the data (in some embodiments, including processed results of evaluation of the data) to the mixed reality system. The mixed reality system displays a visual representation of the scene and mapping data on a near eye display. In some embodiments, the visual representation appears in real space enabling an effect where the user of the mixed reality system can see through walls or other obstructions. In some embodiments, the peripheral is configured to detonate upon the satisfaction of a variable set of conditions.

Abstract: Disclosed herein is a mixed reality application to use a multi-channel audio input to identify a character and origin of a given sound, then present a visual representation of the given sound on a near eye display. The visual representation including a vector to the source of the sound. The visual representation further including graphical elements that describe various attributes of the given sound including the magnitude, directionality, source, and threat level. Where the source of the given sound is moving, the visual representation shifts to illustrate the movement.

Abstract: A peripheral device that is used with a mixed reality system is thrown by the user of the mixed reality system and captures scene and mapping data of the area the peripheral is thrown into. Upon capturing the scene and mapping data, the peripheral transmits the data (in some embodiments, including processed results of evaluation of the data) to the mixed reality system. The mixed reality system displays a visual representation of the scene and mapping data on a near eye display. In some embodiments, the visual representation appears in real space enabling an effect where the user of the mixed reality system can see through walls or other obstructions. In some embodiments, the peripheral is configured to detonate upon the satisfaction of a variable set of conditions.

Abstract: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise a lens assembly comprising two transmissive plates, a first of the two transmissive plates comprising a first surface sag based at least in part on a cubic function, and a DOE to direct image information to a user's eye; wherein the DOE is placed in between the two transmissive plates of the lens assembly, and wherein the DOE is encoded with the inverse of the cubic function corresponding to the surface sag of the first transmissive plate; such that a wavefront created by the encoded DOE is compensated by the wavefront created by the first transmissive plate, thereby collimating light rays associated with virtual content delivered to the DOE.

Abstract: A sensory eyewear system for a mixed reality device can facilitate user's interactions with the other people or with the environment. As one example, the sensory eyewear system can recognize and interpret a sign language, and present the translated information to a user of the mixed reality device. The wearable system can also recognize text in the user's environment, modify the text (e.g., by changing the content or display characteristics of the text), and render the modified text to occlude the original text.

Abstract: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise a lens assembly comprising two transmissive plates, a first of the two transmissive plates comprising a first surface sag based at least in part on a cubic function, and a DOE to direct image information to a user's eye; wherein the DOE is placed in between the two transmissive plates of the lens assembly, and wherein the DOE is encoded with the inverse of the cubic function corresponding to the surface sag of the first transmissive plate; such that a wavefront created by the encoded DOE is compensated by the wavefront created by the first transmissive plate, thereby collimating light rays associated with virtual content delivered to the DOE.