Abstract: An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity.

Abstract: A method of operating a head mounted augmented reality display system includes producing an electromagnetic field using an electromagnetic emitter, positioned in a handheld controller and reflecting the electromagnetic field using a first electromagnetic reflector, positioned adjacent to the electromagnetic emitter, to form a modified electromagnetic field. The method also includes reflecting a portion of the modified electromagnetic field using a second electromagnetic reflector positioned in a headset and detecting the reflected portion of the modified electromagnetic field by an electromagnetic sensor positioned adjacent to the second electromagnetic reflector.

Abstract: Disclosed herein are systems and methods for device authentication or pairing. In an aspect, a wearable display system comprises a display, an image capture device configured to capture images of a companion device, a computer-readable storage medium configured to store the images of the companion device, and a processor in communication with the image capture device and the storage medium. The processor can be programmed with executable instructions to receive a first image of a first optical pattern displayed by the companion device captured by the image capture device, wherein the first optical pattern is generated by the companion device based on first shared data, extract first data from the first optical pattern in the received first image, authenticate the companion device based on the first data extracted from the first optical pattern, and notify a user of the wearable display system that the companion device is authenticated.

Abstract: An eye tracking system includes a pair of glasses including two frames; a light scanning projector coupled to the pair of glasses and operable to scan a beam of light to project an image frame including a plurality of pixels; an eyepiece mounted in one of the two frames and optically coupled to the light scanning projector; one or more photodetectors coupled to one of the two frames and operable to detect time-varying reflected signals; and a processor coupled to the light scanning projector and the photodetectors. The eyepiece includes an exit pupil expander operable to direct a portion of the beam of light towards an eye of a user. Each of the time-varying reflected signals is associated with the plurality of pixels. The processor is operable to correlate the time-varying reflected signals with the plurality of pixels and determine a first eye orientation.

Abstract: A method for refining poses includes receiving a plurality of poses and performing volumetric reconstruction for the plurality of poses to produce a global geometry. The method also includes refining each pose of the plurality of poses with respect to the global geometry to produce a plurality of refined poses.

Abstract: An optical device may include a wedge-shaped light turning element. The optical device can include a first surface that is parallel to a horizontal axis and a second surface opposite to the first surface that is inclined with respect to the horizontal axis by a wedge angle. The optical device may include a light module that includes a plurality of light emitters. The light module can be configured to combine light for the plurality of emitters. The optical device can further include a light input surface that is between the first and the second surfaces and is disposed with respect to the light module to receive light emitted from the plurality of emitters. The optical device may include an end reflector that is disposed on a side opposite the light input surface. The second surface may be inclined such that a height of the light input surface is less than a height of the side opposite the light input surface.

Abstract: Various examples of cross-application systems and methods for authoring, transferring, and evaluating rigging control systems for virtual characters are disclosed. A first application, which implements a first rigging control protocol, can provide an input associated with a request for a behavior from the rig for the virtual character. The input can be converted to be compatible with a second rigging control protocol that is different from the first rigging control protocol. One or more control systems can be evaluated based on the input to determine an output to provide the requested behavior from the virtual character rig. The one or more control systems can be defined according to the second rigging control protocol. The output can be converted to be compatible with the first rigging control protocol and provided to the first application to manipulate the virtual character according to the requested behavior.

Abstract: Disclosed is an approach for managing and displaying virtual content in a mixed reality environment on a one-on-one basis independently by each application, each virtual content is rendered by its respective application into a bounded volume referred herein as a “Prism.” Each Prism may have characteristics and properties that allow a universe application to manage and display the Prism in the mixed reality environment such that the universe application may manage the placement and display of the virtual content in the mixed reality environment by managing the Prism itself.

Abstract: A cross reality system enables any of multiple devices to efficiently access previously stored maps. Both stored maps and tracking maps used by portable devices may have any of multiple types of location metadata associated with them. The location metadata may be used to select a set of candidate maps for operations, such as localization or map merge, that involve finding a match between a location defined by location information from a portable device and any of a number of previously stored maps. The types of location metadata may prioritized for use in selecting the subset. To aid in selection of candidate maps, a universe of stored maps may be indexed based on geo-location information. A cross reality platform may update that index as it interacts with devices that supply geo-location information in connection with location information and may propagate that geo-location information to devices that do not supply it.

Abstract: A viewing optics assembly comprising a spatial light modulator is configured to rotate the spatial light modulator.

Abstract: Described herein are techniques and technologies to identify an encrypted content within a field of view of a user of a VR/AR system and process the encrypted content appropriately. The user of the VR/AR technology may have protected content in a field of view of the user. Encrypted content is mapped to one or more protected surfaces on a display device. Contents mapped to a protected surface may be rendered on the display device but prevented from being replicated from the display device.

Abstract: A head mounted display system configured to project light to an eye of a user to display augmented reality images can include a frame configured to be supported on a head of the user, a camera disposed temporally on said frame, an eyepiece configured to direct light into said user's eye to display augmented reality image content to the user's vision field, a reflective element disposed on the frame, and at least one VCSEL disposed to illuminate said eye, wherein the camera is disposed with respect to the reflective element such that light from the VCSEL is reflected from the user's eye to the reflective element and is reflected from the reflective element to the camera to form images of the eye that are captured by the camera.

Abstract: Disclosed is an approach for managing and displaying virtual content in a mixed reality environment on a one-on-one basis independently by each application, each virtual content is rendered by its respective application into a bounded volume referred herein as a “Prism.” Each Prism may have characteristics and properties that allow a universe application to manage and display the Prism in the mixed reality environment such that the universe application may manage the placement and display of the virtual content in the mixed reality environment by managing the Prism itself.

Abstract: An apparatus configured to be head-worn by a user, includes: a transparent screen configured to allow the user to see therethrough; a sensor system configured to sense a characteristic of a physical object in an environment in which the user is located; and a processing unit coupled to the sensor system, the processing unit configured to: cause the screen to display a user-controllable object, and cause the screen to display an image of a feature that is resulted from a virtual interaction between the user-controllable object and the physical object, so that the feature will appear to be a part of the physical object in the environment or appear to be emanating from the physical object.

Abstract: A visual perception device is described. The visual perception device has corrective optics for viewing virtual and real-world content. An insert for the corrective optics is attached using a magnetic set, pins and/or a nose piece. Interchangeable nose pieces allow for height adjustments to accommodate different users. The visual perception device has pliable components to absorb forces exerted on a nose piece and a protective barrier for limiting electric shock or ingress of dirt.

Abstract: An artifact mitigation system includes a projector assembly and a set of imaging optics optically coupled to the projector assembly. The artifact mitigation system also includes an eyepiece optically coupled to the set of imaging optics. The eyepiece includes a diffractive incoupling interface. The artifact mitigation system further includes an artifact prevention element disposed between the set of imaging optics and the eyepiece. The artifact prevention element includes a linear polarizer, a first quarter waveplate disposed adjacent the linear polarizer, and a color select component disposed adjacent the first quarter waveplate.

Abstract: Systems and methods for displaying a virtual character in a mixed reality environment are disclosed. In some embodiments, a view of the virtual character is based on an animation rig comprising primary joints and helper joints. The animation rig may be in a pose defined by spatial relationships between the primary joints and helper joints. The virtual character may be moving in the mixed reality environment. In some instances, the virtual character may be moving based on a comparison of interestingness values associated with elements in the mixed reality environment. The spatial relationship transformation associated with the movement may be indicated by movement information. In some embodiments, the movement information is received from a neural network.

Abstract: A system may comprise a selectively transparent projection device for projecting an image toward an eye of a viewer from a projection device position in space relative to the eye of the viewer, the projection device being capable of assuming a substantially transparent state when no image is projected; an occlusion mask device coupled to the projection device and configured to selectively block light traveling toward the eye from one or more positions opposite of the projection device from the eye of the viewer in an occluding pattern correlated with the image projected by the projection device; and a zone plate diffraction patterning device interposed between the eye of the viewer and the projection device and configured to cause light from the projection device to pass through a diffraction pattern having a selectable geometry as it travels to the eye.

Abstract: A virtual, augmented, or mixed reality display system includes a display configured to display virtual, augmented, or mixed reality image data, the display including one or more optical components which introduce optical distortions or aberrations to the image data. The system also includes a display controller configured to provide the image data to the display. The display controller includes memory for storing optical distortion correction information, and one or more processing elements to at least partially correct the image data for the optical distortions or aberrations using the optical distortion correction information.