Abstract: An artifact mitigation system includes a projector assembly and a set of imaging optics optically coupled to the projector assembly. The artifact mitigation system also includes an eyepiece optically coupled to the set of imaging optics. The eyepiece includes a diffractive incoupling interface. The artifact mitigation system further includes an artifact prevention element disposed between the set of imaging optics and the eyepiece. The artifact prevention element includes a linear polarizer, a first quarter waveplate disposed adjacent the linear polarizer, and a color select component disposed adjacent the first quarter waveplate.

Abstract: Disclosed herein are systems and methods for presenting audio content in mixed reality environments. A method may include receiving a first input from an application program; in response to receiving the first input, receiving, via a first service, an encoded audio stream; generating, via the first service, a decoded audio stream based on the encoded audio stream; receiving, via a second service, the decoded audio stream; receiving a second input from one or more sensors of a wearable head device; receiving, via the second service, a third input from the application program, wherein the third input corresponds to a position of one or more virtual speakers; generating, via the second service, a spatialized audio stream based on the decoded audio stream, the second input, and the third input; presenting, via one or more speakers of the wearable head device, the spatialized audio stream.

Abstract: An augmented reality viewer includes components, assemblies, and executable logic to provide a user with the perception of rich augmented reality experiences, including aspects of the aquatic world.

Abstract: A method of forming a visual representation of an object from a plurality of image frames acquired using a portable electronic device, the method comprising the steps of determining at least one parameter of motion of the portable electronic device; determining at least one capture condition for at least one first image frame of the plurality of image frames; computing, based on the at least one parameter of motion and the at least one capture condition, an indication of blur in the image frame; based on the indication of blur, conditionally taking a corrective action.

Abstract: An improved method, system, and apparatus is provided to implement a general architecture for robot systems. A mode execution module is provided to universally execute execution modes on different robotic system. A system includes an execution module that receives software instructions in a normalized programming language. The system also includes an interface having a translation layer that converts the software instructions from the normalized language into robot-specific instructions that operate in a particular robotic system. The system further includes a controller that is communicatively coupled to the interface, wherein the controller receives the robot-specific instructions. Moreover, the system includes a robotic device that is operatively controlled by the controller by execution of the robot-specific instructions.

Abstract: Techniques are described for applying an edge sealant to the edge of a multi-layer optical device. In particular, embodiments provide an apparatus that performs a precision measurement of the perimeter of an eyepiece, applying the edge sealant (e.g., polymer) based on the precision-measured perimeter, and subsequently cures the edge sealant, using ultraviolet (UV) light that is directed at the edge sealant. The curing process may be performed within a short time following the application of the edge sealant, to ensure that any wicking of the edge sealant between the layers of the eyepiece is controlled to be no greater than a particular depth tolerance. In some examples, the edge sealant is applied to the optical device prevent, or at least reduce, the leakage of light from the optical device, and also to ensure and maintain the structure of the multi-layer optical device.

Abstract: A method to reconstruct an environment is provided. The method makes available to a wide variety of XR applications fresh and accurate 3D reconstruction data of environments with low processing time and low usage of computational resources and storage spaces. The 3D reconstruction data are structured in a way to be efficiently shared between users for multi-user experiences. The method includes obtaining plane segments of an environment, identifying surface planes of the environment by, for example, filtering and grouping the plane segments or ad hoc selection of the plane segments by a user, and inferring corner points of the environment based on the surface planes. The corner points are used to build a 3D representation of the environment when an XR application requires.

Abstract: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise an image capturing device to capture one or more images, the one or more images corresponding to a field of the view of a user of a head-mounted augmented reality device, and a processor communicatively coupled to the image capturing device to extract a set of map points from the set of images, to identify a set of sparse points and a set of dense points from the extracted set of map points, and to perform a normalization on the set of map points.

Abstract: Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.

Abstract: This disclosure describes techniques for receiving information that is wirelessly transmitted to a mobile computing system by wireless devices that are proximal to a route being travelled by the mobile computing system, and presenting at least a portion of the received information through a display of the mobile computing system. The information can be displayed according to a computing experience that is determined for a user of the mobile computing system (e.g., user-selected, inferred based on a stored schedule of the user, and so forth). Different sets of location-based information can be transmitted to the mobile computing system from different wireless devices that the mobile computing system comes into proximity with while traveling along a route. In some instances, the information can be locally stored on the wireless device(s) to reduce latency.

Abstract: An apparatus configured for head-worn by a user, includes: a screen configured to present graphics for the user; a camera system configured to view an environment in which the user is located; and a processing unit coupled to the camera system, the processing unit configured to: obtain a first image with a first resolution, the first image having a first corner, determine a second image with a second resolution, the second image having a second corner that corresponds with the first corner in the first image, wherein the second image is based on the first image, the second resolution being less than the first resolution, detect the second corner in the second image, determine a position of the second corner in the second image, and determine a position of the first corner in the first image based at least in part on the determined position of the second corner in the second image.

Abstract: Disclosed are methods and systems for a scripting framework and implementations therefor for mixed reality software applications of heterogeneous systems. These methods or systems create a mixed-reality software application that executes across heterogeneous platforms on a server-side instance of a scripting framework and manage a change in the mixed-reality software application using the server-side instance of the scripting framework. Moreover, the change in the mixed-reality software application using a client-side instance of the scripting framework; and the mixed-reality software application may be interactively executed on a mixed-reality device.

Abstract: A hearing aid comprises a sensor configured for detecting a focus of an end user on a real sound source, a microphone assembly configured for converting sounds into electrical signals, a speaker configured for converting the electrical signals into sounds, and a control subsystem configured for modifying the direction and/or distance of a greatest sensitivity of the microphone assembly based on detected focus. A virtual image generation system comprises memory storing a three-dimensional scene, a sensor configured for detecting a focus of the end user on a sound source, a speaker configured for conveying sounds to the end user, and a control subsystem configured for causing the speaker to preferentially convey a sound originating from the sound source in response to detection of the focus, and for rendering image frames of the scene, and a display subsystem configured for sequentially displaying the image frames to the end user.

Abstract: Systems and methods of generating a three-dimensional (3D) reconstruction of a scene or environment surrounding a user of a spatial computing system, such as a virtual reality, augmented reality or mixed reality system, using only multiview images comprising RGB images, and without the need for depth sensors or depth data from sensors. Features are extracted from a sequence of frames of RGB images and back-projected using known camera intrinsics and extrinsic s into a 3D voxel volume wherein each pixel of the voxel volume is mapped to a ray in the voxel volume. The back-projected features are fused into the 3D voxel volume. The 3D voxel volume is passed through a 3D convolutional neural network to refine the and regress truncated signed distance function values at each voxel of the 3D voxel volume.

Abstract: Embodiments provide a computer implemented method for warping multi-field color virtual content for sequential projection. First and second color fields having different first and second colors are obtained. A first time for projection of a warped first color field is determined. A first pose corresponding to the first time is predicted. For each one color among the first colors in the first color field, (a) an input representing the one color among the first colors in the first color field is identified; (b) the input is reconfigured as a series of pulses creating a plurality of per-field inputs; and (c) each one of the series of pulses is warped based on the first pose. The warped first color field is generated based on the warped series of pulses. Pixels on a sequential display are activated based on the warped series of pulses to display the warped first color field.

Abstract: An improved method, system, and apparatus is provided to perform camera calibration, where cameras are mounted onto a moving conveyance apparatus to capture images of a multi-planar calibration target. The calibration process is optimized by reducing the number of images captured while simultaneously preserving overall information density.

Abstract: A method includes capturing an image using a content capture device with an initial image setting. The image includes a plurality of pixel groups, and a pixel group can have one or more pixels. A plurality of edge pixel groups is identified and then classified into two subsets. A first subset of saturated edge pixel groups includes edge pixel groups that have at least one neighboring pixel group with an image intensity exceeding a saturated intensity value. A second subset of non-saturated edge pixel groups includes edge pixel groups that have no neighboring pixel groups with an image intensity exceeding a saturated intensity value. An adjustment value to the image setting is determined based on a total number of saturated edge pixel groups and a total number of non-saturated edge pixel groups. An updated image is captured with an updated image setting based on the adjustment value.

Abstract: Systems, apparatus, and methods for double-sided imprinting are provided. An example system includes first rollers for moving a first web including a first template having a first imprinting feature, second rollers for moving a second web including a second template having a second imprinting feature, dispensers for dispensing resist, a locating system for locating reference marks on the first and second webs for aligning the first and second templates, a light source for curing the resist, such that a cured first resist has a first imprinted feature corresponding to the first imprinting feature on one side of the substrate and a cured second resist has a second imprinted feature corresponding to the second imprinting feature on the other side of the substrate, and a moving system for feeding in the substrate between the first and second templates and unloading the double-imprinted substrate from the first and second webs.

Abstract: An example waveguide can include a polymer layer having substantially optically transparent material with first and second major surfaces configured such that light containing image information can propagate through the polymer layer being guided therein by reflecting from the first and second major surfaces via total internal reflection. The first surface can include first smaller and second larger surface portions monolithically integrated with the polymer layer and with each other. The first smaller surface portion can include at least a part of an in-coupling optical element configured to couple light incident on the in-coupling optical element into the polymer layer for propagation therethrough by reflection from the second major surface and the second larger surface portion of the first major surface.

Abstract: Images perceived to be substantially full color or multi-colored may be formed using component color images that are distributed in unequal numbers across a plurality of depth planes. The distribution of component color images across the depth planes may vary based on color. In some embodiments, a display system includes a stack of waveguides that each output light of a particular color, with some colors having fewer numbers of associated waveguides than other colors. The stack of waveguides may include by multiple pluralities (e.g., first and second pluralities) of waveguides, each configured to produce an image by outputting light corresponding to a particular color. The total number of waveguides in the second plurality of waveguides is less than the total number of waveguides in the first plurality of waveguides, and may be more than the total number of waveguides in a third plurality of waveguides, in embodiments where three component colors are utilized.