Abstract: A composite optical element includes a first optical component and a second optical component. The first optical component includes a first front surface, a first back surface, and a first junction surface. The second optical component that includes an end surface, a second front surface, a second back surface, and a second junction surface. The first front surface and the second front surface together form a first surface of the composite optical element, and the first back surface and the second back surface together form a second surface of the composite optical element. The second junction surface is coupled to the first junction surface to form a beam splitter that transmits light in a first band and reflects light in a second band toward the end surface.

Abstract: Systems described herein use outside-in positional tracking. A base station emits one or more rotational light beams to illuminate a local area. The rotational light beams rotate around a rotation axis and are used for positional tracking one or more objects in the local area. The one or more rotational light beams retroreflect from the one or more objects in the local area. The one or more objects include retroreflectors that retroreflect light beams incident on them. The base station detects the retroreflected light beams. The base station generates illumination data in response to the detected light beams. A system analyzes the illumination to determine an orientation and/or a location of an object.

Abstract: A system includes at least two base stations that emit light beams to illuminate an area for positional tracking objects in the area. A base station emits at least two light beams that rotate around a rotation axis at a rotational speed unique to the base station. Responsive to being illuminated by the light beams emitted by the at least two base stations, an object being tracked generates illumination data. The system determines which illumination data corresponds to one of multiple base stations by analyzing the illumination data over time. The system analyzes the illumination data corresponding to one base station to determine an orientation and/or position of the object relative to that base station.

Abstract: A system tracks eye movement using optical coherence in a head mounted display. The system includes an illumination source configured to project low coherence interference light onto a portion of a user's eye. The system includes a scanning system to select an axial position within the illuminated portion of the user's eye. The system includes a detector configured to collect light reflected from the illuminated portion of the user's eye at the selected axial position, and the reflected light includes measurement data characterizing the illuminated portion of the user's eye. The system includes a controller configured to compare the measurement data with a trained baseline, and determine an eye position based the comparison.

Abstract: A depth camera assembly (DCA) that captures data describing depth information in a local area. The DCA includes an imaging device, a controller, and an illumination source. The illumination source includes a plurality of emitters on a single substrate. The imaging device captures one or more images of the local area illuminated with the light from the illumination source. The controller determines depth information for objects in the local area using the one or more images.

Abstract: Disclosed herein are related to a system and a method of remotely rendering artificial realty. In one approach, a console determines an expected transmission end time of a first session for wireless transmission of image data indicating an image of artificial reality to a head wearable display. In one approach, the console determines an expected process end time of generating additional data associated with the image of the artificial reality. In one approach, the console compares the expected transmission end time and the expected process end time. The console may transmit, to the head wearable display in the first session, the additional data together with the image data, in response to the expected process end time being less than the expected transmission end time.

Abstract: A computing system comprises a database of garments in a retailers inventory, a database of users, a database of garments not in inventory, and a database of mappings, wherein a mapping maps one or more users of the database of users to one or more garments of the database of garments and wherein each mapping includes a weight for its corresponding user-garment pair.

Abstract: An on-line marketplace provides systems and methods for a mutually beneficial messaging campaign with one or more merchants, in order to promote the merchants' products. One aspect of the messaging campaign includes augmenting the merchants' budgets across multiple commercial channels. The channels may include merchant-operated channels, marketplace-operated channels, and/or third party channels. The marketplace selects when and how to augment the merchants' budgets. The augmented budget comprises an overall content budget for the messaging campaign, including a first budget portion provided by the merchant(s) and a second budget portion provided by the on-line marketplace. The augmented budget may be determined based on a weighted combination of goals of the marketplace and one or more merchants. The augmented budget may be segmented into static and dynamic portions, in which the dynamic portion is varied between channels to determine variables to optimize budget allocation and message performance.

Abstract: A near-eye display (NED) has an orientation detection device and a display block. The orientation detection device collects orientation data that describe an orientation of the NED. The display block has a display assembly, a focusing assembly, and a controller. The controller determines an orientation vector of the NED based in part on the orientation data and computes an angular difference between the orientation vector of the NED and a gravity vector. After comparing the angular difference to a threshold value, the controller generates multifocal instructions that adjusts the optical element to display an augmented scene at the selected image plane corresponding to the multifocal instructions.

Abstract: A near eye display (NED) includes an eye tracking system and a steering element. The eye tracking system tracks the location of a very small eyebox that is approximately the size of a user's pupil or smaller and provides this information to the steering element (e.g., MEMS, plurality of sources, liquid crystal prism, etc.). The very small eyebox provides for a very wide field of view and is optically efficient. The steering element adjusts the direction of light output (i.e., the exit pupil) from the NED such that it is directed toward the tracked location (i.e., a relatively small eyebox).

Abstract: A retinal imaging system includes a projector, an imaging device, and a controller coupled to an eye tracking system under test. The projector emits a light pattern to be delivered to a pupil of an eye, a location of the pupil being estimated by the eye tracking system under test. The imaging device captures one or more images of a retina of the eye illuminated with at least a portion of the light pattern. The controller determines one or more eye tracking parameters based on the captured one or more images of the retina. The controller compares each determined eye tracking parameter with each of estimated one or more eye tracking parameters, wherein values for the one or more eye tracking parameters are estimated by the eye tracking system under test. The controller characterizes each estimated eye tracking parameter based on the comparison.

Abstract: A head-mounted display (HMD) includes an electronic display element, a microlens array, and an optics block. The electronic display element outputs image light via sub-pixels having different colors, the sub-pixels separated from each other by a dark space region. The sub-pixels have associated emission distributions that describe ranges of angles of light emitted from the plurality of sub-pixels. The microlens array includes microlenses that are each coupled to at least one corresponding sub-pixel, of the sub-pixels, where the microlenses concentrate the emission distributions and direct the emission distributions toward a target region. The optics block, which is located in the target region optically corrects the image light and directs the optically corrected image light from the microlens array to an exit pupil of the HMD corresponding to a location of an eye of a user of the HMD.

Abstract: A super-resolution scanning display. The scanning display includes a light source, a conditioning assembly, and a scanning mirror assembly. The light source is configured to emit source light from a plurality of columns of emitters formed along a first dimension, including at least a first column of emitters emitting in a first band of light and a second column of emitters emitting in a second band of light which are offset along the first dimension by a fraction of an emitter width and offset along a second dimension—that is orthogonal to the first dimension—by greater than the emitter width. The conditioning assembly receives and conditions the source light. The scanning mirror assembly scans the conditioned light along the second dimension to generate a portion of an image at a first location with a resolution that is more than a first threshold number of emitters in a unit angle in the first dimension.

Abstract: Systems described herein use outside-in positional tracking. A base station emits one or more rotational light beams to illuminate a local area. The rotational light beams rotate around a rotation axis and are used for positional tracking of one or more objects in the local area. A beam waist of a source light beam for generating the rotational light beams is positioned to be within a distance range from a center of rotation of the rotational light beams. An apparent frequency of the particular rotational light beam can be constant or substantially constant throughout a local area. Because the apparent frequency of the particular rotational light beam is constant or substantially constant throughout the local area, the frequency response of a detector in response to the illumination by the rotational light beam is within a limited range of values irrespective of the detector's location within the local area.

Abstract: A head-mounted display (HMD) presented herein comprises a shell and a controller. The shell encloses a display element and includes a dynamic attenuator having one or more controllable pixels that control an amount of light from the local area to an eye box of the HMD. The controller determines, based on positional information for one or more objects in a local area surrounding the HMD, whether a user wearing the HMD is within a threshold distance of an object in the local area. Responsive to the determination, the controller identifies a field of view that includes the object. The controller instructs the dynamic attenuator to allow light from the local area over the identified field of view into the HMD.

Abstract: An eye tracking system comprises a structured light emitter, a camera assembly, and a controller. The structured light emitter illuminates a portion of an eye of a user with a dense structured light pattern. The dense structured light pattern produces a distorted illumination pattern on the portion of the eye. The camera assembly captures one or more images of the distorted illumination pattern that is associated with the portion of the eye. The controller estimates a position of the eye based on the captured one or more images and a model of the eye. The eye tracking system may be part of a head-mounted display.

Abstract: An augmented reality (AR) includes a depth camera assembly (DCA) to capture images of various depth zones of scenes of a local area. The DCA can focus on specific ranges in a scene, important aspects, and/or regions of interest. The DCA generates image data of the local area such that the image includes information pertaining to a single depth zone. The captured image is specific to the single depth zone and is representative of objects within the single depth zone. The DCA uses the generated image data for the depth zones to generate augmented or partially-augmented images that include depth information for the objects in the local area.

Abstract: A super-resolution scanning display. The scanning display includes a light source, a conditioning assembly, and a scanning mirror assembly. The light source is configured to emit source light from a plurality of columns of emitters formed along a first dimension, including at least a first column of emitters emitting in a first band of light and a second column of emitters emitting in a second band of light which are offset along the first dimension by a fraction of an emitter width and offset along a second dimension—that is orthogonal to the first dimension—by greater than the emitter width. The conditioning assembly receives and conditions the source light. The scanning mirror assembly scans the conditioned light along the second dimension to generate a portion of an image at a first location with a resolution that is more than a first threshold number of emitters in a unit angle in the first dimension.

Abstract: A depth camera assembly includes an illumination source, and an imaging device. The illumination source includes one or more emitters on a single substrate, and one or more folding elements folding at least an optical path of the projected light from each emitter. Each emitter emits a respective beam of light. The imaging device captures images of the local area illuminated with the light from the illumination source. In some configurations, the depth camera assembly includes a controller that provides images to a console that determines a depth information based in part on images of the local area illuminated with the light from the illumination source, and generates a virtual object based in part on the depth information.

Abstract: Systems and methods for identifying and associating contextual metadata across related media.