Abstract: A near-eye display (NED) includes a source assembly, a waveguide outside a field-of-view of a user, and a main optic within the field-of-view. The waveguide expands light emitted from the source assembly in at least one dimension and out-couple the expanded light. The main optic is partially transparent and is positioned such that the user of the NED looks through the main optic to view a local area surrounding the NED. The main optic receives light from the local area, combines the received light with the expanded light to generate combined light, and directs the combined light to the user's eye-box.

Abstract: A retinal imaging system includes a projector, an imaging device, and a controller coupled to an eye tracking system under test. The projector emits a light pattern to be delivered to a pupil of an eye, a location of the pupil being estimated by the eye tracking system under test. The imaging device captures one or more images of a retina of the eye illuminated with at least a portion of the light pattern. The controller determines one or more eye tracking parameters based on the captured one or more images of the retina. The controller compares each determined eye tracking parameter with each of estimated one or more eye tracking parameters, wherein values for the one or more eye tracking parameters are estimated by the eye tracking system under test. The controller characterizes each estimated eye tracking parameter based on the comparison.

Abstract: A head-mounted-display includes an electronic display emitting image light and a varifocal block receiving the image light and outputting the image light in at least one of the focal planes of the varifocal block. The varifocal block includes a back optical element, a front optical element, and an actuator assembly coupled to the back and front optical element. The front optical element is positioned closer to an exit pupil than the back optical element, and separated from the back optical element by an adjustable distance, the magnitude of which determines in which of the focal planes the image light is presented. The actuator assembly simultaneously adjusts positions of the back optical element and the front optical element to vary the adjustable distance between the back optical element and the front optical element in accordance with an estimated vergence depth of the user.

Abstract: In one example, an apparatus comprises: multiple distinct sets of photodiodes, wherein each set of photodiodes includes one or more photodiodes, one or more charge sensing units, and a controller. The controller is configured to: transfer charge generated by the one or more photodiodes in response to a different component of incident light to the one or more charge sensing units in order to convert the charge to voltages; perform one or more quantization processes of a plurality of quantization processes corresponding to a plurality of intensity ranges, wherein the one or more quantization processes quantizes the voltages from the one or more charge sensing units to digital values representing components of a pixel of different wavelength ranges; and generate a pixel value based on the at least some of the digital values.

Abstract: A method for correcting artifacts in artificial reality headsets is provided. The method includes coupling a first image portion into a waveguide in a display for an artificial reality device, provided by a first array of pixels, coupling a second image portion into the waveguide in the display, provided by a second array of pixels, directing the first image portion through an eyebox, directing the second image portion through the eyebox, and tiling, in a user's retina, the first image portion and the second image portion to form an image having an extended field of view that includes an overlapping area comprising light provided by the first array of pixels and the second array of pixels. A system including a memory storing instructions and a processor to execute the instructions to cause the system to perform the above method are also provided.

Abstract: A depth camera assembly for depth sensing of a local area includes an illumination source, an imaging device, and a controller. The illumination source illuminates a local area with light emitted in accordance with emission instructions generated by the controller. The illumination source includes an array of optical sources and an optical assembly. Operation of each optical source in the array is controllable based in part on the emission instructions. The optical assembly is configured to project the light into the local area. The imaging device captures one or more images of at least a portion of the light reflected from one or more objects in the local area. The controller determines depth information for the one or more objects based in part on the captured one or more images.

Abstract: Disclosed herein are related to a system and a method of remotely rendering artificial reality. In one approach, a console determines an expected transmission end time of a first session for wireless transmission of image data indicating an image of artificial reality to a head wearable display. In one approach, the console determines an expected process end time of generating additional data associated with the image of the artificial reality. In one approach, the console compares the expected transmission end time and the expected process end time. The console may transmit, to the head wearable display in the first session, the additional data together with the image data, in response to the expected process end time being less than the expected transmission end time.

Abstract: The disclosed projector device may include (1) a first monochromatic emitter array having a plurality of emitters of a first color disposed in a two-dimensional configuration and (2) a second monochromatic emitter array having a plurality of emitters of a second color disposed in a two-dimensional configuration. The first and second monochromatic emitter arrays may be configured to emit images of the first and second colors into a waveguide configuration, and the first color may be different than the second color. Associated display systems and methods are also provided.

Abstract: A method for correcting artifacts in artificial reality headsets is provided. The method includes coupling a first image portion into a waveguide in a display for an artificial reality device, provided by a first array of pixels, coupling a second image portion into the waveguide in the display, provided by a second array of pixels, directing the first image portion through an eyebox, directing the second image portion through the eyebox, and tiling, in a user's retina, the first image portion and the second image portion to form an image having an extended field of view that includes an overlapping area comprising light provided by the first array of pixels and the second array of pixels. A system including a memory storing instructions and a processor to execute the instructions to cause the system to perform the above method are also provided.

Abstract: A retinal imaging system includes a projector, an imaging device, and a controller coupled to an eye tracking system under test. The projector emits a light pattern to be delivered to a pupil of an eye, a location of the pupil being estimated by the eye tracking system under test. The imaging device captures one or more images of a retina of the eye illuminated with at least a portion of the light pattern. The controller determines one or more eye tracking parameters based on the captured one or more images of the retina. The controller compares each determined eye tracking parameter with each of estimated one or more eye tracking parameters, wherein values for the one or more eye tracking parameters are estimated by the eye tracking system under test. The controller characterizes each estimated eye tracking parameter based on the comparison.

Abstract: An optical assembly for a digital projector includes a lens and a field bias optical element. The lens is disposed to receive display light generated by a display and to direct the display light along an optical path. The lens is configured to provide a first field-of-view. The field bias optical element is disposed between the lens and an aperture stop of the optical assembly. The field bias optical element is configured to bias the display light in at least one direction to provide a second field-of-view that is greater than the first field-of-view.

Abstract: A super-resolution scanning display. The scanning display includes a light source, a conditioning assembly, and a scanning mirror assembly. The light source is configured to emit source light from a plurality of columns of emitters formed along a first dimension, including at least a first column of emitters emitting in a first band of light and a second column of emitters emitting in a second band of light which are offset along the first dimension by a fraction of an emitter width and offset along a second dimension—that is orthogonal to the first dimension—by greater than the emitter width. The conditioning assembly receives and conditions the source light. The scanning mirror assembly scans the conditioned light along the second dimension to generate a portion of an image at a first location with a resolution that is more than a first threshold number of emitters in a unit angle in the first dimension.

Abstract: Disclosed herein are related to a system and a method of remotely rendering artificial realty. In one approach, a console determines an expected transmission end time of a first session for wireless transmission of image data indicating an image of artificial reality to a head wearable display. In one approach, the console determines an expected process end time of generating additional data associated with the image of the artificial reality. In one approach, the console compares the expected transmission end time and the expected process end time. The console may transmit, to the head wearable display in the first session, the additional data together with the image data, in response to the expected process end time being less than the expected transmission end time.

Abstract: The disclosed projector device may include (1) a first monochromatic emitter array having a plurality of emitters of a first color disposed in a two-dimensional configuration and (2) a second monochromatic emitter array having a plurality of emitters of a second color disposed in a two-dimensional configuration. The first and second monochromatic emitter arrays may be configured to emit images of the first and second colors into a waveguide configuration, and the first color may be different than the second color. Associated display systems and methods are also provided.

Abstract: In one example, an apparatus comprises: a plurality of photodiodes, one or more charge sensing units, one or more analog-to-digital converters (ADCs), and a controller. The controller is configured to: enable the each photodiode to generate charge in response to a different component of the incident light; transfer the charge from the plurality of photodiodes to the one or more charge sensing units to convert to voltages; receive a selection of one or more quantization processes of a plurality of quantization processes corresponding to a plurality of intensity ranges; based on the selection, control the one or more ADCs to perform the selected one or more quantization processes to quantize the voltages from the one or more charge sensing units to digital values representing components of a pixel of different wavelength ranges; and generate a pixel value based on the digital values.

Abstract: A system tracks eye movement using optical coherence in a head mounted display. The system includes an illumination source configured to project low coherence interference light onto a portion of a user's eye. The system includes a scanning system to select an axial position within the illuminated portion of the user's eye. The system includes a detector configured to collect light reflected from the illuminated portion of the user's eye at the selected axial position, and the reflected light includes measurement data characterizing the illuminated portion of the user's eye. The system includes a controller configured to compare the measurement data with a trained baseline, and determine an eye position based the comparison.

Abstract: Disclosed herein are related to a system and a method of remotely rendering artificial reality. In one approach, a console determines an expected transmission end time of a first session for wireless transmission of image data indicating an image of artificial reality to a head wearable display. In one approach, the console determines an expected process end time of generating additional data associated with the image of the artificial reality. In one approach, the console compares the expected transmission end time and the expected process end time. The console may transmit, to the head wearable display in the first session, the additional data together with the image data, in response to the expected process end time being less than the expected transmission end time.

Abstract: In one example, an apparatus comprises: multiple distinct sets of photodiodes, wherein each set of photodiodes includes one or more photodiodes, one or more charge sensing units, and a controller. The controller is configured to: transfer charge generated by the one or more photodiodes in response to a different component of incident light to the one or more charge sensing units in order to convert the charge to voltages; perform one or more quantization processes of a plurality of quantization processes corresponding to a plurality of intensity ranges, wherein the one or more quantization processes quantizes the voltages from the one or more charge sensing units to digital values representing components of a pixel of different wavelength ranges; and generate a pixel value based on the at least some of the digital values.

Abstract: The disclosed projector device may include (1) a first monochromatic emitter array having a plurality of emitters of a first color disposed in a two-dimensional configuration and (2) a second monochromatic emitter array having a plurality of emitters of a second color disposed in a two-dimensional configuration. The first and second monochromatic emitter arrays may be configured to emit images of the first and second colors into a waveguide configuration, and the first color may be different than the second color. Associated display systems and methods are also provided.

Abstract: By tiling multiple waveguide displays in an artificial-reality system, and/or using multiple projectors per waveguide display, a large field of view for the artificial-reality system can be achieved using waveguide displays. By using waveguide displays, a form factor for a virtual-reality system can be reduced compared to conventional virtual-reality systems.