Abstract: Fabrication of optical lenses in optical assemblies of small form factor cameras and augmented reality (AR)/virtual reality (VR) near-eye display devices is described. An optical lens may be printed using a three-dimensional printing technique over a substrate such as glass following application of an optically clear adhesive (OCA) layer on the substrate. A buffer layer may also be used between the substrate and the OCA layer. Alternatively, a display waveguide may be used as substrate with a low optical index buffer layer between the OCA layer and the waveguide eliminating an air gap between the optical lens and the waveguide.

Abstract: According to examples, a system for implementing structured polarized illumination techniques to determine and reconstruct a shape and a material property of an object is described. The system may include a light source to transmit an original beam of light; a first grating to diffract the original beam of light into a first light beam and a second light beam, a second grating to emit overlapping light beams towards an object, a polarization camera to capture light reflected from the object, and a computer system, comprising a processor and a non-transitory computer-readable storage medium having an executable stored thereon. The processor, when executing the instructions, may cause the system to analyze the light reflected from the object to determine a fringe projection analysis associated with the object, determine a shape of the object; and determine a Mueller matrix to describe material properties of the object.

Abstract: A stabilization actuation assembly includes a lens barrel, a magnetic assembly, one or more stabilizing coils, an outer shell, and a piece of ferromagnetic material. The lens barrel is configured to carry a lens that is positioned along an optical axis. The magnetic assembly includes a plurality of magnets that produce a magnetic field. The one or more stabilizing coils are coupled to a printed circuit board below the plurality of magnets. The outer shell includes an aperture through which the lens barrel can actuate. The piece of ferromagnetic material is coupled to a surface of the outer shell and is positioned to augment the magnetic field. A current supplied to the one or more stabilizing coils interacts with the augmented magnetic field to cause the magnetic assembly together with the lens barrel to translate in a direction perpendicular to the optical axis.

Abstract: Three-dimensional (3D) resolution of a single photon avalanche diode (SPAD) based eye tracking system is enhanced through sensor and/or light source steering. The light source may illuminate the whole eye, while the sensor and/or one or more mirrors associated with the sensor may be steered to capture images of different portions of the eye. The images are stitched to achieve a high-resolution, full view of the eye. Alternatively, the sensor may capture a low-resolution image of the whole eye and be steered to capture multiple low-resolution images, which may be used for interpolation and creation of a high-resolution image of the eye. Both the light source and the sensor (and/or the mirrors) may be steered to illuminate and capture images of different portions of the eye, which may then be stitched to achieve a high-resolution, full view of the eye.

Abstract: A facial tracking device including an illuminator and a photon detector. The illuminator configured to project a light toward a first portion of a head of a user and the photon detector configured to detect light reflected from a second portion of the head of the user. The facial tracking device further including a processor that is connected to the illuminator and photon detector and configured to cause the illuminator to project the light toward the head of the user, receive information from the photon detector, and determine a facial expression of the user.

Abstract: The disclosed computer-implemented method may include synchronizing a timing scheme between a display and a camera. The method may also include triggering, using a display trigger based on the timing scheme, the display to display a content frame, and triggering, using a capture trigger based on the timing scheme, the camera to capture the displayed content frame. The method may further include building a timeline of frame events for the displayed content frame and the captured content frame, and matching, using the timeline of frame events, the displayed content frame with the captured content frame. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: In one embodiment, a method includes generating a visual interaction tool that moves and extends in a three-dimensional artificial-reality environment according to hand and arm movements of a user. It may be detected that the visual interaction tool intersects a predefined region associated with a virtual item of a first type in the AR environment. The visual interaction tool may attach to the first virtual item. A first operating mode for the visual interaction tool may be selected based on the first type of the first virtual item. The first operating mode may be selected from multiple operating modes for the visual interaction tool. A first input from the user may be received while the visual interaction tool is attached to the first virtual item. First operations with the first virtual item may be performed according to the first operating mode and the first input.

Abstract: An elongated heat pipe or vapor chamber is described. In examples, the heat pipe may include a tubular body comprising a hollow glass tube or fiber. The heat pipe may further include a wick within the tubular body and a working fluid within the tubular body. The wick may be made of glass, polymer, metal, etc. The wick may be an elongated cylinder disposed within the tubular body and, some cases, may be bonded to an inner floor of the tubular body. In examples, the wick may have an outer diameter substantially equal to an inner diameter of the tubular body. In examples, the wick may have a substantially cross-shaped cross section or may have a helical shape.

Abstract: In one embodiment, a method includes instructing sensors on an AR headset to capture data of a real-world environment, discovering a 3D location where a native application configured to run natively on an operating system is downloadable, generating and displaying a virtual object representing the native application at the 3D location, detecting a user of the AR system interacting with the virtual object, downloading a first executable portion of the native application, executing the first executable portion within a sandbox process having a predetermined set of access permissions, progressively downloading a remaining executable portion of the native application while the user is interacting with the executed first executable portion, and in response to a determination that the native application is completely downloaded, installing the native application on the operating system.

Abstract: A method of forming a pixel-aligned volumetric avatar includes receiving multiple two-dimensional images having at least two or more fields of view of a subject. The method also includes extracting multiple image features from the two-dimensional images using a set of learnable weights, projecting the image features along a direction between a three-dimensional model of the subject and a selected observation point for a viewer, and providing, to the viewer, an image of the three-dimensional model of the subject. A system and a non-transitory, computer readable medium storing instructions to perform the above method, are also provided.

Abstract: An optical assembly includes a Fresnel lens and a diffractive optical element. The Fresnel lens includes a high-refractive-index material having a refractive index greater than 1.9. The diffractive optical element is optically coupled with the Fresnel lens to compensate for chromatic aberration caused by the Fresnel lens. A method for imaging light with the optical assembly is also disclosed.

Abstract: A wearable device for use in immersive reality applications is provided. The wearable device includes eyepieces to provide a forward-image to a user, a first forward-looking camera mounted on the frame and having a field of view, a processor configured to identify a region of interest within the forward-image, and an interface device to indicate to the user that a field of view of the first forward-looking camera is misaligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.

Abstract: Aspects of the present disclosure are for an interaction mode system that provides multiple interaction modes in an artificial reality environment with automatic, context-specific transitions between interaction modes. An interaction mode can specify how the interaction mode system determines direction indications and movement within an artificial reality environment and interactions for making selections or performing other actions. In some implementations, the interaction mode system can control at least four interaction modes including a no-hands, 3DoF mode, a no-hands, 6DoF mode, a gaze and gesture mode, and a ray casting mode. The interaction mode system can employ a mapping of interaction mode context factors (e.g., which components are enabled, mode settings, lighting or other environment conditions, current body positions, etc.) to interaction modes to control transitioning between particular interaction modes.

Abstract: Systems and methods for performing listen-before-talk (LBT) operations include a first wireless communication device which schedules a data burst comprising a plurality of chirps for transmitting on a channel to a second device. The wireless communication device may perform an LBT operation on the channel between the first device and the second device to determine that the channel is available, prior to transmitting a first chirp of the plurality of chirps. The wireless communication device may transmit the first chirp on the channel responsive to performing the LBT operation.

Abstract: Methods, systems, and apparatuses for eye tracking in a near-eye display device are described. In one aspect, an eye tracking system has an array of Vertical Cavity Surface-Emitting Lasers (VCSELs) with different groupings of VCSELs within the array providing structured light with different polarization states such that the structured light projected onto the user's eye has (i) a spatially varying and/or temporally-varying intensity profile and/or (ii) a spatially varying and/or temporally-varying polarization profile. In another aspect, an eye tracking system includes a light source, an image sensor, and a controller which controls the image sensor to capture series of images of light reflections from the eye when the eye is stationary, determines blood flow characteristics using pattern changes in the captured series of images, and performs user authentication and/or liveness detection based on the detected blood flow characteristics.

Abstract: Antenna systems for near-eye devices are described which include multiple resonance sections fed by a single parasitic element. In one example, an antenna has multiple resonance sections which include an open-ended slot antenna section that resonates within a 2.4 GHz frequency band. In one example, the antenna has a monopole section and a dipole section which both resonate within a 5 GHz to 7 GHz frequency band. In one example, a floating dipole is created by locating an open-ended slot antenna parallel to a monopole antenna, where both antennas share the same electrical feed. In one example, multiple resonance sections on one side of a printed circuit board (PCB) are simultaneously electrically fed by a single parasitic element on the other side of the PCB.

Abstract: In one embodiment, a method includes receiving a user request from a first user from a client system associated with a first user, wherein the user request comprise a gesture-input from the first user and a speech-input from the first user, determining an intent corresponding to the user request based on the gesture-input by a personalized gesture-classification model associated with the first user, executing one or more tasks based on the determined intent and the speech-input, and sending instructions for presenting execution results of the one or more tasks to the client system responsive the user request.

Abstract: For small, high-resolution, light-emitting diode (LED) displays, such as for a near-eye display in an artificial-reality headset, LEDs are spaced closely together. A backplane can be used to drive an array of LEDs in an LED display. A plurality of interconnects electrically couple the backplane with the array of LEDs. The backplane can have a different coefficient of thermal expansion (CTE) than the array of LEDs. During bonding of the backplane to the array of LEDs, CTE mismatch can cause misalignment of bonding sites. The higher the bonding temperature, the greater the misalignment of bonding sites. Lower temperature bonding, using materials with lower melting or bonding temperatures, can be used to mitigate misalignment during bonding so that interconnects can be more closely spaced, which can allow LEDs to be more closely spaced, to enable a higher-resolution display.