Abstract: A system, device, and method for a universal intersystem connection are provided. In one aspect, a shielded twisted pair of wires electrically connects a first circuit board and a second circuit board in an apparatus, where the first and second circuit boards may communicate over the shielded twisted pair using differential signalling, and the first circuit board may also be powered by direct current (DC) power over the shielded twisted pair. In an example, the second circuit board is a controller of the first circuit board and may be electrically connected to a battery which powers the first circuit board via the shielded twisted pair. In other examples, a plurality of circuit boards may be electrically connected by the shielded twisted pair to a power source and may communicate with each other via differential signalling over shielded twisted pair.

Abstract: According to examples, a system for implementing structured polarized illumination techniques to determine and reconstruct a shape and a material property of an object is described. The system may include a light source to transmit an original beam of light; a first grating to diffract the original beam of light into a first light beam and a second light beam, a second grating to emit overlapping light beams towards an object, a polarization camera to capture light reflected from the object, and a computer system, comprising a processor and a non-transitory computer-readable storage medium having an executable stored thereon. The processor, when executing the instructions, may cause the system to analyze the light reflected from the object to determine a fringe projection analysis associated with the object, determine a shape of the object; and determine a Mueller matrix to describe material properties of the object.

Abstract: A facial tracking device including an illuminator and a photon detector. The illuminator configured to project a light toward a first portion of a head of a user and the photon detector configured to detect light reflected from a second portion of the head of the user. The facial tracking device further including a processor that is connected to the illuminator and photon detector and configured to cause the illuminator to project the light toward the head of the user, receive information from the photon detector, and determine a facial expression of the user.

Abstract: In one embodiment, a method includes generating a visual interaction tool that moves and extends in a three-dimensional artificial-reality environment according to hand and arm movements of a user. It may be detected that the visual interaction tool intersects a predefined region associated with a virtual item of a first type in the AR environment. The visual interaction tool may attach to the first virtual item. A first operating mode for the visual interaction tool may be selected based on the first type of the first virtual item. The first operating mode may be selected from multiple operating modes for the visual interaction tool. A first input from the user may be received while the visual interaction tool is attached to the first virtual item. First operations with the first virtual item may be performed according to the first operating mode and the first input.

Abstract: Three-dimensional (3D) resolution of a single photon avalanche diode (SPAD) based eye tracking system is enhanced through sensor and/or light source steering. The light source may illuminate the whole eye, while the sensor and/or one or more mirrors associated with the sensor may be steered to capture images of different portions of the eye. The images are stitched to achieve a high-resolution, full view of the eye. Alternatively, the sensor may capture a low-resolution image of the whole eye and be steered to capture multiple low-resolution images, which may be used for interpolation and creation of a high-resolution image of the eye. Both the light source and the sensor (and/or the mirrors) may be steered to illuminate and capture images of different portions of the eye, which may then be stitched to achieve a high-resolution, full view of the eye.

Abstract: The disclosed computer-implemented method may include synchronizing a timing scheme between a display and a camera. The method may also include triggering, using a display trigger based on the timing scheme, the display to display a content frame, and triggering, using a capture trigger based on the timing scheme, the camera to capture the displayed content frame. The method may further include building a timeline of frame events for the displayed content frame and the captured content frame, and matching, using the timeline of frame events, the displayed content frame with the captured content frame. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A stabilization actuation assembly includes a lens barrel, a magnetic assembly, one or more stabilizing coils, an outer shell, and a piece of ferromagnetic material. The lens barrel is configured to carry a lens that is positioned along an optical axis. The magnetic assembly includes a plurality of magnets that produce a magnetic field. The one or more stabilizing coils are coupled to a printed circuit board below the plurality of magnets. The outer shell includes an aperture through which the lens barrel can actuate. The piece of ferromagnetic material is coupled to a surface of the outer shell and is positioned to augment the magnetic field. A current supplied to the one or more stabilizing coils interacts with the augmented magnetic field to cause the magnetic assembly together with the lens barrel to translate in a direction perpendicular to the optical axis.

Abstract: An elongated heat pipe or vapor chamber is described. In examples, the heat pipe may include a tubular body comprising a hollow glass tube or fiber. The heat pipe may further include a wick within the tubular body and a working fluid within the tubular body. The wick may be made of glass, polymer, metal, etc. The wick may be an elongated cylinder disposed within the tubular body and, some cases, may be bonded to an inner floor of the tubular body. In examples, the wick may have an outer diameter substantially equal to an inner diameter of the tubular body. In examples, the wick may have a substantially cross-shaped cross section or may have a helical shape.

Abstract: In one embodiment, a method includes instructing sensors on an AR headset to capture data of a real-world environment, discovering a 3D location where a native application configured to run natively on an operating system is downloadable, generating and displaying a virtual object representing the native application at the 3D location, detecting a user of the AR system interacting with the virtual object, downloading a first executable portion of the native application, executing the first executable portion within a sandbox process having a predetermined set of access permissions, progressively downloading a remaining executable portion of the native application while the user is interacting with the executed first executable portion, and in response to a determination that the native application is completely downloaded, installing the native application on the operating system.

Abstract: An optical assembly includes a Fresnel lens and a diffractive optical element. The Fresnel lens includes a high-refractive-index material having a refractive index greater than 1.9. The diffractive optical element is optically coupled with the Fresnel lens to compensate for chromatic aberration caused by the Fresnel lens. A method for imaging light with the optical assembly is also disclosed.

Abstract: A wearable device for use in immersive reality applications is provided. The wearable device includes eyepieces to provide a forward-image to a user, a first forward-looking camera mounted on the frame and having a field of view, a processor configured to identify a region of interest within the forward-image, and an interface device to indicate to the user that a field of view of the first forward-looking camera is misaligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.

Abstract: A method of forming a pixel-aligned volumetric avatar includes receiving multiple two-dimensional images having at least two or more fields of view of a subject. The method also includes extracting multiple image features from the two-dimensional images using a set of learnable weights, projecting the image features along a direction between a three-dimensional model of the subject and a selected observation point for a viewer, and providing, to the viewer, an image of the three-dimensional model of the subject. A system and a non-transitory, computer readable medium storing instructions to perform the above method, are also provided.

Abstract: Aspects of the present disclosure are for an interaction mode system that provides multiple interaction modes in an artificial reality environment with automatic, context-specific transitions between interaction modes. An interaction mode can specify how the interaction mode system determines direction indications and movement within an artificial reality environment and interactions for making selections or performing other actions. In some implementations, the interaction mode system can control at least four interaction modes including a no-hands, 3DoF mode, a no-hands, 6DoF mode, a gaze and gesture mode, and a ray casting mode. The interaction mode system can employ a mapping of interaction mode context factors (e.g., which components are enabled, mode settings, lighting or other environment conditions, current body positions, etc.) to interaction modes to control transitioning between particular interaction modes.

Abstract: Antenna systems for near-eye devices are described which include multiple resonance sections fed by a single parasitic element. In one example, an antenna has multiple resonance sections which include an open-ended slot antenna section that resonates within a 2.4 GHz frequency band. In one example, the antenna has a monopole section and a dipole section which both resonate within a 5 GHz to 7 GHz frequency band. In one example, a floating dipole is created by locating an open-ended slot antenna parallel to a monopole antenna, where both antennas share the same electrical feed. In one example, multiple resonance sections on one side of a printed circuit board (PCB) are simultaneously electrically fed by a single parasitic element on the other side of the PCB.

Abstract: Systems and methods for performing listen-before-talk (LBT) operations include a first wireless communication device which schedules a data burst comprising a plurality of chirps for transmitting on a channel to a second device. The wireless communication device may perform an LBT operation on the channel between the first device and the second device to determine that the channel is available, prior to transmitting a first chirp of the plurality of chirps. The wireless communication device may transmit the first chirp on the channel responsive to performing the LBT operation.

Abstract: Methods, systems, and apparatuses for eye tracking in a near-eye display device are described. In one aspect, an eye tracking system has an array of Vertical Cavity Surface-Emitting Lasers (VCSELs) with different groupings of VCSELs within the array providing structured light with different polarization states such that the structured light projected onto the user's eye has (i) a spatially varying and/or temporally-varying intensity profile and/or (ii) a spatially varying and/or temporally-varying polarization profile. In another aspect, an eye tracking system includes a light source, an image sensor, and a controller which controls the image sensor to capture series of images of light reflections from the eye when the eye is stationary, determines blood flow characteristics using pattern changes in the captured series of images, and performs user authentication and/or liveness detection based on the detected blood flow characteristics.

Abstract: In particular embodiments, a computing system may receive an image comprising one or more virtual elements associated with a virtual environment and one or more real-world elements associated with a real-world environment. The system may determine a first metric and a second metric indicative of a measure of clutter in the virtual environment and the real-world environment, respectively. The system may determine gaze features associated with a user based on a user activity and predict, using a machine learning model, a reaction time of the user based on the gaze features. The system may determine a third metric indicative of the measure of clutter in the image based on predicted reaction time. The system may compute an overall clutter metric based on the first, second, and third metrics. The system may perform one or more actions to manage the clutter in the image based on the overall clutter metric.

Abstract: Various embodiments set forth computer vision systems. In some embodiments, one or more activation maps are generated based on eye gaze data and used to control operation of one or more sensors. Each activation map indicates a highest density for acquiring sensor data in a region corresponding to an eye gaze direction and lower densities for acquiring sensor data in other regions. After the sensor data is acquired, a processing pipeline sub-samples (or bins) and processes regions of the acquired sensor data at different ratios based on the eye gaze direction. The sub-sampled (or binned) data for each region is processed independently, and results of the processing are combined to generate processed data, such as an image that can be displayed to a user.