Abstract: In particular embodiments, a computing system may receive an image comprising one or more virtual elements associated with a virtual environment and one or more real-world elements associated with a real-world environment. The system may determine a first metric and a second metric indicative of a measure of clutter in the virtual environment and the real-world environment, respectively. The system may determine gaze features associated with a user based on a user activity and predict, using a machine learning model, a reaction time of the user based on the gaze features. The system may determine a third metric indicative of the measure of clutter in the image based on predicted reaction time. The system may compute an overall clutter metric based on the first, second, and third metrics. The system may perform one or more actions to manage the clutter in the image based on the overall clutter metric.

Abstract: Various embodiments set forth computer vision systems. In some embodiments, one or more activation maps are generated based on eye gaze data and used to control operation of one or more sensors. Each activation map indicates a highest density for acquiring sensor data in a region corresponding to an eye gaze direction and lower densities for acquiring sensor data in other regions. After the sensor data is acquired, a processing pipeline sub-samples (or bins) and processes regions of the acquired sensor data at different ratios based on the eye gaze direction. The sub-sampled (or binned) data for each region is processed independently, and results of the processing are combined to generate processed data, such as an image that can be displayed to a user.

Abstract: A device includes a micro-organic light emitting diode (?-OLED) display panel and an electronic component. An electrical connector electrically couples the ?-OLED display panel and the electronic component. A standoff is disposed between the electronic component and the ?-OLED display panel. The standoff physically couples the electronic component and the ?-OLED display panel with a gap therebetween. The gap thermally decouples the electronic component from the ?-OLED display panel. A U-shaped heat sink can be disposed in the standoff, and heat generated by the ?-OLED display can be mitigated by a system fan when a U-shaped heat sink is disposed in the standoff.

Abstract: A light emitting diode includes an n-type semiconductor layer including a pit structure formed therein, active layers grown only on sidewalls of the pit structure and configured to emit light, and a p-type semiconductor layer on the active layers and at least partially in the pit structure. In one embodiment, the pit structure is characterized by a shape of an inverted pyramid. The pit structure is formed in the n-type semiconductor layer by, for example, etching the n-type semiconductor layer using an etch mask layer having apertures with slanted sidewalls, or growing the n-type semiconductor layer on a substrate through a mask layer having an array of apertures.

Abstract: According to examples, a phase plate may include a transparent substrate and a photopolymer layer attached to the transparent substrate. The photopolymer layer may adjust a backlight via a phase adjustment and focusing. The phase plate may focus a plurality of red, green, and blue components of the backlight onto respective red, green, and blue subpixels of a thin-film-transistor (TFT) layer deposited thereon. A distance between the photopolymer layer of the phase plate and the plurality of red, green, and blue subpixels of the thin-film-transistor (TFT) layer may be in a range from about 200 ?m to about 500 ?m. In some examples, the phase plate may be part of a liquid crystal display (LCD) apparatus along with a red, green, blue (RGB) laser to provide backlight; a grating light guide to transmit the backlight; and a liquid crystal display (LCD) layer on the thin-film-transistor (TFT) layer.

Abstract: A beam scanner and a display device is based on a photonic integrated circuit coupling light to a pair of opposed reflectors. One reflector is tiltable and has an opening through which the light is coupled, and the other reflector is configured to focus light, e.g. a concave reflector. A polarization folding configuration is used to cause the focused light propagate through the opening in the first reflector, get collimated by the second reflector, get scanned by the first reflector, and propagate through the second reflector to a pupil-replicating lightguide which provides multiple laterally offset parallel portions of the scanned beam.

Abstract: Systems, apparatuses and methods identify first data associated with a first user and determines whether a second user is colocated with the first user based on the first data. The systems, apparatuses and methods receive first audio data associated with the first user, and second audio data associated with the second user, and responsive to a determination that the second user is colocated with the first user, one or more of determine that a first audio feed to the first user will exclude the second audio data, or determine that a second audio feed to the second user will exclude the first audio data, and generate one or more of the first audio feed or the second audio feed.

Abstract: Systems and methods for wireless sidelink communications may include a first wireless communication device which establishes a sidelink (SL) session with a second wireless communication device. The first wireless communication device may reserve a block of SL slots for transmission of traffic between the first wireless communication device and the second wireless communication device. The first wireless communication device may transmit, to the second wireless communication device, the traffic of the SL session in the block of SL slots.

Abstract: A system for dynamic profilometric imaging using multiscale pattern(s) is described. The system may include a projector that projects a multiscale pattern on an environment including a target of interest. The system may also include an imaging sensor that receives reflections of the projected multiscale pattern from the target of interest. The system may further include a controller of the camera and the projector which performs profilometric imaging of the target of interest by dynamically adjusting an operational parameter of the camera, the projector, and/or the controller. The multiscale pattern(s) may contain useful features at multiple scales and/or may be optimal at predetermined depths and/or resolutions. By dynamically adjusting the operational parameter, such a profilometric imaging system may perform there-dimensional (3D) scene reconstruction while maintaining optimal performance, power efficiency and profilometric resolution.

Abstract: According to examples, an energy harvesting component for an optical device having an illumination source emitting unused light is described. The apparatus may include a light source to generate and transmit display light comprising at least one beam of light and an illumination source component to receive the at least one beam of light and to diffract the at least one beam of light in a first direction and an opposing direction. The apparatus may further include and an energy harvesting component to receive and absorb the at least one beam of light diffracted in an opposing direction and to convert the at least one beam of light diffracted in an opposing direction into electrical energy.

Abstract: A device is provided. The device includes a light guide configured to guide a first light propagating therein. The device also includes an optical film coupled with the light guide, optically anisotropic molecules in the optical film being configured with an in-plane orientation pattern having an in-plane pitch along the predetermined in-plane direction. Within the in-plane pitch of the in-plane orientation pattern, azimuthal angles of the optically anisotropic molecules are configured to vary nonlinearly along the predetermined in-plane direction. The optical film is configured to diffract the first light as a plurality of second lights at a plurality of locations of the optical film, with a plurality of predetermined, different diffraction efficiencies.

Abstract: An apparatus for a pancake lens with integration accommodation may include a beamsplitter, a first lens, a reflective polarizer, and a second lens, where the second lens includes at least one planar module embedded within the second lens. Other apparatuses, systems, and methods are also disclosed.

Abstract: Devices and camera modules are configured for imaging facial gestures. The imaging may be directed at lower face imaging. The camera modules may be disposed along outside surfaces of devices such as head mounted devices to have a field of view that images a lower face region.

Abstract: Disclosed herein are related to a first device to communicate with an access point and a second device. In one aspect, the first device communicates with the access point during the first time interval through a first wireless communication. In one aspect, the first device prevents communication with the access point during the second time interval. In one aspect, the first device communicates, as a soft access point, with a second device during the third time interval within the second time interval through a second wireless communication, the third time interval shorter than the second time interval.

Abstract: An augmented reality headset is provided that includes a first microphone mounted on a headset and configured to receive a first audio signal from a speaker, and a second microphone remotely located from the headset and configured to receive a second audio signal from the speaker. The augmented reality headset also includes a memory storing multiple instructions, and one or more processors configured to execute the instructions. When the one or more processors execute the instructions, they cause the augmented reality headset to: synchronize the first audio signal and the second audio signal, form an enhanced audio signal with the first audio signal and the second audio signal, and provide the enhanced audio signal to a user of the augmented reality headset.

Abstract: A system for three-dimensional object sensing using fringe-projection profilometry with Fourier transform analysis is described. A fringe-projection profilometry (FPP) projector simultaneously transmits a frequency signal pattern (i.e., modulated or AC signal) and a zero-frequency signal pattern (i.e., unmodulated or DC signal) onto an object's surface. Alternatively, the projector projects two frequency signal patterns phase-shifted by 180 degrees. A dual readout sensor captures reflections of both signals from the object's surface as adjacent frames, and the DC signal is extracted by subtraction of addition to obtain an enhanced signal. The enhanced signal is used to generate a wrapped phase map through Fourier transform profilometry (FTP). The resulting wrapped phase map is unwrapped, and three-dimensional reconstruction of the object's surface is generated by converting phase from the unwrapped phase map to three-dimensional coordinates.

Abstract: A system for harvesting electrostatic discharge (ESD) energy in wearable devices is described. The system may include a mechanical or piezoelectric based vibration component to generate static electricity (e.g., triboelectricity) from the interaction between dissimilar materials such as by rubbing skin, hair, or fabric against a wearable device material. The generated static electricity may be captured by an electrostatic discharge (ESD) harvester and converted to power that may be used to recharge an on-board battery, at least partially. The static electricity may be alternatively generated by the user interacting with other objects or materials and harvested by the electrostatic discharge (ESD) harvester.

Abstract: Aspects of the present disclosure are directed to triggering virtual keyboard selections using multiple input modalities. An interface manager can display an interface, such as a virtual keyboard, to a user in an artificial reality environment. Implementations of the interface manager can track user eye gaze input and user hand input (e.g., hand or finger motion). The interface manager can resolve a character selection on the virtual keyboard according to the tracked user gaze input based on detection that the user's hand motion meets a trigger criteria. For example, the interface manager can: detect that the tracked user hand motion meets the trigger criteria at a given point in time; and resolve a selection from the virtual keyboard (e.g., selection of a displayed character) according to the tracked user gaze on the virtual keyboard at the given point in time.

Abstract: A swappable battery and a swappable battery system for a near-eye device are described. In one aspect, the swappable battery may be detachably integrated into an outer surface of a near-eye device such that the swappable battery may be easily removable and replaceable by the user. In another aspect, the lid of the swappable battery may form an outer surface of the near-eye device when the swappable battery is attached. In some examples, the swappable battery may be detachably attached within a temple arm of a pair of smartglasses such that the outer surface of the swappable battery and the outer surface of the temple arm are substantially contiguous and flush.

Abstract: Static non-uniformity effects in a coherent biresonant scanning projector are mitigated through correction factors for pulse events during one frame time. According to an analytical approach, a set of input parameters such as scan angle, micro-electromechanical system (MEMS) obliquity, ridge spacing, etc. are used to optimize color-wise luminance uniformity. According to an optimization approach, pulse correction factors are determined using a custom-defined cost function that attempts to optimize for both luminance and color uniformity.