Abstract: Disclosed herein includes a system, a method, and a non-transitory computer readable medium for generating and rendering computer generated images of simulated garments with wrinkles based on a physics based cloth simulator and a machine learning model. In one aspect, by a physics based cloth simulator executing on one or more processors, a first normal map of a simulated garment having a first level of detail of wrinkles and a second normal map of the simulated garment having a second level of detail of wrinkles higher than the first level of detail of wrinkles are generated. In one aspect, by the one or more processors, the first normal map and the second normal map are provided as inputs to train a machine learning model. In one aspect, by the one or more processors via training, the machine learning model is configured to generate an output normal map with a level of detail of wrinkles higher than that of an input normal map.

Abstract: Embodiments of the present disclosure generally relate to light emitting diodes LEDs and methods of manufacturing the LEDs. The LEDs include a mesa-structure that improves light extraction of the LEDs. Furthermore, the process for forming the LEDs refrains from using physical etching to a quantum well active region of the LEDs to prevent compromising performance at the quantum well sidewall.

Abstract: Systems and methods for virtual interest segmentation may include (1) performing a semantic segmentation of an image of a user's environment, captured by an artificial reality (AR) device being worn by the user, to identify objects within the user's environment, (2) in addition to performing the semantic segmentation, performing an interest segmentation of the image to determine a personal interest that the user may have in a particular object identified via the semantic segmentation, (3) creating virtual content relating to the particular object based on the user's personal interest in the particular object, and (4) displaying the virtual content within a display element of the AR device. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: An adaptive liquid lens includes a membrane, a patterned film in contact with the membrane, a substrate, and a layer of optical fluid encapsulated within the membrane and the substrate. A display device includes the adaptive liquid lens and an electronic display optically coupled with the adaptive liquid lens for outputting light through the adaptive liquid lens toward a pupil of an eye of a user of the display device. Also disclosed is a method including modifying a surface profile of a membrane of an adaptive liquid lens. Modifying the surface profile of the membrane of the adaptive liquid lens changes a focal distance of the adaptive liquid lens.

Abstract: The disclosed computer-implemented method may include (i) associating a planar element within a virtual environment with an alternate virtual environment and (ii) rendering the virtual environment such that (A) the alternate virtual environment is framed within the planar element, (B) at least one rendered element of the alternate virtual environment renders at a distal depth beyond a proximal depth of the planar element within the virtual environment, and (C) altering a viewpoint within the virtual environment relative to a position of the planar element within the virtual environment produces a parallax effect between the virtual environment and the rendered element of the alternate virtual environment due at least in part to the rendered element of the alternate virtual environment being rendered at the distal depth beyond the proximal depth of the planar element within the virtual environment. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed fluidic power transmission apparatus may include a conduit having an internal volume for containing a fluid, a reciprocating input mechanism for alternating at least one of fluid flow or fluid pressure within the conduit, the reciprocating input mechanism being in fluid communication with the internal volume of the conduit, and a slave unit coupled to the conduit such that the slave unit is positioned to be driven by the alternating fluid flow or fluid pressure within the internal volume of the conduit. Various other methods and systems are also disclosed.

Abstract: Computerized systems, methods, and computer-readable storage media storing code for implementing the methods are described for providing dynamically-updated musculoskeletal information. One such system includes a processor is programmed to: provide, as an input to a trained inference model, information based on a plurality of neuromuscular signals from a user and information based on at least one image of the user; determine, based on an output of the trained inference model, position information describing a spatial relationship between two or more connected musculoskeletal segments of the user and/or force information describing a force exerted by at least one musculoskeletal segment of the user; and output the position information and/or the force information.

Abstract: Embodiments described herein pertain to a machine-learning approach for shading. A system may determine, for each of a plurality of pixels, object visibility information based on one or more objects in a virtual environment. The system may select, for each pixel, a light source from a plurality of light sources in the virtual environment. The system may determine, for each pixel, lighting information associated with the light source selected for that pixel based on the associated object visibility information. The system may generate a first latent representation of the lighting information associated with the plurality of pixels. The system may generate a second latent representation by processing the first latent representation using a first machine-learning model trained to denoise latent light representations. The system may then generate color values for the plurality of pixels by processing at least the second latent representation using a second machine-learning model.

Abstract: A headset includes a compact wide field of view optics block. The headset includes a display element and an optics block. The display element is configured to generate image light. The optics block is configured to direct the image light to an eyebox. The optics block includes a projection lens and a panoramic lens. The projection lens has a first diameter and is adjacent to the display element and is configured to receive the image light from the display element. The panoramic lens is positioned between the projection lens and the eyebox. The panoramic lens has a second diameter that is larger than the first diameter and is configured to provide the image light that has been transmitted by the projection lens to the eyebox.

Abstract: Embodiments relate to testing LEDs by applying a voltage difference between anode electrodes and cathode electrodes of the LEDs using transistors and probe pads and determining whether the LEDs satisfy a threshold level of operability. A final substrate has transistors that apply the voltage difference to the LEDs via conductive traces and probe pads during testing mode. A gate voltage is applied to gate terminals of the transistors, a first voltage is applied to anode electrodes of the LEDs, and a second voltage is applied to cathode electrodes of the LEDs. After applying the voltages, turning on of the LEDs is observed. Embodiments also relate to testing current leakage in the final substrate with the transistors and the LEDs.

Abstract: The disclosed systems for positioning head-mounted displays may include a first track along which a display apparatus of a head-mounted display is configured to move in a first direction and a second track along which the display apparatus is configured to move in a second, different direction. A first electromechanical actuator may move the display apparatus along the first track, and a second electromechanical actuator may move the display apparatus along the second track. Various other methods and systems are also disclosed.

Abstract: Systems, articles, and methods for surface electromyography (“EMG”) sensors that combine elements from traditional capacitive and resistive EMG sensors are described. For example, capacitive EMG sensors that are adapted to resistively couple to a user's skin are described. Resistive coupling between a sensor electrode and the user's skin is galvanically isolated from the sensor circuitry by a discrete component capacitor included downstream from the sensor electrode. The combination of a resistively coupled electrode and a discrete component capacitor provides the respective benefits of traditional resistive and capacitive (respectively) EMG sensor designs while mitigating respective drawbacks of each approach. A wearable EMG device that provides a component of a human-electronics interface and incorporates such capacitive EMG sensors is also described.

Abstract: An electronic display includes a multi-layer structure that reduces form factor and provides optimization of the electronic display on a per layer basis. The electronic display includes a driver layer, a control layer, and an interposer layer between the driver layer and the control layer. The driver layer includes one or more drivers to provide control signals. The control layer includes control circuits configured to drive light emitting diodes (LEDs) under control of the control signals from the driver layer. The interposer layer is between the driver layer and the control layer. The interposer layer includes electrical connections between the one or more drivers of the driver layer and the control circuits of the control layer to transmit the control signals from the driver layer to the control layer.

Abstract: In one embodiment, a system includes at least one projector comprising a plurality of light emitters, where the projector is configured to project a projected pattern comprising a plurality of projected features having different locations; a camera configured to capture an image comprising a detected pattern corresponding to a reflection of the projected pattern; and one or more processors configured to: identify at least one detected feature of the detected pattern, wherein the detected feature corresponds to at least one reflection of the projected features; and activate or deactivate one or more of the light emitters based on the detected feature. The light emitters may be activated or deactivated by determining a detected feature measurement based on the detected feature, and activating or deactivating one or more of the light emitters when the detected feature measurement satisfies a threshold feature measurement condition.

Abstract: A camera assembly for depth sensing of a local area. The camera assembly includes a projector, a sensor and a controller. The projector emits, into the local area, a structured light (SL) pattern at multiple phases. The sensor images the local area using multiple augmented pixels. Each augmented pixel has multiple gates and at least some of the gates have a respective local storage location. Each capture phase of the augmented pixel is divided into a respective plurality of time bins associated with a respective subset of the gates. Each local storage location of the subset of gates stores image data during a respective time bin, the image data based on portions of the SL pattern emitted at a respective phase and reflected from the local area. The controller determines depth information for the local area based on the image data stored during at least one capture phase.

Abstract: A head-mounted display (HMD) includes an electronic display configured to emit an image. The HMD also includes an eye tracking module configured to determine a position of an eye of a user of the HMD, and a varifocal block. The varifocal block includes a stacked liquid crystal (LC) structure that has a tunable optical power. The varifocal block is configured to present the image to the user of the HMD at an adjustable focal distance that is determined by the tunable optical power and is based in part on the determined position of the eye.

Abstract: A head-mounted display (HMD) presented herein comprises an electronic display and an optical assembly. The electronic display is configured to emit image light. The optical assembly is configured to direct the image light to an eye-box of the HMD corresponding to a location of a user's eye. The optical assembly includes a multifocal optical element, e.g., a bifocal optical element. A first portion of the multifocal optical element has a first optical power that is associated with a first image plane. The second portion of the multifocal optical element has a second optical power different than the first optical power, the second portion associated with a second image plane.

Abstract: A depth camera assembly (DCA) includes a polarized structured light generator, an imaging device and a controller. The structured light generator illuminates a local area with one or more polarized structured light patterns in accordance with emission instructions from the controller. The structured light generator comprises an illumination source, an acousto-optic device, and a polarizing element. The acousto-optic device generates a structured light pattern from an optical beam emitted from the illumination source. The polarizing element generates the one or more polarized structured light patterns using the structured light pattern. The imaging device captures portions of the one or more polarized structured light patterns scattered or reflected from the local area. The controller determines depth information, degree of polarization and index of refraction map for the local area based at least in part on the captured portions of the one or more scattered or reflected polarized structured light patterns.

Abstract: The disclosed computer-implemented method may include comprising identifying, within a real-world environment, a position of a user relative to a safety boundary. The position of the user is identified by a head-mounted display system comprising a display device. The display device is configured to at least partially obscure visibility of the real-world environment to the user. The method may further include selecting, based on the position of the user, at least a portion of a model of the real-world environment, rendering the portion of the model of the real-world environment, and displaying the rendered portion of the model of the real-world environment via the display device as a notification of the position of the user relative to the safety boundary. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Disclosed herein includes a system, a method, and a device for performing a convolution on data of a current layer of a neural network, including a plurality of channels arranged in a first order and partitioned into a plurality of first partitions according to the first order. Each first partition includes a result of a convolution on a corresponding partition of channels in data of a previous layer of the neural network. The device shifts the plurality of channels arranged in the first order to a second order, partition the shifted plurality of channels into a plurality of second partitions, according to the second order. For each of the plurality of second partitions, the device performs a convolution on channels of the shifted plurality of channels that are in the corresponding second partition.