Abstract: An optical assembly includes a substrate that has a first surface and a second surface that is opposite to and substantially parallel with the first surface, a reflector, and a volume Bragg grating (VBG). The VBG is configured to transmit light incident upon the VBG at an incident angle that is within a first predetermined angular range and to reflect light that is incident upon the VBG at an incident angle that is within a second predetermined angular range distinct from the first angular range. The optical assembly is configured to transmit first light received at the first surface in an optical path that includes reflection at the reflector and at the VBG. The optical assembly is also configured to transmit second light received at the first surface such that the second light is output from the second surface without undergoing reflection at either the reflector or the VBG.

Abstract: A deformation sensing apparatus comprises an elastic substrate, a first strain-gauge element formed on a first surface of the elastic substrate, and configured to output a first signal in response to a strain applied in a first direction, and a second strain-gauge element formed on a second surface of the elastic substrate opposite to the first surface, and configured to output a second signal in response to a strain applied in the same first direction.

Abstract: An auto-focus head-mounted display (HMD) dynamically generates aberration-adjusted images based on measured accommodation of user's eye(s). An aberration-adjusted image is an image distorted to correct aberrations that would otherwise occur at a retina of the user due to image light passing through optics of the HMD. The aberration-adjusted image corrects the aberrations of the HMD and “accounts” for the aberrations of the eye so that the resulting retinal image is free of optical aberrations due to the HMD but preserves correct eye optical aberrations that are correlated with a current accommodative state of the eye.

Abstract: A variofocal display device includes an image source and a display. The image source is configured to project image light. The display includes a first optical diffuser and a second optical diffuser. The display is configured to receive the image light. The first diffuser is configured to diffuse the image light at the first optical diffuser when the image light has a first polarization, and to diffuse the image light at the second optical diffuser when the image light is configured has a second polarization different from the first polarization. A method of displaying images using a varifocal display device is also disclosed.

Abstract: A deformation sensing apparatus comprises a transmitter coupled to a propagation channel, and a receiver coupled to the same first end of the propagation channel. The propagation channel of the deformation is a transmission line, where a signal is transmitted by the transmitter and reflected signals are measured by the receiver responsive to the transmitted signals. A bend in the propagation channel results in a change in impedance of the transmission line at a location of the bend, resulting in a reflection of the signal from the location of the bend. The time delay of the reflected signals corresponds to the distance along the length of the channel where a bending of the propagation channel occurs. The amplitude of the reflected signal corresponds to a bend angle.

Abstract: A pair of handheld controllers with asymmetric tracking patterns for use with a tracking camera. The pair of controllers includes a right-hand controller and a left-hand controller. The right-hand and the left-hand controllers are substantially symmetric with respect to each other with the exception of their respective tracking patterns. A right-hand pattern of lights is disposed on the right-hand controller and a left-hand pattern of lights is disposed on the left-hand controller. The right-hand pattern of lights and the left-hand pattern of lights are asymmetric with respect to each other. The right-hand controller includes a right-hand handle portion and a surrounding right-hand ring portion and the left-hand controller includes a left-hand handle portion and a surrounding left-hand ring portion. The right-hand pattern of lights and the left-hand pattern of lights are disposed on the right-hand ring portion and the left-hand ring portion, respectively.

Abstract: To address privacy issues with “always on” cameras of an AR headset, the cameras can be muted and content displayed by the headset adjusted to provide a user with a visual indication that the cameras are deactivated. The headset includes a display element configured to display content to a user and an eye tracking system that includes a camera configured to track eye motion of the user. In response to the headset receiving a camera muting event from the user or the external environment, the headset deactivates the camera and adjusts the content displayed on the display element to provide the user with a visual indication that the camera is deactivated. In one embodiment, the visual indication is an adjustment of the display from a default RGB color mode to “monochrome” or other predefined color map.

Abstract: A video generation system is described that extracts one or more characters or other objects from a video, re-animates the character, and generates a new video in which the extracted characters. The system enables the extracted character(s) to be positioned and controlled within a new background scene different from the original background scene of the source video. In one example, the video generation system comprises a pose prediction neural network having a pose model trained with (i) a set of character pose training images extracted from an input video of the character and (ii) a simulated motion control signal generated from the input video. In operation, the pose prediction neural network generates, in response to a motion control input from a user, a sequence of images representing poses of a character. A frame generation neural network generates output video frames that render the character within a scene.

Abstract: In an embodiment, a method includes accessing a first rendered frame generated at a first frame rate. The method includes generating, based on the first rendered frame, one or more sub-frames at a second frame rate that is higher than the first frame rate. A first sub-frame of the one or more sub-frames is generated by determining a displacement measure associated with an anticipated movement of an optics component of a display system and applying, based on the displacement measure, one or more transformations to the first rendered frame to generate the first sub-frame. The first sub-frame is to be perceived by a user using the optics component of the display system. The method includes outputting the one or more sub-frames for display at the second frame rate. The one or more sub-frames are perceived by the user using the optics component of the display system.

Abstract: Systems, devices and methods that enable a user to access and interact with content displayed on a portable electronic display in an inconspicuous, hands-free manner are described. There is disclosed a completely wearable system comprising a wearable muscle interface device and a wearable head-mounted display, as well as methods for using the wearable system to effect interactions between the user and content displayed on the wearable head-mounted display. The wearable muscle interface device includes muscle activity sensors worn on an arm of the user to detect muscle activity generated when the user performs a physical gesture. The wearable system is adapted to recognize a plurality of gestures made by the user and, in response to each recognized gesture, to effect one or more interaction(s) with content displayed on the wearable head-mounted display.

Abstract: A manufacturing system for fabricating optical waveguides includes a diffusion channel with a plurality of inlets at a first end and an outlet at a second end opposite to the first end and separated from the inlets by a channel length. Each of the plurality of inlets includes a central inlet flowing a first resin into the diffusion channel such that the first resin flows along the channel length of the diffusion channel toward the outlet, and an outer inlet flowing a second resin along a periphery of the first resin. The second resin may have an index of refraction different than the first resin. The diffusion may occur between portions of the first resin and portions of the second resin over the channel length to form a composite resin having a profile with a plurality of indices of refraction in at least one dimension.

Abstract: In one embodiment, a system may capture one or more images of a user using one or more cameras, the one or more images depicting at least an eye and a face of the user. The system may determine a direction of a gaze of the user based on the eye depicted in the one or more images. The system may generate a facial mesh based on depth measurements of one or more features of the face depicted in the one or more images. The system may generate an eyeball texture for an eyeball mesh by processing the direction of the gaze and the facial mesh using a machine-learning model. The system may render an avatar of the user based on the eyeball mesh, the eyeball texture, the facial mesh, and a facial texture.

Abstract: Embodiments relate to tracking and determining a location of an object in an environment surrounding a user. A system includes one or more imaging devices and an object tracking unit. The system identifies an object in a search region, determines a tracking region that is smaller than the search region corresponding to the object, and scans the tracking region to determine a location associated with the object. The system may generate a ranking of objects, determine locations associated with the objects, and generate a model of the search region based on the locations associated with the objects.

Abstract: In one embodiment, a computing system may determine a first region and a second region of an image based on gaze data of a user. The second region may be displayed with lower image resolution than the first region. The system may access a first pixel value associated with the first region of the image. The system may cause a first source driver circuit of a display to generate a first pixel signal. The first pixel signal may be configured to control a luminance of a first number of pixels. The system may access a second pixel value associated with the second region of the image. The system may cause a second source driver circuit of the display to generate a second pixel signal which may be configured to control a luminance of a second number of pixels. The second number may be larger than the first number.

Abstract: An audio system for adaptively adjusting spatial sound signal enhancement filter lengths based on estimated direct-to-reverberant ratio (DRR) values. In response to detecting sound waves, sensors in a client device, such as a headset worn by a user, generate audio signals. The audio signals are analyzed to estimate the DRR values associated with the location. A value of a spatial signal enhancement filter length is obtained based on a model. The obtained spatial signal enhancement filter length is used to generate filters for filtering audio signals and generating audio content that are to be provided to an audio system of the headset for audio playback to the user.

Abstract: A light emitting diode (LED) device includes a semiconductor layer and one or more portions of a wafer on which the semiconductor layer was formed, the other portions of the wafer having been removed by an etching process. The semiconductor layer has a front surface that includes a light emitting area. The remnants of the wafer on which the semiconductor layer are disposed on the front surface of the semiconductor layer and define a trench. The trench is positioned such that the light emitting area emits light into the trench. The remnants of the wafer make the LED device more robust and the trench may reduce crosstalk with adjacent LED devices.

Abstract: A depth estimation system is described capable of determining depth information using two images from two cameras. A first camera captures a first image and a second camera captures a second image, both images including a plurality of light channels. In a first light channel of the plurality of light channels, the system calculates a census transform for each pixel of the first image and a census transform for each pixel of the second image. In a second light channel of the plurality of light channels, the system calculates a census transform for each pixel of the first image and a census transform for each pixel of the second image. The system generates a depth map based in part on the census transforms for each pixel of the first image and the second image in the first light channel and in the second light channel.

Abstract: An electroactive device may include a primary electrode, a secondary electrode overlapping at least a portion of the primary electrode, and a tertiary electrode overlapping at least a portion of the secondary electrode. The electroactive device may also include (i) a first electroactive polymer element including a first elastomer material disposed between and abutting the primary electrode and the secondary electrode, and (ii) a second electroactive polymer element including a second elastomer material disposed between and abutting the secondary electrode and the tertiary electrode. Various other devices, methods, and systems are also disclosed.

Abstract: The disclosed haptic vibrotactile actuator may include a textile comprising a first major surface and a second, opposite major surface, an electrode coupled to the first major surface of the textile across at least a majority of a surface area of a first surface of the electrode, and a flexible electroactive material electrically coupled to a second, opposite surface of the electrode. Various other related methods and systems are also disclosed.

Abstract: A varifocal block includes, in optical series, a switchable half waveplate (SHWP) and a plurality of liquid crystal (LC) lenses. The SHWP outputs circularly polarized light, and a handedness of the circularly polarized light is controlled by the SHWP being in an active state or a non-active state. Each LC lens of the plurality of LC lenses has a plurality of optical states, the plurality of optical states including an additive state that adds optical power to the LC lens and a subtractive state that removes optical power from the LC lens. The plurality of optical states of each of the plurality of the LC lenses compounded in optical series provides a range of adjustment of optical power for the varifocal block.