Abstract: Systems and methods for using neuromuscular information to improve speech recognition. The system includes a plurality of neuromuscular sensors arranged on one or more wearable devices and configured to continuously record a plurality of neuromuscular signals from a user, at least one storage device configured to store one or more trained statistical models for determining text based on audio input and the plurality of neuromuscular signals, at least one input interface configured to receive the audio input, and at least one computer processor programmed to obtain the audio input and the plurality of neuromuscular signals, provide as input to the one or more trained statistical models, the audio input and the plurality of neuromuscular signals or signals derived from the plurality of neuromuscular signals, and determine based, at least in part, on an output of the one or more trained statistical models, the text.

Abstract: An avatar personalization engine can generate personalized avatars for a user by creating a 3D user model based on one or more images of the user. The avatar personalization engine can compute a delta between the 3D user model and an average person model, which is a model created based on the average measurements from multiple people. The avatar personalization engine can then apply the delta to a generic avatar model by changing measurements of particular features of the generic avatar model by amounts specified for corresponding features identified in the delta. This personalizes the generic avatar model to resemble the user. Additional features matching characteristics of the user can be added to further personalize the avatar model, such as a hairstyle, eyebrow geometry, facial hair, glasses, etc.

Abstract: A near-eye-display (NED) includes a tracking system and a waveguide assembly. The waveguide assembly includes an infrared (IR) light source and an output waveguide. The output waveguide includes at least a decoupling element that outcouples the IR light emitted by the IR light source to form the structured light pattern. The structured light pattern is projected toward one or more regions of a user's face, for example, the user's eyes. The structured light pattern is reflected off the one or more regions of the user's face and captured by the tracking system. The tracking system can determine tracking information such as eye tracking information as well as face tracking information based on the captured reflected structured light pattern.

Abstract: A depth camera assembly is used to obtain depth information describing a local area. The depth camera assembly includes a sensor having a plurality of pixels. Some or all of the pixels are divided into groups that are coupled to respective multi-purpose time-to-digital converters. Each multi-purpose time-to-digital converter comprises an oscillator and a counter. Each pixel in a group is associated with a multiplexer that is configured to select between inputs coupled to the pixel, the oscillator, or a counter associated with a different pixel. The multiplexer outputs the signal to the counter for the time-to-digital converter associated with the pixel. A time-of-flight measurement is taken during a first portion of an image frame. During a second portion of the image frame, the sensor may be used as an intensity counter. During a third portion of the image frame, the depth sensor may be calibrated.

Abstract: A head mounted display (HMD) includes an electronic display and a light director assembly. The electronic display includes a region of subpixels that are configured to emit light. The light director assembly is coupled to receive the light and to direct the light to an optical assembly of the HMD. The light director assembly includes a plurality of light directors configured to reduce an angular distribution of the light emitted from corresponding subpixels included in the region of subpixels.

Abstract: The disclosure describes artificial reality systems and techniques for providing artificial reality content to a user. For example, an artificial reality system includes a head-mounted display (HMD) configured to output artificial reality content, the HMD including a set of second image capture devices configured to capture image data indicative of a focal point of a gaze of the user and a varifocal display having a focal length that is modifiable based on the focal point of the user. Additionally, the system includes a depth engine configured to generate, based on the real-world image data and depth data associated with the real-world image data, a three-dimensional (3D) scene of the physical environment of the user and generate artificial reality content as an overlay to the 3D scene of the physical environment for display on the varifocal display of the HMD based on the focal point of the user.

Abstract: The disclosed computer-implemented method may include providing test signals from a panel test board included in a fixture to a device under test included in a carrier including providing interface signals from the panel test board to a connector included on a fixture interposer block included in the fixture, interfacing the connector on the fixture interposer block with one or more pogo pins included on a panel interposer board included in the carrier, the interfacing providing the interface signals as inputs to a re-timer circuit included on the panel interposer board, generating, by the re-timer circuit, output interface signals whose signal strength is greater than a signal strength of the interface signals input to the re-timer circuit, and providing the interface signals output from the re-timer circuit to the device under test. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A system for content upsampling comprises a console and a head-mounted display (HMD). The console can select content for presentation and provide the content at a first frame rate. The HMD outputs fast calibration data comprising one or more intermediate estimated positions of a reference point on the HMD. The HMD estimates future positions of the HMD using the fast calibration data, and generates synthetic frames using frames from the content and the future positions of the HMD. The HMD then upsamples the content from the first frame rate to a second frame using the synthetic frames to generate augmented content, wherein the second frame rate is faster than the first frame rate. The HMD presents the augmented content at the second frame rate via an electronic display.

Abstract: A method for providing augmented reality contents to a wearer using a head-mounted display device that includes an eye tracking sensor, a light projector, a beam steerer, and a combiner includes determining, with the eye tracking sensor, a position of a pupil of an eye of the wearer. The method also includes projecting, with the light projector, light for rendering images based at least on the augmented reality contents, and changing, with the beam steerer, a direction of the light from the light projector based on the position of the pupil. The light from the beam steerer is directed toward the combiner and the light from the beam steerer and light from an outside of the head-mounted display device are combined, by the combiner, to provide an overlap of a rendered image and a real image that corresponds to the light from the outside of the head-mounted display device.

Abstract: An apparatus comprises a first photodiode, a second photodiode, a charge sensing unit, a quantizer, a memory, and a controller configured to: set a first exposure period in which the first photodiode generates a first charge; set a second exposure period in which the second photodiode generates a second charge, the second exposure period being set based on the first exposure period and at least one of: a first time associated with a read out operation of the memory to a second apparatus, or a second time associated with a quantization operation by the quantizer; perform, using the quantizer, the first quantization operation of the first charge to generate a first digital output; store the first digital output in the memory; perform, using the quantizer, a second quantization operation of the second charge to generate a second digital output; and store the second digital output in the memory.

Abstract: Determination of an acoustic filter for incorporating local effects of room modes within a target area is presented herein. A model of the target area is determined based in part on a three-dimensional virtual representation of the target area. In some embodiments, the model is selected from a group of candidate models. Room modes of the target area are determined based on a shape and/or dimensions of the model. The room mode parameters are determined based on at least one of the room modes and the position of a user within the target area. The room mode parameters describe an acoustic filter that as applied to audio content, simulates acoustic distortion at the position of the user and at frequencies associated with the at least one room mode. The acoustic filter is generated at a headset based on the room mode parameter and is used to present audio content.

Abstract: In one embodiment, a method includes accessing a digital map of a real-world region, where the digital map includes one or more three-dimensional meshes corresponding to one or more three-dimensional objects within the real-world region, receiving an object query including an identifier for an anchor in the digital map, positional information relative to the anchor, and information associated with a directional vector, determining a position within the digital map based on the identifier for the anchor and the positional information relative to the anchor, determining a three-dimensional mesh in the digital map that intersects with a projection of the directional vector from the determined position within the digital map, identifying metadata associated with the three-dimensional mesh, and sending the metadata to the second computing device.

Abstract: In one embodiment, a computing system may determine degradation levels for an array of light emitting elements of a display. The system may determine, based on the degradation levels, a scaling factor for each light emitting element of the array of light emitting elements. The system may access pixel values of an image to be output by the array of light emitting elements of the display. The system may adjust a luminance of each of the pixel values according to the scaling factor associated with the light emitting element configured to output that pixel value. The system may output the adjusted pixel values of the image using the array of light emitting elements.

Abstract: In one embodiment, a computing system may access a first image that is generated at a first frame rate. The system may determine whether a change of a user viewpoint with respect to one or more display contents satisfies a threshold criterion. The system may select an operation mode from a first operation mode and a second operation mode based on the determination whether the change of the user viewpoint satisfies the threshold criterion. The system may generate a number of second images at a second frame rate higher than the first frame rate. When the selected operation mode is the first operation mode, the second images may be generated using a resampling process. When the selected operation mode is the second operation mode, the second images may be generated by transforming one or more previously generated second images that are generated based on the first image.

Abstract: A media device may include (i) a display device having a front side including a display surface, (ii) a support housing for supporting the display device in each of a plurality of alternative orientations on an external surface, the support housing extending from a back side of the display device between a mounting surface of the support housing abutting the back side of the display device and a distal end of the support housing, (iii) a coupling member disposed at the mounting surface of the support housing and mounted to the display device, and (iv) a battery power supply disposed within the support housing and electrically coupled to the display device via an electrical path extending through the coupling member. Various other systems, devices, assemblies, and methods are also disclosed.

Abstract: A computing system may compute estimated depth measurements of at least one physical object in a physical environment surrounding a user. The system may generate, based on the estimated depth measurements, a first model of the at least one physical object. The system may render, based on the first model and a second model of a virtual object, an image depicting the physical object and the virtual object from a perspective of the user. At least one pixel of the image has a blended color corresponding to a portion of the physical object and a portion of the virtual object. The blended color is computed in response to a determination that a relative depth between a portion of the first model corresponding to the portion of the physical object and a portion of the second model corresponding to the portion of the virtual object is within a threshold.

Abstract: The disclosed optical lens assemblies may include a deformable optical element including a substantially transparent transducer configured to deform, and thus change at least one optical property of, the deformable optical element. At least a portion of the substantially transparent transducer may be positioned within a substantially transparent optical aperture of the optical lens assembly. Various head-mounted displays incorporating such an optical lens assembly, and methods of fabricating the same, are also disclosed.

Abstract: An audio system for a headset includes a plurality of speakers and an audio controller. The plurality of speakers may be in a dipole configuration that cancel sound leakage into a local area of the headset. The controller filters audio content presented by the plurality of speakers to further mitigate leakage of audio content into the local area. The audio determines sound filters based on environmental conditions, such as ambient noise levels, as well as based on the audio content being presented.

Abstract: A method for providing images to a wearer using a head-mounted display device that includes a light projector and a beam shifter includes projecting, with the light projector, light for rendering images based at least on virtual reality contents and/or augmented reality contents. The method also includes changing, with a beam shifter, a path of the light projected from the light projector based on a position of a pupil of an eye of the wearer.

Abstract: An optical assembly is configured to receive visible scene light at a backside of the optical assembly and to direct the visible scene light on an optical path toward the eyeward side. The optical assembly also includes a dimming layer disposed on the optical path, where the dimming layer includes a photochromic material that is configured to darken in response to exposure to a range of light wavelengths. An activation layer, included in the optical assembly, is also disposed on the optical path and includes an in-field dimmer. The in-field dimmer is configured to selectively emit an activation light within the range of light wavelengths to activate a darkening of a region of the dimming layer to dim the visible scene light within the region.