Abstract: A near-eye-display (NED) includes a tracking system and a waveguide assembly. The waveguide assembly includes an infrared (IR) light source and an output waveguide. The output waveguide includes at least a decoupling element that outcouples the IR light emitted by the IR light source to form the structured light pattern. The structured light pattern is projected toward one or more regions of a user's face, for example, the user's eyes. The structured light pattern is reflected off the one or more regions of the user's face and captured by the tracking system. The tracking system can determine tracking information such as eye tracking information as well as face tracking information based on the captured reflected structured light pattern.

Abstract: A display system comprises a light source assembly, a display assembly, a camera assembly, and a controller. The light source assembly is configured to generate visible light and infrared light. The display assembly is configured to generate image light using the visible light and to generate tracking light using the infrared light. The tracking light and the image light pass through a beam splitter prior to being projected into a local area. The camera assembly is configured to capture one or more images of the local area illuminated with the tracking light. The images are illuminated with the tracking light that passes through the beam splitter prior to be being captured by the camera assembly. The controller is configured to calculate depth information for objects in the local area using the one or more images.

Abstract: A display system comprises a light source assembly, a display assembly, a camera assembly, and a controller. The light source assembly is configured to generate visible light and infrared light. The display assembly is configured to generate image light using the visible light and to generate tracking light using the infrared light. The tracking light and the image light pass through a beam splitter prior to being projected into a local area. The camera assembly is configured to capture one or more images of the local area illuminated with the tracking light. The images are illuminated with the tracking light that passes through the beam splitter prior to be being captured by the camera assembly. The controller is configured to calculate depth information for objects in the local area using the one or more images.

Abstract: A near-eye-display (NED) includes a tracking system and a waveguide assembly. The waveguide assembly includes an infrared (IR) light source and an output waveguide. The output waveguide includes at least a decoupling element that outcouples the IR light emitted by the IR light source to form the structured light pattern. The structured light pattern is projected toward one or more regions of a user's face, for example, the user's eyes. The structured light pattern is reflected off the one or more regions of the user's face and captured by the tracking system. The tracking system can determine tracking information such as eye tracking information as well as face tracking information based on the captured reflected structured light pattern.

Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes multiple image capture devices positioned within the HMD to capture portions of a face of a user wearing the HMD. Images from an image capture device include a user's eye, while additional images from another image capture device include the user's other eye. The images and the additional images are provided to a controller, which applies a trained model to the images and the additional images to generate a vector identifying a position of the user's head and positions of the user's eye and fixation of each of the user's eyes. Additionally, illumination sources illuminating portions of the user's face include in the images and in the additional images are configured when the user wears the HMD to prevent over-saturation or under-saturation of the images and the additional images.

Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes multiple image capture devices positioned within the HMD to capture portions of a face of a user wearing the HMD. Images from an image capture device include a user's eye, while additional images from another image capture device include the user's other eye. The images and the additional images are provided to a controller, which applies a trained model to the images and the additional images to generate a vector identifying a position of the user's head and positions of the user's eye and fixation of each of the user's eyes. Additionally, illumination sources illuminating portions of the user's face include in the images and in the additional images are configured when the user wears the HMD to prevent over-saturation or under-saturation of the images and the additional images.

Abstract: An interactive system may include (1) a facial coupling subsystem configured to conduct a biopotential signal generated by a user's body, (2) a receiving subsystem electrically connected to the facial coupling subsystem and configured to receive, from the user's body via a compliant electrode of the facial coupling subsystem, the biopotential signal, and (3) a detection subsystem electrically connected to the receiving subsystem and configured to (a) determine a characteristic of the biopotential signal and (b) use the characteristic of the biopotential signal to determine a gaze direction of an eye of the user and/or a facial gesture of the user. In some examples, the facial coupling subsystem may include a plurality of compliant electrodes that each are configured to comply in a direction normal to a surface of the user's face. Various other apparatus, systems, and methods are also disclosed.

Abstract: A method for facilitating user interaction with an electronic device may include (1) applying, via at least one primary electrode of a human-body coupling subsystem, a body-bound signal to a user's body, (2) receiving, through the user's body via at least one secondary electrode of the human-body coupling subsystem, the body-bound signal, (3) determining at least one characteristic of the received body-bound signal, and (4) identifying a bodily gesture made by the user based on the at least one characteristic of the received body-bound signal. Various other apparatus, systems, and methods are also disclosed.

Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes various image capture devices that capture images of portions of the user's face and body. Through image analysis, points of each portion of the user's face and body are identified from the images and their movement is tracked. The identified points are mapped to a three dimensional model of a face and to a three dimensional model of a body. From the identified points, animation parameters describing positioning of various points of the user's face and body are determined for each captured image. From the animation parameters and transforms mapping the captured images to three dimensions, the three dimensional model of the face and the three dimensional model of the body is altered to render movement of the user's face and body.

Abstract: An interactive system (e.g., a head-mounted-display device) may include (1) a facial coupling subsystem having electrodes configured to conduct at least one biopotential signal (e.g., an EOG or EMG signal) generated by a user's body, (2) a receiving subsystem electrically connected to the facial coupling subsystem and configured to receive, from the user's body via at least one electrode of the facial coupling subsystem, the biopotential signal, and (3) a detection subsystem electrically connected to the receiving subsystem and configured to (a) determine at least one characteristic of the biopotential signal and (b) use the at least one characteristic of the biopotential signal to determine a gaze direction of an eye of the user and/or a facial gesture of the user. Various other apparatus, systems, and methods are also disclosed.

Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes various image capture devices that capture images of portions of the user's face. Through image analysis, points of each portion of the user's face are identified from the images and their movement is tracked. The identified points are mapped to a three dimensional model of a face. From the identified points, a blendshape vector is determined for each captured image, resulting in various vectors indicating the user's facial expressions. A direct expression model that directly maps images to blendshape coefficients for a set of facial expressions based on captured information from a set of users may augment the blendshape vector in various embodiments. From the blendshape vectors and transforms mapping the captured images to three dimensions, the three dimensional model of the face is altered to render the user's facial expressions.

Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes multiple image capture devices positioned within the HMD to capture portions of a face of a user wearing the HMD. Images from an image capture device include a user's eye, while additional images from another image capture device include the user's other eye. The images and the additional images are provided to a controller, which applies a trained model to the images and the additional images to generate a vector identifying a position of the user's head and positions of the user's eye and fixation of each of the user's eyes. Additionally, illumination sources illuminating portions of the user's face include in the images and in the additional images are configured when the user wears the HMD to prevent over-saturation or under-saturation of the images and the additional images.

Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes multiple image capture devices positioned within the HMD to capture portions of a face of a user wearing the HMD. Images from an image capture device include a user's eye, while additional images from another image capture device include the user's other eye. The images and the additional images are provided to a controller, which applies a trained model to the images and the additional images to generate a vector identifying a position of the user's head and positions of the user's eye and fixation of each of the user's eyes. Additionally, illumination sources illuminating portions of the user's face include in the images and in the additional images are configured when the user wears the HMD to prevent over-saturation or under-saturation of the images and the additional images.

Abstract: A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes multiple image capture devices positioned within and on the HMD to capture portions of a face of a user wearing the HMD. Multiple image capture devices are included within the HMD to capture different portions of the face of the user within the HMD, and one or more other image capture devices are positioned to capture portions of the face of the user external to the HMD. Captured images from various image capture devices may be communicated to a console or a controller that generates a graphical representation of the user's face based on the captured images.

Abstract: A method for facilitating user interaction with an electronic device may include (1) applying, via at least one primary electrode of a human-body coupling subsystem, a body-bound signal to a user's body, (2) receiving, through the user's body via at least one secondary electrode of the human-body coupling subsystem, the body-bound signal, (3) determining at least one characteristic of the received body-bound signal, and (4) identifying a bodily gesture made by the user based on the at least one characteristic of the received body-bound signal. Various other apparatus, systems, and methods are also disclosed.

Abstract: A head-mounted energy-harvesting device may include (1) an electronic component that is operable using a direct current, (2) a human-body coupler that includes a first electrode and a second electrode and that is configured to conduct an artificial body-bound signal from a user's body, (3) a receiving subsystem electrically connected to the human-body coupler and configured to receive the artificial body-bound signal, and (4) a rectifying subsystem coupled to the receiving subsystem and configured to convert the artificial body-bound signal into the direct current for use by the electronic component. The artificial body-bound signal may have been transmitted by an energy-supplying device through the user's body. Various other apparatus, systems, and methods are also disclosed.

Abstract: A head-mounted device may include (1) a data source that generates data, (2) a human-body coupler configured to apply body-bound carrier signals to a user's body and conduct body-bound carrier signals from the user's body, (3) a transmitting subsystem electrically connected to the human-body coupler and configured to (a) modulate a body-bound carrier signal with the data and (b) transmit, through the user's body via the human-body coupler, the data to an auxiliary processing device, (4) a receiving subsystem electrically connected to the human-body coupler and configured to (a) receive, through the user's body via the human-body coupler, an additional body-bound carrier signal from the processing device and (b) demodulate a result of processing the data from the additional body-bound carrier signal, and (5) an output device configured to output the result to the user. Various other apparatus, systems, and methods are also disclosed.

Abstract: Periodic signal generators include an oscillator circuit, which is configured to generate a first periodic signal at an output thereof, and a piezoelectric-based microelectromechanical resonator. The resonator is configured to generate a second periodic signal at a first electrode thereof, which is electrically coupled to the oscillator circuit. A variable impedance circuit is provided, which is electrically coupled to a second electrode of the piezoelectric-based microelectromechanical resonator. The variable impedance circuit is configured to passively modify a frequency of the second periodic signal by changing an induced electromechanical stiffness in at least a portion of the piezoelectric-based microelectromechanical resonator.