Abstract: Methods and apparatus for specular surface mapping in which a camera detects reflections of a light source from a specular surface. The detected light sources may be projected onto a celestial sphere as virtual point sources. True positive observations should be tightly clustered on the celestial sphere; thus, false positives may be identified and removed. Specular surface information may then be determined from clusters of the virtual point sources on the celestial sphere. The clusters of virtual point sources on the celestial sphere may be identified and used to identify a surface as a specular surface. The clusters may also be used to extract other information regarding the specular surface, including but not limited to distance to and extent of the specular surface.

Abstract: Embodiments are disclosed for active cancellation of noise in motion sensor signals. In some embodiments, a method comprises: obtaining a motion sensor signal from a motion sensor; obtaining a reference signal indicative of parasitic vibration from a vibration source mechanically coupled to the motion sensor; generating, using an adaptive noise canceller, an estimate of the parasitic vibration; and using the estimated parasitic vibration to cancel the parasitic vibration from the motion sensor signal.

Abstract: Various implementations track an eye using both camera images and light sensor data, e.g., from a photosensitive surface or set of photodetectors. The camera need not capture images at a high capture rate since the light sensor data captured from the light sensor provides information about the eye during the time periods between camera frames. An eye tracking device may thus provide eye tracking with high temporal resolution using less power and resources and prior devices. The eye tracking device includes a lens (e.g., a diffractive optical element (DOE)) that splits received light onto the camera and light sensor. The camera and light sensor may be aligned, e.g., co-centered. Using such a lens to provide light to an aligned camera and light sensor facilitates tracking the eye characteristics by reducing the need for matching the data and/or accounting for multiple environmental light sources.

Abstract: A head-mounted device may include a first display having a first projector and a first waveguide, a second display having a second projector and a second waveguide, first and second cameras, an optical sensor that couples the first waveguide to the second waveguide, and position sensors mounted to the first and second cameras and the optical sensor. The optical sensor may gather image sensor data from first image light propagating in the first waveguide and second image light propagating in the second waveguide. The cameras may capture real-world images. The position sensors may gather position measurements. Control circuitry may calibrate optical misalignment in the device by adjusting the first and/or second image light based on the image sensor data, the position measurements, and/or the world light.

Abstract: A processing unit of an electronic device may transmit a synchronization pulse to each of a first plurality of motion sensors (e.g., Inertial Measurement Units or IMUs) communicatively coupled to the processing unit, wherein the synchronization pulse transmitted to each motion sensor of the first plurality of motion sensors is assigned an offset time amount by the processing unit. The processing unit then obtains motion information samples from each of the first plurality of motion sensors, e.g., in an order corresponding to the offset time amounts assigned to the respective motion sensors, and then performs a processing operation based upon the obtained motion information samples. In some embodiments, each motion sensor may be assigned an equal offset time amount. In other embodiments, the offset time amount assigned to each motion sensor may be individually determined, e.g., based on one or more conditions, settings, or preferences related to the electronic device.

Abstract: A sensor assembly for a head-mountable device, the sensor assembly comprising: a flex circuit, an inertial measurement unit coupled to the flex circuit, an enclosure disposed around the inertial measurement unit and a portion of the flex circuit, to define a sealed volume containing the inertial measurement unit and the portion of the flex circuit. Thereby, a head-mountable device can securely support sensors in a manner that maintains their positions and orientations over time and isolates the sensors from an external environment. The sensor can be mounted within a sealed enclosure while maintaining an operable connection to the sensor. The sensor assemblies provides high robustness during the entirety of the service life of the head-mountable device without placing strain on the sensors themselves. The seal of the enclosure can isolate the sensor from external influences by preventing ingress of elements through the case and plate.

Abstract: A head-mounted device may include optical assemblies for presenting images to a user. The optical assemblies may be movable relative to one another. The head-mounted device may include one or more nose tracking sensors for tracking a location of the nose relative to the optical assemblies and/or for detecting changes in the topographical surface of the nose as the optical assemblies are adjusted. The nose tracking sensor may be used to determine when the optical assemblies are too close to the user's nose or face. The nose tracking sensor may be mounted in the lens barrel, may be formed from gaze tracking components, may be formed from a dedicated sensor, or may be mounted outside of the lens barrel and may gather nose measurements through a nose bridge portion of a light seal.

Abstract: Methods and apparatus for measuring biometric data including respiration in head-mounted devices (HMDs). Accelerometers may be integrated into a HMD and used to collect motion data from a user's face. This motion data may be processed to generate estimates of the user's respiration rate and changes to the respiration rate. Thermal sensors may also be integrated into the HMD and used to collect thermal data from the surface of the user's face (or other regions of the user's head). This thermal data may also be processed to generate estimates of the user's respiration. The respiration rate and changes to respiration rate derived from signals from the sensors may be used to generate and present biometric data to the user.

Abstract: Methods and apparatus for measuring biometric data including temperature in head-mounted devices (HMDs). Thermal sensors may also be integrated into the HMD and used to collect thermal data from the surface of the user's face. This thermal data may, for example, be processed to determine core body temperature of the user, or be processed to generate estimates of the user's respiration. The temperature data and/or respiration rate and changes to respiration rate derived from signals from the sensors may be used to generate and present biometric data to the user.

Abstract: A head-mounted device may include a component such as a sidewall structure that is switchable between an opaque mode and a transparent mode. In the opaque mode, the component may block ambient light from passing into the interior of the head-mounted device (such that the user cannot see the surrounding environment). In the transparent mode, the component may allow ambient light to pass into the interior of the head-mounted device (such that the user can see portions of the surrounding environment). The opaque mode may provide a more immersive experience for the user of the head-mounted device, whereas the transparent mode may allow the user to see objects in their surrounding physical environment. Instead or in addition, the head-mounted device may include one or more sidewall displays.

Abstract: A head-mountable device can include a display, a housing, a processor, and a camera module. The camera module can include a lens assembly, an optical sensor, a substrate, and a motion sensor attached to the camera module to determine a motion of the camera module. The processor can be communicatively coupled to the motion sensor, and can generate a signal based on the motion.

Abstract: A head-mounted device such as a pair of glasses may have a head-mounted housing. The head-mounted device may include displays such as projector displays and may include associated optical components. The optical components may include waveguides that are used in providing images received from the displays to corresponding eye boxes for viewing by a user. Changes in the relative orientation between the displays and waveguides may warp the images in the eye boxes. To compensate for this effect, control circuitry in the head-mounted device may use position sensors to measure the relative positions of the displays and waveguides. Image warping due to misalignment between the displays and waveguides may be removed by applying compensating image warping to the images being produced by the displays.

Abstract: In at least one example of the present disclosure, a head-mountable device includes a display, a frame at least partially surrounding the display, a facial interface attached to the frame, a cover disposed around the facial interface, and a touch sensitive surface incorporated into the cover to receive input from a user for the head-mountable device.

Abstract: A head-mountable device including a display, a housing at least partially surrounding the display, a facial interface attached to the housing, and a cover positioned between the housing and the facial interface, the cover comprising a conductive fabric.

Abstract: An electronic device may have a display with an array of pixels for displaying images. The electronic device may also have a lens through which the images are viewable on the display. The display may have a display panel that is mounted to a printed circuit stack. The printed circuit stack may include multiple printed circuit layers to which components are mounted. The components may include an orientation sensor overlapped by the display panel. A camera may be mounted to a printed circuit stack and may overlap one or more electrical components such as an orientation sensor. The printed circuit stacks may include rigid and flexible printed circuits coupled together using solder and other conductive connections. Air gaps may be created between stacked printed circuit layers.

Abstract: A head mounted device may include one or more interferometric sensors positioned and oriented in a housing to sense particle movement caused by respiration of a user. Interferometric signals from the one or more interferometric sensors may be used to determine respiration information about the user.

Abstract: A head-mounted device may have a display with pixel arrays that display content for a user. A head-mounted support structure in the device supports the pixel arrays on the head of the user. A left positioner may be used to position a left lens assembly that includes a left lens and a first pixel array. A right positioner may be used to position a right lens assembly that includes a right lens and a second pixel array. Control circuitry may adjust the positions of the left and right lens assemblies using interpupillary distance information. Sensing circuitry such as force sensing circuitry may be used to ensure that the lens assemblies do not apply excessive force on a nose. Force sensors may be included between the lens assemblies and the nose, such as in, on, or adjacent to a nasal flap, or may be coupled to the lens assemblies.

Abstract: Various implementations disclosed herein include devices, systems, and methods that initiate an action based on a detected gaze direction oriented towards a target area (e.g., a hot corner/zone). For example, an example process may include producing a reflection by directing light towards an eye using an illuminator, receiving sensor data from a sensor, wherein a direction of sensing by the sensor (e.g., the optical axis of the camera) and a direction from the eye to a target area are approximately aligned, determining a reflective property (e.g., a spectral property) of the reflection based on the sensor data, detecting that a gaze direction of the eye is approximately oriented towards the target area (e.g., a hot zone/spot) based on the reflective property, and initiating an action based on detecting that the gaze direction is approximately oriented towards the target area.

Abstract: A head-mounted device includes a device housing, a display device, an optical system, and a headband. The head-mounted device also includes a first headband connector that includes a headband-side connector portion that is connected to the headband at a first end of the headband and a device-side connector portion that is connected to the device housing. The first headband connector is movable between a disconnected position, in which the headband-side connector portion is disconnected from the device-side connector portion, and a connected position, in which the headband-side connector portion is connected to the device-side connector portion. The first headband connector also includes paired magnetic components that are configured to attract the headband-side connector portion and the device-side connector portion to one another to urge the first headband connector to move to the connected position.

Abstract: Methods and apparatus for specular surface mapping in which a camera detects reflections of a light source from a specular surface. The detected light sources may be projected onto a celestial sphere as virtual point sources. True positive observations should be tightly clustered on the celestial sphere; thus, false positives may be identified and removed. Specular surface information may then be determined from clusters of the virtual point sources on the celestial sphere. The clusters of virtual point sources on the celestial sphere may be identified and used to identify a surface as a specular surface. The clusters may also be used to extract other information regarding the specular surface, including but not limited to distance to and extent of the specular surface.