Abstract: Various implementations track an eye using both camera images and light sensor data, e.g., from a photosensitive surface or set of photodetectors. The camera need not capture images at a high capture rate since the light sensor data captured from the light sensor provides information about the eye during the time periods between camera frames. An eye tracking device may thus provide eye tracking with high temporal resolution using less power and resources and prior devices. The eye tracking device includes a lens (e.g., a diffractive optical element (DOE)) that splits received light onto the camera and light sensor. The camera and light sensor may be aligned, e.g., co-centered. Using such a lens to provide light to an aligned camera and light sensor facilitates tracking the eye characteristics by reducing the need for matching the data and/or accounting for multiple environmental light sources.

Abstract: A lens module in a head-mounted device may include a fluid-filled chamber, a semi-rigid lens element that at least partially defines the fluid-filled chamber, and at least one actuator configured to selectively bend the semi-rigid lens element. The semi-rigid lens element may become rigid along a first axis when the lens element is curved along a second axis perpendicular to the first axis. Six actuators that are evenly distributed around the periphery of the semi-rigid lens element may be used to control the curvature of the semi-rigid lens element. The semi-rigid lens element may initially be planar or non-planar. For example, the semi-rigid lens element may initially have a spherically convex surface and a spherically concave surface. A tunable spherical lens may be incorporated into the lens module to offset a parasitic spherical lens power from the semi-rigid lens element.

Abstract: Performing a combination localization technique includes determining a target localization parameter, selecting a combination localization technique in accordance with the target localization parameter, including a first localization technique associated with a first power error time profile, and a second localization technique associated with a second power error time profile. A device location is determined using the first localization technique for a first time period in accordance with the first power error time profile, and an updated device location is determined using the second localization technique in response to a triggering condition. A further updated device location is determined using the first localization technique following the first time period based on the updated device location. At least one of a combined energy value and a combined maximum error rate for the combination localization technique satisfies the target localization parameter.

Abstract: Various implementations disclosed herein include devices, systems, and methods that initiate an action based on a detected gaze direction oriented towards a target area (e.g., a hot corner/zone). For example, an example process may include producing a reflection by directing light towards an eye using an illuminator, receiving sensor data from a sensor, wherein a direction of sensing by the sensor (e.g., the optical axis of the camera) and a direction from the eye to a target area are approximately aligned, determining a reflective property (e.g., a spectral property) of the reflection based on the sensor data, detecting that a gaze direction of the eye is approximately oriented towards the target area (e.g., a hot zone/spot) based on the reflective property, and initiating an action based on detecting that the gaze direction is approximately oriented towards the target area.

Abstract: Various implementations disclosed herein include devices, systems, and methods that dynamically-size zones used in foveated rendering of content that includes text. In some implementations, this involves adjusting the size of a first zone, e.g., a foveated gaze zone (FGZ), based on the apparent size of text from a viewpoint. For example, a FGZ may be increased or decreased in width, height, diameter, or other size attribute based on determining an angle subtended by one or more individual glyphs of the text from the viewpoint. Various implementations disclosed herein include devices, systems, and methods that select a text-rendering algorithm based on a relationship between (a) the rendering resolution of a portion of an image corresponding to a part of a glyph and (b) the size that the part of the glyph will occupy in the image.

Abstract: A wearable system with a gestural interface for wearing on, for instance, the wrist of a user. The system comprises an ultrasonic transceiver array structure and may comprise a pico projector display element for displaying an image on a surface. User anatomical feature inputs are received in the form of ultrasound signals representative of a spatio-temporal cross-section of the wrist of the user by articulating wrist, finger and hand postures, which articulations are translated into gestures. Inputs from inertial and other sensors are used by the system as part of the anatomical feature posture identification method and device. Gestures are recognized using a mathematically-modeled, simulation-based set of biological metrics of tissue objects, which gestures are converted to executable computer instructions. Embodiments of the system disclosed herein may also be used to monitor biometric and health data over computer networks or using onboard systems.

Abstract: Various implementations disclosed herein include devices, systems, and methods that dynamically-size zones used in foveated rendering of content that includes text. In some implementations, this involves adjusting the size of a first zone, e.g., a foveated gaze zone (FGZ), based on the apparent size of text from a viewpoint. For example, a FGZ may be increased or decreased in width, height, diameter, or other size attribute based on determining an angle subtended by one or more individual glyphs of the text from the viewpoint. Various implementations disclosed herein include devices, systems, and methods that select a text-rendering algorithm based on a relationship between (a) the rendering resolution of a portion of an image corresponding to a part of a glyph and (b) the size that the part of the glyph will occupy in the image.

Abstract: A lens module in a head-mounted device may include a fluid-filled chamber, a semi-rigid lens element that at least partially defines the fluid-filled chamber, and at least one actuator configured to selectively bend the semi-rigid lens element. The semi-rigid lens element may become rigid along a first axis when the lens element is curved along a second axis perpendicular to the first axis. Six actuators that are evenly distributed around the periphery of the semi-rigid lens element may be used to control the curvature of the semi-rigid lens element. The semi-rigid lens element may initially be planar or non-planar. For example, the semi-rigid lens element may initially have a spherically convex surface and a spherically concave surface. A tunable spherical lens may be incorporated into the lens module to offset a parasitic spherical lens power from the semi-rigid lens element.

Abstract: A lens module in a head-mounted device may include a fluid-filled chamber, a semi-rigid lens element that at least partially defines the fluid-filled chamber, and at least one actuator configured to selectively bend the semi-rigid lens element. The semi-rigid lens element may become rigid along a first axis when the lens element is curved along a second axis perpendicular to the first axis. Six actuators that are evenly distributed around the periphery of the semi-rigid lens element may be used to control the curvature of the semi-rigid lens element. The semi-rigid lens element may initially be planar or non-planar. For example, the semi-rigid lens element may initially have a spherically convex surface and a spherically concave surface. A tunable spherical lens may be incorporated into the lens module to offset a parasitic spherical lens power from the semi-rigid lens element.

Abstract: A lens module in a head-mounted device may include a fluid-filled chamber, a semi-rigid lens element that at least partially defines the fluid-filled chamber, and at least one actuator configured to selectively bend the semi-rigid lens element. The semi-rigid lens element may become rigid along a first axis when the lens element is curved along a second axis perpendicular to the first axis. Six actuators that are evenly distributed around the periphery of the semi-rigid lens element may be used to control the curvature of the semi-rigid lens element. The semi-rigid lens element may initially be planar or non-planar. For example, the semi-rigid lens element may initially have a spherically convex surface and a spherically concave surface. A tunable spherical lens may be incorporated into the lens module to offset a parasitic spherical lens power from the semi-rigid lens element.

Abstract: A viewing system is provided including an active transparency modulation film in the form of addressable arrays of electrochromic pixel structures. The viewing system may be used in, for instance, a head-mounted display (HMD) or head-up display (HUD). The film is located on one side of a viewing lens of the system and is selectively variable from opaque to transparent at certain regions on the lens to provide an opaque silhouetted image upon which a virtual image is projected. The viewing system including the film and pixel structure therefore provide improved viewing by minimizing the undesirable effects of image ghosting in a viewed scene.

Abstract: A viewing system is provided including an active transparency modulation film in the form of addressable arrays of electrochromic pixel structures. The viewing system may be used in, for instance, a head-mounted display (HMD) or head-up display (HUD). The film is located on one side of a viewing lens of the system and is selectively variable from opaque to transparent at certain regions on the lens to provide an opaque silhouetted image upon which a virtual image is projected. The viewing system including the film and pixel structure therefore provide improved viewing by minimizing the undesirable effects of image ghosting in a viewed scene.

Abstract: A wearable system with a gestural interface for wearing on, for instance, the wrist of a user. The system comprises an ultrasonic transceiver array structure and may comprise a pico projector display element for displaying an image on a surface. User anatomical feature inputs are received in the form of ultrasound signals representative of a spatio-temporal cross-section of the wrist of the user by articulating wrist, finger and hand postures, which articulations are translated into gestures. Inputs from inertial and other sensors are used by the system as part of the anatomical feature posture identification method and device. Gestures are recognized using a mathematically-modeled, simulation-based set of biological metrics of tissue objects, which gestures are converted to executable computer instructions. Embodiments of the system disclosed herein may also be used to monitor biometric and health data over computer networks or using onboard systems.