Abstract: Embodiments of the disclosure describe an on-head detection technique for an HMD that includes an optical sensor positioned to detect light reflected from at least one of a face of a user or a lens worn by the user. A flexible frame assembly supports an image source and further supports the optical sensor relative to the face or the lens when worn by the user. The flexible frame assembly flexes such that the optical sensor moves closer to at least one of the face or the lens when the HMD is worn by the user. Embodiments determine whether the user is wearing the HMD based on optical sensor data output from the optical sensor.

Abstract: Embodiments described herein may provide a configuration of input interfaces used to perform multi-touch operations. An example device may involve: (a) a housing arranged on a head-mountable device, (b) a first input interface arranged on either a superior or an inferior surface of the housing, (c) a second input interface arranged on a surface of the housing that is opposite to the first input interface, and (d) a control system configured to: (1) receive first input data from the first input interface, where the first input data corresponds to a first input action, and in response, cause a camera to perform a first operation in accordance with the first input action, and (2) receive second input data from the second input interface, where the second input data corresponds to a second input action(s) on the second input interface, and in response, cause the camera to perform a second operation.

Abstract: Example methods and systems activate and deactivate a voice interface based on gaze directions. A computing device can define a range of voice-activation gaze directions and, in some cases, define a range of social-cue gaze directions, where the range of social-cue gaze directions overlaps the range of voice-activation gaze directions. The computing device can determine a gaze direction. The computing device determines whether the gaze direction is within the range of voice-activation gaze directions. In response to determining that the gaze direction is within the range of social-cue directions, the computing device can activate a voice interface. In response to determining that the gaze direction is not within the range of social-cue directions, the computing device can deactivate the voice interface.

Abstract: Systems and methods for navigation and selection with eye gestures in a graphical display are provided, in which a graphical display of content may be provided to a wearer of a head-mountable device. A first signal may be received from a first sensor configured to detect an eye gesture of a first eye of the wearer. A second signal may then be received from a second sensor configured to detect an eye gesture of a second eye of the wearer. The first signal may be associated to a first command to navigate through or select an item in the graphical display of content provided by the head-mountable device, and the second signal may be associated to a subsequent command, based at least in part on a given output of the first command, to navigate through or select another item in the graphical display of content.

Abstract: Methods and systems are described for determining eye position and/or for determining eye movement based on glints. An exemplary computer-implemented method involves: (a) causing a camera that is attached to a head-mounted display (HMD) to record a video of the eye; (b) while the video of the eye is being recorded, causing a plurality of light sources that are attached to the HMD and generally directed towards the eye to switch on and off according to a predetermined pattern, wherein the predetermined pattern is such that at least two of the light sources are switched on at any given time while the video of the eye is being recorded; (c) analyzing the video of the eye to detect controlled glints that correspond to the plurality of light sources; and (d) determining a measure of eye position based on the controlled glints.

Abstract: Methods and systems for authenticating a user using eye tracking information are described. A wearable computing system may include a head mounted display (HMD). The wearable computing system may be operable to be in a locked mode of operation after a period of inactivity by a user. Locked mode of operation may include a locked screen and reduced functionality of the wearable computing system. The user may be authenticated to be able to use the wearable computing system after the period of inactivity. The wearable computing system may generate a display of a random content on the HMD including a content personalized to the user. The wearable computing system may receive information associated with a gaze location of an eye of the user and determine that the gaze location substantially matches a predetermined location of the content personalized to the user on the HMD and authenticate the user.

Abstract: A wearable computing system may include an eye-tracking system configured to track the position of an eye of a wearer of the wearable computing system. In particular, an infrared light source illuminating the eye of a wearer at a relatively high intensity may generate specular reflections off the wearer's cornea, also called ‘glints’. The glints can be imaged with an infrared camera. When the infrared light sources are illuminated at a relatively lower intensity, determination of the pupil location is possible. Glints, in combination with the pupil location, may be used to accurately determine the gaze direction and eye rotation. The determined gaze direction could be used in various eye-tracking applications. By controlling the light sources to change intensity levels and by combining multiple images of the eye to incorporate multiple glint locations with the pupil location, eye tracking can be performed with better accuracy and with fewer light sources.

Abstract: A wearable computing device or a head-mounted display (HMD) may be configured to track the gaze axis of an eye of the wearer. In particular, the device may be configured to observe movement of a wearer's pupil and, based on the movement, determine inputs to a user interface. For example, using eye gaze detection, the HMD may change a tracking rate of a displayed virtual image based on where the user is looking. Gazing at the center of the HMD field of view may, for instance, allow for fine movements of the virtual display. Gazing near an edge of the HMD field of view may provide coarser movements.

Abstract: Exemplary methods and systems help provide for tracking an eye. An exemplary method may involve: causing the projection of a pattern onto an eye, wherein the pattern comprises at least one line, and receiving data regarding deformation of the at least one line of the pattern. The method further includes correlating the data to iris, sclera, and pupil orientation to determine a position of the eye, and causing an item on a display to move in correlation with the eye position.

Abstract: Embodiments of the disclosure describe on-head detection processes for HMD devices that include at least one lens, an optical sensor positioned in front of the lens to detect light reflected from the lens, at least one image source positioned in front of the lens, and a frame assembly to support the lens and the image source for wearing on a head of the user, wherein the frame assembly comprises a flexible frame assembly to flex such that the optical sensor moves closer to the at least one lens when the HMD is worn by the user. In some embodiments, the optical sensor is positioned to also detect a reflected light from the user's face. The light received by the optical sensor is stronger when the user is wearing the HMD, and thus embodiments determine whether the user is wearing the HMD based on the optical sensor data.

Abstract: Methods and systems involving a graphic display in a head mounted display (HMD) are disclosed herein. An exemplary system may be configured to: (1) at a computing system associated with a head-mountable display, receive head-movement data indicative of head movement; (2) use one or more context signals to determine a first activity associated with the head-mountable device; (3) determine a head-movement interpretation scheme corresponding to the first activity; (4) apply the determined head-movement interpretation scheme to determine input data corresponding to the received head-movement data; and (5) provide the determined input data for at least one function of the head-mountable display.

Abstract: Methods and systems for unlocking a screen using eye tracking information are described. A computing system may include a display screen. The computing system may be in a locked mode of operation after a period of inactivity by a user. Locked mode of operation may include a locked screen and reduced functionality of the computing system. The user may attempt to unlock the screen. The computing system may generate a display of a moving object on the display screen of the computing system. An eye tracking system may be coupled to the computing system. The eye tracking system may track eye movement of the user. The computing system may determine that a path associated with the eye movement of the user substantially matches a path associated with the moving object on the display and switch to be in an unlocked mode of operation including unlocking the screen.

Abstract: Methods and systems are described for determining eye position and/or for determining eye movement based on glints. An exemplary computer-implemented method involves: (a) causing a camera that is attached to a head-mounted display (HMD) to record a video of the eye; (b) while the video of the eye is being recorded, causing a plurality of light sources that are attached to the HMD and generally directed towards the eye to switch on and off according to a predetermined pattern, wherein the predetermined pattern is such that at least two of the light sources are switched on at any given time while the video of the eye is being recorded; (c) analyzing the video of the eye to detect controlled glints that correspond to the plurality of light sources; and (d) determining a measure of eye position based on the controlled glints.

Abstract: A wearable audio component includes a first cable and an audio source in electrical communication with the first cable. A housing defines an interior and an exterior, the audio source being contained within the interior thereof. The exterior includes an ear engaging surface, an outer surface, and a peripheral surface extending between the front and outer surfaces. The peripheral surface includes a channel open along a length to surrounding portions of the peripheral surface and having a depth to extend partially between the front and outer surfaces. A portion of the channel is covered by a bridge member that defines an aperture between and open to adjacent portions of the channel. The cable is connected with the housing at a first location disposed within the channel remote from the bridge member and is captured in so as to extend through the aperture in a slidable engagement therewith.

Abstract: Methods and systems are described for determining eye position and/or for determining eye movement based on glints. An exemplary computer-implemented method involves: (a) causing an imaging device that is attached to a head-mountable display (HMD) to record a video of the eye; (b) while the video of the eye is being recorded, causing a plurality of light sources that are attached to the HMD and generally directed towards the eye to switch on and off according to a predetermined pattern, wherein the predetermined pattern is such that at least two of the light sources are switched on at any given time while the video of the eye is being recorded; (c) analyzing the video of the eye to detect controlled glints that correspond to the plurality of light sources; and (d) determining a measure of eye position based on the controlled glints.

Abstract: Systems and methods are described for improving gaze estimation based on glints. An example method may be executable to receive glint-location data indicating a location for each of one or more glints that are reflected from an eye. The glint-location data may be captured by an imaging device that is attached to a head-mountable display (HMD). The method may be further executable to determine a plurality of normalized pupil locations comprising at least a first and a second normalized pupil location. Each normalized pupil location may be determined based on the glint-location data for a different combinatoric subset of the one or more glints. The method may be further executable to determine a regression model to fit the plurality of normalized pupil locations to an expected gaze location, and perform a gaze-tracking process based on the regression model.

Abstract: Methods and systems for using a multi-state button are described. A computing device may be configured to receive an input associated with a press state of a button. The computing device may be configured to cause an image-capture device to capture an image from a point-of-view (POV) of the computing device based on the input corresponding to a first press state on the button and cause the image-capture device to capture a video from the POV of the computing device based on the input corresponding to a second press state on the button. The computing device may be configured, based on the input corresponding to a partial press state of the button, to cause the image-capture device to capture the image and/or the video; and provide a search query based on the image and/or the video.

Abstract: Methods and systems involving navigation of a graphical interface are disclosed herein. An example system may be configured to: (a) cause a head-mounted display (HMD) to provide a graphical interface, the graphical interface comprising (i) a view port having a view-port orientation and (ii) at least one navigable area having at least one border, the at least one border having a first border orientation; (b) receive input data that indicates movement of the view port towards the at least one border; (c) determine that the view-port orientation is within a predetermined threshold distance from the first border orientation; and (d) based on at least the determination that the view-port orientation is within a predetermined threshold distance from the first border orientation, adjust the first border orientation from the first border orientation to a second border orientation.

Abstract: A head-mounted display (HMD) may include an eye-tracking system, an HMD-tracking system and a display configured to display virtual images. The virtual images may present an augmented reality to a wearer of the HMD and the virtual images may adjust dynamically based on HMD-tracking data. However, position and orientation sensor errors may introduce drift into the displayed virtual images. By incorporating eye-tracking data, the drift of virtual images may be reduced. In one embodiment, the eye-tracking data could be used to determine a gaze axis and a target object in the displayed virtual images. The HMD may then move the target object towards a central axis. The HMD may also record data based on the gaze axis, central axis and target object to determine a user interface preference. The user interface preference could be used to adjust similar interactions with the HMD.

Abstract: A head-mounted display (HMD) may include an eye-tracking system, an HMD-tracking system and a display configured to display virtual images. The virtual images may present an augmented reality to a wearer of the HMD and the virtual images may adjust dynamically based on HMD-tracking data. However, position and orientation sensor errors may introduce drift into the displayed virtual images. By incorporating eye-tracking data, the drift of virtual images may be reduced. In one embodiment, the eye-tracking data could be used to determine a gaze axis and a target object in the displayed virtual images. The HMD may then move the target object towards a central axis. The HMD may also record data based on the gaze axis, central axis and target object to determine a user interface preference. The user interface preference could be used to adjust similar interactions with the HMD.