Abstract: A wearable computing device includes a head-mounted display (HMD) that provides a field of view in which at least a portion of the environment of the wearable computing device is viewable. The HMD is operable to display images superimposed over the field of view. When the wearable computing device determines that a target device is within its environment, the wearable computing device obtains target device information related to the target device. The target device information may include information that defines a virtual control interface for controlling the target device and an identification of a defined area of the target device on which the virtual control image is to be provided. The wearable computing device controls the HMD to display the virtual control image as an image superimposed over the defined area of the target device in the field of view.

Abstract: Methods and systems for authenticating a user using eye tracking information are described. A wearable computing system may include a head mounted display (HMD). The wearable computing system may be operable to be in a locked mode of operation after a period of inactivity by a user. Locked mode of operation may include a locked screen and reduced functionality of the wearable computing system. The user may be authenticated to be able to use the wearable computing system after the period of inactivity. The wearable computing system may generate a display of a random content on the HMD including a content personalized to the user. The wearable computing system may receive information associated with a gaze location of an eye of the user and determine that the gaze location substantially matches a predetermined location of the content personalized to the user on the HMD and authenticate the user.

Abstract: Disclosed are methods and devices for rendering interactions between virtual and physical objects on a substantially transparent display are disclosed. In one embodiment, the method includes displaying a user-interface on a substantially transparent display of a wearable computing device. The method further includes displaying a virtual object in the view region at a focal length along a first line of sight and detecting a physical object at a physical distance along a second line of sight. The method still further includes determining that a relationship between the focal length and the physical distance is such that the virtual object and the physical object appear substantially co-located in a user-view through the view region and, responsive to the determination, initiating a collision action between the virtual object and the physical object.

Abstract: An apparatus includes a light source, a display array, a light relay, a photodetector, control circuitry, and measurement circuitry. The light source is for providing lamp light during an ON-time of the light source. The display array is positioned to receive and selectively manipulate the lamp light. The light relay is positioned to receive the image light from the display array. The photodetector is optically coupled to receive light. Control circuitry is coupled to the light source for cycling the light source and coupled to the measurement circuitry for coordinating light measurements of the photodetector.

Abstract: Methods and systems involving a graphic display in a head mounted display (HMD) are disclosed herein. An exemplary system may be configured to: (1) at a computing system associated with a head-mountable display, receive head-movement data indicative of head movement; (2) use one or more context signals to determine a first activity associated with the head-mountable device; (3) determine a head-movement interpretation scheme corresponding to the first activity; (4) apply the determined head-movement interpretation scheme to determine input data corresponding to the received head-movement data; and (5) provide the determined input data for at least one function of the head-mountable display.

Abstract: Methods and systems for unlocking a screen using eye tracking information are described. A computing system may include a display screen. The computing system may be in a locked mode of operation after a period of inactivity by a user. Locked mode of operation may include a locked screen and reduced functionality of the computing system. The user may attempt to unlock the screen. The computing system may generate a display of a moving object on the display screen of the computing system. An eye tracking system may be coupled to the computing system. The eye tracking system may track eye movement of the user. The computing system may determine that a path associated with the eye movement of the user substantially matches a path associated with the moving object on the display and switch to be in an unlocked mode of operation including unlocking the screen.

Abstract: A wearable computing device includes a head-mounted display (HMD) that provides a field of view in which at least a portion of the environment of the wearable computing device is viewable. The HMD is operable to display images superimposed over the field of view. When the wearable computing device determines that a target device is within its environment, the wearable computing device obtains target device information related to the target device. The target device information may include information that defines a virtual control interface for controlling the target device and an identification of a defined area of the target device on which the virtual control image is to be provided. The wearable computing device controls the HMD to display the virtual control image as an image superimposed over the defined area of the target device in the field of view.

Abstract: Methods and devices for determining whether a head-mountable computing device is donned or doffed are disclosed. In one embodiment, a method is disclosed that includes receiving from at least one capacitive sensor data indicating a rate of change of capacitance, making a comparison of the rate of change of capacitance to a threshold rate of change of capacitance and, based on the comparison, determining whether the head-mountable computing device is donned or doffed. The method further includes, if the head-mountable computing device is donned, causing the head-mountable computing device to operate in a first state, and if the head-mountable computing device is doffed, causing the head-mountable computing device to operate in a second state, where the head-mountable computing device consumes less power in the second state than in the first state.

Abstract: Methods and systems for use of an optical display system as an indicator of a wearable computing device are provided. In one example, a method includes receiving, by the wearable computing device, information for display by an optical display system coupled to the wearable computing device. The method includes in response, making a determination of whether the wearable computing device is in use. The method also includes based on the determination, causing a light source coupled to the wearable computing device to modulate an illumination of the optical display system.

Abstract: A system and method of determining regions of interest via collective gaze of multiple wearable head-mounted displays (HMDs) is disclosed. Each of a plurality of HMDs can be communicatively connected with a communication network, and can transmit respective location-orientation data to the communication network or a server or server system in the network. Location-orientation data from the plurality can be collected and analyzed by the server in order to determine spatial regions that are or appear to be focal points of collective or common gaze of two or more HMDs of the plurality. Information about those regions or about the analysis that identified them may thereafter be provided back to one or more HMDs or other wearable computing devices.

Abstract: A display system includes an image generator configured to generate a virtual image and a first beam splitter coupled to the image generator. The virtual image and a real-world view are viewable through the first beam splitter from a viewing location. The display system also includes a second beam splitter coupled to the first beam splitter and a camera coupled to the second beam splitter. The camera is configured to image an eye of a user located at the viewing location. Further, a controller is coupled to the image generator and the camera. The controller is configured to process the image of the eye of the user, to determine a location in at least one of the real-world view and the virtual image where the eye of the user is focused, and to control an operation of the display system in response to the determined location.

Abstract: An optical system has an aperture through which virtual and real-world images are viewable along a viewing axis. The optical system may be incorporated into a head-mounted display (HMD). By illuminating a viewing location with an infrared light source, an eye pupil may be illuminated. Infrared light is reflected from the viewing location and is collected with a proximal beam splitter. An image former is configured to reflect at least a portion of the visible light pattern generated by the display panel to form the virtual image and transmit at least a portion of the collected infrared light. The transmitted infrared light may be imaged by a camera. The HMD may use images from the camera to provide, for example, context-sensitive virtual images to a wearer.

Abstract: Methods and systems for using eye-tracking data to stabilize a video are provided. An example method may involve receiving a video captured using a body-mountable camera and receiving gaze-direction data from one or more head-mountable eye trackers. Additionally, the method may include analyzing the received gaze-direction data to detect at least one involuntary orbital eye-movement. According to the method, the received video may be stabilized based at least in part on the detected at least one involuntary orbital eye-movement, and the stabilized video may be sent In some instances, camera-movement data may also be received and utilized to detect involuntary orbital eye-movements or stabilize the received video.

Abstract: A method includes generating a light pattern using a display panel and forming a virtual image from the light pattern utilizing one or more optical components. The virtual image is viewable from a viewing location. The method also includes receiving external light from a real-world environment incident on an optical sensor. The real-world environment is viewable from the viewing location. Further, the method includes obtaining an image of the real-world environment from the received external light, identifying a background feature in the image of the real-world environment over which the virtual image is overlaid, and extracting one or more visual characteristics of the background feature. Additionally, the method includes comparing the one or more visual characteristics to an upper threshold value and a lower threshold value and controlling the generation of the light pattern based on the comparison.

Abstract: Exemplary methods and systems relate to detecting physical objects near a substantially transparent head-mounted display (HMD) system and activating a collision-avoidance action to alert a user of the detected objects. Detection techniques may include receiving data from distance and/or relative movement sensors and using this data as a basis for determining an appropriate collision-avoidance action. Exemplary collision-avoidance actions may include de-emphasizing virtual objects displayed on the HMD to provide a less cluttered view of the physical objects through the substantially transparent display and/or presenting new virtual objects.

Abstract: An optical system includes a display panel, an image former, a viewing window, a proximal beam splitter, and a distal beam splitter. The display panel is configured to generate a light pattern. The image former is configured to form a virtual image from the light pattern generated by the display panel. The viewing window is configured to allow outside light in from outside of the optical system. The virtual image and the outside light are viewable along a viewing axis extending through the proximal beam splitter. The distal beam splitter is optically coupled to the display panel and the proximal beam splitter and has a beam-splitting interface in a plane that is parallel to the viewing axis. A camera may also be optically coupled to the distal beam splitter so as to be able to receive a portion of the outside light that is viewable along the viewing axis.

Abstract: Methods and systems for unlocking a screen using eye tracking information are described. A computing system may include a display screen. The computing system may be in a locked mode of operation after a period of inactivity by a user. Locked mode of operation may include a locked screen and reduced functionality of the computing system. The user may attempt to unlock the screen. The computing system may generate a display of a moving object on the display screen of the computing system. An eye tracking system may be coupled to the computing system. The eye tracking system may track eye movement of the user. The computing system may determine that a path associated with the eye movement of the user substantially matches a path associated with the moving object on the display and switch to be in an unlocked mode of operation including unlocking the screen.

Abstract: Example methods and systems for displaying one or more indications that indicate (i) the direction of a source of sound and (ii) the intensity level of the sound are disclosed. A method may involve receiving audio data corresponding to sound detected by a wearable computing system. Further, the method may involve analyzing the audio data to determine both (i) a direction from the wearable computing system of a source of the sound and (ii) an intensity level of the sound. Still further, the method may involve causing the wearable computing system to display one or more indications that indicate (i) the direction of the source of the sound and (ii) the intensity level of the sound.

Abstract: Methods and devices for determining whether a head-mountable computing device is donned or doffed are disclosed. In one embodiment, a method is disclosed that includes receiving from at least one capacitive sensor data indicating a rate of change of capacitance, making a comparison of the rate of change of capacitance to a threshold rate of change of capacitance and, based on the comparison, determining whether the head-mountable computing device is donned or doffed. The method further includes, if the head-mountable computing device is donned, causing the head-mountable computing device to operate in a first state, and if the head-mountable computing device is doffed, causing the head-mountable computing device to operate in a second state, where the head-mountable computing device consumes less power in the second state than in the first state.

Abstract: Embodiments of a near-to-eye display include a light guide with a proximal end, a distal end, a front surface spaced apart from a back surface, an ambient input region on the front surface and an output region on the back surface. A display and a camera are positioned at or near the proximal end. A proximal optical element is positioned in the light guide and optically coupled to the display and the camera. A distal optical element is positioned in the light guide and optically coupled to the proximal optical element, the ambient input region and the output region. The proximal optical element can direct display light toward the distal optical element and ambient light to the camera, and the distal optical element can direct display light to the output region and ambient light to the output region and to the proximal optical element.