Abstract: Systems and techniques are disclosed for visually rendering a requested scene based on a virtual camera perspective request as well as a projection of two or more video streams. The video streams can be captured using two dimensional cameras or three dimensional depth cameras and may capture different perspectives. The projection may be an internal projection that maps out the scene in three dimensions based on the two or more video streams. An object internal or external to the scene may be identified and the scene may be visually rendered based on a property of the object. For example, a scene may be visually rendered based on where an mobile object is located within the scene.

Abstract: Aspects of the present disclosure relate to controlling the functions of various devices based on spatial relationships. In one example, a system may include a depth and visual camera and a computer (networked or local) for processing data from the camera. The computer may be connected (wired or wirelessly) to any number of devices that can be controlled by the system. A user may use a mobile device to define a volume of space relative to the camera. The volume of space may then be associated with a controlled device as well as one or more control commands. When the volume of space is subsequently occupied, the one or more control commands may be used to control the controlled device. In this regard, a user may switch a device on or off, increase volume or speed, etc. simply by occupying the volume of space.

Abstract: A video playlist associated with a set of videos is distinguished in a graphical user interface using a dynamic thumbnail to represent the playlist. The dynamic thumbnail comprises a static portion comprising a first image associated with the set of videos and a dynamic portion comprising one or more second images associated with the set of videos. An image provided in the dynamic portion is configured to change while the first image remains the same in response to a shift in the graphical user interface that results in a change in position of the thumbnail about the user graphical user interface.

Abstract: Methods and systems involving a graphic display in a head mounted display (HMD) are disclosed herein. An exemplary system may be configured to: (1) display a pointer and a graphic object in a graphic display; (2) receive body movement data; (3) use the body movement data as a basis to move the pointer in the graphic display; (4) define an active region in an area of the graphic display, where the graphic object is activated when the pointer is located within the active region; (5) define an expanded active region that encompasses and is larger than the active region; and (6) make the graphic object active in response to the pointer being moved into the active region and keep the graphic object active until the pointer is moved outside of the expanded active region.

Abstract: A wearable computing system may include an eye-tracking system configured to track the position of an eye of a wearer of the wearable computing system. In particular, an infrared light source illuminating the eye of a wearer at a relatively high intensity may generate specular reflections off the wearer's cornea, also called ‘glints’. The glints can be imaged with an infrared camera. When the infrared light sources are illuminated at a relatively lower intensity, determination of the pupil location is possible. Glints, in combination with the pupil location, may be used to accurately determine the gaze direction and eye rotation. The determined gaze direction could be used in various eye-tracking applications. By controlling the light sources to change intensity levels and by combining multiple images of the eye to incorporate multiple glint locations with the pupil location, eye tracking can be performed with better accuracy and with fewer light sources.

Abstract: A wearable computing device or a head-mounted display (HMD) may be configured to track the gaze axis of an eye of the wearer. In particular, the device may be configured to observe movement of a wearer's pupil and, based on the movement, determine inputs to a user interface. For example, using eye gaze detection, the HMD may change a tracking rate of a displayed virtual image based on where the user is looking. Gazing at the center of the HMD field of view may, for instance, allow for fine movements of the virtual display. Gazing near an edge of the HMD field of view may provide coarser movements.

Abstract: Methods and systems are disclosed herein that may help to present graphics in a see-through display of a head-mountable display. An exemplary method may involve: (a) receiving image data that is indicative of a real-world field of view associated with a head-mountable display (HMD); (b) analyzing the image data to determine at least one undesirable portion of the real-world field of view, wherein the at least one undesirable portion is undesirable as a background for display of at least one graphic object in a graphic display of the HMD; (c) determining at least one undesirable area of the graphic display that corresponds to the at least one undesirable portion of the real-world field of view; and (d) causing the at least one graphic object to be displayed in an area of the graphic display such that the graphic object substantially avoids the at least one undesirable area.

Abstract: Exemplary methods and systems relate to a wearable computing device determining a user-context and dynamically changing the content of a user-interface based on the determined user-context. The device may determine a user-context based on digital context; such as a text document a user is reading or a current website the device is accessing. User-context may also be based on physical context; such as the device's location or the air temperature around a user. Once a user-context is determined, a device may identify content that is related to the user-context and add objects representing this related content to a user-interface.

Abstract: Methods and devices for applying at least one manipulative action to a selected content object are disclosed. In one aspect, a head-mounted-device (HMD) system includes at least one processor and data storage with user-interface logic executable by the at least one processor to apply at least one manipulative action to a displayed content object based on received data that indicates a first direction in which the HMD is tilted and an extent to which the HMD is tilted in the first direction. The at least one manipulative action is applied to a degree corresponding to the indicated extent to which the HMD is tilted in the first direction.

Abstract: Systems and methods for facilitating character input using a graphical input display having a carousel of characters are provided. In an aspect, a system includes an interface component configured to generate a carousel graphical input display, the carousel graphical input display comprising a plurality of characters arranged in a fixed line, wherein a cursor is configured to move over the characters about the line and the cursor shifts from a first end of the line to a second end of the line in response to reaching either the first end of the line or the second end of the line. The system further includes an input component configured to receive a command to move the cursor over the characters to focus on respective ones of the characters.

Abstract: Exemplary methods and media relate to controlled movement of a viewing window across a graphical user-interface using an orientation-tracked display-device. The viewing window in an exemplary method may move in accordance with detected change in the physical orientation of the display-device. When the physical orientation of the display-device is sufficiently motionless, the position of the viewing window may be held fixed with respect to the graphical user-interface and a stability region may be established in the viewing window. The viewing window may continue to remain still as long as the physical orientation of the display-device remains within a range of orientations represented by the stability region. Then, the viewing window may begin moving again with respect to the graphical user-interface when the orientation moves outside of the range defined by the stability region.

Abstract: A head-mounted display (HMD) may include an eye-tracking system, an HMD-tracking system and a display configured to display virtual images. The virtual images may present an augmented reality to a wearer of the HMD and the virtual images may adjust dynamically based on HMD-tracking data. However, position and orientation sensor errors may introduce drift into the displayed virtual images. By incorporating eye-tracking data, the drift of virtual images may be reduced. In one embodiment, the eye-tracking data could be used to determine a gaze axis and a target object in the displayed virtual images. The HMD may then move the target object towards a central axis. The HMD may also record data based on the gaze axis, central axis and target object to determine a user interface preference. The user interface preference could be used to adjust similar interactions with the HMD.

Abstract: A head-mounted display (HMD) may include an eye-tracking system, an HMD-tracking system and a display configured to display virtual images. The virtual images may present an augmented reality to a wearer of the HMD and the virtual images may adjust dynamically based on HMD-tracking data. However, position and orientation sensor errors may introduce drift into the displayed virtual images. By incorporating eye-tracking data, the drift of virtual images may be reduced. In one embodiment, the eye-tracking data could be used to determine a gaze axis and a target object in the displayed virtual images. The HMD may then move the target object towards a central axis. The HMD may also record data based on the gaze axis, central axis and target object to determine a user interface preference. The user interface preference could be used to adjust similar interactions with the HMD.

Abstract: Methods and systems involving a navigable area in a head-mounted display (HMD) are disclosed herein. An exemplary system may be configured to: (a) cause a head-mounted display (HMD) to provide: (i) a viewing window that is fully visible in a field of view of the HMD, (ii) a navigable area that is not fully visible in a field of view of the HMD such that the viewing window displays a first portion of the navigable area, and (iii) a media object that is associated with a viewing-window state; (b) receive first head-movement data that is indicative of head movement from a first position of the HMD to a second position of the HMD; and (c) based on (i) the first head-movement data and (ii) the viewing-window state, cause the viewing window to display a second portion of the navigable area which includes the media object.

Abstract: A head-mounted display (HMD) may include an eye-tracking system, an HMD-tracking system and a display configured to display virtual images. The virtual images may present an augmented reality to a wearer of the HMD and the virtual images may adjust dynamically based on HMD-tracking data. However, position and orientation sensor errors may introduce drift into the displayed virtual images. By incorporating eye-tracking data, the drift of virtual images may be reduced. In one embodiment, the eye-tracking data could be used to determine a gaze axis and a target object in the displayed virtual images. The HMD may then move the target object towards a central axis. The HMD may also record data based on the gaze axis, central axis and target object to determine a user interface preference. The user interface preference could be used to adjust similar interactions with the HMD.

Abstract: A computer-implemented method includes controlling a wearable computing device (WCD) to provide a user-interface that has one or more menu items and a view region. The method also includes receiving movement data corresponding to movement of the WCD from a first position to a second position and, responsive to the movement data, controlling the WCD such that the one or more menu items are viewable in the view region. Further, the method includes, while the one or more menu items are viewable in the view region, receiving selection data corresponding to a selection of a menu item and, responsive to the selection data, controlling the WCD to maintain the selected menu item substantially fully viewable in the view region and in a substantially fixed position in the view region that is substantially independent of further movement of the WCD.

Abstract: Methods and devices for applying at least one manipulative action to a selected content object are disclosed. In one aspect, a head-mounted-device (HMD) system includes at least one processor and data storage with user-interface logic executable by the at least one processor to apply at least one manipulative action to a displayed content object based on received data that indicates a first direction in which the HMD is tilted and an extent to which the HMD is tilted in the first direction. The at least one manipulative action is applied to a degree corresponding to the indicated extent to which the HMD is tilted in the first direction.

Abstract: A head-mounted display (HMD) may include an eye-tracking system, an HMD-tracking system and a display configured to display virtual images. The virtual images may present an augmented reality to a wearer of the HMD and the virtual images may adjust dynamically based on HMD-tracking data. However, position and orientation sensor errors may introduce drift into the displayed virtual images. By incorporating eye-tracking data, the drift of virtual images may be reduced. In one embodiment, the eye-tracking data could be used to determine a gaze axis and a target object in the displayed virtual images. The HMD may then move the target object towards a central axis. The HMD may also record data based on the gaze axis, central axis and target object to determine a user interface preference. The user interface preference could be used to adjust similar interactions with the HMD.

Abstract: A wearable computing device or a head-mounted display (HMD) may be configured to track the gaze axis of an eye of the wearer. In particular, the device may be configured to observe movement of a wearer's pupil and, based on the movement, determine inputs to a user interface. For example, using eye gaze detection, the HMD may change a tracking rate of a displayed virtual image based on where the user is looking. Gazing at the center of the HMD field of view may, for instance, allow for fine movements of the virtual display. Gazing near an edge of the HMD field of view may provide coarser movements.

Abstract: A search method includes steps of: receiving information required to render a first map of a geographical area on a touch screen display; delivering the map for presentation on a first visual area rendered on the touch screen display; receiving from a user of the touch screen display a selection of a target search area within the geographical area, wherein the user desires to restrict a search for items of interest to said target search area, wherein said selection of the target search area is produced by the user drawing a shape encompassing at least a portion of the target search area over the first map presented on the touch screen display.