Abstract: Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Abstract: Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Abstract: Approaches are described for managing the capture and/or presentation of images, such as panorama images. An electronic device can be used to “paint” the scene desired to be captured, where the device can be panned horizontally or vertically, or both, to capture images of a much larger area than the field of view of the camera. The overlap between adjacent images can be determined image-by-image and visual or other cues can be provided to assist a user controlling the device to pan the device in a particular manner to ensure an appropriate amount of overlap between captured images. Further, the user can be presented the entire panorama image being captured at the highest scale possible by filling the display element of the device with the image and dynamically scaling down the image as the user continues to add to the panorama image.

Abstract: Approaches are described for managing the capture and/or presentation of images, such as panorama images. An electronic device can be used to “paint” the scene desired to be captured, where the device can be panned horizontally or vertically, or both, to capture images of a much larger area than the field of view of the camera. The overlap between adjacent images can be determined image-by-image and visual or other cues can be provided to assist a user controlling the device to pan the device in a particular manner to ensure an appropriate amount of overlap between captured images. Further, the user can be presented the entire panorama image being captured at the highest scale possible by filling the display element of the device with the image and dynamically scaling down the image as the user continues to add to the panorama image.

Abstract: A computing device can utilize a recognition mode wherein an interface utilizes graphical elements, such as virtual fireflies or other such elements, to indicate objects that are recognized or identified. As objects are recognized, fireflies perform one or more specified actions to indicate recognition. A ribbon or other user-selectable icon is displayed indicates a specific action that the device can perform with respect to the respective object. As additional objects are recognized, additional ribbons are created and older ribbons can be moved off screen and stored for subsequent retrieval or search. The fireflies disperse when the objects are no longer represented in captured sensor data, and can be animated to move towards representations of new objects as features of those objects are identified as potential object features, in order to communicate a level of recognition for a current scene or environment.

Abstract: A computing device can include a recognition mode interface utilizing graphical elements, such as virtual fireflies, to indicate recognized or identified objects. The fireflies can be animated to move across a display, and the fireflies can create bounding boxes around visual representations of objects as the objects are recognized. In some cases, the object might be of a type that has specific meaning or information to be conveyed to a user. In such cases, the fireflies might be displayed with a particular size, shape, or color to convey that information. The fireflies also can be configured to form shapes or patterns in order to convey other types of information to a user, such as where audio is being recognized, light is sufficient for image capture, and the like. Other types of information can be conveyed as well via altering characteristics of the fireflies.

Abstract: A computing device can utilize a recognition mode wherein an interface utilizes graphical elements, such as virtual fireflies, to indicate recognized or identified objects. Fireflies can be displayed near an input element to indicate that a recognition mode is available. When a user selects the input element, the fireflies can appear to emanate from the input element and disperse across the display screen. As objects are recognized, fireflies can create bounding boxes around those objects, or otherwise appear proximate those objects, to indicate recognition. The fireflies can again disperse as the objects fall out of view, and can begin moving towards new objects as features of those objects are identified as potential object features. A subsequent selection of the input element to exit recognition mode can cause the fireflies to appear to retreat to their original location in, or near, the input element.

Abstract: A computing device can be controlled based on changes in the angle of a user's head with respect to the device, such as due to the user tilting the device and/or the user tilting his head with respect to the device. Such control based on the angle of the user's head can be achieved even when the user is operating the device “off-axis” or when the device is not orthogonal and/or not centered with respect to the user. This can be accomplished by using an elastic reference point that dynamically adjusts to a detected angle of the user's head with respect to the device. Such an approach can account for differences between when the user is changing his natural resting position and/or the resting position of the device and when the user is intending to perform a gesture based on the angle of the user's head relative to the device.