Abstract: Systems, methods, and computer-readable media are disclosed for systems and methods for device agnostic user interface generation. Example methods include receiving a request for content from a device, determining first data representing a first device characteristic of the device, and determining an intended viewing distance value associated with the first data. Some methods include determining, using the intended viewing distance value, a first value for the device, the first value representing a baseline density-independent number of pixels, determining first content using the first value, and sending the first content to the device, where the first content is to be rendered at the device.

Abstract: Systems and methods for presenting a user interface in a first mode and a second mode based on detection of a touch gesture is described herein. In some embodiments, a first user interface may be presented on an electronic device's display. The first user interface may include a list of items, which may be formatted such that they are optimally viewable from a first distance away from the display. In response to detecting a touch gesture, such as a scrolling gesture, a second user interface may be presented including the list of items, which may be formatted such that they are optimally viewed from a second distance. For example, the first user interface may be optimally viewable from a distance of approximately seven to ten feet from the display. As another example, the second user interface may optimally viewable from a distance of approximately one to three feet.

Abstract: Methods and devices for determining whether a local version of content is stored on an electronic device associated with a user account on a backend system are described herein. In a non-limiting embodiment, the backend system may track and monitor the content stored on the electronic device using the associated user account. If an individual speaks an utterance requesting a particular content item, the backend system may determine, prior to sending the content to the electronic device, whether a local version is stored within the electronic device's memory. If so, the backend system may instruct the electronic device to output the local version, thereby reducing the amount of bandwidth consumed. The backend system may further be capable of predictively generating and then caching certain audio data to the electronic device.

Abstract: Systems, methods, and computer-readable media are disclosed for systems and methods for dynamic user interface type selection. Example methods include receiving a request for content from a first device, determining first data representing a first device input type at the first device, determining an intended viewing distance value associated with the first device input type, and determining, using the intended viewing distance value, a first value for the first device, the first value representing a baseline density-independent number of pixels. Methods may include determining first content using the first value, and sending the first content to the first device, wherein the first content is to be rendered at the first device.

Abstract: Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Abstract: Approaches enable three-dimensional (3D) display and interaction with interfaces (such as a webpage, an application, etc.) when the device is operating in a 3D view mode. For example, interface elements can be highlighted, emphasized, animated, or otherwise altered in appearance, and/or arrangement in the renderings of those interfaces based at least in part on an orientation of the device or a position of a user using the device. Further, the 3D view mode can provide for an animated 3D departure and appearance of elements as the device navigates from a current page to a new page. Further still, approaches provide for the ability to specify 3D attributes (such as the appearance, action, etc.) of the interface elements. In this way, a developer of such interfaces can use information (e.g., tags, CSS, JavaScript, etc.) to specify a 3D appearance change to be applied to at least one interface element when the 3D view mode is activated.

Abstract: Devices, systems and methods are disclosed for emphasizing particular text in reflowable content. Primary text, such as keywords or sentences related to a most recent input, and secondary text, such as row(s) of text including the keywords and/or sentences, are determined. The primary text may be emphasized using a first effect and the secondary text may be emphasized using a second effect, while an opacity of non-emphasized text may be reduced. Content is displayed initially with the first effect, the second effect and the reduced opacity, and an animation sequence removes the first effect and the second effect and increases the opacity in intervals until the content is displayed uniformly. Thus content that is of interest to a reader (such as a previous reading location) may be emphasized when a screen refreshes with reflowed content.

Abstract: A dock device connects participating devices such as a tablet device and an audio activated device, allowing them to operate as a single device. These participating devices may be associated with different accounts, each account being associated with particular “speechlets” or data processing functions. A natural language understanding (NLU) system uses NLU models to process text obtained from an automatic speech recognition (ASR) system to determine a set of possible intents. A second set of possible intents may then be generated that is limited to those possible intents that correspond to the speechlets associated with the docked device. The intents within the second set of possible intents are ranked, and the highest ranked intent may be deemed to be the intent of the user. Command data corresponding to the highest ranked intent may be generated and used to perform the action associated with that intent.

Abstract: A system that generates a personalized content grouped by type and ordered by relevancy. The system determines relevant data for individual feature groups, determines first feature groups that have relevant data to display and displays a page of content for each of the first feature groups. For example, a first page of content may indicate a clock, temperature, weather forecast or timer, a second page of content may correspond to communications and indicate a recent message, a third page of content may correspond to a calendar and may indicate an upcoming event, a fourth page of content may correspond to shipping notifications and may indicate an upcoming shipment, a fifth page of content may correspond to contacts and may indicate an available favorite contact and a sixth page of content may correspond to trending news. The device may generate synthesized speech corresponding to the display of content.

Abstract: Systems and methods for displaying an audio indicator including a main portion having a width proportional to a volume of a particular phoneme of an utterance is described herein. In some embodiments, audio data representing an utterance may be received at a speech-processing system from a user device. The speech-processing system may determine a maximum volume amplitude for the utterance, and using the maximum volume amplitude, may determine a normalized amplitude value between 0 and 1 associated with a volume that phoneme's of an utterance are spoken. The speech-processing system may then map the normalized amplitude value(s) to widths for a main portion of an audio indicator, where larger normalized amplitude values may correspond to smaller main portion widths.

Abstract: Approaches enable three-dimensional (3D) display and interaction with interfaces (such as a webpage, an application, etc.) when the device is operating in a 3D view mode. For example, interface elements can be highlighted, emphasized, animated, or otherwise altered in appearance, and/or arrangement in the renderings of those interfaces based at least in part on an orientation of the device or a position of a user using the device. Further, the 3D view mode can provide for an animated 3D departure and appearance of elements as the device navigates from a current page to a new page. Further still, approaches provide for the ability to specify 3D attributes (such as the appearance, action, etc.) of the interface elements. In this way, a developer of such interfaces can use information (e.g., tags, CSS, JavaScript, etc.) to specify a 3D appearance change to be applied to at least one interface element when the 3D view mode is activated.

Abstract: Approaches enable three-dimensional (3D) display and interaction with interfaces (such as a webpage, an application, etc.) when the device is operating in a 3D view mode. For example, interface elements can be highlighted, emphasized, animated, or otherwise altered in appearance, and/or arrangement in the renderings of those interfaces based at least in part on an orientation of the device or a position of a user using the device. Further, the 3D view mode can provide for an animated 3D departure and appearance of elements as the device navigates from a current page to a new page. Further still, approaches provide for the ability to specify 3D attributes (such as the appearance, action, etc.) of the interface elements. In this way, a developer of such interfaces can use information (e.g., tags, CSS, JavaScript, etc.) to specify a 3D appearance change to be applied to at least one interface element when the 3D view mode is activated.

Abstract: Systems and methods for presenting a user interface in a first mode and a second mode based on detection of a touch gesture is described herein. In some embodiments, a first user interface may be presented on an electronic device's display. The first user interface may include a list of items, which may be formatted such that they are optimally viewable from a first distance away from the display. In response to detecting a touch gesture, such as a scrolling gesture, a second user interface may be presented including the list of items, which may be formatted such that they are optimally viewed from a second distance. For example, the first user interface may be optimally viewable from a distance of approximately seven to ten feet from the display. As another example, the second user interface may optimally viewable from a distance of approximately one to three feet.

Abstract: Methods and devices for determining whether a local version of content is stored on an electronic device associated with a user account on a backend system are described herein. In a non-limiting embodiment, the backend system may track and monitor the content stored on the electronic device using the associated user account. If an individual speaks an utterance requesting a particular content item, the backend system may determine, prior to sending the content to the electronic device, whether a local version is stored within the electronic device's memory. If so, the backend system may instruct the electronic device to output the local version, thereby reducing the amount of bandwidth consumed. The backend system may further be capable of predictively generating and then caching certain audio data to the electronic device.

Abstract: A computing device can utilize a recognition mode wherein an interface utilizes graphical elements, such as virtual fireflies or other such elements, to indicate objects that are recognized or identified. As objects are recognized, fireflies perform one or more specified actions to indicate recognition. A ribbon or other user-selectable icon is displayed indicates a specific action that the device can perform with respect to the respective object. As additional objects are recognized, additional ribbons are created and older ribbons can be moved off screen and stored for subsequent retrieval or search. The fireflies disperse when the objects are no longer represented in captured sensor data, and can be animated to move towards representations of new objects as features of those objects are identified as potential object features, in order to communicate a level of recognition for a current scene or environment.

Abstract: A computing device can include a recognition mode interface utilizing graphical elements, such as virtual fireflies, to indicate recognized or identified objects. The fireflies can be animated to move across a display, and the fireflies can create bounding boxes around visual representations of objects as the objects are recognized. In some cases, the object might be of a type that has specific meaning or information to be conveyed to a user. In such cases, the fireflies might be displayed with a particular size, shape, or color to convey that information. The fireflies also can be configured to form shapes or patterns in order to convey other types of information to a user, such as where audio is being recognized, light is sufficient for image capture, and the like. Other types of information can be conveyed as well via altering characteristics of the fireflies.

Abstract: A computing device can include a recognition mode interface utilizing graphical elements, such as virtual fireflies, to indicate recognized or identified objects. The fireflies can be animated to move across a display, and the fireflies can create bounding boxes around visual representations of objects as the objects are recognized. In some cases, the object might be of a type that has specific meaning or information to be conveyed to a user. In such cases, the fireflies might be displayed with a particular size, shape, or color to convey that information. The fireflies also can be configured to form shapes or patterns in order to convey other types of information to a user, such as where audio is being recognized, light is sufficient for image capture, and the like. Other types of information can be conveyed as well via altering characteristics of the fireflies.

Abstract: A set of application icons can be displayed on an interface (e.g., a home screen) of a computing device. The icons can include a center icon and at least one of a subset of application icons to the left or to the right of the center application icon. Displayed below the icons can be a portion of an application window. The application window can be associated with the center application icon and can display content associated with the center application icon. The user can utilize a fingertip or object to select an area of a display screen associated with the application window and the user can perform an input motion from the area to a region associated with the set of application icons to animate a departure of the icons and an expansion of the application window to display additional content. Further, the input motion can enable at least one additional function associated with the application window.

Abstract: Devices, systems and methods are disclosed for anchoring bookmarks to individual words for precise positioning within electronic documents. The bookmarks may be anchored based on user input selecting particular words, based on gaze tracking identifying most recently read words, or based on estimated reading speed. The bookmarks may be a link used to navigate within the document, may be used as an anchor for a new layout after content reflow or may be automatically saved when the e-reader turns off the display to provide the user with a most recently read passage. If a bookmark isn't anchored to specific words by the user, the device may anchor the bookmark to the beginning of a sentence or a paragraph including the recently read words determined using gaze tracking or estimated reading speed.

Abstract: A computing device can utilize a recognition mode wherein an interface utilizes graphical elements, such as virtual fireflies, to indicate recognized or identified objects. Fireflies can be displayed near an input element to indicate that a recognition mode is available. When a user selects the input element, the fireflies can appear to emanate from the input element and disperse across the display screen. As objects are recognized, fireflies can create bounding boxes around those objects, or otherwise appear proximate those objects, to indicate recognition. The fireflies can again disperse as the objects fall out of view, and can begin moving towards new objects as features of those objects are identified as potential object features. A subsequent selection of the input element to exit recognition mode can cause the fireflies to appear to retreat to their original location in, or near, the input element.