Abstract: Various embodiments discussed herein enable client applications to be heavily integrated with a voice assistant in order to perform commands associated with voice utterances of users via voice assistant functionality and also seamlessly cause client applications to automatically perform native functions as part of executing the voice utterance. Such heavy integration also allows particular embodiments to support multi-modal input from a user for a single conversational interaction. In this way, client application user interface interactions, such as clicks, touch gestures, or text inputs are executed alternative or in addition to the voice utterances.

Abstract: Various embodiments discussed herein enable client applications to be heavily integrated with a voice assistant in order to both perform commands associated with voice utterances of users via voice assistant functionality and also seamlessly cause client applications to automatically perform native functions as part of executing the voice utterance. For example, some embodiments can automatically and intelligently cause a switch to a page the user needs and automatically and intelligently cause a population of particular fields of the page the user needs based on a user view context and the voice utterance.

Abstract: Various embodiments discussed herein enable client applications to be heavily integrated with a voice assistant in order to both perform commands associated with voice utterances of users via voice assistant functionality and also seamlessly cause client applications to automatically perform native functions as part of executing the voice utterance. For example, some embodiments can automatically and intelligently cause a switch to a page the user needs and automatically and intelligently cause a population of particular fields of the page the user needs based on a user view context and the voice utterance.

Abstract: Various embodiments discussed herein enable client applications to be heavily integrated with a voice assistant in order to perform commands associated with voice utterances of users via voice assistant functionality and also seamlessly cause client applications to automatically perform native functions as part of executing the voice utterance. Such heavy integration also allows particular embodiments to support multi-modal input from a user for a single conversational interaction. In this way, client application user interface interactions, such as clicks, touch gestures, or text inputs are executed alternative or in addition to the voice utterances.

Abstract: Various embodiments discussed herein enable client applications to be heavily integrated with a voice assistant in order to both perform commands associated with voice utterances of users via voice assistant functionality and also seamlessly cause client applications to automatically perform native functions as part of executing the voice utterance. For example, some embodiments can automatically and intelligently cause a switch to a page the user needs and automatically and intelligently cause a population of particular fields of the page the user needs based on a user view context and the voice utterance.

Abstract: Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Abstract: Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Abstract: Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Abstract: Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Abstract: A system that generates a personalized content grouped by type and ordered by relevancy. The system determines relevant data for individual feature groups, determines first feature groups that have relevant data to display and displays a page of content for each of the first feature groups. For example, a first page of content may indicate a clock, temperature, weather forecast or timer, a second page of content may correspond to communications and indicate a recent message, a third page of content may correspond to a calendar and may indicate an upcoming event, a fourth page of content may correspond to shipping notifications and may indicate an upcoming shipment, a fifth page of content may correspond to contacts and may indicate an available favorite contact and a sixth page of content may correspond to trending news. The device may generate synthesized speech corresponding to the display of content.

Abstract: Systems and methods for displaying an audio indicator including a main portion having a width proportional to a volume of a particular phoneme of an utterance is described herein. In some embodiments, audio data representing an utterance may be received at a speech-processing system from a user device. The speech-processing system may determine a maximum volume amplitude for the utterance, and using the maximum volume amplitude, may determine a normalized amplitude value between 0 and 1 associated with a volume that phoneme's of an utterance are spoken. The speech-processing system may then map the normalized amplitude value(s) to widths for a main portion of an audio indicator, where larger normalized amplitude values may correspond to smaller main portion widths.

Abstract: Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Abstract: A computing device can utilize a recognition mode wherein an interface utilizes graphical elements, such as virtual fireflies or other such elements, to indicate objects that are recognized or identified. As objects are recognized, fireflies perform one or more specified actions to indicate recognition. A ribbon or other user-selectable icon is displayed indicates a specific action that the device can perform with respect to the respective object. As additional objects are recognized, additional ribbons are created and older ribbons can be moved off screen and stored for subsequent retrieval or search. The fireflies disperse when the objects are no longer represented in captured sensor data, and can be animated to move towards representations of new objects as features of those objects are identified as potential object features, in order to communicate a level of recognition for a current scene or environment.

Abstract: Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Abstract: Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

Abstract: A computing device can utilize a recognition mode wherein an interface utilizes graphical elements, such as virtual fireflies or other such elements, to indicate objects that are recognized or identified. As objects are recognized, fireflies perform one or more specified actions to indicate recognition. A ribbon or other user-selectable icon is displayed indicates a specific action that the device can perform with respect to the respective object. As additional objects are recognized, additional ribbons are created and older ribbons can be moved off screen and stored for subsequent retrieval or search. The fireflies disperse when the objects are no longer represented in captured sensor data, and can be animated to move towards representations of new objects as features of those objects are identified as potential object features, in order to communicate a level of recognition for a current scene or environment.

Abstract: Search results and associated search-result details are provided in response to user queries. Embodiments include identifying a number of search-result details for different indexed search results, identifying one or more detail-attributes for each search-result detail, and identifying one or more user-attributes for a particular user. These search results, associated search-result details, and associated detail-attributes may be stored in a database. Upon receiving a search query from the user, search results may be generated. Search-result details specific to each search result and specific to the end-user may also be generated by identifying the detail-attributes associated with each search-result detail and the user-attributes associated with the end-user. These search results may then be presented to the end-user. Upon receiving an indication of interest in a particular search result, the search result details may then be presented to the end user.

Abstract: Suggested search results are provided with suggested search queries as a user incrementally enters characters of a search query. At each incremental user input, a query portion is received and suggested search queries are identified based on the query portion. Suggested search results associated with the suggested search queries are also identified. These suggested search results enable direct navigation to web sites associated with the search results. In some embodiments, a user's search history is analyzed to identify search results selected by the user for the suggested search queries. In other embodiments, search histories for a group of users associated with the user are analyzed to identify the suggested search results to provide with the suggested search queries.

Abstract: Search results and associated search-result details are provided in response to user queries. Embodiments include identifying a number of search-result details for different indexed search results, identifying one or more detail-attributes for each search-result detail, and identifying one or more user-attributes for a particular user. These search results, associated search-result details, and associated detail-attributes may be stored in a database. Upon receiving a search query from the user, search results may be generated. Search-result details specific to each search result and specific to the end-user may also be generated by identifying the detail-attributes associated with each search-result detail and the user-attributes associated with the end-user. These search results may then be presented to the end-user. Upon receiving an indication of interest in a particular search result, the search result details may then be presented to the end user.

Abstract: Suggested search results are provided with suggested search queries as a user incrementally enters characters of a search query. At each incremental user input, a query portion is received and suggested search queries are identified based on the query portion. Suggested search results associated with the suggested search queries are also identified. These suggested search results enable direct navigation to web sites associated with the search results. In some embodiments, a user's search history is analyzed to identify search results selected by the user for the suggested search queries. In other embodiments, search histories for a group of users associated with the user are analyzed to identify the suggested search results to provide with the suggested search queries.