Abstract: An artificial intelligence (“AI”)-based system is disclosed for utilizing a schema to auto-generate an application for a specific context. An AI engine selects an activity schema associated with an activity. The schema identifies data sources for obtaining activity-specific content for the activity and can be selected based upon topics associated with the activity. The AI engine also selects a view definition that defines an arrangement of an activity-specific user interface (“UT”) for presenting relevant activity-specific content obtained from the data sources identified by the schema. An application is then generated using the schema and the view definition. The application can generate the activity-specific UT for presenting the relevant activity-specific content.

Abstract: An artificial intelligence (“AI”) engine generates an activity graph that includes nodes corresponding to activities and that defines clusters of content associated with the activities. A natural language (“NL”) search engine can receive a NL query and parse the NL query to identify entities and intents specified by the NL query. Clusters of content defined by the activity graph can be identified based upon the identified entities and intents. A search can then be made of the identified clusters of content using the entities and intents. Search results identifying the content located by the search can then be returned in response to the NL query.

Abstract: A storage machine holds instructions executable by a logic machine to receive a digital representation of a spoken command. The digital representation is provided to a speech recognizer trained with a user-specific grammar library. The logic machine then receives from the speech recognizer a confidence rating for each of a plurality of different media items. The confidence rating indicates the likelihood that the media item is named in the spoken command. The logic machine then automatically plays back the media item with a greatest confidence rating.

Abstract: Prioritized and categorized presentation of incoming communications is provided based on characteristics of the communications such as sender, recipients, subject, body content, recipient's past interactions, and similar ones. User or administrator defined explicit rules and configurations may be taken into consideration along with analysis results of incoming communication attributes and user history in determining a category and a priority level for the incoming communication. The incoming communication may then be presented according to the determined category and priority level along with tools for the recipient to modify automatic determinations and otherwise interact with the communication.

Abstract: Navigation of multiple information item hierarchies within a same application display pane or view is provided. Information items may be displayed in a customized collection of information items, for example, a “favorites” collection, that may be assembled from a variety of content sources and that may be persisted across a variety of information item views.

Abstract: Spatial organization of communications is provided. A communication application initiates operations to present a visual representation of a communication on a two-dimensional canvas after a detected intent to do as such. In response to the intent, the visual representation is generated and displayed on the two-dimensional canvas. A detected interaction with the visual representation triggers a modification of the communication based on the interaction.

Abstract: Navigation of multiple information item hierarchies within a same application display pane or view is provided. Information items may be displayed in a customized collection of information items, for example, a “favorites” collection, that may be assembled from a variety of content sources and that may be persisted across a variety of information item views.

Abstract: Systems, methods, and software are disclosed herein to launch embedded extensions in the context of an e-mail application. In an implementation, a user may interact with an e-mail application. An e-mail message is received into an inbox of the e-mail application. The e-mail message may include an embedded extension. The user opens the e-mail, including the embedded extension, for viewing. While viewing the e-mail message, the user clicks on the embedded extension, which launches the embedded extension within the context of the e-mail application.

Abstract: Aspects of the present disclosure relate to systems and methods for integrating first class objects with email messages in an email inbox of an email client. In one example, a request is sent via the email client for first class object data to one or more data sources, where each data source of the one or more data sources includes first class object data of a different first class object type. The first class object data may be received at the email client from the one or more data sources. One or more first class objects may be created from the first class object data for injecting into an email inbox of the email client. The email inbox including at least some of the one or more first class objects and a plurality of email messages may be rendered in a user interface to the email client.

Abstract: Methods and systems for generating suggested calendar events within an electronic calendar. One system includes an electronic processor configured to access a plurality of data records associated with a user and generate and output an electronic calendar of the user, the electronic calendar including a representation of at least one of the plurality of calendar events. The electronic processor is also configured to determine a suggested calendar event for the user and generate and output a representation of the suggested calendar event within the electronic calendar. The electronic processor is also configured to, in response to the user accepting the suggested calendar event, add a data record for the suggested calendar event to the plurality of data records associated with the user and generate and output an updated version of the electronic calendar of the user based on the plurality of data records.

Abstract: A music service remote from a local device user identifies matching video and music content. An identification of a piece of media content that is part of a collection or playlist, is received by the service, the selected piece of media content being included in a unified catalog of video and music content that is accessible by the music service. If the selected piece of media content has a matching member in the unified catalog, the matching member replaces the selected piece of media content during playback of the collection on the local device. The service analyzes a collection of media content associated with the user, the content collection being either i) stored locally on the local device, or ii) stored remotely from the local device in a store that is accessible by the music service, or iii) stored using a combination of local and remote storage.

Abstract: A glanceable, interactive user interface for displaying prioritized relevant information is provided. User interaction efficiency is improved by prioritizing and providing relevant information to a user arranged in an abbreviated format for glanceable viewing. The user is enabled to glance at the display and quickly ascertain such information as: a current time, day, and date; upcoming events and meetings as they relate to the current time; incoming communications; and weather associated with a particular location. Additional details associated with the one or more prioritized information items can be displayed. When a user interacts with a displayed information item, the user interface is updated to display additional details. Through minimal user interaction, the user is enabled to receive on-demand progressive disclosure of additional details of selected information items.

Abstract: A launching mechanism for context based menus is provided. A launcher indicator may be provided at a fixed or dynamic location on a user interface enabling a user to activate a context based menu through a variety of touch or gesture actions, as well as keyboard, mouse, or similar device inputs, directly related to the indicator or through inference from an action on the displayed content such as selection of a portion of the content. The launcher indicator may provide contextual information such as a type of available context based menu and appear/disappear in an animated fashion. Location of the indicator may also be dynamically adjusted based on selected content, user action location (i.e., location of a touch), available display area, and so on. Upon activation of the menu, the launcher indicator may disappear or be displayed at a center of the context based menu.

Abstract: Task oriented organization of communications is provided. A communication application initiates operations to organize communications in response to received communications. The communications are analyzed to parse a shared task information. A communication is created from the communications automatically based on a shared task or manually based on a user input. The communication group integrates the shared task information. Next, the communication group is presented with the shared task information.

Abstract: Spatial organization of communications is provided. A communication application initiates operations to present a visual representation of a communication on a two-dimensional canvas after a detected intent to do as such. In response to the intent, the visual representation is generated and displayed on the two-dimensional canvas. A detected interaction with the visual representation triggers a modification of the communication based on the interaction.

Abstract: Organization of communications on a timeline is provided. A communication application initiates operations to organize the communication on the timeline by analyzing communications to identify a group of the communications associated with a current date. The group of the communications share common attributes such as a topic, a subject, a participant or a stakeholder. A today visualization is created from the group of the communications. Furthermore, the today visualization is presented before other communications on the timeline.

Abstract: Technologies are described related to communication interfaces for wearable devices. User experience with wearable devices may be enhanced through tailored views for communications, calendar items, actions associated with those, where the views and presentations may be dynamically selected and adjusted based on context, user, location, and device capabilities. Smart notifications and user-friendly note taking, functionality may be enabled also based on context, user, location, and device capabilities. Other scenarios may be unlocked based on proximity and/or sensor data.

Abstract: Prioritized and categorized presentation of incoming communications is provided based on characteristics of the communications such as sender, recipients, subject, body content, recipient's past interactions, and similar ones. User or administrator defined explicit rules and configurations may be taken into consideration along with analysis results of incoming communication attributes and user history in determining a category and a priority level for the incoming communication. The incoming communication may then be presented according to the determined category and priority level along with tools for the recipient to modify automatic determinations and otherwise interact with the communication.

Abstract: Context based menus that can be dynamically positioned, laid out, and activated are provided for tap, swipe, and press-and-hold type interactions. Presenting a plurality of executable commands and/or links to submenus, a context based menu may be displayed in various shapes and forms in relation to selected content displayed on a user interface and/or other factors such as available display space, user attributes, and similar ones. Submenus presenting commands within a category may be displayed in place of, adjacent to, or overlapping with a parent context based menu. Menu position, contents, and/or shape may be adjusted in response to changes in selected content, user contact location, changes in user interface, and the like.

Abstract: A music service remote from a local device user identifies matching video and music content. An identification of a piece of media content that is part of a collection or playlist, is received by the service, the selected piece of media content being included in a unified catalog of video and music content that is accessible by the music service. If the selected piece of media content has a matching member in the unified catalog, the matching member replaces the selected piece of media content during playback of the collection on the local device. The service analyzes a collection of media content associated with the user, the content collection being either i) stored locally on the local device, or ii) stored remotely from the local device in a store that is accessible by the music service, or iii) stored using a combination of local and remote storage.