Abstract: Systems, methods, apparatuses, and computer program products are described for implementing a digital personal assistant. The digital personal assistant is capable of determining that a user has asked a question or made a statement that is intended to engage with a persona of the digital personal assistant. In response to determining that the user has asked such a question or made such a statement, the digital personal assistant provides a response thereto by displaying or playing back a multimedia object associated with a popular culture reference within or by a user interface of the digital personal assistant. Additionally or alternatively, in response to determining that the user has asked such a question or made such a statement, the digital personal assistant provides the response thereto by generating or playing back speech that comprises an impersonation of a voice of a person associated with the popular culture reference.

Abstract: A computer system provides an automated tool that processes audio data and data about computer operating context to automatically capture information, such as information from conversations and meetings. The computer operating context can include, for example, environmental data sensed, or other contextual information maintained or tracked, by the computer. The audio data and computer operating context are processed by the computer to detect starting conditions for data extraction. After detecting a starting condition, the processor initiates speech processing on the audio information to generate corresponding text data. The processor processes the text data using text filters that define salient patterns in the text data. Such salient patterns can correspond to, for example, tasks to be performed, follow-up appointments and other events, messages to be sent, important points or notes, and the like.

Abstract: A system is described that infers information about a user and then provides the user with an opportunity to provide input about (e.g., confirm or deny) the inferred information. Inferred information is presented to a user only after certain triggering events have occurred. For example, a sensitive item of inferred information may be presented to a user only after the user has reached a certain stage of relationship with a system, device or service that is deemed compatible with presenting such sensitive information. As another example, an item of inferred information may be presented to a user only after it has been determined that the item of inferred information is likely to be correct with a certain degree of confidence. As a still further example, both sensitivity and confidence level may be used to guide when a particular item of inferred information will be presented to a user.

Abstract: A computer system provides an automated tool that processes audio data and data about computer operating context to automatically capture information, such as information from conversations and meetings. The computer operating context can include, for example, environmental data sensed, or other contextual information maintained or tracked, by the computer. The audio data and computer operating context are processed by the computer to detect starting conditions for data extraction. After detecting a starting condition, the processor initiates speech processing on the audio information to generate corresponding text data. The processor processes the text data using text filters that define salient patterns in the text data. Such salient patterns can correspond to, for example, tasks to be performed, follow-up appointments and other events, messages to be sent, important points or notes, and the like.

Abstract: A computer-implemented technique is described herein that receives captured stroke information when a user enters a handwritten note using an input capture device. The technique then performs analysis on the stroke information to produce output analysis information. Based on the output analysis information, the technique then retrieves at least one supplemental information item that is associated with the captured stroke information. The technique then displays the supplemental information item on a canvas display device, together with the original captured stroke information. In effect, the supplemental information item annotates the captured stroke information with meaningful additional information that enhances the value of the captured stroke information.

Abstract: A computer-implemented technique is described herein that receives captured stroke information when a user enters handwritten notes using an input capture device. The technique then automatically performs analysis on the captured stroke information to produce output analysis information. Based on the output analysis information, the technique uses an assistant component to identify a response to the captured stroke information and/or to identify an action to be performed. The technique then presents the response, together with the original captured stroke information. In addition, or alternatively, the technique performs the action. In one case, the response is a text-based response; that text-based response may be presented in a freeform handwriting style to give the user the impression that a virtual assistant is responding to the user's own note. In another case, the response engages the user in an interactive exercise of any type.

Abstract: A computer system provides an automated tool that processes audio data and data about computer operating context to automatically capture information, such as information from conversations and meetings. The computer operating context can include, for example, environmental data sensed, or other contextual information maintained or tracked, by the computer. The audio data and computer operating context are processed by the computer to detect starting conditions for data extraction. After detecting a starting condition, the processor initiates speech processing on the audio information to generate corresponding text data. The processor processes the text data using text filters that define salient patterns in the text data. Such salient patterns can correspond to, for example, tasks to be performed, follow-up appointments and other events, messages to be sent, important points or notes, and the like.

Abstract: Systems, methods, apparatuses, and computer program products are described for implementing a digital personal assistant. The digital personal assistant is capable of determining that a user has asked a question or made a statement that is intended to engage with a persona of the digital personal assistant. In response to determining that the user has asked such a question or made such a statement, the digital personal assistant provides a response thereto by displaying or playing back a multimedia object associated with a popular culture reference within or by a user interface of the digital personal assistant. Additionally or alternatively, in response to determining that the user has asked such a question or made such a statement, the digital personal assistant provides the response thereto by generating or playing back speech that comprises an impersonation of a voice of a person associated with the popular culture reference.

Abstract: Techniques are described herein that are capable of providing a reactive digital personal assistant. A reactive digital assistant is a digital assistant that is capable of having a reaction. For instance, the reaction may be provided visually and/or audibly. The reaction may be specified by personal assistant logic on a device that provides the digital personal assistant, by an application on the device that communicates with the personal assistant logic, or by a Web service with which the application communicates. The personal assistant logic may retrieve media representation(s) that correspond to the reaction from a store on the device, or the application may retrieve the media representation(s) from the Web service. The personal assistant logic may notify the application of a status of the digital personal assistant once the media representation(s) are retrieved.

Abstract: A system is described that infers information about a user and then provides the user with an opportunity to provide input about (e.g., confirm or deny) the inferred information. Inferred information is presented to a user only after certain triggering events have occurred. For example, a sensitive item of inferred information may be presented to a user only after the user has reached a certain stage of relationship with a system, device or service that is deemed compatible with presenting such sensitive information. As another example, an item of inferred information may be presented to a user only after it has been determined that the item of inferred information is likely to be correct with a certain degree of confidence. As a still further example, both sensitivity and confidence level may be used to guide when a particular item of inferred information will be presented to a user.

Abstract: Methods, systems, and computer program products are provided that address issues related to data privacy by enabling users to elect various levels of data sharing. A user of a user device is enabled to indicate their comfort level with sharing, transmitting, or otherwise exposing individual activity records (data entities) with respect to various activity categories. The exposure of activity records may be controlled with respect to on-device and off-device components. Furthermore, privacy profiles may be automatically generated for the user, and the privacy profiles may be automatically activated in corresponding situations.

Abstract: An action uniform resource identifier (URI) is sent from a web service to a user device in response to a request from the user device. The action URI identifies at least one native task for execution by the user device. The task, when executed, interacts with at least one resource local to the user device. The received action URI is provided by the user device to an application to perform the task involving the local resource. The response may include hosted UI elements not available on the user device. The hosted UI elements enable presentation of new data types on the user device, which may not be adequately presented using pre-defined UI templates. The hosted UI elements interact with elements of the pre-defined UI templates to generate new UI layouts. The action URIs and hosted UI elements are provided and execute without replacing already-installed application code.

Abstract: A user interface is described that temporarily displays portions of a page that reside outside of the viewable area of the screen. An animated transition creates a brief preview of at least one user interface feature. Additionally, the user interface feature is then animated out of the viewable area in a way to suggest a location of the feature. In one embodiment, a target page that is being opened controls the transition and animates features into and out of the viewable area to create the temporary preview. In another embodiment, the target page includes user interface elements that can asynchronously control the preview animation independent from the main content of the target page. In yet another embodiment, a transition coordinator can coordinate the timing between animating out a foreground application while animating in a target application.

Abstract: A user can selectively customize what data is provided to a search engine to influence a degree of personalization of search results. Personalized search engine results can thereby be provided to one or more applications on a client device, such as a mobile phone. The data provided to the search engine can include any of a variety of user preferences stored on the client device (e.g., music, music ratings, search queries, search results selected, etc.), or other user information, such as current location or the location of the user when applications were downloaded. Social networking websites can also be used for supplying data to the search engine.

Abstract: A method and system are disclosed for displaying a user interface text element in an East-Asian mode so that system-based text can be displayed vertically on a user interface. In one embodiment, a device can dynamically switch between a Latin-based layout (horizontally displayed text elements) and an East-Asian based layout (vertically displayed text elements) based on global device settings, such as a language setting or a locale setting. Such settings can be dynamically modified by the user to change the display modes.

Abstract: A user interface is described that temporarily displays portions of a page that reside outside of the viewable area of the screen. An animated transition creates a brief preview of at least one user interface feature. Additionally, the user interface feature is then animated out of the viewable area in a way to suggest a location of the feature. In one embodiment, a target page that is being opened controls the transition and animates features into and out of the viewable area to create the temporary preview. In another embodiment, the target page includes user interface elements that can asynchronously control the preview animation independent from the main content of the target page. In yet another embodiment, a transition coordinator can coordinate the timing between animating out a foreground application while animating in a target application.

Abstract: The present invention facilitates customizing software installation such as software updates for a user interface (UI) of a mobile communication device. The systems and methods of the present invention utilize a component that receives software updates (e.g., releases, releases, patches, upgrades, etc.) and presents various installation options to an installer through an interface. The installer can interact with the interface to select one or more components (e.g., controls, menus, menu items, etc) to install and define how such components are installed. For example, the installer can determine a control's location with respect to other controls within a user interface. This can be achieved by moving graphical components within the user interface and/or by providing parameters, setting flags, and/or including suitable arguments. In addition, the installer can add components to an installation.