Abstract: A collaboration system provides a collaboration interface for display to interacting users. The collaboration system analyzes messages among a group of users to determine an intent of the group to collaborate. When an intent is assigned to a set of messages, the collaboration system generates collaboration interfaces to prompt each of the users to select their preferred values for attributes of the collaboration, such as a meeting location, time, and date. The user selections are recorded in a collaboration data object which is monitored for matching selections. When multiple users have selection the same values for attributes of the collaboration the collaboration data object is locked from further changes and the collaboration system executes tasks to resolve the intent such as booking tickets, making reservations, and providing confirmation messages to the collaborating users.

Abstract: Disclosed is a system for determining sequences of operations that will automatically execute one or more tasks specified by a user. In some embodiments, the sequences of operations are based on operations that have been previously performed by users and recorded by the system. The system interprets an intention of a user based on analysis of terms used by the user to indicate a request. The system generates a sequence of operations, executable by an operating system associated with a client device that will perform one or more tasks specified or implied by the request of the user.

Abstract: A morphing interface system updates, that is, morphs a display on a client device as a user provides portions of input and additionally provides suggested selections for a user based on the received user input. The system receives a first portion of user input and generates intent suggestions for the user based on the user input. The intent suggestions, which represent predicted likely intents of the user, are provided to the user for selection. The user may select an intent suggestion or may provide additional user input. Based on the user response, the system determines whether an intent is selected or if additional information is needed. When an intent is selected, the interface morphs into an interface to provide predicted entity suggestions for the user to select entity values as inputs to execution of the intent.

Abstract: A collaboration system provides a collaboration interface for display to interacting users. The collaboration system analyzes messages among a group of users to determine an intent of the group to collaborate. When an intent is assigned to a set of messages, the collaboration system generates collaboration interfaces to prompt each of the users to select their preferred values for attributes of the collaboration, such as a meeting location, time, and date. The user selections are recorded in a collaboration data object which is monitored for matching selections. When multiple users have selection the same values for attributes of the collaboration the collaboration data object is locked from further changes and the collaboration system executes tasks to resolve the intent such as booking tickets, making reservations, and providing confirmation messages to the collaborating users.

Abstract: A morphing interface system updates, that is, morphs, a display on a client device as a user provides portions of input. The system receives a first portion of user input and selects an intent related to a predicted intent of the user that matches or can be associated with the portion of user input. The system displays an interface associated with the intent at the client device. The system additionally extracts entity values associated with execution of the intent from the first portion of the user input. As the user provides additional portions of input, the morphing interface system reevaluates the user input and determines whether the user input still indicates the same user intent, and thus the same intent for execution. Upon determining that the additional input indicates a different user intent, the system updates the display to show an interface associated with the new intent.

Abstract: Disclosed is a system for automatically executing multiple functional units of operation from multiple applications to complete a task that requires data from a variety of sources. The system stores information about operations that may be executed on a client device. When executing a sequence of operations, for example in response to a user request, the system may automatically store output from each operation. When executing subsequent operations in the sequence of operations, the system can determine whether output from a previously executed operation is appropriate for use as input to a new operation. The system can thus save data from one application and automatically use that data as input to a different application. Additionally, the system may determine subsequent operations to execute in response to previously observed output values.

Abstract: Disclosed is a system for recording and storing sequences of operations that may be performed on a client device. During a training phase, the system collects information about operations performed by a user or by an automatic application crawling program. Information about operations may include view-structure data about components of a user interface and event data about interactions the user has with the interface components and the outcome of such interactions. The operation data is stored in an operation graph that may represent how specific user interactions with interface components can cause transitions to new view-structures of the same or different applications on the client device. The data stored in the operation graph may be used to construct new sequences of operations for later execution, for example, in response to a user query.

Abstract: Disclosed is a system for collecting information about operations performed on a client device and storing the operation information. Operations are combinations of view-structures and events that occur as a user interacts with applications on a client device. A view-structure may be a data structure including information about interface elements of a software application and information about content stored within the interface elements. An event may be an action performed with respect to an interface element, or another type of input to the system. The system receives information about events that occur on a client device and provides a channel of communication between an operation mimicry system and an operating system of the client device such that the operation mimicry system can store data about executed operations.

Abstract: Disclosed is a system for automatically executing multiple functional units of operation from multiple applications to complete a task that requires data from a variety of sources. The system stores information about operations that may be executed on a client device. When executing a sequence of operations, for example in response to a user request, the system may automatically store output from each operation. When executing subsequent operations in the sequence of operations, the system can determine whether output from a previously executed operation is appropriate for use as input to a new operation. The system can thus save data from one application and automatically use that data as input to a different application. Additionally, the system may determine subsequent operations to execute in response to previously observed output values.