Abstract: Techniques and architectures may be used to provide an environment for a speech-based intelligent user assistant (IUA) having a flexible operating system that is based, at least in part, on the context of interaction of a user of a computing system with the computing system. Such a flexible operating system may allow for non-obtrusive communication of the IUA with the user. Thus, for example, a user may communicate with the IUA without interrupting their other activities on the computer, such as playing a video game.

Abstract: Techniques and architectures may be used to provide an environment for a speech-based intelligent user assistant (IUA) having a flexible operating system that is based, at least in part, on the context of interaction of a user of a computing system with the computing system. Such a flexible operating system may allow for non-obtrusive communication of the IUA with the user. Thus, for example, a user may communicate with the IUA without interrupting their other activities on the computer, such as playing a video game.

Abstract: Systems, methods, and computer media for generating and invoking voice-triggered macros are disclosed herein. A buffer is configured to receive sensor data for one or more sensors. The sensor data reflects user actions. A macro generator is configured to receive a command to initiate creation of a voice-triggered macro and determine macro actions for inclusion in the voice-triggered macro based on the sensor data in the buffer. The macro generator is also configured to assign a speech key to the voice-triggered macro. When audio input is determined to match the speech key of the voice-triggered macro, the macro actions are performed.

Abstract: A method and apparatus are disclosed for combining server-supplied user interface elements with client-supplied user interface elements. The server-supplied user interface elements can be received by a client device and inserted into a client-supplied object model, such as a Document Object Model (DOM). The object model can then be used to render a page, such as a webpage. By injecting server-supplied user interface elements into a client object model, the client can intelligently combine UI elements from a server with UI elements from a client. In the situation where there are conflicting or overlapping UI elements, the client device can modify the object model to eliminate such conflicts or overlaps.

Abstract: A method and apparatus are disclosed for combining server-supplied user interface elements with client-supplied user interface elements. The server-supplied user interface elements can be received by a client device and inserted into a client-supplied object model, such as a Document Object Model (DOM). The object model can then be used to render a page, such as a webpage. By injecting server-supplied user interface elements into a client object model, the client can intelligently combine UI elements from a server with UI elements from a client. In the situation where there are conflicting or overlapping UI elements, the client device can modify the object model to eliminate such conflicts or overlaps.

Abstract: Systems, methods, and computer media for generating and invoking voice-triggered macros are disclosed herein. A buffer is configured to receive sensor data for one or more sensors. The sensor data reflects user actions. A macro generator is configured to receive a command to initiate creation of a voice-triggered macro and determine macro actions for inclusion in the voice-triggered macro based on the sensor data in the buffer. The macro generator is also configured to assign a speech key to the voice-triggered macro. When audio input is determined to match the speech key of the voice-triggered macro, the macro actions are performed.

Abstract: A secure communication method between a web compartment and a client application can allow network updates to be used for a client application. For example, a secure communication method can allow predefined operations to be carried out on a client machine. An example web compartment can include an iframe tag and the communication can be a string command, such as by using a postmessage API. Such a structure allows some user interface elements to be supplied from a client device and other user interface elements to be supplied a server computer.

Abstract: A method and apparatus are disclosed for combining server-supplied user interface elements with client-supplied user interface elements. The server-supplied user interface elements can be received by a client device and inserted into a client-supplied object model, such as a Document Object Model (DOM). The object model can then be used to render a page, such as a webpage. By injecting server-supplied user interface elements into a client object model, the client can intelligently combine UI elements from a server with UI elements from a client. In the situation where there are conflicting or overlapping UI elements, the client device can modify the object model to eliminate such conflicts or overlaps.

Abstract: A method and apparatus are disclosed for combining server-supplied user interface elements with client-supplied user interface elements. The server-supplied user interface elements can be received by a client device and inserted into a client-supplied object model, such as a Document Object Model (DOM). The object model can then be used to render a page, such as a webpage. By injecting server-supplied user interface elements into a client object model, the client can intelligently combine UI elements from a server with UI elements from a client. In the situation where there are conflicting or overlapping UI elements, the client device can modify the object model to eliminate such conflicts or overlaps.

Abstract: A method and apparatus are disclosed for combining server-supplied user interface elements with client-supplied user interface elements. The server-supplied user interface elements can be received by a client device and inserted into a client-supplied object model, such as a Document Object Model (DOM). The object model can then be used to render a page, such as a webpage. By injecting server-supplied user interface elements into a client object model, the client can intelligently combine UI elements from a server with UI elements from a client. In the situation where there are conflicting or overlapping UI elements, the client device can modify the object model to eliminate such conflicts or overlaps.

Abstract: A secure communication method between a web compartment and a client application can allow network updates to be used for a client application. For example, a secure communication method can allow predefined operations to be carried out on a client machine. An example web compartment can include an iframe tag and the communication can be a string command, such as by using a postmessage API. Such a structure allows some user interface elements to be supplied from a client device and other user interface elements to be supplied a server computer.