Abstract: A method performed by a remote-control unit (RCU) of managing a content transfer to or from integrated output devices (IODs) in a physical room is disclosed. The content transfer involves moving application context of a computer application with which a user can interact, which includes a computer object being operated on and relevant metadata. The RCU is programmed to recognize simple user instructions for the content transfer and perform the content transfer from a source device to a target device in real time, regardless of data transfer protocols specific to computer applications. Specifically, the RCU is programmed to obtain source data from the source device, generate updated source data by combining the source data with one or more commands specifying how the source data is to be handled based on a session mode indicating a type of activity being performed in the physical room, and transmit the updated source data to the target device for further user interaction.

Abstract: A component management server computer (“server”) and processing methods are disclosed. In some embodiments, the server is programmed to continuously receive input data regarding what is happening in the physical room from one or more input devices. The server is programmed to then detect an utterance of a spoken word from the input data and generate one or more sound metrics based on the input data. Based on the sound metrics as applied to certain criteria, the server is programmed to activate a component, such as an input device, variable, software system, or output device, and cause one or more output devices to execute an action that alerts a user of the activated component. The server can also be programmed to turn on, off, up, or down any of the components based on the activated component.

Abstract: A method of customizing contextual controls of a remote-control unit (RCU) having a plurality of user interface elements is disclosed. A processor within the RCU receives context information from an integrated output device that includes an output mechanism, the context information being related to an active application being run on the integrated output device and an active object being presented by the active application. The processor determines a set of actions that can be performed on the active object within the active application. The processor dynamically maps actions to user interface elements of the RCU based on the context information. The processor receives a selection of a user interface element and sends a request from the RCU to the integrated output device specifying an action mapped to the user interface element to be performed on the active object and the active application.

Abstract: A method comprises receiving from an input device, a capture of user action as an initial command; interpreting the initial command into an interpreted command; generating a first set of modified commands that are based on the interpreted command, including: a first modified command that has a phonetic similarity to the interpreted command within a certain threshold, and a second modified command that is semantically related to an earlier command; transmitting, to an output device, the first set of modified commands; receiving a response to a group of commands including the first set of modified commands; recording an identifier of an input device from which the response was received and a type of the response in a log; when the response includes acknowledging a specific command of the group of commands as an accepted command, executing, the accepted command; otherwise, generating a second set of modified commands.

Abstract: A data management server computer (“server”) is disclosed. The server receives action data associated with one or more users identifying a plurality of actions performed through one or more computer devices in a multi-modal networked environment, identifies useful sequences of actions as compound actions, and generates deep links representing the compound actions as UI elements which when invoked cause execution of the represented compound actions.

Abstract: Interpretation of user commands is accelerated through digital user interfaces of various modalities, including generation and presentation of command modifications for rapid correction of incomplete or erroneous user commands. An embodiment detects whether the interpreted command is accurate and, if inaccurate, precisely what was the intended command or, at least, what suggested modification to the interpreted command would be sufficient to match the intent of the user. Disambiguation occurs that entails multiple recommendation generators proposing modified commands that may more accurately reflect the intent of the user. The user may provide a response that is either a confirmation of which one of several modified commands that were automatically proposed does the user intend or a correction that computer device may use to filter or replace currently offered modified commands to generate improved modified commands.

Abstract: A device management server computer (“server”) and processing methods are disclosed. In some embodiments, the server is programmed to manage a plurality of input devices and output devices in a physical room. The server is programmed to analyze media data capturing actions performed by a user in real time as a participant in the physical room, determine how the user would like to connect at least one of the input devices and one of the output devices from the analysis, and enable the connection. The sever is programmed to interpret the actions and derive commands for connecting two or more devices based on predetermined data regarding the input devices and output devices and rules for referring to and connecting these devices.