Abstract: A component management server computer (“server”) and processing methods are disclosed. In some embodiments, the server is programmed to continuously receive input data regarding what is happening in the physical room from one or more input devices. The server is programmed to then detect an utterance of a spoken word from the input data and generate one or more sound metrics based on the input data. Based on the sound metrics as applied to certain criteria, the server is programmed to activate a component, such as an input device, variable, software system, or output device, and cause one or more output devices to execute an action that alerts a user of the activated component. The server can also be programmed to turn on, off, up, or down any of the components based on the activated component.

Abstract: A method of customizing contextual controls of a remote-control unit (RCU) having a plurality of user interface elements is disclosed. A processor within the RCU receives context information from an integrated output device that includes an output mechanism, the context information being related to an active application being run on the integrated output device and an active object being presented by the active application. The processor determines a set of actions that can be performed on the active object within the active application. The processor dynamically maps actions to user interface elements of the RCU based on the context information. The processor receives a selection of a user interface element and sends a request from the RCU to the integrated output device specifying an action mapped to the user interface element to be performed on the active object and the active application.

Abstract: A method performed by a remote-control unit (RCU) of managing a content transfer to or from integrated output devices (IODs) in a physical room is disclosed. The content transfer involves moving application context of a computer application with which a user can interact, which includes a computer object being operated on and relevant metadata. The RCU is programmed to recognize simple user instructions for the content transfer and perform the content transfer from a source device to a target device in real time, regardless of data transfer protocols specific to computer applications. Specifically, the RCU is programmed to obtain source data from the source device, generate updated source data by combining the source data with one or more commands specifying how the source data is to be handled based on a session mode indicating a type of activity being performed in the physical room, and transmit the updated source data to the target device for further user interaction.

Abstract: A method of managing human-computer interaction using a remote-control unit (RCU) is disclosed. A processor within the RCU receives sensor data from a plurality of sensors within the RCU. The processor determines attributes of the RCU based on the sensor data, the attributes including at least a first user of the RCU and a position and orientation of the RCU in a physical room. The processor determines a use mode of the RCU based on the attributes. The use mode is mapped to a set of actions to be performed on a set of input/output (I/O) devices. Each action is mapped to one or more interactions with the RCU. Responsive to the processor detecting a user interaction with the RCU that is mapped to an action in the set of actions, the processor causes the action to be performed on one or more I/O devices.

Abstract: A method comprises receiving from an input device, a capture of user action as an initial command; interpreting the initial command into an interpreted command; generating a first set of modified commands that are based on the interpreted command, including: a first modified command that has a phonetic similarity to the interpreted command within a certain threshold, and a second modified command that is semantically related to an earlier command; transmitting, to an output device, the first set of modified commands; receiving a response to a group of commands including the first set of modified commands; recording an identifier of an input device from which the response was received and a type of the response in a log; when the response includes acknowledging a specific command of the group of commands as an accepted command, executing, the accepted command; otherwise, generating a second set of modified commands.

Abstract: A method of customizing contextual controls of a remote-control unit (RCU) having a plurality of user interface elements is disclosed. A processor within the RCU receives context information from an integrated output device that includes an output mechanism, the context information being related to an active application being run on the integrated output device and an active object being presented by the active application. The processor determines a set of actions that can be performed on the active object within the active application. The processor dynamically maps actions to user interface elements of the RCU based on the context information. The processor receives a selection of a user interface element and sends a request from the RCU to the integrated output device specifying an action mapped to the user interface element to be performed on the active object and the active application.

Abstract: A method comprises determining a threshold based on a shape or size of a graphical user interface (GUI); selecting one or more sequences of digital actions (actions) as one or more compound actions from a list of sequences of actions, the one sequence of actions being performed by multiple computer devices of a plurality of computer devices, including at least one input device and at least one output device, the one or more sequences of actions having a total number of sequences that is no more than the threshold and satisfying a set of criteria related to a number of actions in each sequence of actions; creating a deep link as a shortcut representing a specific compound action, the shortcut when invoked causing performing the specific compound action and producing a specific result; causing presenting the shortcut as an UI element in the GUI.

Abstract: A data management server computer (“server”) is disclosed. The server receives action data associated with one or more users identifying a plurality of actions performed through one or more computer devices in a multi-modal networked environment, identifies useful sequences of actions as compound actions, and generates deep links representing the compound actions as UI elements which when invoked cause execution of the represented compound actions.

Abstract: A method comprises receiving from an input device, a capture of user action as an initial command; interpreting the initial command into an interpreted command; generating a first set of modified commands that are based on the interpreted command, including: a first modified command that has a phonetic similarity to the interpreted command within a certain threshold, and a second modified command that is semantically related to an earlier command; transmitting, to an output device, the first set of modified commands; receiving a response to a group of commands including the first set of modified commands; recording an identifier of an input device from which the response was received and a type of the response in a log; when the response includes acknowledging a specific command of the group of commands as an accepted command, executing, the accepted command; otherwise, generating a second set of modified commands.

Abstract: A component management server computer (“server”) and processing methods are disclosed. In some embodiments, the server is programmed to continuously receive input data regarding what is happening in the physical room from one or more input devices. The server is programmed to then detect an utterance of a spoken word from the input data and generate one or more sound metrics based on the input data. Based on the sound metrics as applied to certain criteria, the server is programmed to activate a component, such as an input device, variable, software system, or output device, and cause one or more output devices to execute an action that alerts a user of the activated component. The server can also be programmed to turn on, off, up, or down any of the components based on the activated component.

Abstract: Interpretation of user commands is accelerated through digital user interfaces of various modalities, including generation and presentation of command modifications for rapid correction of incomplete or erroneous user commands. An embodiment detects whether the interpreted command is accurate and, if inaccurate, precisely what was the intended command or, at least, what suggested modification to the interpreted command would be sufficient to match the intent of the user. Disambiguation occurs that entails multiple recommendation generators proposing modified commands that may more accurately reflect the intent of the user. The user may provide a response that is either a confirmation of which one of several modified commands that were automatically proposed does the user intend or a correction that computer device may use to filter or replace currently offered modified commands to generate improved modified commands.

Abstract: A data management server computer (“server”) is disclosed. The server receives action data associated with one or more users identifying a plurality of actions performed through one or more computer devices in a multi-modal networked environment, identifies useful sequences of actions as compound actions, and generates deep links representing the compound actions as UI elements which when invoked cause execution of the represented compound actions.

Abstract: An exemplary method includes obtaining a group of classification labels and corresponding confidence values for at least one object identified within an image using a computer-based object recognition technique; generating a conversation, to resolve ambiguity among the classification labels, the generating including iteratively performing the following when (i) each of the confidence values is below a threshold value or (ii) two or more of the confidence values are above the threshold value: using a wordweb to identify properties that distinguish between a first one and a second one of the labels, ranking the properties; selecting the property having the highest rank to generate a question, and filtering at least one of the first and second label based on user input received in response to the question; and when only one of the confidence values exceeds the threshold value, classifying the object using the label corresponding to the one confidence value.

Abstract: Interpretation of user commands is accelerated through digital user interfaces of various modalities, including generation and presentation of command modifications for rapid correction of incomplete or erroneous user commands. An embodiment detects whether the interpreted command is accurate and, if inaccurate, precisely what was the intended command or, at least, what suggested modification to the interpreted command would be sufficient to match the intent of the user. Disambiguation occurs that entails multiple recommendation generators proposing modified commands that may more accurately reflect the intent of the user. The user may provide a response that is either a confirmation of which one of several modified commands that were automatically proposed does the user intend or a correction that computer device may use to filter or replace currently offered modified commands to generate improved modified commands.

Abstract: Methods, systems, and computer program products for image object disambiguation resolution are provided herein. An example of a method includes: obtaining a group of classification labels and corresponding confidence values for an object in an image; using a wordweb to determine one or more properties that distinguish between at least a first one of the classification labels and at least a second one of the classification labels within the group; selecting a first property from the properties to generate a question based on information indicating a level of prior knowledge of the user with each of the properties and each of the one or more labels; assigning a belief score to an answer; and determining whether to present at least a second question to verify the first answer based on a comparison of the belief score to a belief threshold value.

Abstract: A computer-implemented method for a socially connectable agent. A non-limiting example of the computer-implemented method includes receiving, by a processor, input events. The method includes evaluating and enacting rules, by the processor, based on the received input events, where the rule include stochastic elements and temporal operators. The method pushes, by the processor, action events that result from the evaluation and enactment of the rules, and initiates, by the processor, action events.

Abstract: A device management server computer (“server”) and processing methods are disclosed. In some embodiments, the server is programmed to manage a plurality of input devices and output devices in a physical room. The server is programmed to analyze media data capturing actions performed by a user in real time as a participant in the physical room, determine how the user would like to connect at least one of the input devices and one of the output devices from the analysis, and enable the connection. The sever is programmed to interpret the actions and derive commands for connecting two or more devices based on predetermined data regarding the input devices and output devices and rules for referring to and connecting these devices.

Abstract: A computer system, method, and computer-readable product for providing data for career advice, such as job or education recommendations, from automated review and analysis of career-related data for an individual, which is at least initially obtained from documents, such as resumes and writing samples. For a designated individual, career-related data is obtained from the documents and an initial personality estimate is created for the designated individual based upon, at least, the obtained career-related data. One or more latent factor models for known career-personality matches are then gathered from a database and a questionnaire is provided to the individual to gather further information and augment the personality estimate. The created personality estimate is integrated with the latent factor model(s) to create career advice data.

Abstract: Personalized video interjections based on a learner model and a learning objective. A method for adding interjections to a video includes analyzing the content of a plurality of videos based on a set of learning objectives, selecting a video based on a learning objective, determining types of video interjections using an analytics engine that compares a learner model and the learning objective, determining a location for the video interjections using the analytics engine, generating a video interjection for each video interjection type and inserting the video interjections into the video at the determined locations.

Abstract: A computer system, method, and computer-readable product for automatically generating a hierarchy of concepts described in a video using semantic concept matching that assists persons in searching for specific types of content within videos. A video segment is obtained, with the segment having a distinct running time with discrete information related to one or more topics within its content. The discrete information of the video segment is then parsed out and related to a predetermined relevant topic, and then one or more attributes for weighting each discrete information relevant topic within the video segment are determined. A hierarchy of concepts of the video segments is then created, based upon, at least, the weighting of the information topic within the running time of the video segment based upon the presence of the one or more attributes. Other information related to the video segment can also be used to modify the hierarchy.