Abstract: Mechanisms are provided, in a data processing system comprising a fusion sensor service and a human computer interaction (HCI) device, for responding to a user input. The HCI device receives a user input from a first sensor monitoring a monitored environment. The fusion sensor service captures, via one or more second sensors different from the first sensor, sensor data representing characteristics of one or more entities within the monitored environment indicative of a condition within the monitored environment. The fusion sensor service determines whether the user input is specifically directed to the HCI device based on the captured sensor data. The HCI device performs an operation in response to the data processing system determining that the user input is specifically directed to the HCI device based on the capture sensor data.

Abstract: Mechanisms are provided, in a smart speaker system having at least one smart speaker device comprising an audio capture device, and smart speaker system logic, for processing audio sample data captured by the audio capture device. The audio capture device captures an audio sample from a monitored environment and one or more sensor devices capture sensor data representing non-verbal attention indicators associated with a speaker of a speech portion of the audio sample. The smart speaker system logic evaluates the non-verbal attention indicators of the sensor data to determine whether or not the speech portion of the audio sample is directed to the smart speaker device. In response to determining that the speech portion of the audio sample is directed to the smart speaker device, a cognitive system associated with the smart speaker system generates a response to the speech portion.

Abstract: Mechanisms are provided, in a data processing system comprising a fusion sensor service and a human computer interaction (HCI) device, for responding to a user input. The HCI device receives a user input from a first sensor monitoring a monitored environment. The fusion sensor service captures, via one or more second sensors different from the first sensor, sensor data representing characteristics of one or more entities within the monitored environment indicative of a condition within the monitored environment. The fusion sensor service determines whether the user input is specifically directed to the HCI device based on the captured sensor data. The HCI device performs an operation in response to the data processing system determining that the user input is specifically directed to the HCI device based on the capture sensor data.

Abstract: Mechanisms are provided, in a smart speaker system having at least one smart speaker device comprising an audio capture device, and smart speaker system logic, for processing audio sample data captured by the audio capture device. The audio capture device captures an audio sample from a monitored environment and one or more sensor devices capture sensor data representing non-verbal attention indicators associated with a speaker of a speech portion of the audio sample. The smart speaker system logic evaluates the non-verbal attention indicators of the sensor data to determine whether or not the speech portion of the audio sample is directed to the smart speaker device. In response to determining that the speech portion of the audio sample is directed to the smart speaker device, a cognitive system associated with the smart speaker system generates a response to the speech portion.