Abstract: Methods for executing a user input in an IoT environment by at least one IoT device. The method may include receiving a user input from a user of the IoT device to execute at least one task associated with the IoT device. The method may include determining a multimodal context of the IoT environment relevant to the at least one task associated with the IoT device based on the received user input. The method may include retrieving multimodal data of the IoT environment corresponding to the determined multimodal context. The method may include determining a task execution intensity for the task associated with the IoT device based on the retrieved multimodal data. The method may include executing the task associated with the at least one IoT device using the determined task execution intensity.

Abstract: A voice command resolution apparatus, including a memory configured to store instructions; and a processor configured to execute the instructions to: recognize a voice command of a user in an input sound, analyze a non-speech sound included in the input sound, and determine at least one target Internet of things (IoT) device related to execution of the voice command, based on an analysis result of the non-speech sound.

Abstract: A voice command resolution apparatus, including a memory configured to store instructions; and a processor configured to execute the instructions to: recognize a voice command of a user in an input sound, analyze a non-speech sound included in the input sound, and determine at least one target Internet of things (IoT) device related to execution of the voice command, based on an analysis result of the non-speech sound.

Abstract: Provided are a method and an apparatus for providing an intelligent voice response at a voice assistant device. The method includes obtaining, by a voice assistant device, a voice input from a user, identifying non-speech input while obtaining the voice input, determining a correlation between the voice input and the non-speech input, and generating, based on the correlation, a response comprising an action related to the correlation or a suggestion related to the correlation.

Abstract: A method for providing an interaction with a virtual assistant, includes identifying, by an electronic device, at least one of a duration of a silence between a first portion of an utterance received from a user and a second portion of the utterance, and a position of the silence in the utterance; determining, by the electronic device, a contextual relationship between the first portion of the utterance and the second portion of the utterance based on the at least one of the duration of the silence and the position of the silence; determining, by the electronic device, at least one execution criteria corresponding to the first portion of the utterance and the second portion of the utterance based on the determined contextual relationship; and generating, by the electronic device, a response corresponding to the utterance by executing the first portion of the received utterance and the second portion of the received utterance using the at least one execution criteria.

Abstract: Provided are a method and an apparatus for providing an intelligent voice response at a voice assistant device. The method includes obtaining, by a voice assistant device, a voice input from a user, identifying non-speech input while obtaining the voice input, determining a correlation between the voice input and the non-speech input, and generating, based on the correlation, a response comprising an action related to the correlation or a suggestion related to the correlation.

Abstract: A method and a system for controlling at least one Internet of Things (IoT) device is described. The method includes identifying a current user activity associated with each of the at least one IoT device, detecting a non-speech sound during the identified current user activity, predicting a user action based on the detected non-speech sound, wherein the predicted user action impacts the current user activity, and automatically adjusting an operational setting of the at least one IoT device to minimize the impact on the current user activity, based on initiation of the predicted user action.

Abstract: A method in an interactive computing-system includes pre-processing an input natural-language (NL) from a user command based on natural language processing (NLP) for classifying speech information and non-speech information, obtaining an NLP result from the user command, fetching a device specific information from one or more IoT devices operating in an environment based on the NLP result, generating one or more contextual parameters based on the NLP result and the device specific information, selecting at least one speaker embedding stored in a database for the one or more IoT devices based on the one or more contextual parameters, and outputting the selected at least one speaker embedding for playback to the user.

Abstract: Provided are a method and an apparatus for providing an intelligent voice response at a voice assistant device. The method includes obtaining, by a voice assistant device, a voice input from a user, identifying non-speech input while obtaining the voice input, determining a correlation between the voice input and the non-speech input, and generating, based on the correlation, a response comprising an action related to the correlation or a suggestion related to the correlation.

Abstract: A voice command resolution apparatus, including a memory configured to store instructions; and a processor configured to execute the instructions to: recognize a voice command of a user in an input sound, analyze a non-speech sound included in the input sound, and determine at least one target Internet of things (IoT) device related to execution of the voice command, based on an analysis result of the non-speech sound.