Abstract: A method, a structure, and a computer system for OOD sentence detection in dialogue systems. The exemplary embodiments may include receiving, for a domain corresponding to a particular topic, one or more on-topic text inputs and one or more off-topic text inputs. The exemplary embodiments may further include encoding the one or more on-topic text inputs and the one or more off-topic text inputs into a latent space, as well as decoding the one or more on-topic text inputs and the one or more off-topic text inputs from the latent space. The exemplary embodiments may additionally include minimizing a reconstruction error between the encoded one or more on-topic text inputs and the decoded one or more on-topic text inputs, and maximizing a reconstruction error between the encoded one or more off-topic text inputs and the decoded one or more off-topic text inputs.

Abstract: A method, system, and computer-usable medium are disclosed for identifying areas to improve an interactive conversational system, such as a chatbot. A stream of stream of conversational interactions C (C1, C2, . . . , Cn) between users and the interactive conversational system is received. An intent clustering model is periodically applied to the stream to form an incremental clustering based on a set of derived intents to form a mapping from a first set of conversational characteristics to a first set of intents and a second set of conversational characteristics to a first set of unclear intents. Information is provided related to the second set of conversation characteristics.

Abstract: A method, system, and computer-usable medium are disclosed for identifying areas to improve an interactive conversational system, such as a chatbot. A stream of stream of conversational interactions C (C1, C2, . . . , Cn) between users and the interactive conversational system is received. An intent clustering model is periodically applied to the stream to form an incremental clustering based on a set of derived intents to form a mapping from a first set of conversational characteristics to a first set of intents and a second set of conversational characteristics to a first set of unclear intents. Information is provided related to the second set of conversation characteristics.