Abstract: A first step in training a deep learning model may include generating data representing a plurality of historical episodes. Each historical episode may be divided into a sequence of time units, and historical information may be associated with each time unit. Next, for each historical episode of the plurality of episodes, a respective training action sequence may be generated using an evolutionary algorithm. A training data set comprising a plurality of training data points may then be generated. Each of the plurality of training data points may comprise an action extracted from a training action sequence generated by the evolutionary algorithm. The deep learning model may be trained using training data set to generate future actions to be executed at current or future time units.

Abstract: An exemplary system and method are provided for monitoring concept drift in a trained model, such as a chatbot. The system is configured to perform a method including receiving a first dataset representing model operations executed by the trained model; applying a data processing operation to the first dataset to determine a first result data of the first dataset; determining, based on the first result data, a difference between the first result data and a second result data; determining, based on the difference, whether concept drift has occurred; and in accordance with a determination that concept drift has occurred, transmitting an instruction to update training of the trained model. The exemplary system may be implemented as a drift detection system in communication with the trained model.