Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for training machine learning models are presented. An automated task framework comprising a plurality of machine learning models for executing a task may be maintained. A natural language input may be processed by two or more of the machine learning models. An action corresponding to a task intent identified from the natural language input may be executed. User feedback related to the execution may be received. The feedback may be processed by a user sentiment engine. A determination may be made by the user sentiment engine that a machine learning model generated an incorrect output. The machine learning model that generated the incorrect output may be identified. The machine learning model that generated the incorrect output may be automatically penalized via training. Any machine learning models that a user expressed neutral or positive sentiment toward may be rewarded.

Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for training machine learning models are presented. An automated task framework comprising a plurality of machine learning models for executing a task may be maintained. A natural language input may be processed by two or more of the machine learning models. An action corresponding to a task intent identified from the natural language input may be executed. User feedback related to the execution may be received. The feedback may be processed by a user sentiment engine. A determination may be made by the user sentiment engine that a machine learning model generated an incorrect output. The machine learning model that generated the incorrect output may be identified. The machine learning model that generated the incorrect output may be automatically penalized via training. Any machine learning models that a user expressed neutral or positive sentiment toward may be rewarded.