Abstract: In an embodiment of the present disclosure, a method of simultaneously identifying intent and slots in a voice assistant command includes tokenizing, into a plurality of tokens, a current utterance of a user of a device comprising the voice assistant command, prepending the plurality of tokens with a previous utterance and a separation token, obtaining, using a transformer-based machine learning model, one or more predictions for the voice assistant command from the prepended plurality of tokens, aligning, according to one or more constraints, the at least one of the flag prediction, the goal prediction, and the sub-goal prediction, providing, to the device, the identified intent and the identified slots based on the intent prediction and the aligned at least one of the flag prediction, the goal prediction, and the sub-goal prediction, causing the device to perform the voice assistant command according to the identified intent and the identified slots.

Abstract: An electronic system provides visual information to help a development person improve a machine learning model. The visual information includes logic flows, scatter plots, confusion matrices and instances of utterances which are related to poor performance. Guided by the logic flows, the development person is able trace scatter plots confusion matrices in order to identify weaknesses of the machine learning model being developed. A user interface help the development person then specify or indicate a request for additional training data, improved labels or an improved labelling guide. The logic flows, scatter plots and confusion matrices are used iteratively by the development person to repeatedly discover how the machine learning model can be improved and then getting the data to improve the machine learning model. A relatively unskilled person is able to develop a highly effective machine learning model using the logic flows, scatter plots and confusion matrices.