Abstract: A method of classifying a task includes obtaining a plurality of images via an image capturing device and an audio signal via an audio sensor for a predetermined period of time. The method further includes classifying, via a first trained machine learning model, the plurality of images to generate a list of first class probabilities and a list of first class labels. The method further includes classifying, via a second trained machine learning model, the audio signal to generate a list of second class probabilities and a list of second class labels. The method further includes determining, via a merging algorithm, a list of third class probabilities and a list of third class labels based on the lists of first and second class probabilities. The method further includes determining the task corresponding to the predetermined period of time based on the list of third class probabilities.