Abstract: A method and system for handling unlabeled interaction data with contextual understanding are disclosed. In some embodiments, the method includes receiving the interaction data describing agent-consumer interactions associated with a contact center. The method includes analyzing the interaction data to identify a plurality of features. The method includes automatically performing taxonomy driven classification on the plurality of features to generate a first set of labels associated with the interaction data. The method includes training a deep learning model using the first set of labels and the interaction data to determine a second set of labels. The method then includes intelligently combining the first and second sets of labels to obtain a combined set of labels associated with the interaction data.