Abstract: A method for performing hierarchical classification of data is disclosed. The method is being executed by at least one processing device. The method includes receiving input data for encoding into multiple channels. Further, the method includes extracting one or more features and one or more temporal structures corresponding to the input data. The method further includes identifying one or more feature dependences in the input data. Further, the method includes combining the extracted one or more features corresponding to the input data, the extracted one or more temporal structures of the input data, and the identified one or more feature dependencies in the input data into a combined feature set. Thereafter, the method includes classifying the combined feature set into one or more output classes, and thereby performing the hierarchical classification of data.