Abstract: Embodiments provide a system and method for statistical subject identification. The system takes texts, videos, audios, and images as input for which subject needs to be identified. The system pre-process input data and generates n-grams and pre-processed text strings by removing stopwords, punctuations, selective POS tags and lemmatization. Frequency distribution of n-grams are computed, and weightage of n-grams is assigned. For each n-gram, sum of weights across all text strings is computed and a maximum weightage is identified. The computed value as a result of taking a ratio of two, is assigned to each of the n-grams. Values computed for the n-grams have a non-normal distribution, when observed statistically. Thus, the n-gram values are transformed to confidence value following a normal distribution. The system maps the n-gram domains using a domain lexicon. Finally, these domains are aggregated and converged for subject identification based on a pre-annotated mapping dictionary.

Abstract: This disclosure relates to systems and methods for multi-utterance generation of data. Conventionally, the process of utterance generation involves manual efforts and for the utterances to be contextually relevant, identification of subject area is also required. Conventional approaches for utterance generation work with a blackbox approach taking in data and giving augmented utterances. However, these approaches fail to provide any control over quality of utterances generated. The method of the present disclosure addresses unresolved problems of multi-utterance generation with a control over quality of utterances generated. Embodiments of the present disclosure utilizes a smart framework that is capable of generating contextually relevant utterances with immutability regulation and punctuation-memory.

Abstract: Embodiments provide a system and method for statistical subject identification. The system takes texts, videos, audios, and images as input for which subject needs to be identified. The system pre-process input data and generates n-grams and pre-processed text strings by removing stopwords, punctuations, selective POS tags and lemmatization. Frequency distribution of n-grams are computed, and weightage of n-grams is assigned. For each n-gram, sum of weights across all text strings is computed and a maximum weightage is identified. The computed value as a result of taking a ratio of two, is assigned to each of the n-grams. Values computed for the n-grams have a non-normal distribution, when observed statistically. Thus, the n-gram values are transformed to confidence value following a normal distribution. The system maps the n-gram domains using a domain lexicon. Finally, these domains are aggregated and converged for subject identification based on a pre-annotated mapping dictionary.