Abstract: Systems, apparatuses, methods, and computer program products are disclosed for predicting an emotion based on speech and text derived from the speech. An example method includes capturing speech and generating hidden vectors based on the speech and text derived from the speech. The example method further includes generating a word aligned hidden vector based on the speech hidden vector and text hidden vector. The example method further includes generating a hidden vector based on the word aligned hidden vector and the text hidden vector. The example method further includes, after further processing of the final vector, generating one or more probabilities corresponding to one or more emotions. The example method finally includes determining a next action based on the generated one or more probabilities corresponding to one or more emotions.

Abstract: Systems, apparatuses, methods, and computer program products are disclosed for predicting an entity, intent, and emotion based on weighted and segmented portions of captured speech. An example method includes capturing speech and separating the speech and/or text derived from the speech into a plurality of discrete segments. The example method further includes determining or generating metadata, the metadata an entity, an intent, an emotion, and a weight associated with each of the entity, the intent, the emotion. The example method further includes determining a next action based on the determined or generated entity, intent, and emotion of each of the plurality of discrete segments.