Abstract: Disclosed herein are system, method, and computer program product embodiments for machine learning systems to process interactive communications between at least two participants. Speech and text, within the interactive communications, are analyzed using machine learning classifiers to extract prosodic, semantic and key phrase cues located within the interactive communications to identify changes to emotion, sentiments and key phrases. A summary of the interactive communications between a first participant and a second participant is generated at least, in-part, based on the extracted prosodic, semantic and key phrase cues and the summary is highlighted based on any of the changes to emotion, the sentiments or the key phrases.

Abstract: A system and method for allowing a single live customer service agent to simultaneously serve multiple customers. According to various embodiments, a virtual agent operates at the front end to receive and attempt to handle customer issues. The virtual agent employs speech recognition and intent mapping in order to generate a proposed response that attempts to identify and resolve customer issues. In some scenarios, the proposed response includes both a response message and a response action to be taken. A chat history and the proposed response is then provided to the live agent. The live agent reviews the information provided, and determines whether the proposed response is appropriate. The live agent then approves the response or revises or replaces the response. The final response is sent back to the virtual agent for processing and providing to the customer.

Abstract: Disclosed embodiments may include a method for generic aspect-based sentiment analysis. The system may receive training data, which is used to train one or more machine learning models. The system may receive data, which may be transcribed call data. The system may extract one or more aspects from the call data using one machine learning model. For each aspect, the system may determine a sentiment polarity. The system may filter the aspects and sentiment polarities and analyze trends based on the filtered aspects and sentiment polarities. The system may output a result to a dynamic graphical user interface based on the trends. This may allow a user to detect customer attitudes toward a variety of subjects and trends over time without training machine learning models for specific domains.

Abstract: Disclosed herein are system, method, and computer program product embodiments for machine learning systems to process interactive communications between at least two participants. Speech and text, within the interactive communications, are analyzed using machine learning classifiers to extract prosodic, semantic and key phrase cues located within the interactive communications to identify changes to emotion, sentiments and key phrases. A summary of the interactive communications between a first participant and a second participant is generated at least, in-part, based on the extracted prosodic, semantic and key phrase cues and the summary is highlighted based on any of the changes to emotion, the sentiments or the key phrases.

Abstract: In some embodiments, the present disclosure provides an exemplary method that may include steps of monitoring, a conversation script between a call center agent and a customer; utilizing, a speech-to-text deep machine learning model to transcribe the audio call to text; utilizing, a natural language processing deep machine learning model to map intent mappings of the audio call; utilizing, a similarity measurement model to determine a semantic similarity between predefined intent mappings and the intent mappings of the call audio text; determining, an error based on the semantic similarity in the intent mapping call audio text; determining a training session based on the error.

Abstract: In some implementations, a system may capture audio from a call between a calling device and a called device. The system may filter the captured audio to generate a background audio layer. The system may generate an audio footprint that is a representation of sound in the background audio layer. The system may determine that the audio footprint includes a triggering sound footprint based on one or more audio characteristics of the audio footprint. The system may detect synthetic sound based on the audio footprint and after determining that the audio footprint includes the triggering sound footprint, wherein the synthetic sound is indicative of a sound recording. The system may transmit a notification to one or more devices associated with the call based on detecting the synthetic sound.

Abstract: A system may include processor(s), and memory in communication with the processor(s) and storing instructions configured to cause the system to correct ASR errors. The system may receive a transcription comprising transcribed word(s) and may determine whether the transcribed word(s) exceed associated predefined confidence level(s). Responsive to determining a transcribed word does not exceed a predefined confidence level, the system may generate a predicted word. The system may calculate a distance between numerical representations of the transcribed word and the predicted word and may determine whether the distance exceeds a predefined threshold. Responsive to determining the distance exceeds the predefined threshold, the system may determine whether at least one red flag word of a list of red flag words corresponds to a context of the transcription, and, responsive to making that determination, may classify the transcription as associated with a first category.

Abstract: Disclosed herein are system, method, and computer program product embodiments for machine learning systems to process incoming call-center calls to provide communication summaries that capture effort levels of statements made during interactive communications. For a given call, the system receives a transcript as the input and generates a textual summary as the output. In order to improve a call summary and customize a summarization task to a call center domain, the technology disclosed herein may employ a classifier that predicts an effort level and attention score for individual utterances within a call transcript, ranks the attention scores and uses selected ones of the ranked utterances in the summary.

Abstract: In some implementations, a system may capture audio from a call between a calling device and a called device. The system may filter the captured audio to generate a background audio layer. The system may generate an audio footprint that is a representation of sound in the background audio layer. The system may determine that the audio footprint includes a triggering sound footprint based on one or more audio characteristics of the audio footprint. The system may detect synthetic sound based on the audio footprint and after determining that the audio footprint includes the triggering sound footprint, wherein the synthetic sound is indicative of a sound recording. The system may transmit a notification to one or more devices associated with the call based on detecting the synthetic sound.

Abstract: In some embodiments, the present disclosure provides an exemplary method that may include steps of monitoring, a conversation script between a call center agent and a customer; utilizing, a speech-to-text deep machine learning model to transcribe the audio call to text; utilizing, a natural language processing deep machine learning model to map intent mappings of the audio call; utilizing, a similarity measurement model to determine a semantic similarity between predefined intent mappings and the intent mappings of the call audio text; determining, an error based on the semantic similarity in the intent mapping call audio text; determining a training session based on the error.

Abstract: Disclosed herein are system, method, and computer program product embodiments for machine learning systems to process incoming call-center calls to provide communication summaries that capture effort levels of statements made during interactive communications. For a given call, the system receives a transcript as the input and generates a textual summary as the output. In order to improve a call summary and customize a summarization task to a call center domain, the technology disclosed herein may employ a classifier that predicts an effort level and attention score for individual utterances within a call transcript, ranks the attention scores and uses selected ones of the ranked utterances in the summary.

Abstract: Disclosed herein are system, method, and computer program product embodiments for machine learning systems to process incoming call-center calls based on caller preferences. Text of historical interactive communications of a set of first callers is used to train one or more machine learning models to extract current caller preferences. A first sentiment score of a current caller may be labeled as a complaint and, based on subsequent utterances of the current caller, a first and second sentiment score trend of the current caller are detected relative to the complaint. For a second sentiment score above a complaint threshold, phrasing is generated for a call center agent interacting with the current caller and, for a second sentiment score below the complaint threshold, utterances are labelled as non-complaint utterances, and identified as a call resolution.

Abstract: Systems and computer-implemented methods disclosed herein relate to detecting errors in manually entered data. In one embodiment, the system can identify a named entity automatically from a conversation between a customer and service agent with a named entity recognition model that employs natural language processing and machine learning to detect a word or string of words in the conversation that corresponds to a named entity category. In another embodiment, the system can determine whether data entered into a field on a service platform by the service agent includes an error by comparing the data entered with the named entity. In another embodiment, the system can transmit an alert to the service agent through the service platform when there is a mismatch between the named entity and the data entered.

Abstract: In some embodiments, the present disclosure provides an exemplary method that may include steps of monitoring, a conversation script between a call center agent and a customer; utilizing, a speech-to-text deep machine learning model to transcribe the audio call to text; utilizing, a natural language processing deep machine learning model to map intent mappings of the audio call; utilizing, a similarity measurement model to determine a semantic similarity between predefined intent mappings and the intent mappings of the call audio text; determining, an error based on the semantic similarity in the intent mapping call audio text; determining a training session based on the error.

Abstract: Disclosed herein are system, method, and computer program product embodiments for machine learning systems to process incoming call-center calls based on caller preferences. Text of historical interactive communications of a set of first callers are used to train one or more machine learning models to extract caller preferences. These trained models extract caller preferences for a second caller to generate a customer specific profile. An automated call center assistance system is configured to selectively route, based on the customer specific profile, a current call from the second caller to a call center agent and communicate one or more of the caller preferences for the second caller to the call center agent for consideration in an interactive communication during the current call.

Abstract: Disclosed herein are system, method, and computer program product embodiments for machine learning systems to process incoming call-center calls based on inferred themes. The machine learning system extracts a topic and keywords associated with the topic from a plurality of interactive communications and ranks the keywords based on a frequency of occurrence within the plurality of interactive communications. The machine learning systems select an N highest ranked keywords from the plurality of interactive communications, compares the N highest ranked keywords to previously extracted N highest ranked keywords to identify new keywords, and determines, based on new keywords, that an emerging topic has been articulated in the plurality of interactive communications.

Abstract: A system and method for allowing a single live customer service agent to simultaneously serve multiple customers. According to various embodiments, a virtual agent operates at the front end to receive and attempt to handle customer issues. The virtual agent employs speech recognition and intent mapping in order to generate a proposed response that attempts to identify and resolve customer issues. In some scenarios, the proposed response includes both a response message and a response action to be taken. A chat history and the proposed response is then provided to the live agent. The live agent reviews the information provided, and determines whether the proposed response is appropriate. The live agent then approves the response or revises or replaces the response. The final response is sent back to the virtual agent for processing and providing to the customer.

Abstract: Disclosed herein are system, method, and computer program product embodiments for machine learning systems to process incoming call-center calls to provide communication summaries that capture effort levels of statements made during interactive communications. For a given call, the system receives a transcript as the input and generates a textual summary as the output. In order to improve a call summary and customize a summarization task to a call center domain, the technology disclosed herein may employ a classifier that predicts an effort level and attention score for individual utterances within a call transcript, ranks the attention scores and uses selected ones of the ranked utterances in the summary.

Abstract: Disclosed herein are system, method, and computer program product embodiments for machine learning systems to process incoming call-center calls based on inferred themes. The machine learning system extracts a topic and keywords associated with the topic from a plurality of interactive communications and ranks the keywords based on a frequency of occurrence within the plurality of interactive communications. The machine learning systems select an N highest ranked keywords from the plurality of interactive communications, compares the N highest ranked keywords to previously extracted N highest ranked keywords to identify new keywords, and determines, based on new keywords, that an emerging topic has been articulated in the plurality of interactive communications.

Abstract: In some implementations, a system may capture audio from a call between a calling device and a called device. The system may filter the captured audio to generate a background audio layer. The system may generate an audio footprint that is a representation of sound in the background audio layer. The system may determine that the audio footprint includes a triggering sound footprint based on one or more audio characteristics of the audio footprint. The system may detect synthetic sound based on the audio footprint and after determining that the audio footprint includes the triggering sound footprint, wherein the synthetic sound is indicative of a sound recording. The system may transmit a notification to one or more devices associated with the call based on detecting the synthetic sound.