Abstract: Virtual assistants intelligently emulate a representative of a service provider by providing variable responses to user queries received via the virtual assistants. These variable responses may take the context of a user's query into account both when identifying an intent of a user's query and when identifying an appropriate response to the user's query.

Abstract: A system and method for updating computerized language models is provided that automatically adds or deletes terms from the language model to capture trending events or products, while maximizing computer efficiencies by deleting terms that are no longer trending and use of knowledge bases, machine learning model training and evaluation corpora, analysis tools and databases.

Abstract: Detecting fraudulent activity can be a complex, manual process. In this paper, we adapt statistical properties of count data in a novel algorithm to uncover records exhibiting high risk for fraud. Our method identifies shelves, partitioning data under the counts using a Student's t-distribution. We apply this methodology on a univariate dataset including cumulative results from phone calls to a customer service center. Additionally, we extend this technique to multivariate data, illustrating that the same method is applicable to both univariate and multivariate data.

Abstract: The template generation system receives interaction data stored by the CEC from an interaction database and customer service templates (if any) from a template database. The template generation system processes interaction data and customer service templates to learn the domain language of CSR responses and the template responses within the CEC. The template generation system encodes the learned language and generates sentence vector embeddings for the CSR responses and template responses. Based on the learned language, the encoding, and the sentence vector embeddings, the template generation system processes CSR responses derived from the interaction data and customer service templates to predict the need for new customer service templates. Based on the predicted need for new customer service templates, the template generation system provides customer service template suggestions and may also auto-generate suggested customer service templates.

Abstract: A system and method using blockchain for monitoring and tracking customer service representative actions are disclosed. In the system and method, customer service representative actions are encrypted using an encryption key specific to a company on whose behalf the customer service representative is acting. The customer service representative signs the encrypted action with a private key of a public/private key pair. The signed, encrypted action record is placed on the blockchain, which can later be accessed to review the actions of the customer service representative or actions of any customer service representative acting on behalf of the specific company.

Abstract: According to principles described herein, a system applies Active Learning methodology to multiple models simultaneously. The system includes a means to distribute the sample selection algorithm across large pools of unlabeled data and a automatic model training deployed on hardware matched to the model type that scales to large volumes of data without consuming all resources.

Abstract: As described herein, a system for expanding contractions in electronically stored text includes expanding contractions having only on expanded form. For remaining contractions, a grammar check is performed for all possible expanded forms to determine if an expanded form can be selected based on context and grammar rules. If an expanded form is not evident from the first two steps, all possible expanded forms of the remaining contractions are converted to a vector representation along with the original text. A Word Movers Distance (WMD) for each possible expansion is calculated using the vectors for each possible expansion and the original text. An expanded form is chosen without human intervention based on the grammar score alone or the WMD and the grammar score.

Abstract: Computer-implemented techniques are disclosed for presenting an in-page console on a website for reviewing interaction data captured during user interaction with one or more web pages of the website. The web browser activates the in-page console via an activation procedure. One or more of the web pages of the website are selected after activation of the in-page console. A feedback badge on the website can be replaced with a reporting badge upon activation of the in-page console and with the reporting badge displaying an indicator of interaction data captured for the selected web page. The in-page console is overlaid one or more of the selected web pages. The in-page console displays the interaction data, or recordings of user interaction, captured during user interaction with the selected web page to enable review of the captured interaction data for the selected web page overlaid on the selected web page.

Abstract: The segment analysis system analyzes survey data to determine the influence each custom question/response combination (segment) has on a given aggregate scored survey metric for a given date/date range. The system removes from consideration all surveys that do not include a scored survey metric and date that matche the aggregate scored survey metric and given date/date range. The system further removes from consideration all surveys not pertaining received user-defined filtering. Once the system has eliminated all extraneous surveys from consideration, the system segments each question/response combinations across the pool of surveys to generate an influence score for each question/response combination. The system identifies which segment has the greatest positive and negative influence on the aggregate scored survey metric for the given date/date range. The system generates reports for the segment analysis and stores all segment analyses for further comparative analysis.

Abstract: In one embodiment, certain words or phrases spoken by customers during calls to a call center are used to identify or authenticate the user. Words or phrases such as a customer's name, or an account number or telephone number, are selected for a customer. Recordings of the selected words or phrases spoken by the customer during previous calls are used to generate voiceprints that are stored and associated with the customer. Later, when the customer calls the call center, instances of the customer speaking the selected words are extracted from the call (referred to herein as “audio-of-interest”) and are compared against the voiceprints stored for the customer. If the voiceprints match the audio-of-interest the customer is authenticated.

Abstract: This disclosure describes techniques and architectures for evaluating conversations. In some instances, conversations with users, virtual assistants, and others may be analyzed to identify potential risks within a language model that is employed by the virtual assistants and other entities. The potential risks may be evaluated by administrators, users, systems, and others to identify potential issues with the language model that need to be addressed. This may allow the language model to be improved and enhance user experience with the virtual assistants and others that employ the language model.

Abstract: Virtual assistants intelligently emulate a representative of a service provider by providing variable responses to user queries received via the virtual assistants. These variable responses may take the context of a user's query into account both when identifying an intent of a user's query and when identifying an appropriate response to the user's query.

Abstract: Disclosed is a system and method for detecting and addressing bias in training data prior to building language models based on the training data. Accordingly system and method, detect bias in training data for Intelligent Virtual Assistant (IVA) understanding and highlight any found. Suggestions for reducing or eliminating them may be provided This detection may be done for each model within the Natural Language Understanding (NLU) component. For example, the language model, as well as any sentiment or other metadata models used by the NLU, can introduce understanding bias. For each model deployed, training data is automatically analyzed for bias and corrections suggested.

Abstract: To prevent intent classifiers from potentially choosing intents that are ineligible for the current input due to policies, dynamic intent classification systems and methods are provided that dynamically control the possible set of intents using environment variables (also referred to as external variables). Associations between environment variables and ineligible intents, referred to as culling rules, are used.

Abstract: A real-time conversation is monitored between a user and an intelligent virtual assistant (IVA). A visualization may be generated and displayed to the user on the user computing device based on one or more topics identified in the conversation. The conversation between the user and the IVA may continue and is continued to be monitored. The visualization can be updated as the conversation continues, e.g., based on further topics being identified.

Abstract: An anomaly detection system using machine learning to generate predicted survey scores for a given duration and a given metric based on historic survey score data. The system compares a predicted survey score to the actual survey score and identifies anomalous actual survey scores. The anomaly detection system trains a plurality of survey score prediction models using historic survey score data. Each survey score prediction model is based on a specific survey score metric and a specific duration. The survey score prediction models generate expected survey score results for the given duration and the given metric. Based on the user-determined filtering and tolerances, the system determines if the actual survey score result is anomalous. The system generates reports for the detected anomalies and continually updates the survey score prediction models with newly obtained actual survey results, thereby improving the anomaly detection accuracy over time.

Abstract: A scalable system provides automated conversation review that can identify potential miscommunications. The system may provide suggested actions to fix errors in intelligent virtual assistant (IVA) understanding, may prioritize areas of language model repair, and may automate the review of conversations. By the use of an automated system for conversation review, problematic interactions can be surfaced without exposing the entire set of conversation logs to human reviewers, thereby minimizing privacy invasion. A scalable system processes conversations and autonomously marks the interactions where the IVA is misunderstanding the user.

Abstract: Detecting fraudulent activity can be a complex, manual process. In this paper, we adapt statistical properties of count data in a novel algorithm to uncover records exhibiting high risk for fraud. Our method identifies shelves, partitioning data under the counts using a Student's t-distribution. We apply this methodology on a univariate dataset including cumulative results from phone calls to a customer service center. Additionally, we extend this technique to multivariate data, illustrating that the same method is applicable to both univariate and multivariate data.

Abstract: Detecting fraudulent activity can be a complex, manual process. In this paper, we adapt statistical properties of count data in a novel algorithm to uncover records exhibiting high risk for fraud. Our method identifies shelves, partitioning data under the counts using a Student's t-distribution. We apply this methodology on a univariate dataset including cumulative results from phone calls to a customer service center. Additionally, we extend this technique to multivariate data, illustrating that the same method is applicable to both univariate and multivariate data.

Abstract: A conversation user interface enables patients to better understand their healthcare by integrating diagnosis, treatment, medication management, and payment, through a system that uses a virtual assistant to engage in conversation with the patient. The conversation user interface conveys a visual representation of a conversation between the virtual assistant and the patient. An identity of the patient, including preferences and medical records, is maintained throughout all interactions so that each aspect of this integrated system has access to the same information. The conversation user interface presents allows the patient to interact with the virtual assistant using natural language commands to receive information and complete task related to his or her healthcare.