Abstract: The techniques disclosed herein provide intelligent display of auditory world experiences. Specialized Al models are configured to display integrated visualizations for different aspects of the auditory signals that may be communicated during an event, such as a meeting, chat session, etc. For instance, a system can use a sentiment recognition model to identify specific characteristics of a speech input, such as volume or tone, provided by a participant. The system can also use a speech recognition model to identify keywords that can be used to distinguish portions of a transcript that are displayed. The system can also utilize an audio recognition model that is configured to analyze non-speech audio sounds for the purposes of identifying non-speech events. The system can then integrate the user interface attributes, distinguished portions of the transcript, and visual indicators describing the non-speech events.

Abstract: Non-limiting examples of the present disclosure describe proactive speech detection on behalf of a user and alerting the user when a specific word, name, etc. is detected. Speech detection is actively executed through a computing device, where the speech detection analyzes spoken utterances in association with a dynamic grammar file stored locally on the computing device. An alert is generated that indicates when a spoken word of the utterances matches a word stored in the dynamic grammar file. The alert may be displayed, for example, through the computing device. The alert provides indication that the spoken word is identified in the spoken utterances. In further examples, a buffered window of the spoken utterances is captured which is associated with a detection of the specific word. A live transcription of the content in the buffered window is generated and provided to a computing device of the user.

Abstract: Non-limiting examples of the present disclosure describe proactive speech detection on behalf of a user and alerting the user when a specific word, name, etc. is detected. Speech detection is actively executed through a computing device, where the speech detection analyzes spoken utterances in association with a dynamic grammar file stored locally on the computing device. An alert is generated that indicates when a spoken word of the utterances matches a word stored in the dynamic grammar file. The alert may be displayed, for example, through the computing device. The alert provides indication that the spoken word is identified in the spoken utterances. In further examples, a buffered window of the spoken utterances is captured which is associated with a detection of the specific word. A live transcription of the content in the buffered window is generated and provided to a computing device of the user.