Abstract: A data processing system implements displaying, on a first device to a first participant, a first user interface for presentation of audio content, the first user interface including a navigation tool configured to visually represent contextual events in the audio content and a first selectable indicator linked to a second participant. The data processing system further implements receiving a first user selection of the first selectable indicator; and initiating, in response to at least the first user selection, a first telecommunication session between the first participant and the second participant.

Abstract: A method and system for identifying enhancement suggestions for a document and displaying the identified suggestions in a user-friendly manner may include examining the document to identify an enhancement fora portion of content in the document, enabling display of a first user interface element for previewing the identified enhancement as applied to the content, receiving a request to select the identified enhancement, and upon receiving the request enabling display of a second user interface element for accepting the identified enhancement. The first user interface element may provide a preview of the document post enhancement.

Abstract: Techniques performed by a data processing system for processing voice content received from a user herein include receiving a first audio input from a user comprising spoken content, analyzing the first audio input using one or more natural language processing models to produce a first textual output comprising a textual representation of the first audio input, analyzing the first textual output using one or more machine learning models to determine first context information of the first textual output, and processing the first textual output in the application based on the first context information.

Abstract: Techniques performed by a data processing system for processing voice content received from a user herein include receiving a first audio input from the user comprising a mixed-mode dictation, analyzing, using one or more machine learning (ML) models, the first audio input to obtain a first interpretation of the mixed-mode dictation, presenting the first interpretation to the user in an application on the data processing system, receiving a second audio input from the user comprising a corrective command, analyzing the second audio input to obtain a second interpretation of the restatement of the mixed-mode dictation presenting the second interpretation to the user, receiving an indication from the user that the second interpretation is a correct interpretation of the mixed-mode dictation, and modifying the operating parameters of the one or more machine learning models to interpret the subsequent instances of the mixed-mode dictation based on the second interpretation.

Abstract: A data processing system implements displaying, on a first device to a first participant, a first user interface for presentation of audio content, the first user interface including a navigation tool configured to visually represent contextual events in the audio content and a first selectable indicator linked to a second participant. The data processing system further implements receiving a first user selection of the first selectable indicator; and initiating, in response to at least the first user selection, a first telecommunication session between the first participant and the second participant.

Abstract: An audio-visual management system and process for facilitating comprehension of electronic documents. As an example, a user may access contents of an electronic document via a user interface and request a speech-synthesized recitation of any text in the electronic document. In addition, the user interface can include a navigation tool configured to visually represent significant events in the electronic document via selectable indicators, including but not limited to comments, slides, images, graphs, and/or other internal contextual markers. These indicators can serve as navigation options that can provide guidance to users as they listen to a reading of the electronic document. User selection of an indicator can initiate an audio presentation of textual content that is directly associated with the specified event. In addition, users can view availability of others currently listening to the document and connect with them to create a joint listening experience.

Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for generating summary content are presented. Voice audio data and video data for an electronic meeting may be received. A language processing model may be applied to a transcript of the audio data and textual importance scores may be calculated. A video/image model may be applied to the video data and visual importance scores may be calculated. A combined importance score may be calculated for sections of the electronic meeting based on the textual importance scores and the visual importance scores. A meeting summary that includes summary content from sections for which combined importance scores exceed a threshold value may be generated.

Abstract: A computing system, including a processor configured to receive a content item. The processor may extract a plurality of content item features from the content item and receive a user request to summarize the content item. The user request may have associated contextual metadata indicating a spatiotemporal context in which the user request is received. Based on the contextual metadata, the processor may determine an estimated distraction level for the user. The processor may select a subset of the plurality of content item features based on the contextual metadata. The processor may generate a content item summary including the subset of the plurality of content item features based at least in part on the estimated distraction level. The processor may convey the content item summary for output on one or more output devices.

Abstract: A system for dynamically displaying specific sections of a file depending on a user identity is provided. The system utilizes access control data to enable an author to generate and share a file with a number of consumers and have each recipient view a customized set of sections of the file depending on access permissions associated with each recipient. The file can be in any format, e.g., a word processing document, presentation document, a media file, or any other file having a number of sections. A section of a file can be any definitive unit of data, such as a page, slide, tab, worksheet, video segment, audio segment, etc. Permissions can be based on a user's permission level, work history, skill level, role in an organization, title, etc. The system can also prevent access to certain sections of a file depending on the permissions associated with a consumer.

Abstract: Techniques performed by a data processing system for processing voice content received from a user herein include receiving a first audio input from the user comprising a mixed-mode dictation, analyzing, using one or more machine learning (ML) models, the first audio input to obtain a first interpretation of the mixed-mode dictation, presenting the first interpretation to the user in an application on the data processing system, receiving a second audio input from the user comprising a corrective command, analyzing the second audio input to obtain a second interpretation of the restatement of the mixed-mode dictation presenting the second interpretation to the user, receiving an indication from the user that the second interpretation is a correct interpretation of the mixed-mode dictation, and modifying the operating parameters of the one or more machine learning models to interpret the subsequent instances of the mixed-mode dictation based on the second interpretation.

Abstract: Collaborator content selection and manipulation actions and comments during interaction with a document are recorded to enhance asynchronous collaboration. The collaborator content selection and manipulation actions and comments are recorded during interaction with a document in a first collaboration viewport at a first time and played back in a second collaboration viewport at a second time while the same or a different instance of the document is displayed. The collaborator content selection and manipulation actions and comments include at least text selection, mouse or pen movements, and voice comments or ink annotations that are played back to recreate the collaborator changes and comments as though they were occurring in real-time, thereby creating a user experience that is more like the “over the shoulder” collaboration that would be available to collaborators that are at the same physical location.

Abstract: A method for creating events for use by an electronic calendar application. A computer device running a calendar application displays a GUI having a representation of a calendar. A first widget on the GUI initiates a software routine for defining an event. The routine generates an interface window having a plurality of event detail widgets which allow the user to interactively define details of the event. Once the details are entered, the event is saved as a multimedia object, and the multimedia object is placed onto the calendar representation. Further, details of the event may include additional multimedia content. Also, the calendar representation itself may include multimedia content. The event may be defined with an approximate time frame rather than a specific time frame. For example, an event may be linked to another event rather than to a specific time frame.

Abstract: A computing system, including a processor configured to receive a content item. The processor may extract a plurality of content item features from the content item and receive a user request to summarize the content item. The user request may have associated contextual metadata indicating a spatiotemporal context in which the user request is received. Based on the contextual metadata, the processor may determine an estimated distraction level for the user. The processor may select a subset of the plurality of content item features based on the contextual metadata. The processor may generate a content item summary including the subset of the plurality of content item features based at least in part on the estimated distraction level. The processor may convey the content item summary for output on one or more output devices.

Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for generating summary content are presented. Voice audio data and video data for an electronic meeting may be received. A language processing model may be applied to a transcript of the audio data and textual importance scores may be calculated. A video/image model may be applied to the video data and visual importance scores may be calculated. A combined importance score may be calculated for sections of the electronic meeting based on the textual importance scores and the visual importance scores. A meeting summary that includes summary content from sections for which combined importance scores exceed a threshold value may be generated.

Abstract: Progressive functionality command and object access for object and other content insertion and modification are provided. In a software application user interface, when a given command is selected, where the command is a parent command having one or more child commands, a subset of all available child commands under the selected parent command may be provided in the user interface in proximity to the selected parent command. If a user needs more or different commands than are presented in the subset, a contextual pane may be selectively presented in the user interface having a number of additional available commands for selection by the user. Once the contextual pane is displayed, it may stay displayed until it is manually or automatically dismissed.

Abstract: A system configured intelligently reusing content and format is provided. The system receives a selection of data to be copied and an indication to copy the selected data and copies the selected data. The system receives an indication to paste the selected data at a second location. The selected data is analyzed to determine one or more options available for the paste, whereby each of the options being selectable to change an aspect of the selected data being pasted. The one or more options and an image of a placeholder representing the selected data are presented at the second location. The system receives a selection of an option from the one or more options. In response to receiving the selection of the option, the system causes presentation of the selected data in place of the image of the placeholder based on the selected option.

Abstract: Systems and methods for managing an inline conversation area within a document are provided. In example embodiments, a collaboration system causes presentation of a user interface displaying a document that is being collaboratively edited by a plurality of users. The collaboration system receives an indication to present an inline conversation area within the document. In response, the inline conversation area is displayed within the document on the user interface, whereby the inline conversation area is visually distinguished from content of the document. The collaboration system receives, via the inline conversation area, input from the plurality of users. The input comprises comments being exchanged between the plurality of users and draft content. The inputs are displayed in the inline conversation area within the document on the user interface.

Abstract: Techniques performed by a data processing system for processing voice content received from a user herein include receiving a first audio input from a user comprising spoken content, analyzing the first audio input using one or more natural language processing models to produce a first textual output comprising a textual representation of the first audio input, analyzing the first textual output using one or more machine learning models to determine first context information of the first textual output, and processing the first textual output in the application based on the first context information.

Abstract: Systems and methods for presenting content updates in a collaborative computing environment. One system includes a memory storing content and annotations generated in the collaborative computing environment an electronic processor communicatively coupled to the memory. The electronic processor is configured to retrieve, from the memory, a plurality of annotations associated with a document. The electronic processor is configured to assign a relevancy score to each of the plurality of annotations based on at least one relevancy factor associated with the annotation. The electronic processor is configured to determine a subset of the plurality of annotations from the plurality of annotations based on the relevancy score for each annotation. The electronic processor is configured to display the subset of the plurality of annotations.

Abstract: The systems and techniques disclosed here feature a device including an audio analyzer connected to microphone(s) monitoring a conversation between one or more individuals. The audio analyzer can identify auditory expressions from audio captured by the microphone, where the auditory expressions can include linguistic expressions and nonlinguistic expressions. The audio analyzer can analyze the linguistic expressions to identify a topic and a time period when the topic was discussed. A video analyzer can be connected to camera(s) monitoring the conversation. The video analyzer can identify non-auditory expressions by the individuals from video captured by the camera. A sentiment analyzer can analyze auditory expressions during the time period when the topic was discussed and non-auditory expressions during the time period when the topic was discussed to determine sentiments to the topic. A processor can analyze the determined sentiments to the topic to determine a group sentiment to the topic.