Patents by Inventor Min Xiao-Devins
Min Xiao-Devins has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240163400Abstract: A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. The transcript includes strings that are associated with respective timestamps and respective speaker identifiers. Speaker segments—sequences of consecutive strings attributed to the same speaker—are identified in the transcript. A speaker segment is selected based on its duration in time and one or more strings are selected from with the selected speaker segment for inclusion in the conference summary. A short video conference summary or a short audio conference summary is then generated using timestamps from the transcript associated with strings (e.g., sentences) that have been selected for inclusion in the conference summary. The short video or audio summary may be presented to users to enable efficient storage and transmission of information from the conference within a unified communications system.Type: ApplicationFiled: November 17, 2023Publication date: May 16, 2024Inventors: Tao Huang, Xiaoli Song, Hui Wen, Melinda Min Xiao-Devins, Ran Yan, Fangyi Zhao
-
Publication number: 20240113906Abstract: Methods and systems provide for dynamically generated topic segments for a communication session. In one embodiment, the system connects to a communication session with a number of participants; receives a list of topics; receives a transcript of a conversation between the participants produced during the communication session, the transcript including timestamps for a number of utterances associated with speaking participants; for each topic in the list of topics, segments the utterances into one or more topic segments based on the topic; for each of the segments, classifies whether the topic segment is related to the topic, and transmits, to one or more client devices, a list of the topic segments for the communication session.Type: ApplicationFiled: December 13, 2023Publication date: April 4, 2024Inventors: Davide Giovanardi, Helgi Hilmarsson, Stephen Muchovej, Mengxiao Qian, Xiaoli Song, Min Xiao-Devins
-
Publication number: 20240029727Abstract: Methods and systems provide for dynamic conversation alerts within a communication session. In one embodiment, the system presents, to a client device associated with a user of a communication platform, a user interface (“UP”) including a prompt for the user to submit one or more alert phrases, each alert phrase being associated with a category; receives, from the client device, a list of submitted alert phrases; and receives a transcript of a communication session between participants. For each utterance in the transcript, the system determines whether one or more predictions of relatedness are present between the utterance and one or more alert phrases from the list of submitted alert phrases. The system then transmits, to the client device, a list of related categories, each related category including one or more timestamps of utterances for which a prediction of relatedness is present for an alert phrase associated with that category.Type: ApplicationFiled: July 24, 2022Publication date: January 25, 2024Inventors: Davide Giovanardi, Stephen Muchovej, Xiaoli Song, Min Xiao-Devins
-
Patent number: 11876633Abstract: Methods and systems provide for dynamically generated topic segments for a communication session. In one embodiment, the system connects to a communication session with a number of participants; receives a list of topics; receives a transcript of a conversation between the participants produced during the communication session, the transcript including timestamps for a number of utterances associated with speaking participants; for each topic in the list of topics, segments the utterances into one or more topic segments based on the topic; for each of the segments, classifies whether the topic segment is related to the topic, and transmits, to one or more client devices, a list of the topic segments for the communication session.Type: GrantFiled: April 30, 2022Date of Patent: January 16, 2024Assignee: Zoom Video Communications, Inc.Inventors: Davide Giovanardi, Helgi Hilmarsson, Stephen Muchovej, Mengxiao Qian, Xiaoli Song, Min Xiao-Devins
-
Patent number: 11863711Abstract: A transcript of a conference is processed to extract a conference summary. The transcript includes strings that are associated with respective timestamps and respective speaker identifiers. Speaker segments—sequences of consecutive strings attributed to the same speaker—are identified in the transcript. A speaker segment is selected based on its duration in time and one or more strings are selected from with the selected speaker segment for inclusion in the conference summary. A short video conference summary or a short audio conference summary is then generated using timestamps from the transcript associated with strings that have been selected for inclusion in the conference summary. The short video or audio summary may be presented to users to enable efficient storage and transmission of information from the conference within a unified communications system.Type: GrantFiled: October 10, 2022Date of Patent: January 2, 2024Assignee: Zoom Video Communications, Inc.Inventors: Tao Huang, Xiaoli Song, Hui Wen, Melinda Min Xiao-Devins, Ran Yan, Fangyi Zhao
-
Publication number: 20230353407Abstract: Methods and systems provide for dynamically generated topic segments for a communication session. In one embodiment, the system connects to a communication session with a number of participants; receives a list of topics; receives a transcript of a conversation between the participants produced during the communication session, the transcript including timestamps for a number of utterances associated with speaking participants; for each topic in the list of topics, segments the utterances into one or more topic segments based on the topic; for each of the segments, classifies whether the topic segment is related to the topic, and transmits, to one or more client devices, a list of the topic segments for the communication session.Type: ApplicationFiled: April 30, 2022Publication date: November 2, 2023Inventors: Davide Giovanardi, Helgi Hilmarsson, Stephen Muchovej, Mengxiao Qian, Xiaoli Song, Min Xiao-Devins
-
Publication number: 20230283496Abstract: In one embodiment, the system connects to a communication session with a number of participants; receives a transcript of a conversation between the participants; extracts utterances from the transcript; associates a subset of the utterances with a first group of speakers and the remaining subset of the utterances with a second group of speakers; calculates one or more statistical metrics for a number of engagement metrics based on the utterances of the first group of speakers and the utterances of the second group of speakers; assigns a weight to each of the engagement metrics; determines an engagement score for the communication session based on the assigned weights for the engagement metrics; and presents, to one or more users, the engagement score for the communication session.Type: ApplicationFiled: March 2, 2022Publication date: September 7, 2023Inventors: Stephen Muchovej, Min Xiao-Devins
-
Publication number: 20230245658Abstract: Methods and systems provide an asynchronous pipeline for artificial intelligence service requests. In one embodiment, the system receives, at a gateway service, access to content associated with a communication session; sends, to an artificial intelligence (AI) cluster including a number of AI services, a data payload, the data payload including a location to access the content and a number of requests for AI services to be performed by one or more AI models hosted on the AI cluster using the content as an input; receives one or more AI service results as the AI cluster completes the corresponding requests for the AI services; and stores each received AI service result in one or more databases.Type: ApplicationFiled: January 31, 2022Publication date: August 3, 2023Inventors: Haifeng Geng, Jian Jin, Stephen Muchovej, Mengxiao Qian, Min Xiao-Devins, Fangyi Zhao
-
Publication number: 20230245646Abstract: Methods and systems provide for presenting time distributions of participants across topic segments in a communication session. In one embodiment, the system connects to a communication session with a number of participants; receives a transcript of a conversation between the participants produced during the communication session, the transcript including timestamps for each utterance of a speaking participant; determines, based on analysis of the transcript, a meeting type for the communication session; generates a number of topic segments for the conversation and respective timestamps for the topic segments; for each participant, analyzes the time spent by the participant on each of the generated topic segments in the meeting; and presents, to one or more users, data on the time distribution of participants for each topic segment and across topic segments within the conversation.Type: ApplicationFiled: January 31, 2022Publication date: August 3, 2023Inventors: Vijay Parthasarathy, David Dharmendran Rajkumar, Tao Tang, Min Xiao-Devins
-
Publication number: 20230230596Abstract: Methods and systems provide for presenting the results of talking speed analysis per topic segment in a communication session.Type: ApplicationFiled: January 31, 2022Publication date: July 20, 2023Inventors: Vijay Parthasarathy, Xiaoli Song, Yaling Song, Shaoyang Wu, Min Xiao-Devins
-
Publication number: 20230230586Abstract: Methods and systems provide for extracting next step sentences from a communication session. In one embodiment, the system connects to a communication session involving one or more participants; receives or generates a transcript of a conversation; extracts, from the transcript, a number of utterances including one or more sentences spoken by the participants; identifies a subset of the number of utterances spoken by a subset of the participants associated with a prespecified organization; extracts one or more next step sentences within the subset of the utterances, where the next step sentences each include an owner-action pair structure in which the action is an actionable verb in future tense or present tense; determines a set of analytics data corresponding to the next step sentences and the associated participants; and presents, to one or more users, at least a subset of the analytics data corresponding to the next step sentences.Type: ApplicationFiled: January 31, 2022Publication date: July 20, 2023Inventors: Davide Giovanardi, Zhipeng Guo, Vijay Parthasarathy, Xiaoli Song, Min Xiao-Devins
-
Publication number: 20230230588Abstract: Methods and systems provide for extracting filler words and phrases from a communication session. In one embodiment, the system receives a transcript of a conversation involving one or more participants produced during a communication session; extracts, from the transcript, utterances including one or more sentences spoken by the participants; identifies a subset of the utterances spoken by a subset of the participants associated with a prespecified organization; extracts filler phrases within the subset of utterances, the filler phrases each comprising one or more words representing disfluencies within a sentence, where extracting the filler phrases includes applying filler detection rules; and presents, for display at one or more client devices, data corresponding to the extracted filler phrases.Type: ApplicationFiled: January 31, 2022Publication date: July 20, 2023Inventors: Davide Giovanardi, Vijay Parthasarathy, Min Xiao-Devins, Xiaojing Zhao
-
Publication number: 20230136309Abstract: A virtual assistant is configured to automatically identify tasks for a user by processing text from various applications of a unified communications platform (e.g., transcripts of conferences, voicemails, emails, and chat logs) to detect action items and infer associated action item data (e.g., task owner, location, and due date). For example, a virtual assistant system may be configured to utilize machine learning natural language understanding technology to extract action items from various input text to form a to-do list with due dates for the task owner. In some implementations, a two-tier machine learning model topology is used to identify action items in strings. The system may recognize named entities such as nouns, verbs, dates/times, locations of action item sentences. The output information may be displayed on a dashboard, in push notifications, or within other user interface aspects of a personal device, thus providing notification or task planning for personal assistance.Type: ApplicationFiled: October 29, 2021Publication date: May 4, 2023Inventor: Melinda Min Xiao-Devins
-
Patent number: 11616658Abstract: A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. A graphical user interface is presented that enables a user to edit highlighting to select portions of a conference recording for inclusion in the conference summary. The user can edit highlighting on strings of a transcript and/or on a playback slide bar and the highlighting edits are propagated to both of these interfaces. Video clips selected for inclusion in a summary based on timestamps of strings in a transcript may be extended forward in time to incorporate a nearest I-frame of video. The short video or audio summary may be presented to users along with a text summary of the conference to enable efficient storage and transmission of information from the conference within a unified communications system.Type: GrantFiled: April 30, 2021Date of Patent: March 28, 2023Assignee: Zoom Video Communications, Inc.Inventors: Dan Hu, Hao Huang, Tao Huang, Dingping Jiang, Shuo Luo, Juhua Ma, Chuan Qin, Xiaoli Song, Facheng Wang, Hongjuan Wang, Hui Wen, Melinda Min Xiao-Devins, Qingquan Xie, Ran Yan, Fangyi Zhao
-
Publication number: 20230035155Abstract: A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. The transcript includes strings that are associated with respective timestamps and respective speaker identifiers. Speaker segments—sequences of consecutive strings attributed to the same speaker—are identified in the transcript. A speaker segment is selected based on its duration in time and one or more strings are selected from with the selected speaker segment for inclusion in the conference summary. A short video conference summary or a short audio conference summary is then generated using timestamps from the transcript associated with strings (e.g., sentences) that have been selected for inclusion in the conference summary. The short video or audio summary may be presented to users to enable efficient storage and transmission of information from the conference within a unified communications system.Type: ApplicationFiled: October 10, 2022Publication date: February 2, 2023Inventors: Tao Huang, Xiaoli Song, Hui Wen, Melinda Min Xiao-Devins, Ran Yan, Fangyi Zhao
-
Patent number: 11570403Abstract: A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. A short video conference summary or a short audio conference summary is then generated using timestamps from the transcript associated with strings (e.g., sentences) in the transcript that have been selected for highlighting as part of the conference summary. The short video or audio summary may be presented to users along with a text summary of the conference to enable efficient storage and transmission of information from the conference within a unified communications system.Type: GrantFiled: April 30, 2021Date of Patent: January 31, 2023Assignee: Zoom Video Communications, Inc.Inventors: Tao Huang, Xiaoli Song, Hui Wen, Melinda Min Xiao-Devins, Ran Yan, Fangyi Zhao
-
Publication number: 20220353100Abstract: A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. Scores are determined for strings of the transcript that are used to select strings for inclusion in the conference summary. Determining the scores includes determining respective sentence vectors for strings. A sentence vector has elements corresponding to words in the transcript that are proportional to occurrences of the word in the string and inversely proportional to occurrences of the word in the transcript. A short video conference summary or a short audio conference summary is then generated using timestamps from the transcript associated with strings (e.g., sentences) that have been selected for inclusion in the conference summary. The short video or audio summary may be presented to users to enable efficient storage and transmission of conference information within a unified communications system.Type: ApplicationFiled: April 30, 2021Publication date: November 3, 2022Inventors: Tao Huang, Xiaoli Song, Hui Wen, Melinda Min Xiao-Devins, Ran Yan, Fangyi Zhao
-
Publication number: 20220353101Abstract: A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. A graphical user interface is presented that enables a user to edit highlighting to select portions of a conference recording for inclusion in the conference summary. The user can edit highlighting on strings of a transcript and/or on a playback slide bar and the highlighting edits are propagated to both of these interfaces. Video clips selected for inclusion in a summary based on timestamps of strings in a transcript may be extended forward in time to incorporate a nearest I-frame of video. The short video or audio summary may be presented to users along with a text summary of the conference to enable efficient storage and transmission of information from the conference within a unified communications system.Type: ApplicationFiled: April 30, 2021Publication date: November 3, 2022Inventors: Dan Hu, Hao Huang, Tao Huang, Dingping Jiang, Shuo Luo, Juhua Ma, Chuan Qin, Xiaoli Song, Facheng Wang, Hongjuan Wang, Hui Wen, Melinda Min Xiao-Devins, Qingquan Xie, Ran Yan, Fangyi Zhao
-
Publication number: 20220353469Abstract: A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. A short video conference summary or a short audio conference summary is then generated using timestamps from the transcript associated with strings (e.g., sentences) in the transcript that have been selected for highlighting as part of the conference summary. The short video or audio summary may be presented to users along with a text summary of the conference to enable efficient storage and transmission of information from the conference within a unified communications system.Type: ApplicationFiled: April 30, 2021Publication date: November 3, 2022Inventors: Tao Huang, Xiaoli Song, Hui Wen, Melinda Min Xiao-Devins, Ran Yan, Fangyi Zhao
-
Publication number: 20220353470Abstract: A transcript of a conference (e.g., a video conference, an audio conference, or a telephone call with two or more participants) is processed to extract a conference summary. The transcript includes strings that are associated with respective timestamps and respective speaker identifiers. Speaker segments—sequences of consecutive strings attributed to the same speaker—are identified in the transcript. A speaker segment is selected based on its duration in time and one or more strings are selected from with the selected speaker segment for inclusion in the conference summary. A short video conference summary or a short audio conference summary is then generated using timestamps from the transcript associated with strings (e.g., sentences) that have been selected for inclusion in the conference summary. The short video or audio summary may be presented to users to enable efficient storage and transmission of information from the conference within a unified communications system.Type: ApplicationFiled: April 30, 2021Publication date: November 3, 2022Inventors: Tao Huang, Xiaoli Song, Hui Wen, Melinda Min Xiao-Devins, Ran Yan, Fangyi Zhao