Patents by Inventor Chenguang Zhu

Chenguang Zhu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11990132
    Abstract: A transcription of audio speech included in electronic content associated with a meeting is created by an ASR model trained on speech-to-text data. The transcription is post-processed by modifying text included in the transcription, for example, by modifying punctuation, grammar, or formatting introduced by the ASR model and by changing or omitting one or more words that were included in both the audio speech and the transcription. After the transcription is post-processed, output based on the post-processed transcription is generated in the form of a meeting summary and/or template.
    Type: Grant
    Filed: February 28, 2023
    Date of Patent: May 21, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Chenguang Zhu, Yu Shi, William Isaac Hinthorn, Nanshan Zeng, Ruochen Xu, Liyang Lu, Xuedong Huang
  • Publication number: 20240075841
    Abstract: Described are a method for suppressing overshoot of an output voltage or output current, a charging device, and a medium. The method for suppressing the overshoot of the output voltage or output current includes the following. A loop in an open-loop state in a closed-loop control circuit is determined. A wave-sending control value output by the closed-loop control circuit at a present beat is obtained. The wave-sending control value output at the present beat is assigned to an open-loop output value at the present beat, where the open-loop output value is an output value of the loop in the open-loop state. An open-loop output value of a loop in the open-loop state at a next beat is calculated by using an assigned open-loop output value at the present beat.
    Type: Application
    Filed: November 9, 2023
    Publication date: March 7, 2024
    Inventors: Feng Fan, Kaixuan Zhang, Yisai Wu, Chenguang Li, Jiayou Fu, Haidong Zhang, Jianguo Zhu
  • Patent number: 11875787
    Abstract: This document relates to machine learning. One example includes a method or technique that can be performed on a computing device. The method or technique can include obtaining a task-semantically-conditioned generative model that has been pretrained based at least on a first training data set having unlabeled training examples and semantically conditioned based at least on a second training data set having dialog act-labeled utterances. The method or technique can also include inputting dialog acts into the semantically-conditioned generative model and obtaining synthetic utterances that are output by the semantically-conditioned generative model. The method or technique can also include outputting the synthetic utterances.
    Type: Grant
    Filed: October 11, 2022
    Date of Patent: January 16, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Nanshan Zeng, Jianfeng Gao
  • Publication number: 20230376789
    Abstract: Systems and techniques are provided for facilitating the automatic discovery and application of rules for refining the training of pretrained models, such as natural language processing models. Weak symbolic rules are automatically generated from the identification and processing of sparse labeled data by the pretrained model(s). Once the weak rules are generated, they are integrated into the model(s) via an attention mechanism to supplement the direct training performed by the sparse labeled data and to thereby boost a supervision signal generated by the sparse labeled data on any newly processed unlabeled data in the intended runtime environment(s) where the models are applied.
    Type: Application
    Filed: June 10, 2022
    Publication date: November 23, 2023
    Inventors: Reid Allen PRYZANT, Chenguang ZHU, Ziyi YANG, Yichong XU, Nanshan ZENG
  • Patent number: 11798529
    Abstract: A language module is joint trained with a knowledge module for natural language understanding by aligning a first knowledge graph with a second knowledge graph. The knowledge module is trained on the aligned knowledge graphs. Then, the knowledge module is integrated with the language module to generate an integrated knowledge-language module.
    Type: Grant
    Filed: May 18, 2021
    Date of Patent: October 24, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Chenguang Zhu, Nanshan Zeng
  • Publication number: 20230229960
    Abstract: Some disclosed systems are configured to obtain a knowledge module configured to receive one or more knowledge inputs corresponding to one or more different modalities and generate a set of knowledge embeddings to be integrated with a set of multi-modal embeddings generated by a multi-modal main model. The systems receive a knowledge input at the knowledge module, identify a knowledge type associated with the knowledge input, and extract a knowledge unit from the knowledge input. The systems select a representation model that corresponds to the knowledge type and select a grounding type configured to ground the at least one knowledge unit into the representation model. The systems then ground the knowledge unit into the representation model according to the grounding type.
    Type: Application
    Filed: January 19, 2022
    Publication date: July 20, 2023
    Inventors: Chenguang ZHU, Lu YUAN, Yao QIAN, Yu SHI, Nanshan ZENG, Xuedong David HUANG
  • Publication number: 20230205985
    Abstract: A transcription of audio speech included in electronic content associated with a meeting is created by an ASR model trained on speech-to-text data. The transcription is post-processed by modifying text included in the transcription, for example, by modifying punctuation, grammar, or formatting introduced by the ASR model and by changing or omitting one or more words that were included in both the audio speech and the transcription. After the transcription is post-processed, output based on the post-processed transcription is generated in the form of a meeting summary and/or template.
    Type: Application
    Filed: February 28, 2023
    Publication date: June 29, 2023
    Inventors: Chenguang ZHU, Yu SHI, William Isaac HINTHORN, Nanshan ZENG, Rouchen XU, Liyang LU, Xuedong HUANG
  • Patent number: 11615799
    Abstract: A transcription of audio speech included in electronic content associated with a meeting is created by an ASR model trained on speech-to-text data. The transcription is post-processed by modifying text included in the transcription, for example, by modifying punctuation, grammar, or formatting introduced by the ASR model and by changing or omitting one or more words that were included in both the audio speech and the transcription. After the transcription is post-processed, output based on the post-processed transcription is generated in the form of a meeting summary and/or template.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: March 28, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Chenguang Zhu, Yu Shi, William Isaac Hinthorn, Nanshan Zeng, Ruochen Xu, Liyang Lu, Xuedong Huang
  • Publication number: 20230076095
    Abstract: This document relates to machine learning. One example includes a method or technique that can be performed on a computing device. The method or technique can include obtaining a task-adapted generative model that has been tuned using one or more task-specific seed examples. The method or technique can also include inputting dialog acts into the task-adapted generative model and obtaining synthetic utterances that are output by the task-adapted generative model. The method or technique can also include populating a synthetic training corpus with synthetic training examples that include the synthetic utterances. The synthetic training corpus may be suitable for training a natural language understanding model.
    Type: Application
    Filed: October 11, 2022
    Publication date: March 9, 2023
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Nanshan Zeng, Jianfeng Gao
  • Patent number: 11508360
    Abstract: This document relates to machine learning. One example includes a method or technique that can be performed on a computing device. The method or technique can include obtaining a task-adapted generative model that has been tuned using one or more task-specific seed examples. The method or technique can also include inputting dialog acts into the task-adapted generative model and obtaining synthetic utterances that are output by the task-adapted generative model. The method or technique can also include populating a synthetic training corpus with synthetic training examples that include the synthetic utterances. The synthetic training corpus may be suitable for training a natural language understanding model.
    Type: Grant
    Filed: September 15, 2020
    Date of Patent: November 22, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Nanshan Zeng, Jianfeng Gao
  • Patent number: 11403304
    Abstract: According to one or more embodiments, operations may include gathering a set of machine learning (ML) projects from one or more repositories of ML projects based on a filtering criteria. The operations may also include ensuring executability of ML pipelines in the set of ML projects. In addition, the operations may include identifying irrelevant portions of the ML pipelines in the set of ML projects. Moreover, the operations may include generating quality features for the set of ML projects. In addition, the operations may include generating diversity features for the set of ML projects. Moreover, the operations may include selecting a subset of ML projects from the set of ML projects based on the quality features and the diversity features. In addition, the operations may include storing the subset of ML projects in a corpus of ML projects that may be adapted for use in new ML projects.
    Type: Grant
    Filed: September 2, 2020
    Date of Patent: August 2, 2022
    Assignee: FUJITSU LIMITED
    Inventors: Ripon K. Saha, Mukul R. Prasad, Chenguang Zhu
  • Publication number: 20220230625
    Abstract: A language module is joint trained with a knowledge module for natural language understanding by aligning a first knowledge graph with a second knowledge graph. The knowledge module is trained on the aligned knowledge graphs. Then, the knowledge module is integrated with the language module to generate an integrated knowledge-language module.
    Type: Application
    Filed: May 18, 2021
    Publication date: July 21, 2022
    Inventors: Chenguang ZHU, Nanshan ZENG
  • Publication number: 20220230629
    Abstract: A speech module is joint trained with a knowledge module by transforming a first knowledge graph into an acoustic knowledge graph. The knowledge module is trained on the acoustic knowledge graph. Then, the knowledge module is integrated with the speech module to generate an integrated knowledge-speech module. In some instances, the speech module included in the integrated knowledge-speech module is aligned with a language module to generate an optimized speech model configured to leverage acoustic information and acoustic-based knowledge information, along with language information.
    Type: Application
    Filed: May 18, 2021
    Publication date: July 21, 2022
    Inventors: Chenguang ZHU, Nanshan ZENG
  • Publication number: 20220230628
    Abstract: A system is provided for generating an optimized speech model by training a knowledge module on a knowledge graph. A language module is trained on unlabeled text data and a speech module is trained on unlabeled acoustic data. The knowledge module is integrated with the language module to perform semantic analysis using knowledge-graph based information. The speech module is then aligned to the language module of the integrated knowledge-language module. The speech module is then configured as an optimized speech model configured to leverage acoustic and language information in natural language processing tasks.
    Type: Application
    Filed: May 18, 2021
    Publication date: July 21, 2022
    Inventors: Chenguang ZHU, Nanshan ZENG
  • Publication number: 20220084510
    Abstract: This document relates to machine learning. One example includes a method or technique that can be performed on a computing device. The method or technique can include obtaining a task-adapted generative model that has been tuned using one or more task-specific seed examples. The method or technique can also include inputting dialog acts into the task-adapted generative model and obtaining synthetic utterances that are output by the task-adapted generative model. The method or technique can also include populating a synthetic training corpus with synthetic training examples that include the synthetic utterances. The synthetic training corpus may be suitable for training a natural language understanding model.
    Type: Application
    Filed: September 15, 2020
    Publication date: March 17, 2022
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Nanshan Zeng, Jianfeng Gao
  • Publication number: 20220067054
    Abstract: According to one or more embodiments, operations may include gathering a set of machine learning (ML) projects from one or more repositories of ML projects based on a filtering criteria. The operations may also include ensuring executability of ML pipelines in the set of ML projects. In addition, the operations may include identifying irrelevant portions of the ML pipelines in the set of ML projects. Moreover, the operations may include generating quality features for the set of ML projects. In addition, the operations may include generating diversity features for the set of ML projects. Moreover, the operations may include selecting a subset of ML projects from the set of ML projects based on the quality features and the diversity features. In addition, the operations may include storing the subset of ML projects in a corpus of ML projects that may be adapted for use in new ML projects.
    Type: Application
    Filed: September 2, 2020
    Publication date: March 3, 2022
    Applicant: FUJITSU LIMITED
    Inventors: Ripon K. SAHA, Mukul R. PRASAD, Chenguang ZHU
  • Publication number: 20210375289
    Abstract: A transcription of audio speech included in electronic content associated with a meeting is created by an ASR model trained on speech-to-text data. The transcription is post-processed by modifying text included in the transcription, for example, by modifying punctuation, grammar, or formatting introduced by the ASR model and by changing or omitting one or more words that were included in both the audio speech and the transcription. After the transcription is post-processed, output based on the post-processed transcription is generated in the form of a meeting summary and/or template.
    Type: Application
    Filed: May 29, 2020
    Publication date: December 2, 2021
    Inventors: Chenguang Zhu, Yu Shi, William Isaac Hinthorn, Nanshan Zeng, Ruochen Xu, Liyang Lu, Xuedong Huang
  • Patent number: 11157490
    Abstract: Conversational virtual assistance for delivering relevant query solutions is provided. A virtual assistant system comprises various components associated with developing a knowledge database that can be searched for finding documents that fulfill the user's intent. The virtual assistant system further comprises components for receiving a query from a user, extracting entities for understanding the user's intent, and for searching a knowledge database for documents responsive to the query. When additional information is needed for determining more relevant results, a conversation strategy is determined, and a question is formulated for generating a conversation with the user for clarifying the user's intent, confirming a solution, or obtaining additional information. The user is enabled to provide a follow-up response that is related to a previously identified entity. The entity is edited in the query, and responses are refined responsive to the edited query.
    Type: Grant
    Filed: February 16, 2017
    Date of Patent: October 26, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Chenguang Zhu, Weizhu Chen, Jianwen Zhang, Xuedong Huang, Zheng Chen
  • Publication number: 20190156220
    Abstract: Systems and methods for machine comprehension are provided. In example embodiments, a machine accesses a context and a question related to the context. The machine determines a low-level meaning of the question and a low-level meaning of the context, the low-level meaning corresponding to words or phrases. The machine determines a high-level meaning of the question and a high-level meaning of the context, the high-level meaning corresponding to sentences or paragraphs. The machine computes, for each position i in the context, a first probability that an answer to the question starts at the position i. The machine computes, for each position j in the context, a second probability that the answer to the question ends at the position j. The machine determines the answer to the question based on the computed first probabilities and the computed second probabilities.
    Type: Application
    Filed: November 22, 2017
    Publication date: May 23, 2019
    Inventors: Chenguang Zhu, Hsin-Yuan Huang, Pengcheng He, Weizhu Chen, Yelong Shen, Zheng Chen
  • Publication number: 20180232376
    Abstract: Conversational virtual assistance for delivering relevant query solutions is provided. A virtual assistant system comprises various components associated with developing a knowledge database that can be searched for finding documents that fulfill the user's intent. The virtual assistant system further comprises components for receiving a query from a user, extracting entities for understanding the user's intent, and for searching a knowledge database for documents responsive to the query. When additional information is needed for determining more relevant results, a conversation strategy is determined, and a question is formulated for generating a conversation with the user for clarifying the user's intent, confirming a solution, or obtaining additional information. The user is enabled to provide a follow-up response that is related to a previously identified entity. The entity is edited in the query, and responses are refined responsive to the edited query.
    Type: Application
    Filed: February 16, 2017
    Publication date: August 16, 2018
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Chenguang Zhu, Weizhu Chen, Jianwen Zhang, Xuedong Huang, Zheng Chen