Patents by Inventor Furu Wei
Furu Wei has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11877016Abstract: The present disclosure provides a technical solution of live comments generating, which may acquire candidate texts highly similar with segments of video as live comments of corresponding segments by matching the candidate texts with the segments, and further generate new live comments based on video segments and existed live comments to enrich the live comments information of related video.Type: GrantFiled: March 16, 2020Date of Patent: January 16, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Lei Cui, Furu Wei, Shaohan Huang, Ming Zhou
-
Publication number: 20230368782Abstract: Systems and methods are provided for training a machine learning model to learn speech representations. Labeled speech data or both labeled and unlabeled data sets is applied to a feature extractor of a machine learning model to generate latent speech representations. The latent speech representations are applied to a quantizer to generate quantized latent speech representations and to a transformer context network to generate contextual representations. Each contextual representation included in the contextual representations is aligned with a phoneme label to generate phonetically-aware contextual representations. Quantized latent representations are aligned with phoneme labels to generate phonetically aware latent speech representations.Type: ApplicationFiled: July 3, 2023Publication date: November 16, 2023Inventors: Yao QIAN, Yu WU, Kenichi KUMATANI, Shujie LIU, Furu WEI, Nanshan ZENG, Xuedong David HUANG, Chengyi WANG
-
Publication number: 20230315969Abstract: A system and method for converting a document is described. The system accesses a document comprising one or more section breaks. The system detects sections of the text document demarked by the one or more section breaks and generates a section title metadata and a section summary metadata for each section of the plurality of sections. The system inserts the section title metadata and the section summary metadata at the corresponding section breaks in the text document. The system modifies the text document into slides. Each slide being formed for each section based on the corresponding section title metadata and the section summary metadata. The system generates a presentation document based on the slides.Type: ApplicationFiled: May 20, 2021Publication date: October 5, 2023Inventors: Tomasz L. Religa, Utsab Bose, Si-Qing CHEN, Lei CUI, Tao Ge, Huitian JIAO, Ravi Mandliya, Kaushik Ramaiah Narayanan, Max Wang, Furu WEI
-
Patent number: 11735171Abstract: Systems and methods are provided for training a machine learning model to learn speech representations. Labeled speech data or both labeled and unlabeled data sets is applied to a feature extractor of a machine learning model to generate latent speech representations. The latent speech representations are applied to a quantizer to generate quantized latent speech representations and to a transformer context network to generate contextual representations. Each contextual representation included in the contextual representations is aligned with a phoneme label to generate phonetically-aware contextual representations. Quantized latent representations are aligned with phoneme labels to generate phonetically aware latent speech representations.Type: GrantFiled: May 14, 2021Date of Patent: August 22, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Yao Qian, Yu Wu, Kenichi Kumatani, Shujie Liu, Furu Wei, Nanshan Zeng, Xuedong David Huang, Chengyi Wang
-
Patent number: 11727270Abstract: A method and system for training a text-to-content recommendation ML model includes training a first ML model using a first training data set, utilizing the trained first ML model to infer information about the data contained in the first training data set, collecting the inferred information to generate a second training data set, and utilizing the first training data set and the second training data set to train a second ML model. The second ML model may be a text-to-content recommendation ML model.Type: GrantFiled: February 24, 2020Date of Patent: August 15, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Ji Li, Amit Srivastava, Xingxing Zhang, Furu Wei, Ming Zhou
-
Patent number: 11705096Abstract: Implementations of the subject matter described herein provide a solution that enables a machine to automatically generate a melody. In this solution, user emotion and/or environment information is used to select a first melody feature parameter from a plurality of melody feature parameters, wherein each of the plurality of melody feature parameters corresponds to a music style of one of a plurality of reference melodies. The first melody feature parameter is further used to generate a first melody that conforms to the music style and is different from the reference melody. Thus, a melody that matches user emotions and/or environmental information may be automatically created.Type: GrantFiled: May 24, 2019Date of Patent: July 18, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Shaohan Huang, Lei Cui, Tao Ge, Furu Wei, Ming Zhou
-
Publication number: 20230206670Abstract: There is provided a solution for semantic representation of text in a document. In this solution, textual information comprising a sequence of text elements (220) and layout information (230) of the text element are determined from a document. The layout information (230) indicates a spatial arrangement of the plurality of text elements (220) presented within the document. Based at least in part on the plurality of text elements (220) and the layout information (230), respective semantic feature representations (180) of the plurality of text elements (220) are generated. By jointly using both the textual information and the layout information (230), rich semantics of the text elements (220) in the document can be effectively captured in the feature representations.Type: ApplicationFiled: June 12, 2020Publication date: June 29, 2023Inventors: Lei Cui, Shaohan HUANG, Li DONG, Furu WEI
-
Publication number: 20230129314Abstract: A data processing system implements obtaining first textual content in a first language from a first client device; determining that the first language is supported by a first machine learning model; obtaining a guard list of prohibited terms associated with the first language; determining that the textual content does not include one or more prohibited terms associated based on the guard list; providing the first textual content as an input to the first machine learning model responsive to the textual content not including the one or more prohibited terms; analyzing the first textual content with the first machine learning model to obtain a first content recommendation; obtaining a first content recommendation policy that identifies content associated with the first language that may not be provided as a content recommendation; determining that the first content recommendation is not prohibited; and providing the first content recommendation to the first client device.Type: ApplicationFiled: October 26, 2021Publication date: April 27, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Ji LI, Amit SRIVASTAVA, XingXing ZHANG, Furu WEI
-
Publication number: 20230076387Abstract: Methods and systems for linking comments to portions of content items. An example computing device receives information associated with a content item produced by a source system, the content item being accessible to other the computing devices via a network and receives a comment associated with the content item, the comment produced by one of the other computing devices. In response to receiving the information and the comment, the computing device predicts a subsection of the content item to link to the received comment based at least on details associated with the content item and the comment, then makes information associated with the predicted subsection of the content item available to other computing devices requesting access to the content item.Type: ApplicationFiled: October 27, 2022Publication date: March 9, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Furu WEI, Ming ZHOU, Yang LIU, Ziqiang CAO, Shaohan HUANG, Li DONG, Lei CUI
-
Patent number: 11516159Abstract: Methods and systems for linking comments to portions of content items. An example computing device receives information associated with a content item produced by a source system, the content item being accessible to other the computing devices via a network and receives a comment associated with the content item, the comment produced by one of the other computing devices. In response to receiving the information and the comment, the computing device predicts a subsection of the content item to link to the received comment based at least on details associated with the content item and the comment, then makes information associated with the predicted subsection of the content item available to other computing devices requesting access to the content item.Type: GrantFiled: May 29, 2015Date of Patent: November 29, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Furu Wei, Ming Zhou, Yang Liu, Ziqiang Cao, Shaohan Huang, Li Dong, Lei Cui
-
Publication number: 20220366898Abstract: Systems and methods are provided for training a machine learning model to learn speech representations. Labeled speech data or both labeled and unlabeled data sets is applied to a feature extractor of a machine learning model to generate latent speech representations. The latent speech representations are applied to a quantizer to generate quantized latent speech representations and to a transformer context network to generate contextual representations. Each contextual representation included in the contextual representations is aligned with a phoneme label to generate phonetically-aware contextual representations. Quantized latent representations are aligned with phoneme labels to generate phonetically aware latent speech representations.Type: ApplicationFiled: May 14, 2021Publication date: November 17, 2022Inventors: Yao QIAN, Yu WU, Kenichi KUMATANI, Shujie LIU, Furu WEI, Nanshan ZENG, Xuedong David HUANG, Chengyi WANG
-
Patent number: 11455466Abstract: A method and system for providing an application-specific embedding for an entire text-to-content suggestions service is disclosed. The method includes accessing a dataset containing unlabeled training data collected from an application, the unlabeled training data being collected under user privacy constraints, applying an unsupervised ML model to the dataset to generate a pretrained embedding; and utilizing the pretrained embedding to train the text-to-content suggestion ML model utilized by the application.Type: GrantFiled: May 1, 2019Date of Patent: September 27, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Xingxing Zhang, Ji Li, Furu Wei, Ming Zhou, Amit Srivastava
-
Patent number: 11429787Abstract: Method and system for training a text-to-content suggestion ML model include accessing a dataset containing unlabeled training data collected from an application, the unlabeled training data being collected under user privacy constraints, applying an ML model to the dataset to generate a pretrained embedding, and applying a supervised ML model to a labeled dataset to train the text-to-content suggestion ML model utilized by the application by utilizing the pretrained embedding generated by the supervised ML model.Type: GrantFiled: May 1, 2019Date of Patent: August 30, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Ji Li, Xingxing Zhang, Furu Wei, Ming Zhou, Amit Srivastava
-
Publication number: 20220141503Abstract: The present disclosure provides a technical solution of live comments generating, which may acquire candidate texts highly similar with segments of video as live comments of corresponding segments by matching the candidate texts with the segments, and further generate new live comments based on video segments and existed live comments to enrich the live comments information of related video.Type: ApplicationFiled: March 16, 2020Publication date: May 5, 2022Inventors: Lei CUI, Furu WEI, Shaohan HUANG, Ming ZHOU
-
Publication number: 20210334457Abstract: A method and system for providing an application-specific embedding for an entire text-to-content suggestions service is disclosed. The method includes accessing a dataset containing unlabeled training data collected from an application, the unlabeled training data being collected under user privacy constraints, applying an unsupervised ML model to the dataset to generate a pretrained embedding; and utilizing the pretrained embedding to train the text-to-content suggestion ML model utilized by the application.Type: ApplicationFiled: May 1, 2019Publication date: October 28, 2021Applicant: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Xingxing ZHANG, Ji LI, Furu WEI, Ming ZHOU, Amit SRIVASTAVA
-
Publication number: 20210334708Abstract: Method and system for training a text-to-content suggestion ML model include accessing a dataset containing unlabeled training data collected from an application, the unlabeled training data being collected under user privacy constraints, applying an ML model to the dataset to generate a pretrained embedding, and applying a supervised ML model to a labeled dataset to train the text-to-content suggestion ML model utilized by the application by utilizing the pretrained embedding generated by the supervised ML model.Type: ApplicationFiled: May 1, 2019Publication date: October 28, 2021Applicant: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Ji LI, Xingxing ZHANG, Furu WEI, Ming ZHOU, Amit SRIVASTAVA
-
Publication number: 20210264106Abstract: A method and system for training a text-to-content recommendation ML model includes training a first ML model using a first training data set, utilizing the trained first ML model to infer information about the data contained in the first training data set, collecting the inferred information to generate a second training data set, and utilizing the first training data set and the second training data set to train a second ML model. The second ML model may be a text-to-content recommendation ML model.Type: ApplicationFiled: February 24, 2020Publication date: August 26, 2021Applicant: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Ji LI, Amit SRIVASTAVA, Xingxing ZHANG, Furu WEI, Ming ZHOU
-
Publication number: 20210166014Abstract: According to implementations of the subject matter described herein, there is provided a solution for generating a summary of a document. In this solution, feature information of pages comprised in a document is extracted, which characterizes at least one type of content contained in each page. Respective importance of the pages is determined at least based on the extracted feature information. A summary of the document is generated for the document by selecting a predetermined number of pages less than the number of the pages based on the respective importance. Through the solution, instead of providing all the pages, pages containing important content may be determined automatically to serve as the summary of the document. This summary allows the user to learn quickly main content of the document, shorten the time consumed in browsing all documents and/or facilitate location of a document of interest as soon as possible.Type: ApplicationFiled: June 17, 2019Publication date: June 3, 2021Inventors: Xingxing ZHANG, Shaohan HUANG, Lei CUI, Tao GE, Furu WEI, Ming ZHOU
-
Publication number: 20210158790Abstract: Implementations of the subject matter described herein provide a solution that enables a machine to automatically generate a melody. In this solution, user emotion and/or environment information is used to select a first melody feature parameter from a plurality of melody feature parameters, wherein each of the plurality of melody feature parameters corresponds to a music style of one of a plurality of reference melodies. The first melody feature parameter is further used to generate a first melody that conforms to the music style and is different from the reference melody. Thus, a melody that matches user emotions and/or environmental information may be automatically created.Type: ApplicationFiled: May 24, 2019Publication date: May 27, 2021Inventors: Shaohan HUANG, Lei CUI, Tao GE, Furu WEI, Ming ZHOU
-
Publication number: 20210142002Abstract: In embodiments of the present disclosure, there is provided a method of generating a slide for presentation. Upon a target passage for presentation is obtained, a plurality of sentences are generated based on the target passage, and a label associated with each sentence and an icon corresponding to each label are determined. Then, the sentences, labels and icons are displayed in association in a user interface of an application for presentation. According to embodiments of the present disclosure, the illustrated slides can be automatically generated for a passage to be presented, which can improve efficiency of slide making and improve user experience for slide presentation.Type: ApplicationFiled: June 18, 2019Publication date: May 13, 2021Inventors: Lei Cui, Shaohan HUANG, Xingxing ZHANG, Furu WEI, Ming ZHOU