Patents by Inventor Nan Duan

Nan Duan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11965578
    Abstract: A design method for an inerter with adaptively adjusted inertia ratio is based on a lead screw-flywheel inerter, which is to change the positions of mass blocks on a flywheel along the radial direction of the flywheel, so as to change of the moment of inertia of the flywheel, and thus to realize adaptive adjustment of the inertia ratio of the inerter. Specifically, the change of angular velocity of the flywheel is caused by the change of an external force load on a lead screw, a centrifugal force on the mass blocks in spring-mass block structures is changed by the angular velocity, and the positions of the mass blocks in the radial direction of the flywheel is determined by the balanced relation of the centrifugal force and a spring restore force, so that the design purpose is achieved.
    Type: Grant
    Filed: October 6, 2020
    Date of Patent: April 23, 2024
    Assignee: DALIAN UNIVERSITY OF TECHNOLOGY
    Inventors: Ximing Sun, Nan Duan, Yuhu Wu, Chongquan Zhong
  • Patent number: 11966428
    Abstract: A training system produces a resource-efficient machine-trained model via a training architecture that employs plural processing paths. Some of the processing paths incorporate the use of auxiliary information that imparts external knowledge about source items being processed. The training architecture also employs contrastive learning that operates at different respective levels within the training architecture. For instance, the training architecture uses encoder-level contrastive learning to compare output information generated by different encoders within the training architecture. The training architecture uses decoder-level contrastive learning to compare output information produced by different decoders within the training architecture. An inference-stage system performs an application task using the model produced by the training system.
    Type: Grant
    Filed: July 1, 2021
    Date of Patent: April 23, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Jian Jiao, Yeyun Gong, Nan Duan, Ruofei Zhang
  • Patent number: 11947914
    Abstract: In embodiments of the present disclosure, there is provided an approach for fact checking based on semantic graphs. According to embodiments of the present disclosure, after obtaining a text to be fact checked, a plurality of evidence sentences related to the text are retrieved from an evidence database. Then, semantic graphs of the text and the evidence sentences are constructed based on the semantic analysis, and a veracity of a statement in the text can be determined based on the semantic graphs. Embodiments of the present disclosure propose a graph-based reasoning approach for fact checking, and use the constructed semantic graphs to facilitate verification of the truthfulness of the text, thereby improving the accuracy for fact checking.
    Type: Grant
    Filed: June 30, 2020
    Date of Patent: April 2, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Duyu Tang, Nan Duan, Ming Zhou, Jiun-Hung Chen, Pengcheng Wang, Ying Qiao
  • Publication number: 20240089143
    Abstract: This disclosure relates to a chip, an electronic device, a transportation vehicle, and a method for generating a control signal. The chip includes a mesh bus and a ring bus. The mesh bus is coupled to each sensor to receive and transmit perception data. The ring bus is coupled to a processor and the mesh bus. The processor receives different types of perception data from different sensors such as a camera and a lidar, and fuses the data to generate a control signal for controlling an execution apparatus.
    Type: Application
    Filed: November 16, 2023
    Publication date: March 14, 2024
    Inventors: Jing Xia, Nan Duan, Chunxiao Cai, Hengchao Xin
  • Patent number: 11921782
    Abstract: The present disclosure provides a technical solution of multi-modal chatting, which may provide response to user query by using multi-modal response in the interaction between chatbot and human beings, so that the expressing ways and the expressed content by the chatbot could be richer by using such response in a multi-modal way.
    Type: Grant
    Filed: November 1, 2019
    Date of Patent: March 5, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Nan Duan, Lei Ji, Ming Zhou
  • Publication number: 20240046037
    Abstract: Systems and methods are provided for training a data model based on training data. The training includes pre-training and fine-tuning the data model based on a combination of an autoregressive (AR) model and a non-autoregressive (NAR) model. Training data may be received and encoded into streams of tokens. A pre-trainer during decoding generates a continuum of data structures of the AR and NAR combined model including a main stream and a series of predicting streams. Masked tokens in predicting streams reference or attend to one or more preceding tokens in the main stream or the preceding predicting streams. A fine-tuner selects streams to generate a trained model according to a target data model. The target data model is determined based on balancing an accuracy constraint and an efficiency constraint for predicting tokens. The decoder acts as abridge between the AR and NAR models in generating a trained data model.
    Type: Application
    Filed: December 25, 2020
    Publication date: February 8, 2024
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Jian JIAO, Yeyun GONG, Nan DUAN, Weizhu CHEN, Kewen TANG, Qiang LOU, Ruofei ZHANG, Yu YAN, Jiusheng CHEN
  • Publication number: 20230394333
    Abstract: A knowledge injection model for generative commonsense reasoning. In examples, an encoder-decoder model is used to generate a model output (204) a plausible description for a set of concepts. A prototype (218) is generated from an in-domain or out-of-domain knowledge corpus, which is further used as input (202) for the encoder-decoder model. Concept input tokens and prototype input tokens are scaled to limit potential skew that may be introduced by the prototype (218). Additionally, position indicators are generated for each input token, which indicate the relative position each respective input token as compared to other input tokens. As such, when decoding the scaled encoded input tokens, the decoder (214) may be more attuned to the scenario bias that is introduced by the prototype (218) when generating a model output (204). Thus, the encoder-decoder model need not rely solely on the set of concepts when generating the model output (204).
    Type: Application
    Filed: November 12, 2020
    Publication date: December 7, 2023
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Jian JIAO, Yeyun GONG, Nan DUAN, Yameng HUANG, Ruofei ZHANG, Ming ZHOU
  • Publication number: 20230385315
    Abstract: Systems and methods are provided for generating a keyword sequence from an input query. A first text sequence corresponding to an input query may be received and encoded into a source sequence representation using an encoder of a machine learning model. A keyword sentence may then be generated from the source sequence representation using a decoder of the machine learning model. The decoder may generate a modified generation score for a plurality of prediction tokens, wherein the modified generation score is based on the respective prediction token generation score and a maximum generation score for a suffix of each prediction token. The decoder may then select the prediction token of the plurality of prediction tokens based on the modified generation score, and add the selected prediction token to the previously decoded partial hypothesis provided by the decoder.
    Type: Application
    Filed: October 14, 2020
    Publication date: November 30, 2023
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Jian JIAO, Yeyun GONG, Nan DUAN, Ruofei ZHANG, Ming ZHOU
  • Publication number: 20230359441
    Abstract: A retrieval-augmented code completion system uses the context of a partially-formed source code snippet of a source code program and a hint to predict the source code tokens needed to complete the partially-formed source code snippet. The hint is a source code segment that completes a semantically-similar source code segment of the partially-formed source code snippet. The hint is found in a retrieval source code database using a hybrid retrieval technique. A deep learning decoder model uses the context of the partially-formed source code snippet and the hint to predict the most likely candidate sequence of source code tokens to complete the partially-formed source code snippet.
    Type: Application
    Filed: May 9, 2022
    Publication date: November 9, 2023
    Inventors: NAN DUAN, SHUAI LU, NEELAKANTAN SUNDARESAN, ALEXEY SVYATKOVSKIY
  • Publication number: 20230267328
    Abstract: Described herein is a mechanism to identify user intent in requests submitted to a system such as a digital assistant or question-answer systems. Embodiments utilize a match methodology instead of a classification methodology. Features derived from a subgraph retrieved from a knowledge base based on the request are concatenated with pretrained word embeddings for both the request and a candidate predicate. The concatenated inputs for both the request and predicate are encoded using two independent LSTM networks and then a matching score is calculated using a match LSTM network. The result is identified based on the matching scores for a plurality of candidate predicates. The pretrained word embeddings allow for knowledge transfer since pretrained word embeddings in one intent domain can apply to another intent domain without retraining.
    Type: Application
    Filed: May 1, 2023
    Publication date: August 24, 2023
    Inventors: Jianshu JI, Yeyun GONG, Nan DUAN, Yi-Cheng PAN, Guihong CAO
  • Patent number: 11693894
    Abstract: In implementations of the subject matter described herein, a new approach for presenting a response to a message in a conversation is proposed. Generally speaking, in response to receiving a message in a conversation, the received message will be matched with one or more documents on the sentence basis. That is, the received message is compared with the sentences from a document(s), rather than predefined query-response pairs. In this way, a whole sentence may be selected from the document as a candidate response. Then the suitability of this sentence with respect to the ongoing conversation will be determined, and the response will be generated and rendered in an adaptive way based on the suitability. As a result, the user experiences may be significantly enhanced in the chatbot scenario.
    Type: Grant
    Filed: June 23, 2021
    Date of Patent: July 4, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Nan Duan, Ming Zhou
  • Publication number: 20230004588
    Abstract: A training system produces a resource-efficient machine-trained model via a training architecture that employs plural processing paths. Some of the processing paths incorporate the use of auxiliary information that imparts external knowledge about source items being processed. The training architecture also employs contrastive learning that operates at different respective levels within the training architecture. For instance, the training architecture uses encoder-level contrastive learning to compare output information generated by different encoders within the training architecture. The training architecture uses decoder-level contrastive learning to compare output information produced by different decoders within the training architecture. An inference-stage system performs an application task using the model produced by the training system.
    Type: Application
    Filed: July 1, 2021
    Publication date: January 5, 2023
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Jian JIAO, Yeyun GONG, Nan DUAN, Ruofei ZHANG
  • Patent number: 11544474
    Abstract: Implementations of the subject matter described herein provide a solution for generating a text from the structured data. In this solution, the structured data is converted into its representation, where the structured data comprises a plurality of cells, and the representation of the structured data comprises plurality of representations of the plurality of cells. A natural language sentence associated with the structured data may be determined based on the representation of the structured data, thereby implementing the function of converting the structured data into a text.
    Type: Grant
    Filed: December 6, 2018
    Date of Patent: January 3, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Nan Duan, Yuanhua Lv, Ming Zhou, Duyu Tang
  • Publication number: 20220318601
    Abstract: Computing technology is described herein that provides an attention mechanism, implemented by a neural network, that generates attention information based on head-specific query information and shared key and value (KV) information, without computing head-specific key information and head-specific value information, and without caching the head-specific key information and the head-specific value information in memory. This manner of operation allows the computing technology to make efficient use of processing and memory resources. In some implementations, the attention mechanism is part of decoder of an encoder-decoder system, or a standalone decoder system. In some implementations, the computing technology leverages the attention information to generate synthesized text based on input text.
    Type: Application
    Filed: April 3, 2021
    Publication date: October 6, 2022
    Inventors: Yu YAN, Jiusheng CHEN, Nikhil BHENDAWADE, Yeyun GONG, Nan DUAN, Ruofei ZHANG
  • Publication number: 20220163094
    Abstract: A design method for an inerter with adaptively adjusted inertia ratio is based on a lead screw-flywheel inerter, which is to change the positions of mass blocks on a flywheel along the radial direction of the flywheel, so as to change of the moment of inertia of the flywheel, and thus to realize adaptive adjustment of the inertia ratio of the inerter. Specifically, the change of angular velocity of the flywheel is caused by the change of an external force load on a lead screw, a centrifugal force on the mass blocks in spring-mass block structures is changed by the angular velocity, and the positions of the mass blocks in the radial direction of the flywheel is determined by the balanced relation of the centrifugal force and a spring restore force, so that the design purpose is achieved.
    Type: Application
    Filed: October 6, 2020
    Publication date: May 26, 2022
    Inventors: Ximing SUN, Nan DUAN, Yuhu WU, Chongquan ZHONG
  • Patent number: 11327971
    Abstract: In embodiments of the present disclosure, there is provided an assertion-based question answering manner. After a question and the related passage are obtained, an assertion answer to the question is determined based on content of the passage, and the assertion answer has a predetermined structure and represents a complete semantic meaning. Then, the assertion answer to the question may be outputted to the user. In the embodiments of the present disclosure, the question and the relevant passage are used as input, and a semi-structured assertion answer is output. The assertion answer according to embodiments of the present disclosure can provide richer semantic content than the traditional short answer, and provide a more concise expression than the traditional long answer, thereby ensuring accuracy of the answer while improving the user experience.
    Type: Grant
    Filed: December 6, 2018
    Date of Patent: May 10, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Duyu Tang, Nan Duan, Ming Zhou, Wendi Wang, Daxin Jiang, Shujie Liu, Linjun Shou, Ming Gong
  • Publication number: 20220121797
    Abstract: The present invention provides a method for analyzing global stability of a conveying fluid pipe-nonlinear energy sink system, and belongs to the technical field of system stability proof and analysis of a control system. The method comprises: establishing a high-order partial differential model of a conveying fluid pipe-nonlinear energy sink system based on a target energy transfer theory, discretizing the model into a second-order nonlinear ordinary differential form by means of the Galerkin approximation method, and further transforming the model into a quadratic model containing gradient information first; then obtaining a global stability judgment condition of the system by means of the energy disturbance technology, and verifying the theoretical results by means of the numerical method finally.
    Type: Application
    Filed: July 13, 2020
    Publication date: April 21, 2022
    Inventors: Ximing SUN, Nan DUAN, Yuhu WU, Chongquan ZHONG
  • Publication number: 20220067533
    Abstract: A transformer-based neural network includes at least one mask attention network (MAN). The MAN computes an original attention data structure that expresses influence between pairs of data items in a sequence of data items. The MAN then modifies the original data structure by mask values in a mask data structure, to produce a modified attention data structure. Compared to the original attention data structure, the modified attention data structure better accounts for the influence of neighboring data items in the sequence of data items, given a particular data item under consideration. The mask data structure used by the MAN can have static and/or machine-trained mask values. In one implementation, the transformer-based neural network includes at least one MAN in combination with at least one other attention network that does not use a mask data structure, and at least one feed-forward neural network.
    Type: Application
    Filed: August 27, 2020
    Publication date: March 3, 2022
    Inventors: Jian JIAO, Yeyun GONG, Nan DUAN, Ruofei ZHANG, Ming ZHOU
  • Publication number: 20220027577
    Abstract: Implementations of the present disclosure relate to text generation with a customizable style. In a method, a first natural language is received; the first natural language text is converted, via a text generation model, into a second natural language text that at least partly reflects the meaning of the first natural language text and has a style distinguishable from the first natural language text, the text generation model comprising a modifiable parameter; and in response to receiving a modification to the parameter, the first natural language text is converted, via the text generation model, into a third natural language text that at least partly reflects the meaning of the first natural language text and includes a style distinguishable from both the first natural language text and the second natural language text.
    Type: Application
    Filed: December 6, 2019
    Publication date: January 27, 2022
    Inventors: Nan DUAN, Ming ZHOU, Yaobo Liang
  • Publication number: 20210406475
    Abstract: In embodiments of the present disclosure, there is provided an approach for fact checking based on semantic graphs. According to embodiments of the present disclosure, after obtaining a text to be fact checked, a plurality of evidence sentences related to the text are retrieved from an evidence database. Then, semantic graphs of the text and the evidence sentences are constructed based on the semantic analysis, and a veracity of a statement in the text can be determined based on the semantic graphs. Embodiments of the present disclosure propose a graph-based reasoning approach for fact checking, and use the constructed semantic graphs to facilitate verification of the truthfulness of the text, thereby improving the accuracy for fact checking.
    Type: Application
    Filed: June 30, 2020
    Publication date: December 30, 2021
    Inventors: Duyu Tang, Nan Duan, Ming Zhou, Jiun-Hung Chen, Pengcheng Wang, Ying Qiao