Patents by Inventor Jingfeng HU

Jingfeng HU has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220383126
    Abstract: A computer implemented method obtains neural network-based model base model weight matrices for each of multiple neural network layers. First low-rank factorization matrices are added to corresponding base model weight matrices to form a first domain model. The low-rank factorization matrices are treated as trainable parameters. The first domain model is trained with first domain specific training data without modifying base model weight matrices.
    Type: Application
    Filed: May 19, 2021
    Publication date: December 1, 2022
    Inventors: Weizhu Chen, Jingfeng HU, Yelong SHEN, Shean WANG, Yabin LIU
  • Publication number: 20220058477
    Abstract: Systems and method are provided that are directed to tuning a hyperparameter associated with a small neural network model and transferring the hyperparameter to a large neural network model. At least one neural network model may be received along with a request for one or more tuned hyperparameters. Prior to scaling the large neural network, the large neural network is parameterized in accordance with a parameterizing schemed. The large neural network is then scaled and reduced in size such that a hyperparameter tuning process may be performed. A tuned hyperparameter may then be provided to a requestor such that the hyperparameter can be directly input into the large neural network. By tuning a hyper parameter using a small neural network, significant computation cycles and energy may be saved.
    Type: Application
    Filed: August 21, 2020
    Publication date: February 24, 2022
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Jingfeng HU, Ge YANG, Xiaodong LIU, Jianfeng GAO