Patents by Inventor Mingyue Shang

Mingyue Shang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • CONSTRAINED PREFIX MATCHING FOR GENERATING NEXT TOKEN PREDICTIONS
    Publication number: 20230418567
    Abstract: Pre-fix matching may constrain the generation of next token predictions. Input text to perform a next token prediction may be received. Multiple tokens may be determined from the input text, including a partial token. From possible tokens, one or more matching possible tokens with the partial token may be identified. Next token predictions may then be filtered using the identified possible tokens in order to ensure that the partial token is matched.
    Type: Application
    Filed: June 22, 2022
    Publication date: December 28, 2023
    Applicant: Amazon Technologies, Inc.
    Inventors: Praphruetpong Athiwaratkun, Yuchen Tian, Mingyue Shang, Zijian Wang, Ramesh M. Nallapati, Parminder Bhatia, Andrew Oliver Arnold, Bing Xiang, Sudipta Sengupta, Yanitsa Donchev, Srinivas Iragavarapu, Matthew Lee, Vamshidhar Krishnamurthy Dantu, Atul Deo, Ankur Deepak Desai
  • RANDOM TOKEN SEGMENTATION FOR TRAINING NEXT TOKEN PREDICTION MODELS
    Publication number: 20230419036
    Abstract: Random token segmentation may be implemented for next token prediction. Text data may be received for training a machine learning model to predict a next token given input text tokens. Multiple tokens may be determined from the text data. Different ones of the multiple token may be randomly segmented in to sub-tokens. The machine learning model may then be trained using the multiple tokens including the respective sub-tokens as a training data set.
    Type: Application
    Filed: June 22, 2022
    Publication date: December 28, 2023
    Applicant: Amazon Technologies, Inc.
    Inventors: Zijian Wang, Yuchen Tian, Mingyue Shang, Praphruetpong Athiwaratkun, Ming Tan, Parminder Bhatia, Andrew Oliver Arnold, Ramesh M Nallapati, Sudipta Sengupta, Bing Xiang, Atul Deo, Ankur Deepak Desai