Patents by Inventor An V. Le

An V. Le has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20190354895
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for learning a data augmentation policy for training a machine learning model. In one aspect, a method includes: receiving training data for training a machine learning model to perform a particular machine learning task; determining multiple data augmentation policies, comprising, at each of multiple time steps: generating a current data augmentation policy based on quality measures of data augmentation policies generated at previous time steps; training a machine learning model on the training data using the current data augmentation policy; and determining a quality measure of the current data augmentation policy using the machine learning model after it has been trained using the current data augmentation policy; and selecting a final data augmentation policy based on the quality measures of the determined data augmentation policies.
    Type: Application
    Filed: May 20, 2019
    Publication date: November 21, 2019
    Inventors: Vijay Vasudevan, Barret Zoph, Ekin Dogus Cubuk, Quoc V. Le
  • Publication number: 20190352572
    Abstract: Systems and methods are provided for adding a heated stream of light hydrocarbons to a fluidized coking environment to improve liquid product yield and/or reduce coke production. The light hydrocarbons can correspond to C1-C10 hydrocarbons and/or hydrogen. The light hydrocarbons can be heated so that the light hydrocarbons are exposed to an activation temperature of 535° C. to 950° C. and/or an activation temperature higher than the temperature in the coking zone by 50° C. or more for an activation time prior to entering the fluidized coking reactor and/or the coking zone in the fluidized coking environment.
    Type: Application
    Filed: May 16, 2018
    Publication date: November 21, 2019
    Inventors: Tien V. Le, Walter E. Dubois, Brenda A. Raich, Bing Du, Sumathy Raman, Gawain J. Lau
  • Publication number: 20190347552
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating document vector representations. One of the methods includes obtaining a new document; and determining a vector representation for the new document using a trained neural network system, wherein the trained neural network system has been trained to receive an input document and a sequence of words from the input document and to generate a respective word score for each word in a set of words, wherein each of the respective word scores represents a predicted likelihood that the corresponding word follows a last word in the sequence in the input document, and wherein determining the vector representation for the new document using the trained neural network system comprises iteratively providing each of the plurality of sequences of words to the trained neural network system to determine the vector representation for the new document using gradient descent.
    Type: Application
    Filed: July 26, 2019
    Publication date: November 14, 2019
    Inventor: Quoc V. Le
  • Publication number: 20190340236
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing sequential data. In one aspect, a computer-implemented method includes receiving a request to generate a system output for an input data sequence, the input data sequence including a plurality of tokens. One or more tokens may be designated as tokens to be skipped. When a token has not been designated as a token to be skipped, the token is processed using a recurrent neural network to update a current internal state of the recurrent neural network. The system output is generated from the final internal state of the recurrent neural network.
    Type: Application
    Filed: July 10, 2019
    Publication date: November 7, 2019
    Inventors: Quoc V. Le, Hongrae Lee, Wei Yu
  • Publication number: 20190338179
    Abstract: Scales are prevented or inhibited from forming in a well or in a formation penetrated by a well by pumping into the well a fluid comprising a hydratable polymer, a crosslinking agent, such as an organometallic crosslinking agent containing a polyvalent metal and a scale inhibitor selected from the group consisting of polyvinyl sulfonates, a polyacrylamidomethylpropane sulfonic acid, carboxymethyl inulin and sulfonated polyacrylates and mixtures thereof.
    Type: Application
    Filed: July 18, 2019
    Publication date: November 7, 2019
    Inventors: Dong Shen, Dora V. Galvan, Hoang V. Le, Qi Qu
  • Publication number: 20190323960
    Abstract: An FI having an in-situ particle detector and a method for particle detection therein are provided. In one aspect, the FI includes a fan, a substrate support, a particle detector, and an exhaust outlet. The fan, substrate support, and particle detector are arranged such that, in operation, the fan directs air towards the exhaust outlet and over a substrate on the substrate support to create laminar flow. The particle detector, positioned downstream from the substrate support and upstream from the exhaust outlet, analyzes the air and detects particle concentration before the particles are exhausted. The collected particle detection data may be combined with data from other sensors in the FI and used to identify the source of particle contamination. The particle detector may also be incorporated into other system components, including but not limited to, a load-lock or buffer chamber to detect particle concentration therein.
    Type: Application
    Filed: June 27, 2019
    Publication date: October 24, 2019
    Inventors: Lin ZHANG, Xuesong LU, Andrew V. LE, Fa JI, Jang Seok OH, Patrick L. SMITH, Shawyon JAFARI, Ralph Peter ANTONIO
  • Patent number: 10445623
    Abstract: Systems and techniques are disclosed for labeling objects within an image. The objects may be labeled by selecting an option from a plurality of options such that each option is a potential label for the object. An option may have an option score associated with. Additionally, a relation score may be calculated for a first option and a second option corresponding to a second object in an image. The relation score may be based on a frequency, probability, or observance corresponding to the co-occurrence of text associated with the first option and the second option in a text corpus such as the World Wide Web. An option may be selected as a label for an object based on a global score calculated based at least on an option score and relation score associated with the option.
    Type: Grant
    Filed: April 14, 2017
    Date of Patent: October 15, 2019
    Assignee: Google LLC
    Inventors: Samy Bengio, Jeffrey Adgate Dean, Quoc V. Le, Jonathon Shlens, Yoram Singer
  • Publication number: 20190311708
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating speech from text. One of the systems includes one or more computers and one or more storage devices storing instructions that when executed by one or more computers cause the one or more computers to implement: a sequence-to-sequence recurrent neural network configured to: receive a sequence of characters in a particular natural language, and process the sequence of characters to generate a spectrogram of a verbal utterance of the sequence of characters in the particular natural language; and a subsystem configured to: receive the sequence of characters in the particular natural language, and provide the sequence of characters as input to the sequence-to-sequence recurrent neural network to obtain as output the spectrogram of the verbal utterance of the sequence of characters in the particular natural language.
    Type: Application
    Filed: June 20, 2019
    Publication date: October 10, 2019
    Inventors: Samy Bengio, Yuxuan Wang, Zongheng Yang, Zhifeng Chen, Yonghui Wu, Ioannis Agiomyrgiannakis, Ron J. Weiss, Navdeep Jaitly, Ryan M. Rifkin, Robert Andrew James Clark, Quoc V. Le, Russell J. Ryan, Ying Xiao
  • Patent number: 10438113
    Abstract: A method for determining a placement for machine learning model operations across multiple hardware devices includes receiving data specifying machine learning operations, and determining a placement that assigns each of the operations specified by the data to a respective device from the multiple hardware devices.
    Type: Grant
    Filed: July 19, 2018
    Date of Patent: October 8, 2019
    Assignee: Google LLC
    Inventors: Benoit Steiner, Anna Darling Goldie, Jeffrey Adgate Dean, Hieu Hy Pham, Azalia Mirhoseini, Quoc V. Le
  • Publication number: 20190303761
    Abstract: A method for determining a placement for machine learning model operations across multiple hardware devices is described.
    Type: Application
    Filed: June 19, 2019
    Publication date: October 3, 2019
    Inventors: Samy Bengio, Mohammad Edward Norouzi, Benoit Steiner, Jeffrey Adgate Dean, Hieu Hy Pham, Azalia Mirhoseini, Quoc V. Le, Naveen Kumar, Yuefeng Zhou, Rasmus Munk Larsen
  • Patent number: 10400177
    Abstract: Systems and methods are provided for integrating a fluidized coking process, optionally a coke gasification process, and processes for production of additional liquid products from the coking and/or gasification process. In some aspects, the integrated processes can allow for conversion of olefins generated during a fluidized coking process to form additional liquid products. Additionally or alternately, in some aspects the integrated processes can allow for separation of syngas from the flue gas/fuel gas generated by a gasifier integrated with a fluidized coking process. This syngas can then be used to form methanol, which can then be converted in a methanol conversion process to form heavier products. In such aspects, olefins generated during the fluidized coking process can be added to the methanol conversion process to improve the yield.
    Type: Grant
    Filed: November 14, 2017
    Date of Patent: September 3, 2019
    Assignee: ExxonMobil Research and Engineering Company
    Inventors: Tien V. Le, Brenda A. Raich, Bing Du, Mohsen N. Harandi, Suriyanarayanan Rajagopalan
  • Patent number: 10392553
    Abstract: Scales are prevented or inhibited from forming in a well or in a formation penetrated by a well by pumping into the well a fluid comprising a hydratable polymer, a crosslinking agent, such as an organometallic crosslinking agent containing a polyvalent metal and a scale inhibitor selected from the group consisting of polyvinyl sulfonates, a polyacrylamidomethylpropane sulfonic acid, carboxymethyl inulin and sulfonated polyacrylates and mixtures thereof.
    Type: Grant
    Filed: August 30, 2013
    Date of Patent: August 27, 2019
    Assignee: BAKER HUGHES, A GE COMPANY, LLC
    Inventors: Dong Shen, Dora V. Galvan, Hoang V. Le, Qi Qu
  • Publication number: 20190257429
    Abstract: A seal assembly includes a seal body, a spring disposed adjacent to the seal body, and a seal ring disposed adjacent to the seal body. The seal body and the seal ring can include a plastic polymer material. The seal assembly can be a subcomponent of hydraulic strut in the landing gear of an aircraft.
    Type: Application
    Filed: February 26, 2019
    Publication date: August 22, 2019
    Inventors: Jon M. LENHERT, Robert T. RACICOT, Kha V. LE
  • Publication number: 20190258961
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media for performing machine learning tasks. One method includes receiving (i) a model input, and (ii) data identifying a first machine learning task to be performed on the model input to generate a first type of model output for the model input; augmenting the model input with an identifier for the first machine learning task to generate an augmented model input; and processing the augmented model input using a machine learning model. An exemplary system applying implicit bridging for machine learning tasks, as described in this specification, trains a machine learning model to perform certain types of machine learning tasks without requiring explicit training data for the certain types of machine learning tasks to be used during training.
    Type: Application
    Filed: May 3, 2019
    Publication date: August 22, 2019
    Inventors: Zhifeng Chen, Michael Schuster, Melvin Jose Johnson Premkumar, Yonghui Wu, Quoc V. Le, Maxim Krikun, Thorsten Brants
  • Publication number: 20190256489
    Abstract: Tetrahydrothiophene and related heterocyclic analogs and related methods for GABA aminotransferase inactivation.
    Type: Application
    Filed: January 18, 2019
    Publication date: August 22, 2019
    Applicant: Northwestern University
    Inventors: Richard B. Silverman, Hoang V. Le, Dustin D. Hawker
  • Publication number: 20190251439
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for determining neural network architectures. One of the methods includes generating, using a controller neural network, a batch of output sequences, each output sequence in the batch defining a respective architecture of a child neural network that is configured to perform a particular neural network task; for each output sequence in the batch: training a respective instance of the child neural network having the architecture defined by the output sequence; evaluating a performance of the trained instance of the child neural network on the particular neural network task to determine a performance metric for the trained instance of the child neural network on the particular neural network task; and using the performance metrics for the trained instances of the child neural network to adjust the current values of the controller parameters of the controller neural network.
    Type: Application
    Filed: April 29, 2019
    Publication date: August 15, 2019
    Inventors: Barret Zoph, Quoc V. Le
  • Publication number: 20190251449
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for structuring and training a recurrent neural network. This describes a technique that improves the ability to capture long term dependencies in recurrent neural networks by adding an unsupervised auxiliary loss at one or more anchor points to the original objective. This auxiliary loss forces the network to either reconstruct previous events or predict next events in a sequence, making truncated backpropagation feasible for long sequences and also improving full backpropagation through time.
    Type: Application
    Filed: February 11, 2019
    Publication date: August 15, 2019
    Inventors: Andrew M. Dai, Quoc V. Le, Hoang Trieu Trinh, Thang Minh Luong
  • Publication number: 20190238409
    Abstract: A network function optimization method, system, and computer program product, include optimizing network function chain components by modifying a structure of the network function chain components by removing one of the functions of the network function chain components in response to a constraint according to a policy requirement.
    Type: Application
    Filed: April 8, 2019
    Publication date: August 1, 2019
    Inventors: Seraphin Calo, Douglas Freimuth, Thai V. Le, Christian Makaya, Erich Nahum, Dinesh Verma
  • Patent number: 10365216
    Abstract: An FI having an in-situ particle detector and a method for particle detection therein are provided. In one aspect, the FI includes a fan, a substrate support, a particle detector, and an exhaust outlet. The fan, substrate support, and particle detector are arranged such that, in operation, the fan directs air towards the exhaust outlet and over a substrate on the substrate support to create laminar flow. The particle detector, positioned downstream from the substrate support and upstream from the exhaust outlet, analyzes the air and detects particle concentration before the particles are exhausted. The collected particle detection data may be combined with data from other sensors in the FI and used to identify the source of particle contamination. The particle detector may also be incorporated into other system components, including but not limited to, a load-lock or buffer chamber to detect particle concentration therein.
    Type: Grant
    Filed: October 25, 2017
    Date of Patent: July 30, 2019
    Assignee: Applied Materials, Inc.
    Inventors: Lin Zhang, Xuesong Lu, Andrew V. Le, Fa Ji, Jang Seok Oh, Patrick L. Smith, Shawyon Jafari, Ralph Peter Antonio
  • Patent number: 10366327
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating document vector representations. One of the methods includes obtaining a new document; and determining a vector representation for the new document using a trained neural network system, wherein the trained neural network system has been trained to receive an input document and a sequence of words from the input document and to generate a respective word score for each word in a set of words, wherein each of the respective word scores represents a predicted likelihood that the corresponding word follows a last word in the sequence in the input document, and wherein determining the vector representation for the new document using the trained neural network system comprises iteratively providing each of the plurality of sequences of words to the trained neural network system to determine the vector representation for the new document using gradient descent.
    Type: Grant
    Filed: January 30, 2015
    Date of Patent: July 30, 2019
    Assignee: Google LLC
    Inventor: Quoc V. Le