Patents by Inventor Matthieu Devin

Matthieu Devin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11847176
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for correcting entity names. One method includes receiving texts and deriving a plurality of name-context pairs from the texts. The method further includes calculating a context consistency measure for each name-context pair and storing context-entity name data representing the name-context pairs. Another method includes identifying an entity name and one or more context terms from a query and generating candidate names for the entity name. The method further includes determining a score for each of the candidate names, selecting a number of top scoring candidate names, and using the selected candidate names to respond to the query.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: December 19, 2023
    Assignee: GOOGLE LLC
    Inventors: Lawrence J. Brunsman, Matthieu Devin, Uri N. Lerner, Simon Tong
  • Patent number: 11687832
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a model using parameter server shards. One of the methods includes receiving, at a parameter server shard configured to maintain values of a disjoint partition of the parameters of the model, a succession of respective requests for parameter values from each of a plurality of replicas of the model; in response to each request, downloading a current value of each requested parameter to the replica from which the request was received; receiving a succession of uploads, each upload including respective delta values for each of the parameters in the partition maintained by the shard; and updating values of the parameters in the partition maintained by the parameter server shard repeatedly based on the uploads of delta values to generate current parameter values.
    Type: Grant
    Filed: August 3, 2020
    Date of Patent: June 27, 2023
    Assignee: Google LLC
    Inventors: Gregory S. Corrado, Kai Chen, Jeffrey A. Dean, Samy Bengio, Rajat Monga, Matthieu Devin
  • Patent number: 11067988
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for implementing an interactive autonomous vehicle agent. One of the methods includes receiving a request to generate an experience tuple for a vehicle in a particular driving context. A predicted environment observation representing a predicted environment of the autonomous vehicle after the candidate action is taken by the autonomous vehicle in an initial environment is generated, including providing an initial environment observation and the candidate action as input to a vehicle behavior model neural network trained to generate predicted environment observations. An immediate quality value is generated from a context-specific quality model that generates immediate quality values that are specific to the particular driving context.
    Type: Grant
    Filed: March 13, 2019
    Date of Patent: July 20, 2021
    Assignee: Waymo LLC
    Inventors: Aleksandra Faust, Matthieu Devin, Yu-hsin Joyce Chen, Franklin Morley, Vadim Furman, Carlos Alberto Fuertes Pascual
  • Patent number: 10733535
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a model using parameter server shards. One of the methods includes receiving, at a parameter server shard configured to maintain values of a disjoint partition of the parameters of the model, a succession of respective requests for parameter values from each of a plurality of replicas of the model; in response to each request, downloading a current value of each requested parameter to the replica from which the request was received; receiving a succession of uploads, each upload including respective delta values for each of the parameters in the partition maintained by the shard; and updating values of the parameters in the partition maintained by the parameter server shard repeatedly based on the uploads of delta values to generate current parameter values.
    Type: Grant
    Filed: July 31, 2017
    Date of Patent: August 4, 2020
    Assignee: Google LLC
    Inventors: Gregory S. Corrado, Kai Chen, Jeffrey A. Dean, Samy Bengio, Rajat Monga, Matthieu Devin
  • Patent number: 10254759
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for implementing an interactive autonomous vehicle agent. One of the methods includes receiving a request to generate an experience tuple for a vehicle in a particular driving context. A predicted environment observation representing a predicted environment of the autonomous vehicle after the candidate action is taken by the autonomous vehicle in an initial environment is generated, including providing an initial environment observation and the candidate action as input to a vehicle behavior model neural network trained to generate predicted environment observations. An immediate quality value is generated from a context-specific quality model that generates immediate quality values that are specific to the particular driving context.
    Type: Grant
    Filed: September 14, 2017
    Date of Patent: April 9, 2019
    Assignee: Waymo LLC
    Inventors: Aleksandra Faust, Matthieu Devin, Yu-hsin Joyce Chen, Franklin Morley, Vadim Furman, Carlos Alberto Fuertes Pascual
  • Patent number: 10162895
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for correcting entity names. One method includes receiving texts and deriving a plurality of name-context pairs from the texts. The method further includes calculating a context consistency measure for each name-context pair and storing context-entity name data representing the name-context pairs. Another method includes identifying an entity name and one or more context terms from a query and generating candidate names for the entity name. The method further includes determining a score for each of the candidate names, selecting a number of top scoring candidate names, and using the selected candidate names to respond to the query.
    Type: Grant
    Filed: February 9, 2015
    Date of Patent: December 25, 2018
    Assignee: Google LLC
    Inventors: Lawrence J. Brunsman, Matthieu Devin, Uri N. Lerner, Simon Tong
  • Patent number: 9721214
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a model using parameter server shards. One of the methods includes receiving, at a parameter server shard configured to maintain values of a disjoint partition of the parameters of the model, a succession of respective requests for parameter values from each of a plurality of replicas of the model; in response to each request, downloading a current value of each requested parameter to the replica from which the request was received; receiving a succession of uploads, each upload including respective delta values for each of the parameters in the partition maintained by the shard; and updating values of the parameters in the partition maintained by the parameter server shard repeatedly based on the uploads of delta values to generate current parameter values.
    Type: Grant
    Filed: August 8, 2016
    Date of Patent: August 1, 2017
    Assignee: Google Inc.
    Inventors: Gregory S. Corrado, Kai Chen, Jeffrey A. Dean, Samy Bengio, Rajat Monga, Matthieu Devin
  • Patent number: 9460711
    Abstract: Methods and systems for processing multilingual DNN acoustic models are described. An example method may include receiving training data that includes a respective training data set for each of two or more or languages. A multilingual deep neural network (DNN) acoustic model may be processed based on the training data. The multilingual DNN acoustic model may include a feedforward neural network having multiple layers of one or more nodes. Each node of a given layer may connect with a respective weight to each node of a subsequent layer, and the multiple layers of one or more nodes may include one or more shared hidden layers of nodes and a language-specific output layer of nodes corresponding to each of the two or more languages. Additionally, weights associated with the multiple layers of one or more nodes of the processed multilingual DNN acoustic model may be stored in a database.
    Type: Grant
    Filed: April 15, 2013
    Date of Patent: October 4, 2016
    Assignee: Google Inc.
    Inventors: Vincent Olivier Vanhoucke, Jeffrey Adgate Dean, Georg Heigold, Marc'aurelio Ranzato, Matthieu Devin, Patrick An Phu Nguyen, Andrew William Senior
  • Patent number: 9412065
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a model using parameter server shards. One of the methods includes receiving, at a parameter server shard configured to maintain values of a disjoint partition of the parameters of the model, a succession of respective requests for parameter values from each of a plurality of replicas of the model; in response to each request, downloading a current value of each requested parameter to the replica from which the request was received; receiving a succession of uploads, each upload including respective delta values for each of the parameters in the partition maintained by the shard; and updating values of the parameters in the partition maintained by the parameter server shard repeatedly based on the uploads of delta values to generate current parameter values.
    Type: Grant
    Filed: August 4, 2015
    Date of Patent: August 9, 2016
    Assignee: Google Inc.
    Inventors: Gregory S. Corrado, Kai Chen, Jeffrey A. Dean, Samy Bengio, Rajat Monga, Matthieu Devin
  • Patent number: 9310211
    Abstract: Embodiments relate to determining commute routes and clustering commute routes from a user's location history. Points in the user's location history may be clustered to find the user's home and work locations. Additionally, points along the user's commute may be identified to determine the user's typical commute. Similar commutes can be clustered together, and used to suggest various services to the user.
    Type: Grant
    Filed: August 29, 2014
    Date of Patent: April 12, 2016
    Assignee: Google Inc.
    Inventors: Andrew Kirmse, Tushar Udeshi, Pablo Bellver, James Jeffrey Shuma, Matthieu Devin
  • Patent number: 9218573
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a model using parameter server shards. One of the methods includes receiving, at a parameter server shard configured to maintain values of a disjoint partition of the parameters of the model, a succession of respective requests for parameter values from each of a plurality of replicas of the model; in response to each request, downloading a current value of each requested parameter to the replica from which the request was received; receiving a succession of uploads, each upload including respective delta values for each of the parameters in the partition maintained by the shard; and updating values of the parameters in the partition maintained by the parameter server shard repeatedly based on the uploads of delta values to generate current parameter values.
    Type: Grant
    Filed: March 14, 2013
    Date of Patent: December 22, 2015
    Assignee: Google Inc.
    Inventors: Gregory S. Corrado, Kai Chen, Jeffrey A. Dean, Samy Bengio, Rajat Monga, Matthieu Devin
  • Patent number: 9002866
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for correcting entity names. One method includes receiving texts and deriving a plurality of name-context pairs from the texts. The method further includes calculating a context consistency measure for each name-context pair and storing context-entity name data representing the name-context pairs. Another method includes identifying an entity name and one or more context terms from a query and generating candidate names for the entity name. The method further includes determining a score for each of the candidate names, selecting a number of top scoring candidate names, and using the selected candidate names to respond to the query.
    Type: Grant
    Filed: March 24, 2011
    Date of Patent: April 7, 2015
    Assignee: Google Inc.
    Inventors: Lawrence J. Brunsman, Matthieu Devin, Uri N. Lerner, Simon Tong
  • Patent number: 8825383
    Abstract: Embodiments relate to determining commute routes and clustering commute routes from a user's location history. Points in the user's location history may be clustered to find the user's home and work locations. Additionally, points along the user's commute may be identified to determine the user's typical commute. Similar commutes can be clustered together, and used to suggest various services to the user.
    Type: Grant
    Filed: May 26, 2011
    Date of Patent: September 2, 2014
    Assignee: Google Inc.
    Inventors: Andrew Kirmse, Tushar Udeshi, Pablo Bellver, James Shuma, Matthieu Devin
  • Patent number: 8768870
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a model using parameter server shards. One of the methods includes receiving, at a parameter server shard configured to maintain values of a disjoint partition of the parameters of the model, a succession of respective requests for parameter values from each of a plurality of replicas of the model; in response to each request, downloading a current value of each requested parameter to the replica from which the request was received; receiving a succession of uploads, each upload including respective delta values for each of the parameters in the partition maintained by the shard; and updating values of the parameters in the partition maintained by the parameter server shard repeatedly based on the uploads of delta values to generate current parameter values.
    Type: Grant
    Filed: August 15, 2013
    Date of Patent: July 1, 2014
    Assignee: Google Inc.
    Inventors: Gregory S. Corrado, Kai Chen, Jeffrey A. Dean, Samy Bengio, Rajat Monga, Matthieu Devin
  • Patent number: 8402032
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for correcting entity names. One method includes receiving texts and deriving a plurality of name-context pairs from the texts. The method further includes calculating a context consistency measure for each name-context pair and storing context-entity name data representing the name-context pairs. Another method includes identifying an entity name and one or more context terms from a query and generating candidate names for the entity name. The method further includes determining a score for each of the candidate names, selecting a number of top scoring candidate names, and using the selected candidate names to respond to the query.
    Type: Grant
    Filed: March 24, 2011
    Date of Patent: March 19, 2013
    Assignee: Google Inc.
    Inventors: Lawrence J. Brunsman, Matthieu Devin, Uri N. Lerner, Simon Tong