Patents by Inventor Noam Shazeer
Noam Shazeer has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11960848Abstract: The present disclosure is directed to systems and methods that include and/or leverage one or more machine-learned language models that generate intermediate textual analysis (e.g., including usage of structural tools such as APIs) in service of contextual text generation. For example, a computing system can obtain a contextual text string that includes one or more contextual text tokens. The computing system can process the contextual text string with the machine-learned language model to generate one or more intermediate text strings that include one or more intermediate text tokens. The computing system can process the one or more intermediate text strings with the machine-learned language model to generate an output text string comprising one or more output text tokens. The one or more intermediate text strings can include textual analysis of the contextual text string that supports the output text string.Type: GrantFiled: February 3, 2023Date of Patent: April 16, 2024Assignee: GOOGLE LLCInventors: Noam Shazeer, Daniel De Freitas Adiwardana
-
Publication number: 20230177276Abstract: The present disclosure is directed to systems and methods that include and/or leverage one or more machine-learned language models that generate intermediate textual analysis (e.g., including usage of structural tools such as APIs) in service of contextual text generation. For example, a computing system can obtain a contextual text string that includes one or more contextual text tokens. The computing system can process the contextual text string with the machine-learned language model to generate one or more intermediate text strings that include one or more intermediate text tokens. The computing system can process the one or more intermediate text strings with the machine-learned language model to generate an output text string comprising one or more output text tokens. The one or more intermediate text strings can include textual analysis of the contextual text string that supports the output text string.Type: ApplicationFiled: February 3, 2023Publication date: June 8, 2023Inventors: Noam Shazeer, Daniel De Freitas Adiwardana
-
Patent number: 11574131Abstract: The present disclosure is directed to systems and methods that include and/or leverage one or more machine-learned language models that generate intermediate textual analysis (e.g., including usage of structural tools such as APIs) in service of contextual text generation. For example, a computing system can obtain a contextual text string that includes one or more contextual text tokens. The computing system can process the contextual text string with the machine-learned language model to generate one or more intermediate text strings that include one or more intermediate text tokens. The computing system can process the one or more intermediate text strings with the machine-learned language model to generate an output text string comprising one or more output text tokens. The one or more intermediate text strings can include textual analysis of the contextual text string that supports the output text string.Type: GrantFiled: May 20, 2022Date of Patent: February 7, 2023Assignee: GOOGLE LLCInventors: Noam Shazeer, Daniel De Freitas Adiwardana
-
Publication number: 20220374608Abstract: The present disclosure is directed to systems and methods that include and/or leverage one or more machine-learned language models that generate intermediate textual analysis (e.g., including usage of structural tools such as APIs) in service of contextual text generation. For example, a computing system can obtain a contextual text string that includes one or more contextual text tokens. The computing system can process the contextual text string with the machine-learned language model to generate one or more intermediate text strings that include one or more intermediate text tokens. The computing system can process the one or more intermediate text strings with the machine-learned language model to generate an output text string comprising one or more output text tokens. The one or more intermediate text strings can include textual analysis of the contextual text string that supports the output text string.Type: ApplicationFiled: May 20, 2022Publication date: November 24, 2022Inventors: Noam Shazeer, Daniel De Freitas Adiwardana
-
Patent number: 9858590Abstract: Different ad selection techniques may be evaluated and compared by (i) combining ads generated using at least two different techniques and (ii) determining performance statistics of these combined (e.g., interleaved) advertising serves over time. The relative performance of the different techniques can then be determined. These principles can also be used to gauge different ad scoring techniques. These principles can also be used to gauge different ad rendering techniques.Type: GrantFiled: December 30, 2003Date of Patent: January 2, 2018Assignee: Google Inc.Inventors: Jeffrey A. Dean, Georges R. Harik, Noam Shazeer, Simon Tong
-
Patent number: 9116976Abstract: A system ranks documents based, at least in part, on a ranking model. The ranking model may be generated to predict the likelihood that a document will be selected. The system may receive a search query and identify documents relating to the search query. The system may then rank the documents based, at least in part, on the ranking model and form search results for the search query from the ranked documents.Type: GrantFiled: May 11, 2010Date of Patent: August 25, 2015Assignee: Google Inc.Inventors: Jeremy Bem, Georges R. Harik, Joshua L. Levenberg, Noam Shazeer, Simon Tong
-
Patent number: 8688705Abstract: A system for generating a model is provided. The system generates, or selects, candidate conditions and generates, or otherwise obtains, statistics regarding the candidate conditions. The system also forms rules based, at least in part, on the statistics and the candidate conditions and selectively adds the rules to the model.Type: GrantFiled: January 28, 2013Date of Patent: April 1, 2014Assignee: Google Inc.Inventors: Jeremy Bem, Georges R. Harik, Joshua L. Levenberg, Noam Shazeer, Simon Tong
-
Patent number: 8621344Abstract: A computer-implemented method for determining whether a target text-string is correctly spelled is provided. The target text-string is compared to a corpus to determine a set of contexts which each include an occurrence of the target text-string. Using heuristics, each context of the set is characterized based on occurrences in the corpus of the target text-string and a reference text-string. Contexts are characterized as including a correct spelling of the target text-string, an incorrect spelling of the reference text-string, or including an indeterminate usage of the target text-string. A likelihood that the target text-string is a misspelling of the reference text-string is computed as a function of the quantity of contexts including a correct spelling of the target text-string and the quantity of contexts including an incorrect spelling of a reference text-string. In one application, the target text-string is received in a search query, the search executed following a spell-check.Type: GrantFiled: September 30, 2011Date of Patent: December 31, 2013Assignee: Google Inc.Inventor: Noam Shazeer
-
Publication number: 20130346434Abstract: A computer-implemented method for determining whether a target text-string is correctly spelled is provided. The target text-string is compared to a corpus to determine a set of contexts which each include an occurrence of the target text-string. Using heuristics, each context of the set is characterized based on occurrences in the corpus of the target text-string and a reference text-string. Contexts are characterized as including a correct spelling of the target text-string, an incorrect spelling of the reference text-string, or including an indeterminate usage of the target text-string. A likelihood that the target text-string is a misspelling of the reference text-string is computed as a function of the quantity of contexts including a correct spelling of the target text-string and the quantity of contexts including an incorrect spelling of a reference text-string. In one application, the target text-string is received in a search query, the search executed following a spell-check.Type: ApplicationFiled: September 30, 2011Publication date: December 26, 2013Applicant: GOOGLE INC.Inventor: Noam SHAZEER
-
Patent number: 8606730Abstract: A system may track statistics for a number of features using an approximate counting technique by: subjecting each feature to multiple, different hash functions to generate multiple, different hash values, where each of the hash values may identify a particular location in a memory, and storing statistics for each feature at the particular locations identified by the hash values. The system may generate rules for a model based on the tracked statistics.Type: GrantFiled: August 3, 2012Date of Patent: December 10, 2013Assignee: Google Inc.Inventors: Simon Tong, Noam Shazeer
-
Publication number: 20130185149Abstract: Keyword suggestions that are category-aware (and field-proven) may be used to help advertisers better target the serving of their ads, and may reduce unused ad spot inventory. The advertiser can enter ad information, such as a creative, a landing Webpage, other keywords, etc. for example. A keyword facility may use this entered ad information as seed information to infer one or more categories. It may then request that the advertiser confirm or deny some basic feedback information (e.g., categories, Webpage information, etc.). For example, an advertiser may be provided with candidate categories and may be asked to confirm (e.g., using checkboxes) which of the categories are relevant to their ad. Keywords may be determined using at least the categories. The determined keywords may be provided to the advertiser as suggested keywords, or may automatically populate ad serving constraint information as targeting keywords.Type: ApplicationFiled: March 4, 2013Publication date: July 18, 2013Inventors: Ross Koningstein, Valentin Spitkovsky, Georges R. Harik, Noam Shazeer
-
Patent number: 8392249Abstract: Keyword suggestions that are category-aware (and field-proven) may be used to help advertisers better target the serving of their ads, and may reduce unused ad spot inventory. The advertiser can enter ad information, such as a creative, a landing Webpage, other keywords, etc. for example. A keyword facility may use this entered ad information as seed information to infer one or more categories. It may then request that the advertiser confirm or deny some basic feedback information (e.g., categories, Webpage information, etc.). For example, an advertiser may be provided with candidate categories and may be asked to confirm (e.g., using checkboxes) which of the categories are relevant to their ad. Keywords may be determined using at least the categories. The determined keywords may be provided to the advertiser as suggested keywords, or may automatically populate ad serving constraint information as targeting keywords.Type: GrantFiled: December 31, 2003Date of Patent: March 5, 2013Assignee: Google Inc.Inventors: Ross Koningstein, Valentin Spitkovsky, Georges R. Harik, Noam Shazeer
-
Patent number: 8364618Abstract: A system for generating a model is provided. The system generates, or selects, candidate conditions and generates, or otherwise obtains, statistics regarding the candidate conditions. The system also forms rules based, at least in part, on the statistics and the candidate conditions and selectively adds the rules to the model.Type: GrantFiled: June 4, 2012Date of Patent: January 29, 2013Assignee: Google Inc.Inventors: Jeremy Bem, Georges R. Harik, Joshua L. Levenberg, Noam Shazeer, Simon Tong
-
Patent number: 8255343Abstract: A system may track statistics for a number of features using an approximate counting technique by: subjecting each feature to multiple, different hash functions to generate multiple, different hash values, where each of the hash values may identify a particular location in a memory, and storing statistics for each feature at the particular locations identified by the hash values. The system may generate rules for a model based on the tracked statistics.Type: GrantFiled: August 9, 2011Date of Patent: August 28, 2012Assignee: Google Inc.Inventors: Simon Tong, Noam Shazeer
-
Patent number: 8195674Abstract: A system for generating a model is provided. The system generates, or selects, candidate conditions and generates, or otherwise obtains, statistics regarding the candidate conditions. The system also forms rules based, at least in part, on the statistics and the candidate conditions and selectively adds the rules to the model.Type: GrantFiled: June 24, 2010Date of Patent: June 5, 2012Assignee: Google Inc.Inventors: Jeremy Bem, Georges R. Harik, Joshua L. Levenberg, Noam Shazeer, Simon Tong
-
Patent number: 8086559Abstract: A client-side application (such as a browser, a browser plug-in, a browser toolbar plug-in, etc. on an end user's computer) is used to support the serving of content-relevant ads to the client device. The client-side application may provide such support by sending document information (such as a document identifier, document content, content relevance information, etc.) to a content ad server. The client-side application may also be used to combine content of the document and the content-relevant ads. For example, the client-side application may combine content of the document and the ads in a window (e.g., in a browser window), may provide the ads in a window above, below, adjacent to a document window, may provide the ads in “chrome” of the browser, etc.Type: GrantFiled: August 5, 2003Date of Patent: December 27, 2011Assignee: Google, Inc.Inventors: Darrell Anderson, Paul Buchheit, Jeffrey A. Dean, Georges R. Harik, Carl Laurence Gonsalves, Noam Shazeer, Narayanan Shivakumar
-
Patent number: 8086690Abstract: A geographic relevance component determines geographic relevance of web resources based on an analysis of data points that correspond to estimated physical locations of the IP addresses of a number of visitors to the web site. The geographic relevance component may additionally determine the probability that a particular user is within the geographical relevance corresponding to a web resource.Type: GrantFiled: September 22, 2003Date of Patent: December 27, 2011Assignee: Google Inc.Inventors: Maureen Heymans, Radhika Malpani, Noam Shazeer, Abhay Puri
-
Patent number: 8051374Abstract: A computer-implemented method for determining whether a target text-string is correctly spelled is provided. The target text-string is compared to a corpus to determine a set of contexts which each include an occurrence of the target text-string. Using heuristics, each context of the set is characterized based on occurrences in the corpus of the target text-string and a reference text-string. Contexts are characterized as including a correct spelling of the target text-string, an incorrect spelling of the reference text-string, or including an indeterminate usage of the target text-string. A likelihood that the target text-string is a misspelling of the reference text-string is computed as a function of the quantity of contexts including a correct spelling of the target text-string and the quantity of contexts including an incorrect spelling of a reference text-string. In one application, the target text-string is received in a search query, the search executed following a spell-check.Type: GrantFiled: February 2, 2007Date of Patent: November 1, 2011Assignee: Google Inc.Inventor: Noam Shazeer
-
Patent number: 8019704Abstract: A system may track statistics for a number of features using an approximate counting technique by: subjecting each feature to multiple, different hash functions to generate multiple, different hash values, where each of the hash values may identify a particular location in a memory, and storing statistics for each feature at the particular locations identified by the hash values. The system may generate rules for a model based on the tracked statistics.Type: GrantFiled: May 12, 2010Date of Patent: September 13, 2011Assignee: Google Inc.Inventors: Simon Tong, Noam Shazeer
-
Publication number: 20110145731Abstract: A client-side application (such as a browser, a browser plug-in, a browser toolbar plug-in, etc. on an end user's computer) is used to support the serving of content-relevant ads to the client device. The client-side application may provide such support by sending document information (such as a document identifier, document content, content relevance information, etc.) to a content ad server. The client-side application may also be used to combine content of the document and the content-relevant ads. For example, the client-side application may combine content of the document and the ads in a window (e.g., in a browser window), may provide the ads in a window above, below, adjacent to a document window, may provide the ads in “chrome” of the browser, etc.Type: ApplicationFiled: November 15, 2010Publication date: June 16, 2011Inventors: Darrell Anderson, Paul Buchheit, Jeffrey A. Dean, Georges R. Harik, Carl Laurence Gonsalves, Noam Shazeer, Narayanan Shivakumar