Patents by Inventor David Marwood

David Marwood has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230186082
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing a network input using a neural network to generate a network output for the network input. One of the methods includes maintaining, for each of the plurality of neural network layers, a respective look-up table that maps each possible combination of a quantized input index and a quantized weight index to a multiplication result; and generating a network output from a network input, comprising, for each of the neural network layers: receiving data specifying a quantized input to the neural network layer, the quantized input comprising a plurality of quantized input values; and generating a layer output for the neural network layer from the quantized input to the neural network layer using the respective look-up table for the neural network layer.
    Type: Application
    Filed: October 31, 2022
    Publication date: June 15, 2023
    Inventors: Michele Covell, David Marwood, Shumeet Baluja, Nicholas Johnston
  • Patent number: 11488016
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing a network input using a neural network to generate a network output for the network input. One of the methods includes maintaining, for each of the plurality of neural network layers, a respective look-up table that maps each possible combination of a quantized input index and a quantized weight index to a multiplication result; and generating a network output from a network input, comprising, for each of the neural network layers: receiving data specifying a quantized input to the neural network layer, the quantized input comprising a plurality of quantized input values; and generating a layer output for the neural network layer from the quantized input to the neural network layer using the respective look-up table for the neural network layer.
    Type: Grant
    Filed: January 23, 2020
    Date of Patent: November 1, 2022
    Assignee: Google LLC
    Inventors: Michele Covell, David Marwood, Shumeet Baluja, Nicholas Johnston
  • Publication number: 20210209475
    Abstract: The present disclosure provides systems and methods that train and use neural networks that can be run with no multiplications and no floating point operations. In particular, according to one aspect of the present disclosure, the respective non-linear and continuous activation functions typically used by the nodes of a neural network can be replaced with custom activation functions that output one of a discrete number of activation values. Likewise, according to another aspect of the present disclosure, the neural network can be trained such that each of its weights equals one of a discrete number of weight values. Taken together, this enables replacement of the typical multiplication process associated with computing a node of the network with a simple, and much faster, lookup process. In particular, a lookup table can store the result of multiplying each unique pair of activation value and weight value.
    Type: Application
    Filed: May 20, 2019
    Publication date: July 8, 2021
    Inventors: Shumeet Baluja, David Marwood
  • Patent number: 11019366
    Abstract: An encoder system can include a pixel grid generator to receive an image having a first dimension, generate a grid having a second dimension, add a plurality of points to positions on the grid, and map a plurality of pixels of the image to the plurality of points. The encoder system can include a color module to assign a color to each of the plurality of points using a color table, a triangulation module to generate a plurality of vertices based on the plurality of points and triangulate the grid using the vertices, and a compression module to compress the vertices as a set of compressed vertex positions and a set of vertex colors.
    Type: Grant
    Filed: May 16, 2019
    Date of Patent: May 25, 2021
  • Publication number: 20200234126
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing a network input using a neural network to generate a network output for the network input. One of the methods includes maintaining, for each of the plurality of neural network layers, a respective look-up table that maps each possible combination of a quantized input index and a quantized weight index to a multiplication result; and generating a network output from a network input, comprising, for each of the neural network layers: receiving data specifying a quantized input to the neural network layer, the quantized input comprising a plurality of quantized input values; and generating a layer output for the neural network layer from the quantized input to the neural network layer using the respective look-up table for the neural network layer.
    Type: Application
    Filed: January 23, 2020
    Publication date: July 23, 2020
  • Patent number: 10681388
    Abstract: Encoding and decoding occupancy information is disclosed. A method includes determining row sums for the region, determining column sums for the region, encoding, in a compressed bitstream, at least one of the row sums and the column sums, and encoding, in the compressed bitstream and based on a coding order, at least one of the rows and the columns of the region. The coding order is based on the encoded at least one of the row sums and the column sums. The row sums include, for each row of the region, a respective count of a number of locations in the row having a specified value. The column sums include, for each column of the region, a respective count of a number of locations in the column having the specified value. A location having the specified value is indicative of the occupancy information at the location.
    Type: Grant
    Filed: January 30, 2018
    Date of Patent: June 9, 2020
  • Publication number: 20190356931
    Abstract: An encoder system can include a pixel grid generator to receive an image having a first dimension, generate a grid having a second dimension, add a plurality of points to positions on the grid, and map a plurality of pixels of the image to the plurality of points. The encoder system can include a color module to assign a color to each of the plurality of points using a color table, a triangulation module to generate a plurality of vertices based on the plurality of points and triangulate the grid using the vertices, and a compression module to compress the vertices as a set of compressed vertex positions and a set of vertex colors.
    Type: Application
    Filed: May 16, 2019
    Publication date: November 21, 2019
  • Publication number: 20190238893
    Abstract: Encoding and decoding occupancy information is disclosed. A method includes determining row sums for the region, determining column sums for the region, encoding, in a compressed bitstream, at least one of the row sums and the column sums, and encoding, in the compressed bitstream and based on a coding order, at least one of the rows and the columns of the region. The coding order is based on the encoded at least one of the row sums and the column sums. The row sums include, for each row of the region, a respective count of a number of locations in the row having a specified value. The column sums include, for each column of the region, a respective count of a number of locations in the column having the specified value. A location having the specified value is indicative of the occupancy information at the location.
    Type: Application
    Filed: January 30, 2018
    Publication date: August 1, 2019
  • Patent number: 10282430
    Abstract: Methods, systems, and computer program products are provided for determining content items for delivery to users based on imagery. One example method includes determining a location of a user or a location associated with a query submitted by the user, identifying imagery associated with the determined location, and determining one or more content items for delivery to the user based at least in part on the imagery.
    Type: Grant
    Filed: July 21, 2015
    Date of Patent: May 7, 2019
  • Patent number: 10146883
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, including a method that comprises: determining a target geographic feature that has insufficient targeting information associated therewith, the target geographic feature defining a location; determining one or more similar geographic features to the target geographic feature, each geographic feature including targeting information, the determining based on shared excess queries that are shared between geographic features that are determined to be similar to the target geographic feature, wherein each excess query is a query associated with and exceeds an expected query count for each of the similar geographic features and the target geographic feature; attributing targeting information associated with at least one of the one or more similar geographic features to the target geographic feature; and serving content responsive to queries that relate to the target geographic feature based at least in part on the at
    Type: Grant
    Filed: October 9, 2015
    Date of Patent: December 4, 2018
  • Patent number: 9691138
    Abstract: In one aspect, a computer-implemented method for adjusting pixel saturation may generally include accessing, by one or more computing devices, a target distribution function associated with at least one target image and an input distribution function associated with at least one input image. The target distribution function may define a target probability for a pixel saturation of each pixel within the target image(s). The input distribution function may define an input probability for an initial saturation value of each pixel within the input image(s), with the input image(s) differing from the target image(s). The method may also include associating, by the computing device(s), the initial saturation value of each pixel within the input image(s) with a target saturation value based on the input and target distribution functions and adjusting, by the computing device(s), the initial saturation value of each pixel within the input image(s) to the corresponding target saturation value.
    Type: Grant
    Filed: August 30, 2013
    Date of Patent: June 27, 2017
  • Patent number: 9547696
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer-readable storage medium, including a method for ranking content using location-based query log analysis. The method comprises: identifying a region defining an area of interest including identifying a plurality of content items that are associated with the region; evaluating query logs associated with users that submitted queries associated with the region to determine a ranking associated with the plurality of content items; receiving a request for content associated with the region; and providing one or more of the content items based at least in part on the ranking.
    Type: Grant
    Filed: September 4, 2015
    Date of Patent: January 17, 2017
  • Patent number: 9294529
    Abstract: An embodiment for reusing data in content files includes receiving a request for a content file and retrieving a recipe that includes a series of instructions needed to compose the content file. Data identified by the recipe may then be retrieved from a content file server and the requested content file is composed based on the set of instructions in the recipe. In an example, the recipe is processed by a recipe player to compose a content file. In another embodiment, content files are stored in a cache as a series of instructions for generating them from portions of other content files. In this way, performance in a content delivery network may be improved by reusing similar data in content files.
    Type: Grant
    Filed: September 1, 2015
    Date of Patent: March 22, 2016
  • Publication number: 20160034480
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, including a method that comprises: determining a target geographic feature that has insufficient targeting information associated therewith, the target geographic feature defining a location; determining one or more similar geographic features to the target geographic feature, each geographic feature including targeting information, the determining based on shared excess queries that are shared between geographic features that are determined to be similar to the target geographic feature, wherein each excess query is a query associated with and exceeds an expected query count for each of the similar geographic features and the target geographic feature; attributing targeting information associated with at least one of the one or more similar geographic features to the target geographic feature; and serving content responsive to queries that relate to the target geographic feature based at least in part on the at
    Type: Application
    Filed: October 9, 2015
    Publication date: February 4, 2016
  • Publication number: 20150379017
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer-readable storage medium, including a method for ranking content using location-based query log analysis. The method comprises: identifying a region defining an area of interest including identifying a plurality of content items that are associated with the region; evaluating query logs associated with users that submitted queries associated with the region to determine a ranking associated with the plurality of content items; receiving a request for content associated with the region; and providing one or more of the content items based at least in part on the ranking.
    Type: Application
    Filed: September 4, 2015
    Publication date: December 31, 2015
  • Publication number: 20150371269
    Abstract: Methods, system, and apparatus, including computer programs are encoded on a computer storage medium, for providing content based on geographic location data. In one aspect, a method includes receiving a request from a website for a map segment corresponding to a particular location. Keywords are extracted from the website as targeting criteria for the particular location. The targeting criteria is associated with the particular location. A subsequent request for advertising content associated with the particular location is received. One or more advertising content items are selected based on the targeting criteria. The selected advertising content items are provided responsive to the subsequent request.
    Type: Application
    Filed: August 30, 2012
    Publication date: December 24, 2015
  • Patent number: 9177069
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, including a method that comprises: determining a target geographic feature that has insufficient targeting information associated therewith, the target geographic feature defining a location; determining one or more similar geographic features to the target geographic feature, each geographic feature including targeting information, the determining based on shared excess queries that are shared between geographic features that are determined to be similar to the target geographic feature, wherein each excess query is a query associated with and exceeds an expected query count for each of the similar geographic features and the target geographic feature; attributing targeting information associated with at least one of the one or more similar geographic features to the target geographic feature; and serving content responsive to queries that relate to the target geographic feature based at least in part on the at
    Type: Grant
    Filed: May 19, 2011
    Date of Patent: November 3, 2015
  • Patent number: 9160776
    Abstract: An embodiment for reusing data in content files includes receiving a request for a content file and retrieving a recipe that includes a series of instructions needed to compose the content file. Data identified by the recipe may then be retrieved from a content file server and the requested content file is composed based on the set of instructions in the recipe. In an example, the recipe is processed by a recipe player to compose a content file. In another embodiment, content files are stored in a cache as a series of instructions for generating them from portions of other content files. In this way, performance in a content delivery network may be improved by reusing similar data in content files.
    Type: Grant
    Filed: July 16, 2012
    Date of Patent: October 13, 2015
  • Patent number: 9135271
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer-readable storage medium, for providing a method that comprises: determining excess queries over multiple time periods for a given geographic feature, where the geographic feature defines a location; comparing geographic features for similarity based at least in part on the excess queries associated with a respective geographic feature; and for a given target geographic feature, determining one or more similar geographic features based on the comparing.
    Type: Grant
    Filed: August 5, 2013
    Date of Patent: September 15, 2015
  • Patent number: 9129029
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer-readable storage medium, including a method for ranking content using location-based query log analysis. The method comprises: identifying a region defining an area of interest including identifying a plurality of content items that are associated with the region; evaluating query logs associated with users that submitted queries associated with the region to determine a ranking associated with the plurality of content items; receiving a request for content associated with the region; and providing one or more of the content items based at least in part on the ranking.
    Type: Grant
    Filed: May 19, 2011
    Date of Patent: September 8, 2015