Patents by Inventor Shumeet Baluja

Shumeet Baluja has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240370706
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing an input through each of a plurality of layers of a neural network to generate an output, wherein the plurality of layers comprise a convolutional layer. One of the methods includes: receiving a layer input for the convolutional layer; processing the layer input to generate a layer output for the convolutional layer, comprising determining a convolution between the layer input and a filter associated with the convolutional layer; generating a spatial weight mask for the convolutional layer by using a contextual convolution block in accordance with a set of one or more spatially sensitive mask functions defined in the contextual convolution block; and determining a weighted layer output for the convolutional layer, comprising determining a product between the spatial weight mask and the layer output of the convolutional layer.
    Type: Application
    Filed: October 1, 2021
    Publication date: November 7, 2024
    Inventors: David Marwood, Shumeet Baluja
  • Patent number: 12118466
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing a network input using a neural network to generate a network output for the network input. One of the methods includes maintaining, for each of the plurality of neural network layers, a respective look-up table that maps each possible combination of a quantized input index and a quantized weight index to a multiplication result; and generating a network output from a network input, comprising, for each of the neural network layers: receiving data specifying a quantized input to the neural network layer, the quantized input comprising a plurality of quantized input values; and generating a layer output for the neural network layer from the quantized input to the neural network layer using the respective look-up table for the neural network layer.
    Type: Grant
    Filed: October 31, 2022
    Date of Patent: October 15, 2024
    Assignee: Google LLC
    Inventors: Michele Covell, David Marwood, Shumeet Baluja, Nicholas Johnston
  • Publication number: 20240289842
    Abstract: Techniques for identifying groups of local features in an image and presenting advertisement information associated with stored images that match one or more features within the group of local features are described. The techniques include providing an image, identifying a region of interest in the image, providing a user-selectable link associated with the region of interest in the image, receiving a request for the region of interest in the image via the user-selectable link, and presenting advertisement information associated with a stored image that matches one or more features within the requested region of interest.
    Type: Application
    Filed: May 3, 2024
    Publication date: August 29, 2024
    Inventors: Yushi Jing, Shumeet Baluja
  • Patent number: 12002069
    Abstract: Techniques for identifying groups of local features in an image and presenting advertisement information associated with stored images that match one or more features within the group of local features are described. The techniques include providing an image, identifying a region of interest in the image, providing a user-selectable link associated with the region of interest in the image, receiving a request for the region of interest in the image via the user-selectable link, and presenting advertisement information associated with a stored image that matches one or more features within the requested region of interest.
    Type: Grant
    Filed: November 7, 2018
    Date of Patent: June 4, 2024
    Assignee: GOOGLE LLC
    Inventors: Yushi Jing, Shumeet Baluja
  • Patent number: 11971897
    Abstract: A computer-implemented method for generating results for a client-requested query involves receiving a query produced by a client communication device, generating a result for the query in response to reception of the query, determining one or more predictive follow-up requests before receiving an actual follow-up request from the client device, and initiating retrieval of information associated with the one or more predictive follow-up requests, and transmitting at least part of the result to the client device, and then transmitting to the client device at least part of the information associated with the one or more predictive follow-up requests.
    Type: Grant
    Filed: March 18, 2019
    Date of Patent: April 30, 2024
    Assignee: GOOGLE LLC
    Inventors: Shumeet Baluja, Henry Allan Rowley
  • Publication number: 20230385613
    Abstract: A computer-implemented method for providing level-reduced tensor data having improved representation of information can include obtaining input tensor data, providing the input tensor data as input to a machine-learned discretization level reduction model configured to receive tensor data having a number of discretization levels and produce, in response to receiving the tensor data, level-reduced tensor data having a reduced number of discretization levels, and obtaining, from the machine-learned discretization level reduction model, the level-reduced tensor data. The machine-learned discretization level reduction model is trained using reconstructed input tensor data generated using an output of the machine-learned discretization level reduction model. The machine-learned discretization level reduction model can include one or more level reduction layers configured to receive input having a first number of discretization levels and to provide a layer output having a reduced a number of discretization levels.
    Type: Application
    Filed: October 29, 2020
    Publication date: November 30, 2023
    Inventor: Shumeet Baluja
  • Publication number: 20230307003
    Abstract: In accordance with some embodiments of the disclosed subject matter, mechanisms for seamless audio melding between audio items in a playlist are provided.
    Type: Application
    Filed: June 1, 2023
    Publication date: September 28, 2023
    Inventors: Michele Covell, Shumeet Baluja
  • Publication number: 20230186082
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing a network input using a neural network to generate a network output for the network input. One of the methods includes maintaining, for each of the plurality of neural network layers, a respective look-up table that maps each possible combination of a quantized input index and a quantized weight index to a multiplication result; and generating a network output from a network input, comprising, for each of the neural network layers: receiving data specifying a quantized input to the neural network layer, the quantized input comprising a plurality of quantized input values; and generating a layer output for the neural network layer from the quantized input to the neural network layer using the respective look-up table for the neural network layer.
    Type: Application
    Filed: October 31, 2022
    Publication date: June 15, 2023
    Inventors: Michele Covell, David Marwood, Shumeet Baluja, Nicholas Johnston
  • Patent number: 11670338
    Abstract: In accordance with some embodiments of the disclosed subject matter, mechanisms for seamless audio melding between audio items in a playlist are provided.
    Type: Grant
    Filed: December 6, 2021
    Date of Patent: June 6, 2023
    Assignee: Google LLC
    Inventors: Michele Covell, Shumeet Baluja
  • Patent number: 11488016
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing a network input using a neural network to generate a network output for the network input. One of the methods includes maintaining, for each of the plurality of neural network layers, a respective look-up table that maps each possible combination of a quantized input index and a quantized weight index to a multiplication result; and generating a network output from a network input, comprising, for each of the neural network layers: receiving data specifying a quantized input to the neural network layer, the quantized input comprising a plurality of quantized input values; and generating a layer output for the neural network layer from the quantized input to the neural network layer using the respective look-up table for the neural network layer.
    Type: Grant
    Filed: January 23, 2020
    Date of Patent: November 1, 2022
    Assignee: Google LLC
    Inventors: Michele Covell, David Marwood, Shumeet Baluja, Nicholas Johnston
  • Patent number: 11455299
    Abstract: Methods, systems and apparatus, including computer programs encoded on a computer storage medium for selecting keywords for resources are disclosed. In one aspect, a search query is received associated with a first user. A determination is made that the first user is a follower of an entity feed that is provided by a first entity and that is provided through a social network. A content item is selected having distribution parameters specifying that the content item is to be provided to users that are followers of the entity feed and that submit the search query. The selected content item is provided for the first user.
    Type: Grant
    Filed: March 6, 2019
    Date of Patent: September 27, 2022
    Assignee: Google LLC
    Inventors: Michael Chu, Michele Covell, Joshua J. Sacks, Shumeet Baluja, Zhengrong Ji
  • Publication number: 20220237882
    Abstract: The present disclosure is directed to encoding images. In particular, one or more computing devices can receive data representing one or more machine learning (ML) models configured, at least in part, to encode images comprising objects of a particular type. The computing device(s) can receive data representing an image comprising one or more objects of the particular type. The computing device(s) can generate, based at least in part on the data representing the image and the data representing the ML model(s), data representing an encoded version of the image that alters at least a portion of the image comprising the object(s) such that when the encoded version of the image is decoded, the object(s) are unrecognizable as being of the particular type by one or more object-recognition ML models based at least in part upon which the ML model(s) configured to encode the images were trained.
    Type: Application
    Filed: May 28, 2019
    Publication date: July 28, 2022
    Inventors: Shumeet Baluja, Rahul Sukthankar
  • Publication number: 20220093130
    Abstract: In accordance with some embodiments of the disclosed subject matter, mechanisms for seamless audio melding between audio items in a playlist are provided.
    Type: Application
    Filed: December 6, 2021
    Publication date: March 24, 2022
    Inventors: Michele Covell, Shumeet Baluja
  • Patent number: 11265403
    Abstract: Systems and techniques, including computer software, for retrieving information to a mobile device involve installing a data retrieval application on the mobile device. The data retrieval application includes instructions for presenting a structured data display on the mobile device, defining a structure of the structured data display, requesting selected hyperlinks included in the structured data display, and rendering markup language information received in response to the selected hyperlinks. A user request to retrieve data through the data retrieval application is received, and data is retrieved in response to the received user request. The retrieved data is displayed according to the structure of the structured data display, and a user can select a hyperlink in the displayed data to retrieve and render markup language information using the data retrieval application.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: March 1, 2022
    Assignee: GOOGLE LLC
    Inventors: Elad Gil, Shumeet Baluja, Maryam Garrett, Cedric Beust
  • Patent number: 11195553
    Abstract: In accordance with some embodiments of the disclosed subject matter, mechanisms for seamless audio melding between audio items in a playlist are provided.
    Type: Grant
    Filed: September 1, 2020
    Date of Patent: December 7, 2021
    Assignee: Google LLC
    Inventors: Michele Covell, Shumeet Baluja
  • Patent number: 11092455
    Abstract: A computer-implemented method of providing personalized route information involves gathering a plurality of past location indicators over time for a wireless client device, determining a future driving objective using the plurality of previously-gathered location indicators, obtaining real-time traffic data for an area proximate to the determined driving objective, and generating a suggested route for the driving objective using the near real-time traffic data.
    Type: Grant
    Filed: April 11, 2018
    Date of Patent: August 17, 2021
    Assignee: Google LLC
    Inventors: Henry Allan Rowley, Shumeet Baluja
  • Patent number: 11093973
    Abstract: Ad rendering parameters for a set of two or more ads may be determined by (a) accepting, for a set of two or more ads, ad information which includes at least one ad feature having a value that depends on ad rendering parameters, and (b) determining ad rendering parameters for at least one ad from the set of two or more ads using the accepted ad information. The act of determining ad rendering parameters may use accepted ad rendering constraints. The ad rendering constraints may include space available for rendering the ads, a footprint available for rendering the ads, and/or a maximum number of ads permitted to be rendered. The act of determining ad rendering parameters may include maximizing a value associated with serving at least one ad from the set of two or more ads with ad rendering parameters subject to the ad rendering constraints. The ad rendering parameters may include sizes of the served ads, and/or a layout of the served ads.
    Type: Grant
    Filed: August 12, 2019
    Date of Patent: August 17, 2021
    Assignee: Google LLC
    Inventors: Shumeet Baluja, Vibhu Mittal, Mehran Sahami
  • Patent number: 11080809
    Abstract: The present disclosure provides systems and methods for hiding information using deep neural networks. In one example, a computer-implemented method is provided to train neural networks for hiding images, which includes inputting a package image and a cover image into an image hiding neural network and generating a carrier image as an output, the carrier image comprising the package image hidden within the cover image. The method includes inputting the carrier image into an image decoding neural network and generating a reconstruction of the package image as an output. The method includes simultaneously training the image decoding neural network based at least in part on a first loss function that describes a difference between the package image and the reconstruction of the package image and the image hiding neural network based at least in part on the first loss function and on a second loss function that describes a difference between the cover image and the carrier image.
    Type: Grant
    Filed: February 13, 2018
    Date of Patent: August 3, 2021
    Assignee: Google LLC
    Inventor: Shumeet Baluja
  • Publication number: 20210209475
    Abstract: The present disclosure provides systems and methods that train and use neural networks that can be run with no multiplications and no floating point operations. In particular, according to one aspect of the present disclosure, the respective non-linear and continuous activation functions typically used by the nodes of a neural network can be replaced with custom activation functions that output one of a discrete number of activation values. Likewise, according to another aspect of the present disclosure, the neural network can be trained such that each of its weights equals one of a discrete number of weight values. Taken together, this enables replacement of the typical multiplication process associated with computing a node of the network with a simple, and much faster, lookup process. In particular, a lookup table can store the result of multiplying each unique pair of activation value and weight value.
    Type: Application
    Filed: May 20, 2019
    Publication date: July 8, 2021
    Inventors: Shumeet Baluja, David Marwood
  • Publication number: 20210166731
    Abstract: In accordance with some embodiments of the disclosed subject matter, mechanisms for seamless audio melding between audio items in a playlist are provided.
    Type: Application
    Filed: September 1, 2020
    Publication date: June 3, 2021
    Inventors: Michele Covell, Shumeet Baluja