Patents by Inventor Shumeet Baluja

Shumeet Baluja has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230385613
    Abstract: A computer-implemented method for providing level-reduced tensor data having improved representation of information can include obtaining input tensor data, providing the input tensor data as input to a machine-learned discretization level reduction model configured to receive tensor data having a number of discretization levels and produce, in response to receiving the tensor data, level-reduced tensor data having a reduced number of discretization levels, and obtaining, from the machine-learned discretization level reduction model, the level-reduced tensor data. The machine-learned discretization level reduction model is trained using reconstructed input tensor data generated using an output of the machine-learned discretization level reduction model. The machine-learned discretization level reduction model can include one or more level reduction layers configured to receive input having a first number of discretization levels and to provide a layer output having a reduced a number of discretization levels.
    Type: Application
    Filed: October 29, 2020
    Publication date: November 30, 2023
    Inventor: Shumeet Baluja
  • Publication number: 20230307003
    Abstract: In accordance with some embodiments of the disclosed subject matter, mechanisms for seamless audio melding between audio items in a playlist are provided.
    Type: Application
    Filed: June 1, 2023
    Publication date: September 28, 2023
    Inventors: Michele Covell, Shumeet Baluja
  • Publication number: 20230186082
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing a network input using a neural network to generate a network output for the network input. One of the methods includes maintaining, for each of the plurality of neural network layers, a respective look-up table that maps each possible combination of a quantized input index and a quantized weight index to a multiplication result; and generating a network output from a network input, comprising, for each of the neural network layers: receiving data specifying a quantized input to the neural network layer, the quantized input comprising a plurality of quantized input values; and generating a layer output for the neural network layer from the quantized input to the neural network layer using the respective look-up table for the neural network layer.
    Type: Application
    Filed: October 31, 2022
    Publication date: June 15, 2023
    Inventors: Michele Covell, David Marwood, Shumeet Baluja, Nicholas Johnston
  • Patent number: 11670338
    Abstract: In accordance with some embodiments of the disclosed subject matter, mechanisms for seamless audio melding between audio items in a playlist are provided.
    Type: Grant
    Filed: December 6, 2021
    Date of Patent: June 6, 2023
    Assignee: Google LLC
    Inventors: Michele Covell, Shumeet Baluja
  • Patent number: 11488016
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing a network input using a neural network to generate a network output for the network input. One of the methods includes maintaining, for each of the plurality of neural network layers, a respective look-up table that maps each possible combination of a quantized input index and a quantized weight index to a multiplication result; and generating a network output from a network input, comprising, for each of the neural network layers: receiving data specifying a quantized input to the neural network layer, the quantized input comprising a plurality of quantized input values; and generating a layer output for the neural network layer from the quantized input to the neural network layer using the respective look-up table for the neural network layer.
    Type: Grant
    Filed: January 23, 2020
    Date of Patent: November 1, 2022
    Assignee: Google LLC
    Inventors: Michele Covell, David Marwood, Shumeet Baluja, Nicholas Johnston
  • Patent number: 11455299
    Abstract: Methods, systems and apparatus, including computer programs encoded on a computer storage medium for selecting keywords for resources are disclosed. In one aspect, a search query is received associated with a first user. A determination is made that the first user is a follower of an entity feed that is provided by a first entity and that is provided through a social network. A content item is selected having distribution parameters specifying that the content item is to be provided to users that are followers of the entity feed and that submit the search query. The selected content item is provided for the first user.
    Type: Grant
    Filed: March 6, 2019
    Date of Patent: September 27, 2022
    Assignee: Google LLC
    Inventors: Michael Chu, Michele Covell, Joshua J. Sacks, Shumeet Baluja, Zhengrong Ji
  • Publication number: 20220237882
    Abstract: The present disclosure is directed to encoding images. In particular, one or more computing devices can receive data representing one or more machine learning (ML) models configured, at least in part, to encode images comprising objects of a particular type. The computing device(s) can receive data representing an image comprising one or more objects of the particular type. The computing device(s) can generate, based at least in part on the data representing the image and the data representing the ML model(s), data representing an encoded version of the image that alters at least a portion of the image comprising the object(s) such that when the encoded version of the image is decoded, the object(s) are unrecognizable as being of the particular type by one or more object-recognition ML models based at least in part upon which the ML model(s) configured to encode the images were trained.
    Type: Application
    Filed: May 28, 2019
    Publication date: July 28, 2022
    Inventors: Shumeet Baluja, Rahul Sukthankar
  • Publication number: 20220093130
    Abstract: In accordance with some embodiments of the disclosed subject matter, mechanisms for seamless audio melding between audio items in a playlist are provided.
    Type: Application
    Filed: December 6, 2021
    Publication date: March 24, 2022
    Inventors: Michele Covell, Shumeet Baluja
  • Patent number: 11265403
    Abstract: Systems and techniques, including computer software, for retrieving information to a mobile device involve installing a data retrieval application on the mobile device. The data retrieval application includes instructions for presenting a structured data display on the mobile device, defining a structure of the structured data display, requesting selected hyperlinks included in the structured data display, and rendering markup language information received in response to the selected hyperlinks. A user request to retrieve data through the data retrieval application is received, and data is retrieved in response to the received user request. The retrieved data is displayed according to the structure of the structured data display, and a user can select a hyperlink in the displayed data to retrieve and render markup language information using the data retrieval application.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: March 1, 2022
    Assignee: GOOGLE LLC
    Inventors: Elad Gil, Shumeet Baluja, Maryam Garrett, Cedric Beust
  • Patent number: 11195553
    Abstract: In accordance with some embodiments of the disclosed subject matter, mechanisms for seamless audio melding between audio items in a playlist are provided.
    Type: Grant
    Filed: September 1, 2020
    Date of Patent: December 7, 2021
    Assignee: Google LLC
    Inventors: Michele Covell, Shumeet Baluja
  • Patent number: 11092455
    Abstract: A computer-implemented method of providing personalized route information involves gathering a plurality of past location indicators over time for a wireless client device, determining a future driving objective using the plurality of previously-gathered location indicators, obtaining real-time traffic data for an area proximate to the determined driving objective, and generating a suggested route for the driving objective using the near real-time traffic data.
    Type: Grant
    Filed: April 11, 2018
    Date of Patent: August 17, 2021
    Assignee: Google LLC
    Inventors: Henry Allan Rowley, Shumeet Baluja
  • Patent number: 11093973
    Abstract: Ad rendering parameters for a set of two or more ads may be determined by (a) accepting, for a set of two or more ads, ad information which includes at least one ad feature having a value that depends on ad rendering parameters, and (b) determining ad rendering parameters for at least one ad from the set of two or more ads using the accepted ad information. The act of determining ad rendering parameters may use accepted ad rendering constraints. The ad rendering constraints may include space available for rendering the ads, a footprint available for rendering the ads, and/or a maximum number of ads permitted to be rendered. The act of determining ad rendering parameters may include maximizing a value associated with serving at least one ad from the set of two or more ads with ad rendering parameters subject to the ad rendering constraints. The ad rendering parameters may include sizes of the served ads, and/or a layout of the served ads.
    Type: Grant
    Filed: August 12, 2019
    Date of Patent: August 17, 2021
    Assignee: Google LLC
    Inventors: Shumeet Baluja, Vibhu Mittal, Mehran Sahami
  • Patent number: 11080809
    Abstract: The present disclosure provides systems and methods for hiding information using deep neural networks. In one example, a computer-implemented method is provided to train neural networks for hiding images, which includes inputting a package image and a cover image into an image hiding neural network and generating a carrier image as an output, the carrier image comprising the package image hidden within the cover image. The method includes inputting the carrier image into an image decoding neural network and generating a reconstruction of the package image as an output. The method includes simultaneously training the image decoding neural network based at least in part on a first loss function that describes a difference between the package image and the reconstruction of the package image and the image hiding neural network based at least in part on the first loss function and on a second loss function that describes a difference between the cover image and the carrier image.
    Type: Grant
    Filed: February 13, 2018
    Date of Patent: August 3, 2021
    Assignee: Google LLC
    Inventor: Shumeet Baluja
  • Publication number: 20210209475
    Abstract: The present disclosure provides systems and methods that train and use neural networks that can be run with no multiplications and no floating point operations. In particular, according to one aspect of the present disclosure, the respective non-linear and continuous activation functions typically used by the nodes of a neural network can be replaced with custom activation functions that output one of a discrete number of activation values. Likewise, according to another aspect of the present disclosure, the neural network can be trained such that each of its weights equals one of a discrete number of weight values. Taken together, this enables replacement of the typical multiplication process associated with computing a node of the network with a simple, and much faster, lookup process. In particular, a lookup table can store the result of multiplying each unique pair of activation value and weight value.
    Type: Application
    Filed: May 20, 2019
    Publication date: July 8, 2021
    Inventors: Shumeet Baluja, David Marwood
  • Publication number: 20210166731
    Abstract: In accordance with some embodiments of the disclosed subject matter, mechanisms for seamless audio melding between audio items in a playlist are provided.
    Type: Application
    Filed: September 1, 2020
    Publication date: June 3, 2021
    Inventors: Michele Covell, Shumeet Baluja
  • Patent number: 11019366
    Abstract: An encoder system can include a pixel grid generator to receive an image having a first dimension, generate a grid having a second dimension, add a plurality of points to positions on the grid, and map a plurality of pixels of the image to the plurality of points. The encoder system can include a color module to assign a color to each of the plurality of points using a color table, a triangulation module to generate a plurality of vertices based on the plurality of points and triangulate the grid using the vertices, and a compression module to compress the vertices as a set of compressed vertex positions and a set of vertex colors.
    Type: Grant
    Filed: May 16, 2019
    Date of Patent: May 25, 2021
  • Publication number: 20200252491
    Abstract: Systems and techniques, including computer software, for retrieving information to a mobile device involve installing a data retrieval application on the mobile device. The data retrieval application includes instructions for presenting a structured data display on the mobile device, defining a structure of the structured data display, requesting selected hyperlinks included in the structured data display, and rendering markup language information received in response to the selected hyperlinks. A user request to retrieve data through the data retrieval application is received, and data is retrieved in response to the received user request. The retrieved data is displayed according to the structure of the structured data display, and a user can select a hyperlink in the displayed data to retrieve and render markup language information using the data retrieval application.
    Type: Application
    Filed: February 20, 2020
    Publication date: August 6, 2020
    Inventors: Elad Gil, Shumeet Baluja, Maryam Garrett, Cedric Beust
  • Publication number: 20200234126
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing a network input using a neural network to generate a network output for the network input. One of the methods includes maintaining, for each of the plurality of neural network layers, a respective look-up table that maps each possible combination of a quantized input index and a quantized weight index to a multiplication result; and generating a network output from a network input, comprising, for each of the neural network layers: receiving data specifying a quantized input to the neural network layer, the quantized input comprising a plurality of quantized input values; and generating a layer output for the neural network layer from the quantized input to the neural network layer using the respective look-up table for the neural network layer.
    Type: Application
    Filed: January 23, 2020
    Publication date: July 23, 2020
  • Publication number: 20200184592
    Abstract: The present disclosure provides systems and methods for hiding information using deep neural networks. In one example, a computer-implemented method is provided to train neural networks for hiding images, which includes inputting a package image and a cover image into an image hiding neural network and generating a carrier image as an output, the carrier image comprising the package image hidden within the cover image. The method includes inputting the carrier image into an image decoding neural network and generating a reconstruction of the package image as an output. The method includes simultaneously training the image decoding neural network based at least in part on a first loss function that describes a difference between the package image and the reconstruction of the package image and the image hiding neural network based at least in part on the first loss function and on a second loss function that describes a difference between the cover image and the carrier image.
    Type: Application
    Filed: February 13, 2018
    Publication date: June 11, 2020
    Inventor: Shumeet Baluja
  • Patent number: 10681388
    Abstract: Encoding and decoding occupancy information is disclosed. A method includes determining row sums for the region, determining column sums for the region, encoding, in a compressed bitstream, at least one of the row sums and the column sums, and encoding, in the compressed bitstream and based on a coding order, at least one of the rows and the columns of the region. The coding order is based on the encoded at least one of the row sums and the column sums. The row sums include, for each row of the region, a respective count of a number of locations in the row having a specified value. The column sums include, for each column of the region, a respective count of a number of locations in the column having the specified value. A location having the specified value is indicative of the occupancy information at the location.
    Type: Grant
    Filed: January 30, 2018
    Date of Patent: June 9, 2020