Patents Assigned to Google LLC
  • Publication number: 20230169976
    Abstract: A method for streaming action fulfillment receives audio data corresponding to an utterance where the utterance includes a query to perform an action that requires performance of a sequence of sub-actions in order to fulfill the action. While receiving the audio data, but before receiving an end of speech condition, the method processes the audio data to generate intermediate automated speech recognition (ASR) results, performs partial query interpretation on the intermediate ASR results to determine whether the intermediate ASR results identify an application type needed to perform the action and, when the intermediate ASR results identify a particular application type, performs a first sub-action in the sequence of sub-actions by launching a first application to execute on the user device where the first application is associated with the particular application type. The method, in response to receiving an end of speech condition, fulfills performance of the action.
    Type: Application
    Filed: January 27, 2023
    Publication date: June 1, 2023
    Applicant: Google LLC
    Inventors: Matthew Sharifi, Victor Carbune
  • Publication number: 20230169979
    Abstract: Provided are methods, systems, and apparatuses for detecting, processing, and responding to audio signals, including speech signals, within a designated area or space. A platform for multiple media devices connected via a network is configured to process speech, such as voice commands, detected at the media devices, and respond to the detected speech by causing the media devices to simultaneously perform one or more requested actions. The platform is capable of scoring the quality of a speech request, handling speech requests from multiple end points of the platform using a centralized processing approach, a de-centralized processing approach, or a combination thereof, and also manipulating partial processing of speech requests from multiple end points into a coherent whole when necessary.
    Type: Application
    Filed: January 24, 2023
    Publication date: June 1, 2023
    Applicant: Google LLC
    Inventors: Jay Pierre Civelli, Mikhal Shemer, Turaj Zakizadeh Shabestary, David Tapuska
  • Patent number: 11662527
    Abstract: An optical assembly includes a light source for providing a beam of light, a lens system configured to expand and collimate the beam of light, and a configurable beam injector, wherein the beam injector contains a first grid plate and a second grid plate to block individual beams of light. The first grid plate and the second grid plate may be configured such that each grid plate respectively corresponds to particular MEMS mirrors. The grid plates can be configured to have pathways that allow for beams of light to be passed through and other pathways which are blocked to prevent the passage of light. The first grid plate and second grid plate may thus block or allow for transmission of beams of lights to those particular MEMS mirrors. The second grid plate can be configured to be easily swappable during or removable to allow for a different set of beams of light, corresponding to a different set of MEMS mirrors, to be blocked.
    Type: Grant
    Filed: March 2, 2021
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Kevin Yasumura, Jill Berger
  • Patent number: 11663733
    Abstract: A method includes obtaining a reference image and a target image each representing an environment containing moving features and static features. The method also includes determining an object mask configured to mask out the moving features and preserves the static features in the target image. The method additionally includes determining, based on motion parallax between the reference image and the target image, a static depth image representing depth values of the static features in the target image. The method further includes generating, by way of a machine learning model, a dynamic depth image representing depth values of both the static features and the moving features in the target image. The model is trained to generate the dynamic depth image by determining depth values of at least the moving features based on the target image, the object mask, and the static depth image.
    Type: Grant
    Filed: March 23, 2022
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Tali Dekel, Forrester Cole, Ce Liu, William Freeman, Richard Tucker, Noah Snavely, Zhengqi Li
  • Patent number: 11664011
    Abstract: A method of providing a frame-based mel spectral representation of speech includes receiving a text utterance having at least one word and selecting a mel spectral embedding for the text utterance. Each word has at least one syllable and each syllable has at least one phoneme. For each phoneme, the method further includes using the selected mel spectral embedding to: (i) predict a duration of the corresponding phoneme based on corresponding linguistic features associated with the word that includes the corresponding phoneme and corresponding linguistic features associated with the syllable that includes the corresponding phoneme; and (ii) generate a plurality of fixed-length predicted mel-frequency spectrogram frames based on the predicted duration for the corresponding phoneme. Each fixed-length predicted mel-frequency spectrogram frame represents mel-spectral information of the corresponding phoneme.
    Type: Grant
    Filed: February 9, 2022
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Robert Andrew James Clark, Chun-an Chan, Vincent Ping Leung Wan
  • Patent number: 11663827
    Abstract: A computer-implemented method includes receiving a video that includes multiple frames. The method further includes identifying a start time and an end time of each action in the video based on application of one or more of an audio classifier, an RGB classifier, and a motion classifier. The method further includes identifying video segments from the video that include frames between the start time and the end time for each action in the video. The method further includes generating a confidence score for each of the video segments based on a probability that a corresponding action corresponds to one or more of a set of predetermined actions. The method further includes selecting a subset of the video segments based on the confidence score for each of the video segments.
    Type: Grant
    Filed: July 13, 2022
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Sudheendra Vijayanarasimhan, Alexis Bienvenu, David Ross, Timothy Novikoff, Arvind Balasubramanian
  • Patent number: 11663447
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for receiving graph data representing an input graph comprising a plurality of vertices connected by edges; generating, from the graph data, vertex input data representing characteristics of each vertex in the input graph and pair input data representing characteristics of pairs of vertices in the input graph; and generating order-invariant features of the input graph using a neural network, wherein the neural network comprises: a first subnetwork configured to generate a first alternative representation of the vertex input data and a first alternative representation of the pair input data from the vertex input data and the pair input data; and a combining layer configured to receive an input alternative representation and to process the input alternative representation to generate the order-invariant features.
    Type: Grant
    Filed: August 24, 2021
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Patrick F. Riley, Marc Berndl
  • Patent number: 11663472
    Abstract: Techniques and apparatuses are described for deep neural network (DNN) processing for a user equipment-coordination set (UECS). A network entity selects (910) an end-to-end (E2E) machine-learning (ML) configuration that forms an E2E DNN for processing UECS communications. The network entity directs (915) each device of multiple devices participating in an UECS to form, using at least a portion of the E2E ML configuration, a respective sub-DNN of the E2E DNN that transfers the UECS communications through the E2E communication, where the multiple devices include at least one base station, a coordinating user equipment (UE), and at least one additional UE. The network entity receives (940) feedback associated with the UECS communications and identifies (945) an adjustment to the E2E ML configuration. The network entity then directs at least some of the multiple devices participating in an UECS to update the respective sub-DNN of the E2E DNN based on the adjustment.
    Type: Grant
    Filed: June 29, 2020
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Jibing Wang, Erik Richard Stauffer
  • Patent number: 11664679
    Abstract: A circuit for stealing power from an external system without interfering with a communication protocol may include wiring connectors configured to receive wires from the external system; a first voltage regulator to regulate a voltage on the plurality of wiring connectors at a plurality of voltage levels to encode a first multi-bit binary message according to the communication protocol to be sent to the external system; a current monitor to measure a plurality of current levels received through the plurality of wiring connectors and decode the plurality of current levels to determine a second multi-bit binary message sent from the external system according to the communication protocol; and a power converter that adjusts an amount of power stolen from the plurality of wiring connectors based at least in part on the voltage on the plurality of wiring connectors.
    Type: Grant
    Filed: April 26, 2021
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Daniel Adam Warren, Eric Marschalkowski, Nathan Lentz, Timothy Lai
  • Patent number: 11660027
    Abstract: This document describes techniques and devices for Fourier-transform infrared (FT-IR) spectroscopy using a mobile device. A mobile device (502) includes a light source (504) that emits light toward an interferometer (508) that uses mirrors to separate and recombine the light. The interferometer directs the recombined light toward a person. Light reflected from, or transmitted through, the person is received through a reception port (506) to a photodetector (510) that outputs photodetector data that corresponds to a measured light intensity of the reflected and transmitted light as a function of a path length of the light or a mirror position of the interferometer. Based on the photodetector data, an interferogram is generated. Applying a technique such as a Fourier transform to the interferogram, a spectrum data set of the reflected and transmitted light is generated. Based on the spectrum data set, a concentration of solutes in the person's blood is calculated.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Christopher David Workman, Ricky Bomber, Kelly Dobson
  • Patent number: 11664329
    Abstract: A weight optimized stiffener for use in a semiconductor device is disclosed herein. In one example, the stiffener is made of AlSiC for its weight and thermal properties. An O-ring provides sealing between a top surface of the stiffener and a component of the semiconductor device and adhesive provides sealing between a bottom surface of the stiffener and another component of the semiconductor device. The stiffener provides warpage control for a lidless package while enabling direct liquid cooling of a chip or substrate.
    Type: Grant
    Filed: May 19, 2020
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Madhusudan K. Iyengar, Connor Burgess, Padam Jain, Emad Samadiani, Yuan Li
  • Patent number: 11662887
    Abstract: This disclosure relates to adaptive content control and display for internet media. A playback component provides for playback of media content. An input component detects user inputs during playback of the content. In response to the user inputs being detected, a menu component displays a level of a pivot menu during playback of the content. The pivot menu is displayed on top, or in front, of a portion of the content during playback, and the pivot menu can be at least partially transparent to enable consumption of the content to continue without complete obstruction.
    Type: Grant
    Filed: August 5, 2022
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Shivakumar Littoo Rajaraman, Stein Eldar Johnsen, Jonas Yngvesson, Jasmine Kent, Elena Kaschner, Jun Li, Matias Cudich, Thomas Robinson Purnell-Fisher
  • Patent number: 11663520
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training machine learning systems. One of the methods includes receiving a plurality of training examples; and training a machine learning system on each of the plurality of training examples to determine trained values for weights of a machine learning model, wherein training the machine learning system comprises: assigning an initial value for a regularization penalty for a particular weight for a particular feature; and adjusting the initial value for the regularization penalty for the particular weight for the particular feature during the training of the machine learning system.
    Type: Grant
    Filed: August 26, 2019
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Yoram Singer, Tal Shaked, Tushar Deepak Chandra, Tze Way Eugene Ie
  • Patent number: 11663768
    Abstract: This technology relates to rendering content from discrete applications. In this regard, one or more computing devices may receive a global scene graph containing resources provided by two or more discrete processes, wherein the global scene graph is instantiated by a first process of the two or more discrete processes. The one or more computing devices may render and output for display, the global scene graph in accordance with the resources contained there.
    Type: Grant
    Filed: May 24, 2021
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Joshua Gargus, Jeffrey Brown, Michael Jurka
  • Patent number: 11662664
    Abstract: A method of fabricating a circuit element, such as a quantum computing circuit element, including obtaining a lithography mask write file that includes mask information characterizing one or more mask features, obtaining a uniformity function that is configured to modify the mask information to compensate for a non-uniform deposition process, applying the uniformity function to the lithography mask write to obtain a modified lithography mask write file, and performing lithography as directed by the modified lithography mask write file.
    Type: Grant
    Filed: July 1, 2022
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Brian James Burkett, Rami Barends
  • Patent number: 11664021
    Abstract: A method of biasing speech recognition includes receiving audio data encoding an utterance and obtaining a set of one or more biasing phrases corresponding to a context of the utterance. Each biasing phrase in the set of one or more biasing phrases includes one or more words. The method also includes processing, using a speech recognition model, acoustic features derived from the audio data and grapheme and phoneme data derived from the set of one or more biasing phrases to generate an output of the speech recognition model. The method also includes determining a transcription for the utterance based on the output of the speech recognition model.
    Type: Grant
    Filed: December 9, 2021
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Rohit Prakash Prabhavalkar, Golan Pundak, Tara N. Sainath, Antoine Jean Bruguier
  • Patent number: 11665543
    Abstract: In some implementations, (i) audio data representing a voice command spoken by a speaker and (ii) a speaker identification result indicating that the voice command was spoken by the speaker are obtained. A voice action is selected based at least on a transcription of the audio data. A service provider corresponding to the selected voice action is selected from among a plurality of different service providers. One or more input data types that the selected service provider uses to perform authentication for the selected voice action are identified. A request to perform the selected voice action and (i) one or more values that correspond to the identified one or more input data types are provided to the service provider.
    Type: Grant
    Filed: August 10, 2020
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventor: Barnaby John James
  • Patent number: 11663396
    Abstract: A method to incorporate a first edit and a second edit into an electronic document includes receiving the first edit and the second edit having a shared position in the electronic document, and determining whether the second edit is privileged relative to the first edit. The method further includes responsive to determining that the second edit is not privileged relative to the first edit, requiring the second edit to be independently accepted prior to incorporating the second edit into the electronic document, and responsive to determining that the second edit is privileged relative to the first edit, incorporating the second edit into the electronic document without requiring the second edit to be independently accepted, and responsive to receiving an acceptance of the first edit, causing the first edit and the second edit to be incorporated into the electronic document.
    Type: Grant
    Filed: August 9, 2021
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Vance Julius Vagell, Fil Zembowicz, Luiz Amaral Franca Pereira Filho, Ian Gunn, Nikita Rybak
  • Patent number: 11662832
    Abstract: Features described herein generally relate to enhancing functionality of electronic devices. Particularly, a notification is received from a wearable device that includes a position of the wearable device within an area, a determination is made that the wearable device is located within a predetermined distance from a controllable device, a graphical user interface page that includes buttons is sent to the wearable device, an indication that a button of the buttons has been activated is received from the wearable device, and a command signal that includes an instruction is sent to the controllable device. In this way, functionality of electronic devices can be extended with wearable devices.
    Type: Grant
    Filed: August 25, 2022
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Richard Lee Marks, Ding Xu
  • Patent number: 11663482
    Abstract: A method identifies a text region in an electronic document. The method determines that the text region includes a candidate text portion that is a candidate for applying a formatting suggestion based on a comparison of the text region with predetermined patterns. The method identifies a stored text record that corresponds to the candidate text portion. The method confirms whether the formatting type is appropriate for the candidate text portion based on individual word matches between the candidate text portion and the stored text record. The method notifies a user of the electronic document of the formatting suggestion according to the formatting type.
    Type: Grant
    Filed: July 6, 2018
    Date of Patent: May 30, 2023
    Assignee: Google LLC
    Inventors: Abraham Ittycheriah, Adam Tishok, Max Kessler, Peter Likarish