Patents Assigned to GOOGLE
  • Patent number: 11527248
    Abstract: The subject matter of this specification can be embodied in, among other things, a method that includes receiving an audio signal and initiating speech recognition tasks by a plurality of speech recognition systems (SRS's). Each SRS is configured to generate a recognition result specifying possible speech included in the audio signal and a confidence value indicating a confidence in a correctness of the speech result. The method also includes completing a portion of the speech recognition tasks including generating one or more recognition results and one or more confidence values for the one or more recognition results, determining whether the one or more confidence values meets a confidence threshold, aborting a remaining portion of the speech recognition tasks for SRS's that have not generated a recognition result, and outputting a final recognition result based on at least one of the generated one or more speech results.
    Type: Grant
    Filed: May 27, 2020
    Date of Patent: December 13, 2022
    Assignee: GOOGLE LLC
    Inventors: Brian Strope, Francoise Beaufays, Olivier Siohan
  • Patent number: 11528498
    Abstract: Image coding using alpha channel prediction may include generating a reconstructed image using alpha channel prediction and outputting the reconstructed image. Generating the reconstructed image using alpha channel prediction may include decoding reconstructed color channel values for a current pixel expressed with reference to first color space, obtaining color space converted color channel values for the current pixel by converting the reconstructed color channel values to a second color space, obtaining an alpha channel lower bound for an alpha channel value for the current pixel using the color space converted color channel values, generating a candidate predicted alpha value for the current pixel, obtaining an adjusted predicted alpha value for the current pixel using the candidate predicted alpha value and the alpha channel lower bound, generating a reconstructed pixel for the current pixel using the adjusted predicted alpha value, and including the reconstructed pixel in the reconstructed image.
    Type: Grant
    Filed: June 22, 2021
    Date of Patent: December 13, 2022
    Assignee: GOOGLE LLC
    Inventors: Maryla Ustarroz-Calonge, Vincent Rabaud
  • Patent number: 11526570
    Abstract: Techniques are described herein for determining a predicted intent of a user and displaying additional content selected based on the predicted intent of the user. A method includes: receiving information identifying a webpage that a user is visiting and a navigational path of the user in navigating to the webpage; determining a predicted intent of the user based on the information identifying the webpage that the user is visiting and the navigational path of the user in navigating to the webpage; selecting additional content based upon the predicted intent of the user; and displaying an overlay, on a portion of the webpage, that includes the additional content.
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: December 13, 2022
    Assignee: GOOGLE LLC
    Inventor: Ibrahim Badr
  • Patent number: 11520469
    Abstract: Systems and methods are provided for displaying and interacting with multiple open views in a mobile environment. An example method can include displaying a current pane in a maximized state and at least a first pane in a minimized state in a dock area. The current pane is a top of a stack list and displays content associated with a first location and the first pane is in a dock list and displays content associated with a second location. The minimized state for a pane is a scaled down version of the maximized state for the pane, the scale applying to the content for the pane and a size of the pane. The method also includes receiving a drag input on the first pane in the dock area and scaling the size of the first pane according to proximity to the dock area.
    Type: Grant
    Filed: December 10, 2019
    Date of Patent: December 6, 2022
    Assignee: GOOGLE LLC
    Inventors: Alan Lee Rogers, Ricardo Escutia, Sun Kyung Park, Michael Oh, Renwei Wu, Min-sang Choi, Stephen Joseph McDonald
  • Patent number: 11521600
    Abstract: Techniques are described herein for enabling an automated assistant to adjust its behavior depending on a detected vocabulary level or other vocal characteristics of an input utterance provided to an automated assistant. The estimated vocabulary level or other vocal characteristics may be used to influence various aspects of a data processing pipeline employed by the automated assistant. In some implementations, one or more tolerance thresholds associated with, for example, grammatical tolerances or vocabulary tolerances, may be adjusted based on the estimated vocabulary level or vocal characteristics of the input utterance.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: December 6, 2022
    Assignee: GOOGLE LLC
    Inventors: Pedro Gonnet Anders, Victor Carbune, Daniel Keysers, Thomas Deselaers, Sandro Feuz
  • Patent number: 11521277
    Abstract: A method for serving an audio-only shared content on a video sharing web site, including: receiving a playlist listing a plurality of videos; determining a content identification (content-id) for the plurality of the videos in the playlist; determining that the content-id for the plurality of videos corresponds to an audio-related category; selecting audio-only shared content based on the determination that the content-id corresponds to the audio-related category; and inserting the audio-only shared content between two of the plurality of videos.
    Type: Grant
    Filed: October 26, 2020
    Date of Patent: December 6, 2022
    Assignee: GOOGLE LLC
    Inventor: Tawei Liao
  • Patent number: 11521022
    Abstract: Provided are methods, systems, and devices for updating a sensor based on sensor data and the semantic state associated with an area. Sensor data can be received by a computing system. The sensor data can be based on sensor outputs from sensors. The sensor data can include information associated with states of areas detected by the sensors. An estimated semantic state of one of the areas from a target sensor that can detect the states of the areas can be generated. Based on a comparison of the estimated semantic state to semantic states of the area from the sensors, an uncertainty level associated with an accuracy of the estimated semantic state can be determined. In response to the uncertainty level satisfying one or more update criteria, an updated version of the sensor data from the target sensor can be obtained.
    Type: Grant
    Filed: November 7, 2017
    Date of Patent: December 6, 2022
    Assignee: GOOGLE LLC
    Inventors: Brian Brewington, Zhiyuan Weng, Yan Mayster, Brian Shucker, Sujoy Banerjee
  • Patent number: 11521604
    Abstract: Techniques are described herein for improving performance of machine learning model(s) and thresholds utilized in determining whether automated assistant function(s) are to be initiated. A method includes: receiving, via one or more microphones of a client device, audio data that captures a spoken utterance of a user; processing the audio data using a machine learning model to generate a predicted output that indicates a probability of one or more hotwords being present in the audio data; determining that the predicted output satisfies a secondary threshold that is less indicative of the one or more hotwords being present in the audio data than is a primary threshold; in response to determining that the predicted output satisfies the secondary threshold, prompting the user to indicate whether or not the spoken utterance includes a hotword; receiving, from the user, a response to the prompting; and adjusting the primary threshold based on the response.
    Type: Grant
    Filed: September 3, 2020
    Date of Patent: December 6, 2022
    Assignee: GOOGLE LLC
    Inventors: Aleks Kracun, Niranjan Subrahmanya, Aishanee Shah
  • Patent number: 11521597
    Abstract: Implementations can receive audio data corresponding to a spoken utterance of a user, process the audio data to generate a plurality of speech hypotheses, determine an action to be performed by an automated assistant based on the speech hypotheses, and cause the computing device to render an indication of the action. In response to the computing device rendering the indication, implementations can receive additional audio data corresponding to an additional spoken utterance of the user, process the additional audio data to determine that a portion of the spoken utterance is similar to an additional portion of the additional spoken utterance, supplant the action with an alternate action, and cause the automated assistant to initiate performance of the alternate action. Some implementations can determine whether to render the indication of the action based on a confidence level associated with the action.
    Type: Grant
    Filed: September 3, 2020
    Date of Patent: December 6, 2022
    Assignee: GOOGLE LLC
    Inventors: Matthew Sharifi, Victor Carbune
  • Patent number: 11521358
    Abstract: Systems and methods for data asset acquisition and obfuscation can be helpful for retrieving augmented reality rendering data assets from third parties. The sending of a software development kit and receiving back data assets can ensure the data assets are compatible with the augmented reality rendering experience in the user interface. The data acquisition system with obfuscation can also ensure the code generated by third parties is stripped of semantics and has reduced readability.
    Type: Grant
    Filed: January 7, 2021
    Date of Patent: December 6, 2022
    Assignee: GOOGLE LLC
    Inventors: Ivan Neulander, Ian Joseph Roth, Hao Wang, Agustin III Olivan Venezuela, Subramanian Shyamsunder Mathur, Xuemei Zhao, James Sraw Singh, Valdrin Koshi
  • Patent number: 11521618
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for collaboration between multiple voice controlled devices are disclosed. In one aspect, a method includes the actions of identifying, by a first computing device, a second computing device that is configured to respond to a particular, predefined hotword; receiving audio data that corresponds to an utterance; receiving a transcription of additional audio data outputted by the second computing device in response to the utterance; based on the transcription of the additional audio data and based on the utterance, generating a transcription that corresponds to a response to the additional audio data; and providing, for output, the transcription that corresponds to the response.
    Type: Grant
    Filed: December 17, 2019
    Date of Patent: December 6, 2022
    Assignee: GOOGLE LLC
    Inventors: Victor Carbune, Pedro Gonnet Anders, Thomas Deselaers, Sandro Feuz
  • Patent number: 11523190
    Abstract: Implementations set forth herein relate to providing notifications regarding events that may interrupt content being rendered at an interface. The notifications can be preemptive and/or can indicate a predicted time and/or source for the events. The event can be, for example, a person attempting to contact a user who is viewing content at a display interface. The person can be associated with a food delivery that has been ordered by the user via a delivery application. An application, such an automated assistant application, can predict when the person is expected to arrive with the food delivery, and generate a notification ahead of the person arriving. In some implementations, the notification can be rendered at a scrubber user interface (UI) at a location corresponding to the time that the food delivery is expected to arrive, thereby putting the user on notice of when the streaming content may be interrupted.
    Type: Grant
    Filed: January 10, 2022
    Date of Patent: December 6, 2022
    Assignee: GOOGLE LLC
    Inventors: Cliff Kuang, Jesse Kaczmarek, Andy Gugel, Jonathan Lee
  • Patent number: 11520471
    Abstract: The illustrative embodiments described herein provide systems and methods for notifying a user when a set of characters are identified in a media file. In one embodiment, a method includes receiving a set of characters inputted by the user of a computing device, playing the media file, transcribing the media file to form a transcription, and determining whether the transcription of the media file includes the set of characters. The method also includes initiating a notification prompt on a graphical user interface of the computing device in response to determining that the media file includes the set of characters.
    Type: Grant
    Filed: October 31, 2021
    Date of Patent: December 6, 2022
    Assignee: GOOGLE LLC
    Inventor: Margarita Khafizova
  • Patent number: 11521037
    Abstract: An example method includes receiving, by a computational assistant executing at one or more processors, a representation of an utterance spoken at a computing device; identifying, based on the utterance, a task to be performed by the computational assistant; responsive to determining, by the computational assistant, that complete performance of the task will take more than a threshold amount of time, outputting, for playback by one or more speakers operably connected to the computing device, synthesized voice data that informs a user of the computing device that complete performance of the task will not be immediate; and performing, by the computational assistant, the task.
    Type: Grant
    Filed: May 26, 2021
    Date of Patent: December 6, 2022
    Assignee: GOOGLE LLC
    Inventors: Yariv Adan, Vladimir Vuskovic, Behshad Behzadi
  • Patent number: 11514035
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining query refinements using search data. In one aspect, a method includes receiving a first query and a second query each comprising one or more n-grams for a user session, determining a first set of query refinements for the first query, determining a second set of query refinements from the first set of query refinements, each query refinement in the second set of query refinements including at least one n-gram that is similar to an n-gram from the first query and at least on n-gram that is similar to an n-gram from the second query, scoring each query refinement in the second set of query refinements, selecting a third query from a group consisting of the second set of query refinements and the second query, and providing the third query as input to a search operation.
    Type: Grant
    Filed: June 1, 2020
    Date of Patent: November 29, 2022
    Assignee: GOOGLE LLC
    Inventors: Matthias Heiler, Behshad Behzadi, Evgeny A. Cherepanov, Nils Grimsmo, Aurelien Boffy, Alessandro Agostini, Karoly Csalogany, Fredrik Bergenlid, Marcin M. Nowak-Przygodzki
  • Patent number: 11516587
    Abstract: An electromagnetic actuator includes an inner magnet arranged relative to an axis, an outer magnet arranged a radial distance from the axis, an inner radial wall of the outer magnet facing an outer radial wall of the inner magnet, the inner and outer radial walls being separated by an air gap, a voice coil arranged in the air gap separating the inner and outer magnets, and an actuator coupling plate attached to the voice coil. During operation of the device electrical activation of the voice coil causes axial motion of the actuator coupling plate.
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: November 29, 2022
    Assignee: GOOGLE LLC
    Inventor: Graham Robert Landick
  • Patent number: 11514672
    Abstract: Provided are methods, systems, and devices for generating semantic objects and an output based on the detection or recognition of the state of an environment that includes objects. State data, based in part on sensor output, can be received from one or more sensors that detect a state of an environment including objects. Based in part on the state data, semantic objects are generated. The semantic objects can correspond to the objects and include a set of attributes. Based in part on the set of attributes of the semantic objects, one or more operating modes, associated with the semantic objects can be determined. Based in part on the one or more operating modes, object outputs associated with the semantic objects can be generated. The object outputs can include one or more visual indications or one or more audio indications.
    Type: Grant
    Filed: May 21, 2020
    Date of Patent: November 29, 2022
    Assignee: GOOGLE LLC
    Inventors: Tim Wantland, Donald A. Barnett, David Matthew Jones
  • Patent number: 11516156
    Abstract: Methods and apparatus related to determining reply content for a reply to an electronic communication. Some implementations are directed generally toward analyzing a corpus of electronic communications to determine relationships between one or more original message features of “original” messages of electronic communications and reply content that is included in “reply” messages of those electronic communications. Some implementations are directed generally toward providing reply text to include in a reply to a communication based on determined relationships between one or more message features of the communication and the reply text.
    Type: Grant
    Filed: July 24, 2020
    Date of Patent: November 29, 2022
    Assignee: GOOGLE LLC
    Inventors: Phillip Neal Sharp, Prabhakar Raghavan, Thompson Alexander Ivor Gawley, Balint Miklos, Karol Kurach, Tobias Kaufmann, Gregory Sean Corrado, László Lukács
  • Patent number: 11514475
    Abstract: Systems, methods, and computer program products are provided for location-based distribution of data. One or more sets of data from one of a plurality of partner systems are received and stored, each set of data including at least one of a location data and a range. Application information associated with each application of a plurality of applications stored on respective mobile device is retrieved. The application information includes at least application location information. A pool of eligible applications are identified from the plurality of applications, based on the application location information of each of the plurality of applications and at least one of the location data and range of one of the one or more sets of data. A message is generated for each of the applications in the pool of eligible applications, the message including at least a portion of the one of the one or more sets of data.
    Type: Grant
    Filed: November 24, 2014
    Date of Patent: November 29, 2022
    Assignee: GOOGLE LLC
    Inventor: Thomas B. Hayes
  • Patent number: D972598
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: December 13, 2022
    Assignee: GOOGLE LLC
    Inventors: Carolyn Huynh, Mark Waggoner, Vandhana Ramadurai, Ritika Mathur, Christopher Law