Patents by Inventor Matthew Sharifi

Matthew Sharifi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240361149
    Abstract: A shared mapping session includes a plurality of users including a first user of a first electronic device and a second user of a second electronic device. A method for implementing the shared mapping session includes initiating the shared mapping session and receiving, from the second electronic device via the shared mapping session, second point-of-interest (POI) information associated with the second user, the second POI information including a visual element to identify a second POI as an item of interest to the second user. The method further includes displaying a user interface which displays map information indicating the visual element and a location associated with the first user, at least the visual element being simultaneously viewable in the shared mapping session to the first user via the first electronic device and the second user via the second electronic device.
    Type: Application
    Filed: April 22, 2022
    Publication date: October 31, 2024
    Inventor: Matthew Sharifi
  • Publication number: 20240361139
    Abstract: The present disclosure provides computer-implemented methods, systems, and devices for integrating external services into a navigation system. A computing device receives, from a user computing system associated with a user, a navigation request, the navigation request including a destination. The computing device generates, based on geographic data stored in a database, a suggested route to the destination, wherein the suggested route includes an interaction with a system other than the navigation system. The computing device transmits, to the user computing system, route recommendation data for display at the user computing system, the route recommendation including a recommendation to perform the interaction with the system other than the navigation system. The computing device, in response to receiving an approval indication from the user computing system, transmits initiation data to the system other than the navigation system to initiate the interaction.
    Type: Application
    Filed: August 30, 2022
    Publication date: October 31, 2024
    Inventor: Matthew Sharifi
  • Patent number: 12132944
    Abstract: Systems and methods for matching live media content are disclosed. At a server, obtaining first media content from a client device, herein the first media content corresponds to a portion of media content being played on the client device, and the first media content is associated with a predefined expiration time; obtaining second media content from one or more content feeds, wherein the second media content also corresponds to a portion of the media content being played on the client device; in accordance with a determination that the second media content corresponds to a portion of the media content that has been played on the client device: before the predefined expiration time, obtaining third media content corresponding to the media content being played on the client device, from the one or more content feeds; and comparing the first media content with the third media content.
    Type: Grant
    Filed: June 12, 2023
    Date of Patent: October 29, 2024
    Assignee: Google LLC
    Inventor: Matthew Sharifi
  • Publication number: 20240347060
    Abstract: Some implementations process, using warm word model(s), a stream of audio data to determine a portion of the audio data that corresponds to particular word(s) and/or phrase(s) (e.g., a warm word) associated with an assistant command, process, using an automatic speech recognition (ASR) model, a preamble portion of the audio data (e.g., that precedes the warm word) and/or a postamble portion of the audio data (e.g., that follows the warm word) to generate ASR output, and determine, based on processing the ASR output, whether a user intended the assistant command to be performed. Additional or alternative implementations can process the stream of audio data using a speaker identification (SID) model to determine whether the audio data is sufficient to identify the user that provided a spoken utterance captured in the stream of audio data, and determine if that user is authorized to cause performance of the assistant command.
    Type: Application
    Filed: June 21, 2024
    Publication date: October 17, 2024
    Inventors: Victor Carbune, Matthew Sharifi, Ondrej Skopek, Justin Lu, Daniel Valcarce, Kevin Kilgour, Mohamad Hassan Rom, Nicolo D'Ercole, Michael Golikov
  • Patent number: 12117308
    Abstract: To present a navigation directions preview, a server device receives a request for navigation directions from a starting location to a destination location and generates a set of navigation directions in response to the request. The set of navigation directions includes a set of route segments for traversing from the starting location to the destination location. The server device selects a subset of the route segments based on characteristics of each route segment in the set of route segments. For each selected route segment, the server device provides a preview of the route segment to be displayed on a client device. The preview of the route segment includes panoramic street level imagery depicting the route segment.
    Type: Grant
    Filed: August 18, 2020
    Date of Patent: October 15, 2024
    Assignee: GOOGLE LLC
    Inventors: Victor Carbune, Matthew Sharifi
  • Patent number: 12111834
    Abstract: Systems and methods for generating and providing outputs in a multi-device system can include leveraging environment-based prompt generation and generative model response generation to provide dynamic response generation and display. The systems and methods can obtain input data associated with one or more computing devices within an environment, can obtain environment data descriptive of the plurality of computing devices within the environment, and can generate a prompt based on the input data and environment data. The prompt can be processed with a generative model to generate a model-generated output. The model-generated output can then be transmitted to a particular computing device of the plurality of computing devices.
    Type: Grant
    Filed: December 20, 2023
    Date of Patent: October 8, 2024
    Assignee: GOOGLE LLC
    Inventors: Victor Carbune, Arash Sadr, Matthew Sharifi
  • Patent number: 12111875
    Abstract: Implementations described herein relate to pairing a location-based automated assistant with a user device. The user device can include, for example, a headphones apparatus and/or a device that is paired with the headphones apparatus. The user device provides an indication that it is present at a location that is associated with a location-based automated assistant. A trust measure is determined that is indicative of trust between the user device and the location-based automated assistant. User information is provided by the user device to the location-based automated assistant. The location-based automated assistant determines response data to provide, via one or more speakers associated with the user device, that is specific to the location and further based on the user information.
    Type: Grant
    Filed: December 14, 2022
    Date of Patent: October 8, 2024
    Assignee: GOOGLE LLC
    Inventors: Victor Carbune, Matthew Sharifi
  • Patent number: 12112754
    Abstract: Implementations relate to an automated assistant that can respond to communications received via a third party application and/or other third party communication modality. The automated assistant can determine that the user is participating in multiple different conversations via multiple different third party communication services. In some implementations, conversations can be processed to identify particular features of the conversations. When the automated assistant is invoked to provide input to a conversation, the automated assistant can compare the input to the identified conversation features in order to select the particular conversation that is most relevant to the input. In this way, the automated assistant can assist with any of multiple disparate conversations that are each occurring via a different third party application.
    Type: Grant
    Filed: November 20, 2023
    Date of Patent: October 8, 2024
    Assignee: GOOGLE LLC
    Inventors: Victor Carbune, Matthew Sharifi
  • Publication number: 20240328808
    Abstract: To provide content-aware audio navigation instructions, a client device executing a mapping application obtains one or more audio navigation directions for traversing from a starting location to a destination location along a route. The client device also identifies electronic media content playing from a source different from the mapping application which is executing at the client device or in proximity to the client device. The client device determines characteristics of the electronic media content and adjusts the audio navigation directions in accordance with the characteristics of the electronic media content. Then the client device presents the adjusted audio navigation directions to a user.
    Type: Application
    Filed: June 12, 2024
    Publication date: October 3, 2024
    Inventors: Victor Carbune, Matthew Sharifi
  • Publication number: 20240330372
    Abstract: A computing system: receives a first user input from a user selecting a portion of the query image; detects text in a first area of the query image associated with the portion of the query image selected by the user; obtains first search results and a suggested search query, based on a first optical character recognition (OCR) operation performed with respect to the text in the first area of the query image and a second OCR operation performed with respect to further text in a second area of the query image, different from the first area of the query image; and provides a first user interface for display to the user, the first user interface comprising the first search results and the suggested search query. The first processing power associated with the first OCR operation is greater than a second processing power associated with the second OCR operation.
    Type: Application
    Filed: June 12, 2024
    Publication date: October 3, 2024
    Inventors: Abhanshu Sharma, David Petrou, Matthew Sharifi
  • Patent number: 12106755
    Abstract: Techniques are described herein for warm word arbitration between automated assistant devices. A method includes: determining that warm word arbitration is to be initiated between a first assistant device and one or more additional assistant devices, including a second assistant device; broadcasting, by the first assistant device, to the one or more additional assistant devices, an active set of warm words for the first assistant device; for each of the one or more additional assistant devices, receiving, from the additional assistant device, an active set of warm words for the additional assistant device; identifying a matching warm word included in the active set of warm words for the first assistant device and included in the active set of warm words for the second assistant device; and enabling or disabling detection of the matching warm word by the first assistant device, in response to identifying the matching warm word.
    Type: Grant
    Filed: January 11, 2022
    Date of Patent: October 1, 2024
    Assignee: GOOGLE LLC
    Inventors: Matthew Sharifi, Victor Carbune
  • Patent number: 12108314
    Abstract: Systems and methods are provided for a personalized entity repository. For example, a computing device comprises a personalized entity repository having fixed sets of entities from an entity repository stored at a server, a processor, and memory storing instructions that cause the computing device to identify fixed sets of entities that are relevant to a user based on context associated with the computing device, rank the fixed sets by relevancy, and update the personalized entity repository using selected sets determined based on the rank and on set usage parameters applicable to the user. In another example, a method includes generating fixed sets of entities from an entity repository, including location-based sets and topic-based sets, and providing a subset of the fixed sets to a client, the client requesting the subset based on the client's location and on items identified in content generated for display on the client.
    Type: Grant
    Filed: July 28, 2023
    Date of Patent: October 1, 2024
    Assignee: GOOGLE LLC
    Inventors: Matthew Sharifi, Jorge Pereira, Dominik Roblek, Julian Odell, Cong Li, David Petrou
  • Publication number: 20240318971
    Abstract: The present disclosure is directed to interactive voice navigation. In particular, a computing system can provide audio information including one or more navigation instructions to a user via a computing system associated with the user. The computing system can activate an audio sensor associated with the computing system. The computing system can collect, using the audio sensor, audio data associated with the user. The computing system can determine, based on the audio data, whether the audio data is associated with one or more navigation instructions. The computing system can, in accordance with a determination that the audio data is associated with one or more navigation instructions, determine a context-appropriate audio response. The computing system can provide the context-appropriate audio response to the user.
    Type: Application
    Filed: February 29, 2024
    Publication date: September 26, 2024
    Inventors: Victor Carbune, Matthew Sharifi, Blaise Aguera-Arcas
  • Publication number: 20240319859
    Abstract: Implementations set forth herein relate to an automated assistant that can control a sequence of operations for a routine according to whether power data indicates that energy expense and/or energy consumption can be preserved by modifying the sequence of operations for the routine. In some implementations, the automated assistant can suggest certain routines, and/or triggering conditions for operations of the routine, to reduce energy expense and/or energy consumption. Alternatively, or additionally, the automated assistant can infer certain operation requests or triggering conditions depending on whether the user has expressed an interest in preserving energy resources and expenses. In this way, the automated assistant can facilitate minimizing energy consumption and/or energy expenses without necessitating that the user exclusively, or manually, schedule all assistant operations with particularity.
    Type: Application
    Filed: March 22, 2023
    Publication date: September 26, 2024
    Inventors: Martin Bruse, Matthew Sharifi
  • Publication number: 20240311697
    Abstract: Systems and methods are provided for suggesting actions for selected text based on content displayed on a mobile device. An example method can include converting a selection made via a display device into a query, providing the query to an action suggestion model that is trained to predict an action given a query, each action being associated with a mobile application, receiving one or more predicted actions, and initiating display of the one or more predicted actions on the display device. Another example method can include identifying, from search records, queries where a website is highly ranked, the website being one of a plurality of websites in a mapping of websites to mobile applications. The method can also include generating positive training examples for an action suggestion model from the identified queries, and training the action suggestion model using the positive training examples.
    Type: Application
    Filed: May 20, 2024
    Publication date: September 19, 2024
    Inventors: Matthew Sharifi, Daniel Ramage, David Petrou
  • Publication number: 20240312455
    Abstract: Implementations relate to transferring actions from a shared device to a personal device that is associated with an account of a user. Some implementations relate to determining that a request is associated with sensitive information, determining that one or more other users are co-present with the shared device, and transferring the request that is related to sensitive information to a personal device of the user. Some implementations relate determining that a user is no longer co-present with a shared device that is currently performing one or more actions and transferring one or more of the actions to a personal device that is associated with an account of the user.
    Type: Application
    Filed: March 14, 2023
    Publication date: September 19, 2024
    Inventors: Matthew Sharifi, Victor Carbune
  • Patent number: 12094454
    Abstract: Implementations described herein include detecting a stream of audio data that captures a spoken utterance of the user and that captures ambient noise occurring within a threshold time period of the spoken utterance being spoken by the user. Implementations further include processing a portion of the audio data that includes the ambient noise to determine ambient noise classification(s), processing a portion of the audio data that includes the spoken utterance to generate a transcription, processing both the transcription and the ambient noise classification(s) with a machine learning model to generate a user intent and parameter(s) for the user intent, and performing one or more automated assistant actions based on the user intent and using the parameter(s).
    Type: Grant
    Filed: January 5, 2022
    Date of Patent: September 17, 2024
    Assignee: GOOGLE LLC
    Inventors: Victor Carbune, Matthew Sharifi
  • Patent number: 12096321
    Abstract: A computer-implemented technique can include detecting, by a first computing device, a set of user communications at least one of transmitted to and received by from a second computing device via a first communication mode, identifying a second communication mode that is available for communication between the first and second computing devices, and obtaining an appropriateness score for the first and second communication modes based on a contextual feature of the set of user communications, wherein the contextual feature relates an appropriateness of a particular communication mode for the set of user communications, and wherein each appropriateness score is indicative of a level of the appropriateness of a particular communication mode for the set of user communications. The technique can also include selectively outputting a suggestion to switch from the first communication mode to the second communication mode.
    Type: Grant
    Filed: March 15, 2022
    Date of Patent: September 17, 2024
    Assignee: GOOGLE LLC
    Inventors: Matthew Sharifi, Jakob Foerster
  • Patent number: 12087297
    Abstract: A method includes receiving a first instance of raw audio data corresponding to a voice-based command and receiving a second instance of the raw audio data corresponding to an utterance of audible contents for an audio-based communication spoken by a user. When a voice filtering recognition routine determines to activate voice filtering for at least the voice of the user, the method also includes obtaining a respective speaker embedding of the user and processing, using the respective speaker embedding, the second instance of the raw audio data to generate enhanced audio data for the audio-based communication that isolates the utterance of the audible contents spoken by the user and excludes at least a portion of the one or more additional sounds that are not spoken by the user The method also includes executing.
    Type: Grant
    Filed: September 9, 2022
    Date of Patent: September 10, 2024
    Assignee: Google LLC
    Inventors: Matthew Sharifi, Victor Carbune
  • Publication number: 20240296848
    Abstract: Implementations relate to automatic generation of speaker features for each of one or more particular text-dependent speaker verifications (TD-SVs) for a user. Implementations can generate speaker features for a particular TD-SV using instances of audio data that each capture a corresponding spoken utterance of the user during normal non-enrollment interactions with an automated assistant via one or more respective assistant devices. For example, a portion of an instance of audio data can be used in response to: (a) determining that recognized term(s) for the spoken utterance captured by that the portion correspond to the particular TD-SV; and (b) determining that an authentication measure, for the user and for the spoken utterance, satisfies a threshold. Implementations additionally or alternatively relate to utilization of speaker features, for each of one or more particular TD-SVs for a user, in determining whether to authenticate a spoken utterance for the user.
    Type: Application
    Filed: May 13, 2024
    Publication date: September 5, 2024
    Inventors: Matthew Sharifi, Victor Carbune