Patents by Inventor Mat Balez

Mat Balez has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230120601
    Abstract: Embodiments may be implemented by a computing device, such as a head-mountable display, in order to use a single guard phrase to enable different voice commands in different interface modes. An example device includes an audio sensor and a computing system configured to analyze audio data captured by the audio sensor to detect speech that includes a predefined guard phrase, and to operate in a plurality of different interface modes comprising at least a first and a second interface mode. During operation in the first interface mode, the computing system may initially disable one or more first-mode speech commands, and respond to detection of the guard phrase by enabling the one or more first-mode speech commands. During operation in the second interface mode, the computing system may initially disable a second-mode speech command, and to respond to the guard phrase by enabling the second-mode speech command.
    Type: Application
    Filed: December 16, 2022
    Publication date: April 20, 2023
    Inventors: Michael J. LeBeau, Mat Balez
  • Publication number: 20210082435
    Abstract: Embodiments may be implemented by a computing device, such as a head-mountable display, in order to use a single guard phrase to enable different voice commands in different interface modes. An example device includes an audio sensor and a computing system configured to analyze audio data captured by the audio sensor to detect speech that includes a predefined guard phrase, and to operate in a plurality of different interface modes comprising at least a first and a second interface mode. During operation in the first interface mode, the computing system may initially disable one or more first-mode speech commands, and respond to detection of the guard phrase by enabling the one or more first-mode speech commands. During operation in the second interface mode, the computing system may initially disable a second-mode speech command, and to respond to the guard phrase by enabling the second-mode speech command.
    Type: Application
    Filed: December 2, 2020
    Publication date: March 18, 2021
    Inventors: Michael J. LeBeau, Mat Balez
  • Patent number: 10891953
    Abstract: Embodiments may be implemented by a computing device, such as a head-mountable display, in order to use a single guard phrase to enable different voice commands in different interface modes. An example device includes an audio sensor and a computing system configured to analyze audio data captured by the audio sensor to detect speech that includes a predefined guard phrase, and to operate in a plurality of different interface modes comprising at least a first and a second interface mode. During operation in the first interface mode, the computing system may initially disable one or more first-mode speech commands, and respond to detection of the guard phrase by enabling the one or more first-mode speech commands. During operation in the second interface mode, the computing system may initially disable a second-mode speech command, and to respond to the guard phrase by enabling the second-mode speech command.
    Type: Grant
    Filed: December 11, 2018
    Date of Patent: January 12, 2021
    Assignee: GOOGLE LLC
    Inventors: Michael J. LeBeau, Mat Balez
  • Publication number: 20190237073
    Abstract: Embodiments may be implemented by a computing device, such as a head-mountable display, in order to use a single guard phrase to enable different voice commands in different interface modes. An example device includes an audio sensor and a computing system configured to analyze audio data captured by the audio sensor to detect speech that includes a predefined guard phrase, and to operate in a plurality of different interface modes comprising at least a first and a second interface mode. During operation in the first interface mode, the computing system may initially disable one or more first-mode speech commands, and respond to detection of the guard phrase by enabling the one or more first-mode speech commands. During operation in the second interface mode, the computing system may initially disable a second-mode speech command, and to respond to the guard phrase by enabling the second-mode speech command.
    Type: Application
    Filed: December 11, 2018
    Publication date: August 1, 2019
    Inventors: Michael J. LeBeau, Mat Balez
  • Patent number: 10194121
    Abstract: A computing device configured to dynamically capture and store experience data received the by the computing device. An example method involves: (a) receiving first experience data that indicates at least one environmental condition; (b) selecting a capture mode from a plurality of capture modes based on the at least one environmental condition, where the capture mode defines a manner of capturing experience data; and (c) causing the computing device to operate in the selected capture mode, where operating in the selected capture mode includes capturing second experience data in the manner defined by the capture mode. The method may optionally additionally involve: (d) after entering the capture mode, receiving third experience data; (e) determining that the capture mode should be exited based on at least the received third experience data; and (f) based on the determination that the capture mode should be exited, exiting the capture mode such that at least one type of experience data is not captured.
    Type: Grant
    Filed: July 24, 2017
    Date of Patent: January 29, 2019
    Assignee: Google LLC
    Inventors: Mat Balez, Nirmal Patel, Thad Eugene Starner
  • Patent number: 10181324
    Abstract: Embodiments may be implemented by a computing device, such as a head-mountable display, in order to use a single guard phrase to enable different voice commands in different interface modes. An example device includes an audio sensor and a computing system configured to analyze audio data captured by the audio sensor to detect speech that includes a predefined guard phrase, and to operate in a plurality of different interface modes comprising at least a first and a second interface mode. During operation in the first interface mode, the computing system may initially disable one or more first-mode speech commands, and respond to detection of the guard phrase by enabling the one or more first-mode speech commands. During operation in the second interface mode, the computing system may initially disable a second-mode speech command, and to respond to the guard phrase by enabling the second-mode speech command.
    Type: Grant
    Filed: December 6, 2016
    Date of Patent: January 15, 2019
    Assignee: Google LLC
    Inventors: Michael J. LeBeau, Mat Balez
  • Patent number: 10114466
    Abstract: Methods and systems for hands-free browsing in a wearable computing device are provided. A wearable computing device may provide for display a view of a first card of a plurality of cards which include respective virtual displays of content. The wearable computing device may determine a first rotation of the wearable computing device about a first axis and one or more eye gestures. Based on a combination of the first rotation and the eye gestures, the wearable computing device may provide for display the navigable menu, which may include an alternate view of the first card and at least a portion of one or more cards. Then, based on a determined second rotation of the wearable computing device about a second axis and based on a direction of the second rotation, the wearable computing device may generate a display indicative of navigation through the navigable menu.
    Type: Grant
    Filed: August 16, 2016
    Date of Patent: October 30, 2018
    Assignee: Google LLC
    Inventors: Nirmal Patel, Hayes Solos Raffle, Mat Balez, Max Benjamin Braun, Jerrica Jones
  • Publication number: 20180217994
    Abstract: Provided are methods and computer-readable media for providing recommended entities based on a user's external social graph, such as asymmetric social graph of a social networking service. In some embodiments, entities responsive to a search query or other request may be obtained. Each entity may be evaluated to determine if the entity is associated with a contact from a user's social graph. The association may include an evaluation (e.g., a rating, review, other evaluation or combination thereof) of the entity by the contact. Additionally, the contacts having associations with an entity may be ranked based on a relationship score with a user. The entities having associations with the contacts from a user's social graph may be provided as recommended entities to the user, and the association may be annotated to the recommended entity for viewing by the user.
    Type: Application
    Filed: March 28, 2018
    Publication date: August 2, 2018
    Inventors: Sebastian Dorner, Mat Balez
  • Patent number: 10019487
    Abstract: Provided are methods and computer-readable media for providing recommended entities based on a user's external social graph, such as asymmetric social graph of a social networking service. In some embodiments, entities responsive to a search query or other request may be obtained. Each entity may be evaluated to determine if the entity is associated with a contact from a user's social graph. The association may include an evaluation (e.g., a rating, review, other evaluation or combination thereof) of the entity by the contact. Additionally, the contacts having associations with an entity may be ranked based on a relationship score with a user. The entities having associations with the contacts from a user's social graph may be provided as recommended entities to the user, and the association may be annotated to the recommended entity for viewing by the user.
    Type: Grant
    Filed: October 13, 2014
    Date of Patent: July 10, 2018
    Assignee: GOOGLE LLC
    Inventors: Sebastian Domer, Mat Balez
  • Patent number: 9794527
    Abstract: A computing device configured to dynamically capture and store experience data received the by the computing device. An example method involves: (a) receiving first experience data that indicates at least one environmental condition; (b) selecting a capture mode from a plurality of capture modes based on the at least one environmental condition, where the capture mode defines a manner of capturing experience data; and (c) causing the computing device to operate in the selected capture mode, where operating in the selected capture mode includes capturing second experience data in the manner defined by the capture mode. The method may optionally additionally involve: (d) after entering the capture mode, receiving third experience data; (e) determining that the capture mode should be exited based on at least the received third experience data; and (f) based on the determination that the capture mode should be exited, exiting the capture mode such that at least one type of experience data is not captured.
    Type: Grant
    Filed: September 28, 2012
    Date of Patent: October 17, 2017
    Assignee: Google Inc.
    Inventors: Mat Balez, Nirmal Patel, Thad Eugene Starner
  • Patent number: 9779758
    Abstract: Example methods and systems use multiple sensors to determine whether a speaker is speaking. Audio data in an audio-channel speech band detected by a microphone can be received. Vibration data in a vibration-channel speech band representative of vibrations detected by a sensor other than the microphone can be received. The microphone and the sensor can be associated with a head-mountable device (HMD). It is determined whether the audio data is causally related to the vibration data. If the audio data and the vibration data are causally related, an indication can be generated that the audio data contains HMD-wearer speech. Causally related audio and vibration data can be used to increase accuracy of text transcription of the HMD-wearer speech. If the audio data and the vibration data are not causally related, an indication can be generated that the audio data does not contain HMD-wearer speech.
    Type: Grant
    Filed: August 17, 2015
    Date of Patent: October 3, 2017
    Assignee: Google Inc.
    Inventors: Michael Patrick Johnson, Jianchun Dong, Mat Balez
  • Publication number: 20170277255
    Abstract: The present description discloses systems and methods for changing the state of a device. One embodiment may include a device configured to provide a device in a first state, receive a signal indicative of first angular data of the device, and compare the first angular data to a first threshold. The device may then execute instructions to initiate a timer when the first angular data is greater than the first threshold, receive a signal indicative of a second angular data of the device, and compare the second angular data to a second threshold. When the second angular data is less than the second threshold and the time passed is within a pre-determined time period, the device may execute instructions to transition the device to a second state.
    Type: Application
    Filed: June 7, 2017
    Publication date: September 28, 2017
    Inventors: Michael Patrick Johnson, Steve Lee, Mat Balez, Nirmal Patel
  • Patent number: 9746915
    Abstract: Examples of methods and systems for providing calibration for eye gesture recognition are described. In some examples, calibration can be executed via a head-mountable device. A method for calibration of a system may account for changes in orientation of the head-mountable device, update recognition of the eye gestures, or increase efficiency of the system, for example. The head-mountable device may be configured to receive signals indicative of eye gestures from an eye gesture-detection system and in response to receiving a second command confirming that the signal is indicative of an eye gesture command, to make adjustments to the eye gesture recognition system and/or the reference signals. The head-mountable device may calibrate an eye gesture recognition system via implicit or explicit calibration, for example.
    Type: Grant
    Filed: October 22, 2012
    Date of Patent: August 29, 2017
    Assignee: Google Inc.
    Inventors: Hayes Solos Raffle, Thad Eugene Starner, Mat Balez, Michael Patrick Johnson, Yong Zhao, Bo Wu, David Sparks, Nirmal J. Patel
  • Publication number: 20170236515
    Abstract: Methods and systems are described herein related to enabling service providers to address voice-activated commands. An example method may involve: receiving a first utterance on a computing device, where the first utterance includes a first command; selecting a service action corresponding to the first command; determining a selected service provider for the selected service action, where the selected service provider is selected from a plurality of service providers; and sending a service fulfillment request to the selected service provider to execute the selected service action.
    Type: Application
    Filed: April 30, 2017
    Publication date: August 17, 2017
    Inventors: Yury Pinsky, Steven John Lee, Mat Balez, Michael J. LeBeau
  • Patent number: 9710056
    Abstract: The present description discloses systems and methods for changing the state of a device. One embodiment may include a device configured to provide a device in a first state, receive a signal indicative of first angular data of the device, and compare the first angular data to a first threshold. The device may then execute instructions to initiate a timer when the first angular data is greater than the first threshold, receive a signal indicative of a second angular data of the device, and compare the second angular data to a second threshold. When the second angular data is less than the second threshold and the time passed is within a pre-determined time period, the device may execute instructions to transition the device to a second state.
    Type: Grant
    Filed: March 21, 2012
    Date of Patent: July 18, 2017
    Assignee: Google Inc.
    Inventors: Michael Patrick Johnson, Steve Lee, Mat Balez, Nirmal Patel
  • Patent number: 9666187
    Abstract: Methods and systems are described herein related to enabling service providers to address voice-activated commands. An example method may involve: receiving a first utterance on a computing device, where the first utterance includes a first command; selecting a service action corresponding to the first command; determining a selected service provider for the selected service action, where the selected service provider is selected from a plurality of service providers; and sending a service fulfillment request to the selected service provider to execute the selected service action.
    Type: Grant
    Filed: July 25, 2013
    Date of Patent: May 30, 2017
    Assignee: Google Inc.
    Inventors: Yury Pinsky, Steven John Lee, Mat Balez, Michael J LeBeau
  • Publication number: 20170084276
    Abstract: Embodiments may be implemented by a computing device, such as a head-mountable display, in order to use a single guard phrase to enable different voice commands in different interface modes. An example device includes an audio sensor and a computing system configured to analyze audio data captured by the audio sensor to detect speech that includes a predefined guard phrase, and to operate in a plurality of different interface modes comprising at least a first and a second interface mode. During operation in the first interface mode, the computing system may initially disable one or more first-mode speech commands, and respond to detection of the guard phrase by enabling the one or more first-mode speech commands. During operation in the second interface mode, the computing system may initially disable a second-mode speech command, and to respond to the guard phrase by enabling the second-mode speech command.
    Type: Application
    Filed: December 6, 2016
    Publication date: March 23, 2017
    Inventors: Michael J. LeBeau, Mat Balez
  • Publication number: 20160357266
    Abstract: Methods and systems for hands-free browsing in a wearable computing device are provided. A wearable computing device may provide for display a view of a first card of a plurality of cards which include respective virtual displays of content. The wearable computing device may determine a first rotation of the wearable computing device about a first axis and one or more eye gestures. Based on a combination of the first rotation and the eye gestures, the wearable computing device may provide for display the navigable menu, which may include an alternate view of the first card and at least a portion of one or more cards. Then, based on a determined second rotation of the wearable computing device about a second axis and based on a direction of the second rotation, the wearable computing device may generate a display indicative of navigation through the navigable menu.
    Type: Application
    Filed: August 16, 2016
    Publication date: December 8, 2016
    Inventors: Nirmal Patel, Hayes Solos Raffle, Mat Balez, Max Benjamin Braun, Jerrica Jones
  • Patent number: 9442631
    Abstract: Methods and systems for hands-free browsing in a wearable computing device are provided. A wearable computing device may provide for display a view of a first card of a plurality of cards which include respective virtual displays of content. The wearable computing device may determine a first rotation of the wearable computing device about a first axis and one or more eye gestures. Based on a combination of the first rotation and the eye gestures, the wearable computing device may provide for display the navigable menu, which may include an alternate view of the first card and at least a portion of one or more cards. Then, based on a determined second rotation of the wearable computing device about a second axis and based on a direction of the second rotation, the wearable computing device may generate a display indicative of navigation through the navigable menu.
    Type: Grant
    Filed: March 17, 2014
    Date of Patent: September 13, 2016
    Assignee: Google Inc.
    Inventors: Nirmal Patel, Hayes Solos Raffle, Mat Balez, Max Benjamin Braun, Jerrica Jones
  • Patent number: 9368113
    Abstract: Methods, apparatus, and computer-readable media are described herein related to a user interface (UI) that can be implemented on a head-mountable device (HMD). The UI can include a voice-navigable UI. The voice-navigable UI can include a voice navigable menu that includes one or more menu items comprising an original menu item and an added command menu item. The original menu item can be associated with one or more original commands, and the added menu item can be associated with one or more added commands, including a first added command. The interface can also present a first visible menu that includes at least a portion of the voice navigable menu. Responsive to a first utterance comprising the first added command, the interface can invoke the first added command. In some embodiments, the interface can display a second visible menu, wherein the first added command can be displayed above other menu items.
    Type: Grant
    Filed: January 30, 2013
    Date of Patent: June 14, 2016
    Assignee: Google Inc.
    Inventors: Michael J. LeBeau, Mat Balez, Yury Pinsky