Patents by Inventor Mat Balez
Mat Balez has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230120601Abstract: Embodiments may be implemented by a computing device, such as a head-mountable display, in order to use a single guard phrase to enable different voice commands in different interface modes. An example device includes an audio sensor and a computing system configured to analyze audio data captured by the audio sensor to detect speech that includes a predefined guard phrase, and to operate in a plurality of different interface modes comprising at least a first and a second interface mode. During operation in the first interface mode, the computing system may initially disable one or more first-mode speech commands, and respond to detection of the guard phrase by enabling the one or more first-mode speech commands. During operation in the second interface mode, the computing system may initially disable a second-mode speech command, and to respond to the guard phrase by enabling the second-mode speech command.Type: ApplicationFiled: December 16, 2022Publication date: April 20, 2023Inventors: Michael J. LeBeau, Mat Balez
-
Publication number: 20210082435Abstract: Embodiments may be implemented by a computing device, such as a head-mountable display, in order to use a single guard phrase to enable different voice commands in different interface modes. An example device includes an audio sensor and a computing system configured to analyze audio data captured by the audio sensor to detect speech that includes a predefined guard phrase, and to operate in a plurality of different interface modes comprising at least a first and a second interface mode. During operation in the first interface mode, the computing system may initially disable one or more first-mode speech commands, and respond to detection of the guard phrase by enabling the one or more first-mode speech commands. During operation in the second interface mode, the computing system may initially disable a second-mode speech command, and to respond to the guard phrase by enabling the second-mode speech command.Type: ApplicationFiled: December 2, 2020Publication date: March 18, 2021Inventors: Michael J. LeBeau, Mat Balez
-
Patent number: 10891953Abstract: Embodiments may be implemented by a computing device, such as a head-mountable display, in order to use a single guard phrase to enable different voice commands in different interface modes. An example device includes an audio sensor and a computing system configured to analyze audio data captured by the audio sensor to detect speech that includes a predefined guard phrase, and to operate in a plurality of different interface modes comprising at least a first and a second interface mode. During operation in the first interface mode, the computing system may initially disable one or more first-mode speech commands, and respond to detection of the guard phrase by enabling the one or more first-mode speech commands. During operation in the second interface mode, the computing system may initially disable a second-mode speech command, and to respond to the guard phrase by enabling the second-mode speech command.Type: GrantFiled: December 11, 2018Date of Patent: January 12, 2021Assignee: GOOGLE LLCInventors: Michael J. LeBeau, Mat Balez
-
Publication number: 20190237073Abstract: Embodiments may be implemented by a computing device, such as a head-mountable display, in order to use a single guard phrase to enable different voice commands in different interface modes. An example device includes an audio sensor and a computing system configured to analyze audio data captured by the audio sensor to detect speech that includes a predefined guard phrase, and to operate in a plurality of different interface modes comprising at least a first and a second interface mode. During operation in the first interface mode, the computing system may initially disable one or more first-mode speech commands, and respond to detection of the guard phrase by enabling the one or more first-mode speech commands. During operation in the second interface mode, the computing system may initially disable a second-mode speech command, and to respond to the guard phrase by enabling the second-mode speech command.Type: ApplicationFiled: December 11, 2018Publication date: August 1, 2019Inventors: Michael J. LeBeau, Mat Balez
-
Patent number: 10194121Abstract: A computing device configured to dynamically capture and store experience data received the by the computing device. An example method involves: (a) receiving first experience data that indicates at least one environmental condition; (b) selecting a capture mode from a plurality of capture modes based on the at least one environmental condition, where the capture mode defines a manner of capturing experience data; and (c) causing the computing device to operate in the selected capture mode, where operating in the selected capture mode includes capturing second experience data in the manner defined by the capture mode. The method may optionally additionally involve: (d) after entering the capture mode, receiving third experience data; (e) determining that the capture mode should be exited based on at least the received third experience data; and (f) based on the determination that the capture mode should be exited, exiting the capture mode such that at least one type of experience data is not captured.Type: GrantFiled: July 24, 2017Date of Patent: January 29, 2019Assignee: Google LLCInventors: Mat Balez, Nirmal Patel, Thad Eugene Starner
-
Patent number: 10181324Abstract: Embodiments may be implemented by a computing device, such as a head-mountable display, in order to use a single guard phrase to enable different voice commands in different interface modes. An example device includes an audio sensor and a computing system configured to analyze audio data captured by the audio sensor to detect speech that includes a predefined guard phrase, and to operate in a plurality of different interface modes comprising at least a first and a second interface mode. During operation in the first interface mode, the computing system may initially disable one or more first-mode speech commands, and respond to detection of the guard phrase by enabling the one or more first-mode speech commands. During operation in the second interface mode, the computing system may initially disable a second-mode speech command, and to respond to the guard phrase by enabling the second-mode speech command.Type: GrantFiled: December 6, 2016Date of Patent: January 15, 2019Assignee: Google LLCInventors: Michael J. LeBeau, Mat Balez
-
Patent number: 10114466Abstract: Methods and systems for hands-free browsing in a wearable computing device are provided. A wearable computing device may provide for display a view of a first card of a plurality of cards which include respective virtual displays of content. The wearable computing device may determine a first rotation of the wearable computing device about a first axis and one or more eye gestures. Based on a combination of the first rotation and the eye gestures, the wearable computing device may provide for display the navigable menu, which may include an alternate view of the first card and at least a portion of one or more cards. Then, based on a determined second rotation of the wearable computing device about a second axis and based on a direction of the second rotation, the wearable computing device may generate a display indicative of navigation through the navigable menu.Type: GrantFiled: August 16, 2016Date of Patent: October 30, 2018Assignee: Google LLCInventors: Nirmal Patel, Hayes Solos Raffle, Mat Balez, Max Benjamin Braun, Jerrica Jones
-
METHOD AND COMPUTER-READABLE MEDIA FOR PROVIDING RECOMMENDED ENTITIES BASED ON A USER'S SOCIAL GRAPH
Publication number: 20180217994Abstract: Provided are methods and computer-readable media for providing recommended entities based on a user's external social graph, such as asymmetric social graph of a social networking service. In some embodiments, entities responsive to a search query or other request may be obtained. Each entity may be evaluated to determine if the entity is associated with a contact from a user's social graph. The association may include an evaluation (e.g., a rating, review, other evaluation or combination thereof) of the entity by the contact. Additionally, the contacts having associations with an entity may be ranked based on a relationship score with a user. The entities having associations with the contacts from a user's social graph may be provided as recommended entities to the user, and the association may be annotated to the recommended entity for viewing by the user.Type: ApplicationFiled: March 28, 2018Publication date: August 2, 2018Inventors: Sebastian Dorner, Mat Balez -
Method and computer-readable media for providing recommended entities based on a user's social graph
Patent number: 10019487Abstract: Provided are methods and computer-readable media for providing recommended entities based on a user's external social graph, such as asymmetric social graph of a social networking service. In some embodiments, entities responsive to a search query or other request may be obtained. Each entity may be evaluated to determine if the entity is associated with a contact from a user's social graph. The association may include an evaluation (e.g., a rating, review, other evaluation or combination thereof) of the entity by the contact. Additionally, the contacts having associations with an entity may be ranked based on a relationship score with a user. The entities having associations with the contacts from a user's social graph may be provided as recommended entities to the user, and the association may be annotated to the recommended entity for viewing by the user.Type: GrantFiled: October 13, 2014Date of Patent: July 10, 2018Assignee: GOOGLE LLCInventors: Sebastian Domer, Mat Balez -
Patent number: 9794527Abstract: A computing device configured to dynamically capture and store experience data received the by the computing device. An example method involves: (a) receiving first experience data that indicates at least one environmental condition; (b) selecting a capture mode from a plurality of capture modes based on the at least one environmental condition, where the capture mode defines a manner of capturing experience data; and (c) causing the computing device to operate in the selected capture mode, where operating in the selected capture mode includes capturing second experience data in the manner defined by the capture mode. The method may optionally additionally involve: (d) after entering the capture mode, receiving third experience data; (e) determining that the capture mode should be exited based on at least the received third experience data; and (f) based on the determination that the capture mode should be exited, exiting the capture mode such that at least one type of experience data is not captured.Type: GrantFiled: September 28, 2012Date of Patent: October 17, 2017Assignee: Google Inc.Inventors: Mat Balez, Nirmal Patel, Thad Eugene Starner
-
Patent number: 9779758Abstract: Example methods and systems use multiple sensors to determine whether a speaker is speaking. Audio data in an audio-channel speech band detected by a microphone can be received. Vibration data in a vibration-channel speech band representative of vibrations detected by a sensor other than the microphone can be received. The microphone and the sensor can be associated with a head-mountable device (HMD). It is determined whether the audio data is causally related to the vibration data. If the audio data and the vibration data are causally related, an indication can be generated that the audio data contains HMD-wearer speech. Causally related audio and vibration data can be used to increase accuracy of text transcription of the HMD-wearer speech. If the audio data and the vibration data are not causally related, an indication can be generated that the audio data does not contain HMD-wearer speech.Type: GrantFiled: August 17, 2015Date of Patent: October 3, 2017Assignee: Google Inc.Inventors: Michael Patrick Johnson, Jianchun Dong, Mat Balez
-
Publication number: 20170277255Abstract: The present description discloses systems and methods for changing the state of a device. One embodiment may include a device configured to provide a device in a first state, receive a signal indicative of first angular data of the device, and compare the first angular data to a first threshold. The device may then execute instructions to initiate a timer when the first angular data is greater than the first threshold, receive a signal indicative of a second angular data of the device, and compare the second angular data to a second threshold. When the second angular data is less than the second threshold and the time passed is within a pre-determined time period, the device may execute instructions to transition the device to a second state.Type: ApplicationFiled: June 7, 2017Publication date: September 28, 2017Inventors: Michael Patrick Johnson, Steve Lee, Mat Balez, Nirmal Patel
-
Patent number: 9746915Abstract: Examples of methods and systems for providing calibration for eye gesture recognition are described. In some examples, calibration can be executed via a head-mountable device. A method for calibration of a system may account for changes in orientation of the head-mountable device, update recognition of the eye gestures, or increase efficiency of the system, for example. The head-mountable device may be configured to receive signals indicative of eye gestures from an eye gesture-detection system and in response to receiving a second command confirming that the signal is indicative of an eye gesture command, to make adjustments to the eye gesture recognition system and/or the reference signals. The head-mountable device may calibrate an eye gesture recognition system via implicit or explicit calibration, for example.Type: GrantFiled: October 22, 2012Date of Patent: August 29, 2017Assignee: Google Inc.Inventors: Hayes Solos Raffle, Thad Eugene Starner, Mat Balez, Michael Patrick Johnson, Yong Zhao, Bo Wu, David Sparks, Nirmal J. Patel
-
Publication number: 20170236515Abstract: Methods and systems are described herein related to enabling service providers to address voice-activated commands. An example method may involve: receiving a first utterance on a computing device, where the first utterance includes a first command; selecting a service action corresponding to the first command; determining a selected service provider for the selected service action, where the selected service provider is selected from a plurality of service providers; and sending a service fulfillment request to the selected service provider to execute the selected service action.Type: ApplicationFiled: April 30, 2017Publication date: August 17, 2017Inventors: Yury Pinsky, Steven John Lee, Mat Balez, Michael J. LeBeau
-
Patent number: 9710056Abstract: The present description discloses systems and methods for changing the state of a device. One embodiment may include a device configured to provide a device in a first state, receive a signal indicative of first angular data of the device, and compare the first angular data to a first threshold. The device may then execute instructions to initiate a timer when the first angular data is greater than the first threshold, receive a signal indicative of a second angular data of the device, and compare the second angular data to a second threshold. When the second angular data is less than the second threshold and the time passed is within a pre-determined time period, the device may execute instructions to transition the device to a second state.Type: GrantFiled: March 21, 2012Date of Patent: July 18, 2017Assignee: Google Inc.Inventors: Michael Patrick Johnson, Steve Lee, Mat Balez, Nirmal Patel
-
Patent number: 9666187Abstract: Methods and systems are described herein related to enabling service providers to address voice-activated commands. An example method may involve: receiving a first utterance on a computing device, where the first utterance includes a first command; selecting a service action corresponding to the first command; determining a selected service provider for the selected service action, where the selected service provider is selected from a plurality of service providers; and sending a service fulfillment request to the selected service provider to execute the selected service action.Type: GrantFiled: July 25, 2013Date of Patent: May 30, 2017Assignee: Google Inc.Inventors: Yury Pinsky, Steven John Lee, Mat Balez, Michael J LeBeau
-
Publication number: 20170084276Abstract: Embodiments may be implemented by a computing device, such as a head-mountable display, in order to use a single guard phrase to enable different voice commands in different interface modes. An example device includes an audio sensor and a computing system configured to analyze audio data captured by the audio sensor to detect speech that includes a predefined guard phrase, and to operate in a plurality of different interface modes comprising at least a first and a second interface mode. During operation in the first interface mode, the computing system may initially disable one or more first-mode speech commands, and respond to detection of the guard phrase by enabling the one or more first-mode speech commands. During operation in the second interface mode, the computing system may initially disable a second-mode speech command, and to respond to the guard phrase by enabling the second-mode speech command.Type: ApplicationFiled: December 6, 2016Publication date: March 23, 2017Inventors: Michael J. LeBeau, Mat Balez
-
Publication number: 20160357266Abstract: Methods and systems for hands-free browsing in a wearable computing device are provided. A wearable computing device may provide for display a view of a first card of a plurality of cards which include respective virtual displays of content. The wearable computing device may determine a first rotation of the wearable computing device about a first axis and one or more eye gestures. Based on a combination of the first rotation and the eye gestures, the wearable computing device may provide for display the navigable menu, which may include an alternate view of the first card and at least a portion of one or more cards. Then, based on a determined second rotation of the wearable computing device about a second axis and based on a direction of the second rotation, the wearable computing device may generate a display indicative of navigation through the navigable menu.Type: ApplicationFiled: August 16, 2016Publication date: December 8, 2016Inventors: Nirmal Patel, Hayes Solos Raffle, Mat Balez, Max Benjamin Braun, Jerrica Jones
-
Patent number: 9442631Abstract: Methods and systems for hands-free browsing in a wearable computing device are provided. A wearable computing device may provide for display a view of a first card of a plurality of cards which include respective virtual displays of content. The wearable computing device may determine a first rotation of the wearable computing device about a first axis and one or more eye gestures. Based on a combination of the first rotation and the eye gestures, the wearable computing device may provide for display the navigable menu, which may include an alternate view of the first card and at least a portion of one or more cards. Then, based on a determined second rotation of the wearable computing device about a second axis and based on a direction of the second rotation, the wearable computing device may generate a display indicative of navigation through the navigable menu.Type: GrantFiled: March 17, 2014Date of Patent: September 13, 2016Assignee: Google Inc.Inventors: Nirmal Patel, Hayes Solos Raffle, Mat Balez, Max Benjamin Braun, Jerrica Jones
-
Patent number: 9368113Abstract: Methods, apparatus, and computer-readable media are described herein related to a user interface (UI) that can be implemented on a head-mountable device (HMD). The UI can include a voice-navigable UI. The voice-navigable UI can include a voice navigable menu that includes one or more menu items comprising an original menu item and an added command menu item. The original menu item can be associated with one or more original commands, and the added menu item can be associated with one or more added commands, including a first added command. The interface can also present a first visible menu that includes at least a portion of the voice navigable menu. Responsive to a first utterance comprising the first added command, the interface can invoke the first added command. In some embodiments, the interface can display a second visible menu, wherein the first added command can be displayed above other menu items.Type: GrantFiled: January 30, 2013Date of Patent: June 14, 2016Assignee: Google Inc.Inventors: Michael J. LeBeau, Mat Balez, Yury Pinsky