Patents by Inventor Bryan Horling

Bryan Horling has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10769155
    Abstract: Methods, apparatus, systems, and computer-readable media are provided for automatically augmenting message exchange threads based on a detected tone of messages exchanged between participants. In various implementations, a message contributed to a message exchange thread involving one or more message exchange clients by a participant may be determined. In various implementations, an idle chatter score associated with the message may be calculated. In various implementations, either a conversational response to the message or content responsive to a search query generated based on the message may be selectively incorporated into the message exchange thread based at least in part on the idle chatter score. In some implementations, a search query suitability score associated with the message may also be calculated.
    Type: Grant
    Filed: May 17, 2016
    Date of Patent: September 8, 2020
    Assignee: GOOGLE LLC
    Inventors: David Kogan, Wangqing Yuan, Wei Chen, Bryan Horling, Michael Itz
  • Patent number: 10650647
    Abstract: The various implementations described herein include methods, devices, and systems for monitoring activity in a home environment. In one aspect, a method performed at a voice-assistant device includes: while operating in an assistant mode, receiving an occupant command to operate in a monitoring mode; in response to the command, transitioning to operating in the monitoring mode; while operating in the monitoring mode, detecting a sound; obtaining a determination as to whether the sound meets one or more monitoring criteria; and in accordance with a determination that the sound meets the one or more monitoring criteria: obtaining a classification of the sound; and generating an alert or notification in accordance with the classification of the sound.
    Type: Grant
    Filed: August 8, 2019
    Date of Patent: May 12, 2020
    Assignee: GOOGLE LLC
    Inventor: Bryan Horling
  • Patent number: 10635832
    Abstract: Methods, apparatus, systems, and computer-readable media are provided for interactive assistant modules to safely access and provide restricted content in group contexts. In various implementations, a dialog between a first individual and an interactive assistant module may be determined to be sensorially perceivable by at least a second individual. Restricted content that is to be automatically incorporated into the dialog by the interactive assistant module may be identified. In various implementations, access to the restricted content may be controlled by the first individual. In various implementations, the restricted content may be conditionally incorporated into the dialog in response to a determination that the second individual is authorized to perceive the restricted content.
    Type: Grant
    Filed: November 28, 2018
    Date of Patent: April 28, 2020
    Assignee: GOOGLE LLC
    Inventors: Bryan Horling, Wan Fen Nicole Quah, Maryam Garrett, Ruijie He
  • Publication number: 20200118567
    Abstract: Techniques are described herein for chatbots to achieve greater social grace by tracking users' states and providing corresponding dialog. In various implementations, input may be received from a user at a client device operating a chatbot, e.g., during a first session between the user and the chatbot. The input may be semantically processed to determine a state expressed by the user to the chatbot. An indication of the state expressed by the user may be stored in memory for future use by the chatbot. It may then be determined, e.g., by the chatbot based on various signals, that a second session between the user and the chatbot is underway. In various implementations, as part of the second session, the chatbot may output a statement formed from a plurality of candidate words, phrases, and/or statements based on the stored indication of the state expressed by the user.
    Type: Application
    Filed: December 12, 2019
    Publication date: April 16, 2020
    Inventors: Bryan Horling, David Kogan, Maryam Garrett, Daniel Kunkle, Wan Fen Nicole Quah, Ruijie He, Wangqing Yuan, Wei Chen, Michael Itz
  • Publication number: 20200117672
    Abstract: Methods, apparatus, systems, and computer-readable media are provided for automatically augmenting message exchange threads based on a detected tone of messages exchanged between participants. In various implementations, a message contributed to a message exchange thread involving one or more message exchange clients by a participant may be determined. In various implementations, an idle chatter score associated with the message may be calculated. In various implementations, either a conversational response to the message or content responsive to a search query generated based on the message may be selectively incorporated into the message exchange thread based at least in part on the idle chatter score. In some implementations, a search query suitability score associated with the message may also be calculated.
    Type: Application
    Filed: December 11, 2019
    Publication date: April 16, 2020
    Inventors: David Kogan, Wangqing Yuan, Wei Chen, Bryan Horling, Michael Itz
  • Patent number: 10572490
    Abstract: Methods, apparatus, systems, and computer-readable media are provided for automatically augmenting message exchange threads based on a detected tone of messages exchanged between participants. In various implementations, a message contributed to a message exchange thread involving one or more message exchange clients by a participant may be determined. In various implementations, an idle chatter score associated with the message may be calculated. In various implementations, either a conversational response to the message or content responsive to a search query generated based on the message may be selectively incorporated into the message exchange thread based at least in part on the idle chatter score. In some implementations, a search query suitability score associated with the message may also be calculated.
    Type: Grant
    Filed: May 17, 2016
    Date of Patent: February 25, 2020
    Assignee: GOOGLE LLC
    Inventors: David Kogan, Wangqing Yuan, Wei Chen, Bryan Horling, Michael Itz
  • Publication number: 20200034116
    Abstract: Methods, apparatus, and computer readable media related to interaction between a user and an automated assistant during a dialog between the user and the automated assistant. Some implementations are directed to adapting a graphical and/or audible presentation of search results provided by the automated assistant for presentation to the user. The adaptation may be in response to attribute(s), of one or more of the search results, referenced in spoken and/or typed textual input provided by the user during the dialog. Some of those implementations may enable a user to provide textual input to navigate the search results within the dialog and within resource and/or interface constraints associated with the dialog. Some of those implementations may additionally and/or alternatively enable adapting, based on textual input provided by a user to the automated assistant, when and/or whether search results having certain attributes are provided to the user by the automated assistant.
    Type: Application
    Filed: October 2, 2019
    Publication date: January 30, 2020
    Inventors: David Kogan, Bryan Horling
  • Patent number: 10515635
    Abstract: Techniques are described herein for chatbots to achieve greater social grace by tracking users' states and providing corresponding dialog. In various implementations, input may be received from a user at a client device operating a chatbot, e.g., during a first session between the user and the chatbot. The input may be semantically processed to determine a state expressed by the user to the chatbot. An indication of the state expressed by the user may be stored in memory for future use by the chatbot. It may then be determined, e.g., by the chatbot based on various signals, that a second session between the user and the chatbot is underway. In various implementations, as part of the second session, the chatbot may output a statement formed from a plurality of candidate words, phrases, and/or statements based on the stored indication of the state expressed by the user.
    Type: Grant
    Filed: November 6, 2018
    Date of Patent: December 24, 2019
    Assignee: GOOGLE LLC
    Inventors: Bryan Horling, David Kogan, Maryam Garrett, Daniel Kunkle, Wan Fen Nicole Quah, Ruijie He, Wangqing Yuan, Wei Chen, Michael Itz
  • Publication number: 20190362608
    Abstract: The various implementations described herein include methods, devices, and systems for monitoring activity in a home environment. In one aspect, a method performed at a voice-assistant device includes: while operating in an assistant mode, receiving an occupant command to operate in a monitoring mode; in response to the command, transitioning to operating in the monitoring mode; while operating in the monitoring mode, detecting a sound; obtaining a determination as to whether the sound meets one or more monitoring criteria; and in accordance with a determination that the sound meets the one or more monitoring criteria: obtaining a classification of the sound; and generating an alert or notification in accordance with the classification of the sound.
    Type: Application
    Filed: August 8, 2019
    Publication date: November 28, 2019
    Inventor: BRYAN HORLING
  • Patent number: 10481861
    Abstract: Methods, apparatus, and computer readable media related to interaction between a user and an automated assistant during a dialog between the user and the automated assistant. Some implementations are directed to adapting a graphical and/or audible presentation of search results provided by the automated assistant for presentation to the user. The adaptation may be in response to attribute(s), of one or more of the search results, referenced in spoken and/or typed textual input provided by the user during the dialog. Some of those implementations may enable a user to provide textual input to navigate the search results within the dialog and within resource and/or interface constraints associated with the dialog. Some of those implementations may additionally and/or alternatively enable adapting, based on textual input provided by a user to the automated assistant, when and/or whether search results having certain attributes are provided to the user by the automated assistant.
    Type: Grant
    Filed: August 30, 2016
    Date of Patent: November 19, 2019
    Assignee: GOOGLE LLC
    Inventors: David Kogan, Bryan Horling
  • Patent number: 10380852
    Abstract: The various implementations described herein include methods, devices, and systems for monitoring activity in a home environment. In one aspect, a method performed at a voice-assistant device includes: (1) while operating in an assistant mode, receiving an occupant voice command to operate in a monitoring mode; (2) in response to the command, transitioning to operating in the monitoring mode; (3) obtaining one or more monitoring criteria; (4) while operating in the monitoring mode, detecting a sound; (5) obtaining a determination as to whether the sound meets the one or more monitoring criteria; and (6) in accordance with a determination that the sound meets the one or more monitoring criteria: (a) obtaining a classification of the sound; and (b) based on sound having a first sound classification, emitting a first simulated occupant response of a plurality of simulated occupant responses via the one or more speakers.
    Type: Grant
    Filed: February 13, 2018
    Date of Patent: August 13, 2019
    Assignee: GOOGLE LLC
    Inventor: Bryan Horling
  • Publication number: 20190220519
    Abstract: Some implementations are directed to translating chatspeak to a normalized form, where the chatspeak is included in natural language input formulated by a user via a user interface input device of a computing device—such as input provided by the user to an automated assistant. The normalized form of the chatspeak may be utilized by the automated assistant in determining reply content that is responsive to the natural language input, and that reply content may be presented to the user via one or more user interface output devices of the computing device of the user. Some implementations are additionally and/or alternatively directed to providing, for presentation to a user, natural language output that includes chatspeak in lieu of a normalized form of the chatspeak, based at least in part on a “chatspeak measure” that is determined based on past usage of chatspeak by the user and/or by additional users.
    Type: Application
    Filed: March 21, 2019
    Publication date: July 18, 2019
    Inventors: Wan Fen Nicole Quah, Bryan Horling, Maryam Garrett, Brian Roark, Richard Sproat
  • Patent number: 10268683
    Abstract: Some implementations are directed to translating chatspeak to a normalized form, where the chatspeak is included in natural language input formulated by a user via a user interface input device of a computing device—such as input provided by the user to an automated assistant. The normalized form of the chatspeak may be utilized by the automated assistant in determining reply content that is responsive to the natural language input, and that reply content may be presented to the user via one or more user interface output devices of the computing device of the user. Some implementations are additionally and/or alternatively directed to providing, for presentation to a user, natural language output that includes chatspeak in lieu of a normalized form of the chatspeak, based at least in part on a “chatspeak measure” that is determined based on past usage of chatspeak by the user and/or by additional users.
    Type: Grant
    Filed: May 17, 2016
    Date of Patent: April 23, 2019
    Assignee: GOOGLE LLC
    Inventors: Wan Fen Nicole Quah, Bryan Horling, Maryam Garrett, Brian Roark, Richard Sproat
  • Publication number: 20190095642
    Abstract: Methods, apparatus, systems, and computer-readable media are provided for interactive assistant modules to safely access and provide restricted content in group contexts. In various implementations, a dialog between a first individual and an interactive assistant module may be determined to be sensorially perceivable by at least a second individual. Restricted content that is to be automatically incorporated into the dialog by the interactive assistant module may be identified. In various implementations, access to the restricted content may be controlled by the first individual. In various implementations, the restricted content may be conditionally incorporated into the dialog in response to a determination that the second individual is authorized to perceive the restricted content.
    Type: Application
    Filed: November 28, 2018
    Publication date: March 28, 2019
    Inventors: Bryan Horling, Wan Fen Nicole Quah, Maryam Garrett, Ruijie He
  • Publication number: 20190074010
    Abstract: Techniques are described herein for chatbots to achieve greater social grace by tracking users' states and providing corresponding dialog. In various implementations, input may be received from a user at a client device operating a chatbot, e.g., during a first session between the user and the chatbot. The input may be semantically processed to determine a state expressed by the user to the chatbot. An indication of the state expressed by the user may be stored in memory for future use by the chatbot. It may then be determined, e.g., by the chatbot based on various signals, that a second session between the user and the chatbot is underway. In various implementations, as part of the second session, the chatbot may output a statement formed from a plurality of candidate words, phrases, and/or statements based on the stored indication of the state expressed by the user.
    Type: Application
    Filed: November 6, 2018
    Publication date: March 7, 2019
    Inventors: Bryan Horling, David Kogan, Maryam Garrett, Daniel Kunkle, Wan Fen Nicole Quah, Ruijie He, Wangqing Yuan, Wei Chen, Michael Itz
  • Patent number: 10185840
    Abstract: Methods, apparatus, systems, and computer-readable media are provided for interactive assistant modules to safely access and provide restricted content in group contexts. In various implementations, a dialog between a first individual and an interactive assistant module may be determined to be sensorially perceivable by at least a second individual. Restricted content that is to be automatically incorporated into the dialog by the interactive assistant module may be identified. In various implementations, access to the restricted content may be controlled by the first individual. In various implementations, the restricted content may be conditionally incorporated into the dialog in response to a determination that the second individual is authorized to perceive the restricted content.
    Type: Grant
    Filed: August 30, 2016
    Date of Patent: January 22, 2019
    Assignee: GOOGLE LLC
    Inventors: Bryan Horling, Wan Fen Nicole Quah, Maryam Garrett, Ruijie He
  • Patent number: 10157615
    Abstract: Techniques are described herein for chatbots to achieve greater social grace by tracking users' states and providing corresponding dialog. In various implementations, input may be received from a user at a client device operating a chatbot, e.g., during a first session between the user and the chatbot. The input may be semantically processed to determine a state expressed by the user to the chatbot. An indication of the state expressed by the user may be stored in memory for future use by the chatbot. It may then be determined, e.g., by the chatbot based on various signals, that a second session between the user and the chatbot is underway. In various implementations, as part of the second session, the chatbot may output a statement formed from a plurality of candidate words, phrases, and/or statements based on the stored indication of the state expressed by the user.
    Type: Grant
    Filed: March 8, 2018
    Date of Patent: December 18, 2018
    Assignee: GOOGLE LLC
    Inventors: Bryan Horling, David Kogan, Maryam Garrett, Daniel Kunkle, Wan Fen Nicole Quah, Ruijie He, Wangqing Yuan, Wei Chen, Michael Itz
  • Publication number: 20180330589
    Abstract: The various implementations described herein include methods, devices, and systems for monitoring activity in a home environment. In one aspect, a method performed at a voice-assistant device includes: (1) while operating in an assistant mode, receiving an occupant voice command to operate in a monitoring mode; (2) in response to the command, transitioning to operating in the monitoring mode; (3) obtaining one or more monitoring criteria; (4) while operating in the monitoring mode, detecting a sound; (5) obtaining a determination as to whether the sound meets the one or more monitoring criteria; and (6) in accordance with a determination that the sound meets the one or more monitoring criteria: (a) obtaining a classification of the sound; and (b) based on sound having a first sound classification, emitting a first simulated occupant response of a plurality of simulated occupant responses via the one or more speakers.
    Type: Application
    Filed: February 13, 2018
    Publication date: November 15, 2018
    Inventor: BRYAN HORLING
  • Publication number: 20180197542
    Abstract: Techniques are described herein for chatbots to achieve greater social grace by tracking users' states and providing corresponding dialog. In various implementations, input may be received from a user at a client device operating a chatbot, e.g., during a first session between the user and the chatbot. The input may be semantically processed to determine a state expressed by the user to the chatbot. An indication of the state expressed by the user may be stored in memory for future use by the chatbot. It may then be determined, e.g., by the chatbot based on various signals, that a second session between the user and the chatbot is underway. In various implementations, as part of the second session, the chatbot may output a statement formed from a plurality of candidate words, phrases, and/or statements based on the stored indication of the state expressed by the user.
    Type: Application
    Filed: March 8, 2018
    Publication date: July 12, 2018
    Inventors: Bryan Horling, David Kogan, Maryam Garrett, Daniel Kunkle, Wan Fen Nicole Quah, Ruijie He, Wangqing Yuan, Wei Chen, Michael Itz
  • Patent number: 9947319
    Abstract: Techniques are described herein for chatbots to achieve greater social grace by tracking users' states and providing corresponding dialog. In various implementations, input may be received from a user at a client device operating a chatbot, e.g., during a first session between the user and the chatbot. The input may be semantically processed to determine a state expressed by the user to the chatbot. An indication of the state expressed by the user may be stored in memory for future use by the chatbot. It may then be determined, e.g., by the chatbot based on various signals, that a second session between the user and the chatbot is underway. In various implementations, as part of the second session, the chatbot may output a statement formed from a plurality of candidate words, phrases, and/or statements based on the stored indication of the state expressed by the user.
    Type: Grant
    Filed: September 27, 2016
    Date of Patent: April 17, 2018
    Assignee: GOOGLE LLC
    Inventors: Bryan Horling, David Kogan, Maryam Garrett, Daniel Kunkle, Wan Fen Nicole Quah, Ruijie He, Wangqing Yuan, Wei Chen, Michael Itz