Patents by Inventor Robert Stets
Robert Stets has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11948572Abstract: Modulating packetized audio signals in a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request, and generate a first action data structure. The system can identify a content item object based on the trigger keyword, and generate an output signal comprising a first portion corresponding to the first action data structure and a second portion corresponding to the content item object. The system can apply a modulation to the first or second portion of the output signal, and transmit the modulated output signal to the device.Type: GrantFiled: October 24, 2022Date of Patent: April 2, 2024Assignee: GOOGLE LLCInventors: Gaurav Bhaya, Robert Stets
-
Patent number: 11930050Abstract: A system of multi-modal transmission of packetized data in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify first and second candidate interfaces, and respective resource utilization values. The interface management component can select, based on the resource utilization values, the first candidate interface to present the content item. The interface management component can provide the first action data structure to the client computing device for rendering as audio output, and can transmit the content item converted for a first modality to deliver the content item for rendering from the selected interface.Type: GrantFiled: July 1, 2022Date of Patent: March 12, 2024Assignee: GOOGLE LLCInventors: Justin Lewis, Richard Rapp, Gaurav Bhaya, Robert Stets
-
Patent number: 11880442Abstract: The present disclosure is generally directed a data processing system for authenticating packetized audio signals in a voice activated computer network environment. The data processing system can improve the efficiency and effectiveness of auditory data packet transmission over one or more computer networks by, for example, disabling malicious transmissions prior to their transmission across the network. The present solution can also improve computational efficiency by disabling remote computer processes possibly affected by or caused by the malicious audio signal transmissions. By disabling the transmission of malicious audio signals, the system can reduce bandwidth utilization by not transmitting the data packets carrying the malicious audio signal across the networks.Type: GrantFiled: December 6, 2021Date of Patent: January 23, 2024Assignee: GOOGLE LLCInventors: Ken Krieger, Andrew Joseph Alexander Gildfind, Nicholas Salvatore Arini, Simon Michael Rowe, Raimundo Mirisola, Gaurav Bhaya, Robert Stets
-
Publication number: 20230274205Abstract: An example method includes receiving, by one or more processors, a representation of an utterance spoken at a computing device; identifying, by a first computational agent from a plurality of computational agents and based on the utterance, a multi-element task to be performed, wherein the plurality of computational agents includes one or more first party computational agents and a plurality of third-party computational agents; and performing, by the first computational agent, a first sub-set of elements of the multi-element task, wherein performing the first sub-set of elements comprises selecting a second computational agent from the plurality of computational agents to perform a second sub-set of elements of the multi-element task.Type: ApplicationFiled: April 17, 2023Publication date: August 31, 2023Inventors: Robert Stets, Valerie Nygaard, Bogdan Caprita, Bradley M. Abrams, Jason Brant Douglas
-
Publication number: 20230246936Abstract: A selective sensor polling system for a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request. The system can select a template for an action data structure with a plurality of fields. The system can determine to poll a first sensor for data for the first field. The system can determine to obtain data in memory previously collected by the second sensor. The system can generate and transmit the action data structure with the data from the sensor and memory, and transmit the action data structure to a third party device.Type: ApplicationFiled: April 10, 2023Publication date: August 3, 2023Inventors: Gaurav Bhaya, Robert Stets
-
Patent number: 11705121Abstract: A system of multi-modal transmission of packetized data in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify first and second candidate interfaces, and respective resource utilization values. The interface management component can select, based on the resource utilization values, the first candidate interface to present the content item. The interface management component can provide the first action data structure to the client computing device for rendering as audio output, and can transmit the content item converted for a first modality to deliver the content item for rendering from the selected interface.Type: GrantFiled: July 23, 2020Date of Patent: July 18, 2023Assignee: GOOGLE LLCInventors: Gaurav Bhaya, Robert Stets, Umesh Patil
-
Patent number: 11663535Abstract: An example method includes receiving, by one or more processors, a representation of an utterance spoken at a computing device; identifying, by a first computational agent from a plurality of computational agents and based on the utterance, a multi-element task to be performed, wherein the plurality of computational agents includes one or more first party computational agents and a plurality of third-party computational agents; and performing, by the first computational agent, a first sub-set of elements of the multi-element task, wherein performing the first sub-set of elements comprises selecting a second computational agent from the plurality of computational agents to perform a second sub-set of elements of the multi-element task.Type: GrantFiled: November 16, 2017Date of Patent: May 30, 2023Assignee: GOOGLE LLCInventors: Robert Stets, Valerie Nygaard, Bogdan Caprita, Bradley M. Abrams, Jason Brant Douglas
-
Publication number: 20230111040Abstract: Modulating packetized audio signals in a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request, and generate a first action data structure. The system can identify a content item object based on the trigger keyword, and generate an output signal comprising a first portion corresponding to the first action data structure and a second portion corresponding to the content item object. The system can apply a modulation to the first or second portion of the output signal, and transmit the modulated output signal to the device.Type: ApplicationFiled: October 24, 2022Publication date: April 13, 2023Inventors: Gaurav Bhaya, Robert Stets
-
Patent number: 11627065Abstract: A selective sensor polling system for a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request. The system can select a template for an action data structure with a plurality of fields. The system can determine to poll a first sensor for data for the first field. The system can determine to obtain data in memory previously collected by the second sensor. The system can generate and transmit the action data structure with the data from the sensor and memory, and transmit the action data structure to a third party device.Type: GrantFiled: January 19, 2021Date of Patent: April 11, 2023Assignee: GOOGLE LLCInventors: Gaurav Bhaya, Robert Stets
-
Patent number: 11625402Abstract: Systems and methods of voice activated thread management in a voice activated data packet based environment are provided. A natural language processor (“NLP”) component can receive and parse data packets comprising a first input audio signal to identify a first request and a first trigger keyword. A direct action application programming interface (“API”) can generate a first action data structure with a parameter defining a first action. The NLP component can receive and parse a second input audio signal to identify a second request and a second trigger keyword, and can generate a second action data structure with a parameter defining a second action. A pooling component can generate the first and second action data structures into a pooled data structure, and can transmit the pooled data structure to a service provider computing device to cause it device to perform an operation defined by the pooled data structure.Type: GrantFiled: June 29, 2020Date of Patent: April 11, 2023Assignee: GOOGLE LLCInventors: Gaurav Bhaya, Robert Stets
-
Patent number: 11610045Abstract: Systems and methods for automatically determining a content item size may be based on a size of a viewport and a width of a parent element. A script may be configured to determine a size of a viewport, determine a width of a parent element of a resource, and determine a content item size based, at least in part, on the size of the view port and the width of the parent element. A dimension of the determined content item size may be used by a content item selection system to determine a set of content items. A content item selection system may select a content item from the determined set of content items and serve data to effect display of the selected content item in the parent element with the resource.Type: GrantFiled: August 3, 2021Date of Patent: March 21, 2023Assignee: GOOGLE LLCInventors: Graeme John Rimmer, Lewis Jay Hemens, Gaurav Bhaya, Robert Stets
-
Publication number: 20220353303Abstract: A system of multi-modal transmission of packetized data in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify first and second candidate interfaces, and respective resource utilization values. The interface management component can select, based on the resource utilization values, the first candidate interface to present the content item. The interface management component can provide the first action data structure to the client computing device for rendering as audio output, and can transmit the content item converted for a first modality to deliver the content item for rendering from the selected interface.Type: ApplicationFiled: July 1, 2022Publication date: November 3, 2022Inventors: Justin Lewis, Richard Rapp, Gaurav Bhaya, Robert Stets
-
Patent number: 11482216Abstract: Modulating packetized audio signals in a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request, and generate a first action data structure. The system can identify a content item object based on the trigger keyword, and generate an output signal comprising a first portion corresponding to the first action data structure and a second portion corresponding to the content item object. The system can apply a modulation to the first or second portion of the output signal, and transmit the modulated output signal to the device.Type: GrantFiled: June 20, 2019Date of Patent: October 25, 2022Assignee: GOOGLE LLCInventors: Gaurav Bhaya, Robert Stets
-
Publication number: 20220237273Abstract: The present disclosure is generally directed a data processing system for authenticating packetized audio signals in a voice activated computer network environment. The data processing system can improve the efficiency and effectiveness of auditory data packet transmission over one or more computer networks by, for example, disabling malicious transmissions prior to their transmission across the network. The present solution can also improve computational efficiency by disabling remote computer processes possibly affected by or caused by the malicious audio signal transmissions. By disabling the transmission of malicious audio signals, the system can reduce bandwidth utilization by not transmitting the data packets carrying the malicious audio signal across the networks.Type: ApplicationFiled: December 6, 2021Publication date: July 28, 2022Inventors: Ken Krieger, Andrew Joseph Alexander Gildfind, Nicholas Salvatore Arini, Simon Michael Rowe, Raimundo Mirisola, Gaurav Bhaya, Robert Stets
-
Patent number: 11381609Abstract: A system of multi-modal transmission of packetized data in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify first and second candidate interfaces, and respective resource utilization values. The interface management component can select, based on the resource utilization values, the first candidate interface to present the content item. The interface management component can provide the first action data structure to the client computing device for rendering as audio output, and can transmit the content item converted for a first modality to deliver the content item for rendering from the selected interface.Type: GrantFiled: June 23, 2020Date of Patent: July 5, 2022Assignee: GOOGLE LLCInventors: Justin Lewis, Richard Rapp, Gaurav Bhaya, Robert Stets
-
Patent number: 11295738Abstract: Modulating packetized audio signals in a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request, and generate a first action data structure. The system can identify a content item object based on the trigger keyword, and generate an output signal comprising a first portion corresponding to the first action data structure and a second portion corresponding to the content item object. The system can apply a modulation to the first or second portion of the output signal, and transmit the modulated output signal to the device.Type: GrantFiled: July 22, 2019Date of Patent: April 5, 2022Assignee: GOOGLE, LLCInventors: Gaurav Bhaya, Robert Stets, Bailiang Zhou
-
Patent number: 11218434Abstract: Systems and methods to determine the status of transmitted audio packets. The audio packets can include digital components that are presented by a client computing device. Based on presentation variables and determinations of presentation status, the system can generate a predictive model that can be used to dynamically determines presentation values of audio packets prior to their transmission to a client computing device.Type: GrantFiled: May 2, 2017Date of Patent: January 4, 2022Assignee: Google LLCInventors: Jonathan William Ray, Farnaz Azmoodeh, Eric Wood, Congxing Cai, Paul Schelte Albert Reitsma, Glenn Wilson, Peng Zhang, Troy Louis Walker, Gaurav Bhaya, Robert Stets
-
Patent number: 11194893Abstract: The present disclosure is generally directed a data processing system for authenticating packetized audio signals in a voice activated computer network environment. The data processing system can improve the efficiency and effectiveness of auditory data packet transmission over one or more computer networks by, for example, disabling malicious transmissions prior to their transmission across the network. The present solution can also improve computational efficiency by disabling remote computer processes possibly affected by or caused by the malicious audio signal transmissions. By disabling the transmission of malicious audio signals, the system can reduce bandwidth utilization by not transmitting the data packets carrying the malicious audio signal across the networks.Type: GrantFiled: January 5, 2018Date of Patent: December 7, 2021Assignee: Google LLCInventors: Ken Krieger, Andrew Joseph Alexander Gildfind, Nicholas Salvatore Arini, Simon Michael Rowe, Raimundo Mirisola, Gaurav Bhaya, Robert Stets
-
Publication number: 20210374324Abstract: Systems and methods for automatically determining a content item size may be based on a size of a viewport and a width of a parent element. A script may be configured to determine a size of a viewport, determine a width of a parent element of a resource, and determine a content item size based, at least in part, on the size of the view port and the width of the parent element. A dimension of the determined content item size may be used by a content item selection system to determine a set of content items. A content item selection system may select a content item from the determined set of content items and serve data to effect display of the selected content item in the parent element with the resource.Type: ApplicationFiled: August 3, 2021Publication date: December 2, 2021Applicant: GOOGLE LLCInventors: Graeme John RIMMER, Lewis Jay HEMENS, Gaurav BHAYA, Robert STETS
-
Publication number: 20210365628Abstract: Systems and methods for extracting audiovisual features from images and other digital components. A data processing system can extract image data and image features from an input image. The data processing system can match the image features to the image features of a plurality of image to identify candidate images. A second image can be selected from the candidate images based on a request that the data processing system received with the input image.Type: ApplicationFiled: August 3, 2021Publication date: November 25, 2021Applicant: Google LLCInventors: Boon-Lock Yeo, Xuemei GU, Gangjiang Li, Gaurav Bhaya, Robert Stets