Patents by Inventor Sujith Ravi
Sujith Ravi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10885277Abstract: The present disclosure provides projection neural networks and example applications thereof. In particular, the present disclosure provides a number of different architectures for projection neural networks, including two example architectures which can be referred to as: Self-Governing Neural Networks (SGNNs) and Projection Sequence Networks (ProSeqoNets). Each projection neural network can include one or more projection layers that project an input into a different space. For example, each projection layer can use a set of projection functions to project the input into a bit-space, thereby greatly reducing the dimensionality of the input and enabling computation with lower resource usage. As such, the projection neural networks provided herein are highly useful for on-device inference in resource-constrained devices. For example, the provided SGNN and ProSeqoNet architectures are particularly beneficial for on-device inference such as, for example, solving natural language understanding tasks on-device.Type: GrantFiled: September 19, 2018Date of Patent: January 5, 2021Assignee: Google LLCInventors: Sujith Ravi, Zornitsa Kozareva
-
Patent number: 10862836Abstract: Implementations relate to automatic response suggestions based on images received in messaging applications. In some implementations, a computer-executed method includes detecting a first image included within a first message received at a second device over a communication network from a first device of a first user, and programmatically analyzing the first image to extract a first image content. The method includes retrieving a first semantic concept associated with the first image content, programmatically generating a suggested response to the first message based on the first semantic concept, and transmitting instructions causing rendering of the suggested response in the messaging application as a suggestion to a second user of the second device.Type: GrantFiled: September 4, 2019Date of Patent: December 8, 2020Assignee: Google LLCInventors: John Patrick McGregor, Jr., Ryan Cassidy, Ariel Fuxman, Vivek Ramavajjala, Sujith Ravi, Sergey Nazarov, Amit Fulay
-
Patent number: 10846618Abstract: A computing device may receive a communication sent from an external computing device. At least one processor of the computing device may determine, using an on-device machine-trained model and based at least in part on the communication, one or more candidate responses to the communication. The at least one processor may receive an indication of a user input that selects a candidate response from the one or more candidate responses. Responsive to receiving the indication of the user input that selects the candidate response, the at least one processor may send the candidate response to the external computing device.Type: GrantFiled: August 25, 2017Date of Patent: November 24, 2020Assignee: Google LLCInventors: Sujith Ravi, Thomas Matthew Rudick, Nathan Dickerson Beach, John Patrick McGregor, Jr., Mirko Ranieri
-
Publication number: 20200349450Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a projection neural network. In one aspect, a projection neural network is configured to receive a projection network input and to generate a projection network output from the projection network input. The projection neural network includes a sequence of one or more projection layers. Each projection layer has multiple projection layer parameters, and is configured to receive a layer input, apply multiple projection layer functions to the layer input, and generate a layer output by applying the projection layer parameters for the projection layer to the projection function outputs.Type: ApplicationFiled: July 13, 2020Publication date: November 5, 2020Inventor: Sujith Ravi
-
Patent number: 10824630Abstract: Methods, systems, apparatus, including computer programs encoded on computer storage medium, to facilitate identification of additional trigger-terms for a structured information card. In one aspect, the method includes actions of accessing data associated with a template for presenting structured information, wherein the accessed data references (i) a label term and (ii) a value. Other actions may include obtaining a candidate label term, identifying one or more entities that are associated with the label term, identifying one or more of the entities that are associated with the candidate label term, and for each particular entity of the one or more entities that are associated with the candidate label term, associating, with the candidate label term, (i) a label term that is associated with the particular entity, and (ii) the value associated with the label term.Type: GrantFiled: October 26, 2016Date of Patent: November 3, 2020Assignee: GOOGLE LLCInventors: Marc Alexander Najork, Sujith Ravi, Michael Bendersky, Peter Shao-sen Young, Timothy Youngjin Sohn, Mingyang Zhang, Thomas Nelson, Xuanhui Wang
-
Publication number: 20200265196Abstract: Systems and methods are provided to pre-train projection networks for use as transferable natural language representation generators. In particular, example pre-training schemes described herein enable learning of transferable deep neural projection representations over randomized locality sensitive hashing (LSH) projections, thereby surmounting the need to store any embedding matrices because the projections can be dynamically computed at inference time.Type: ApplicationFiled: February 14, 2020Publication date: August 20, 2020Inventors: Sujith Ravi, Zornitsa Kozareva, Chinnadhurai Sankar
-
Patent number: 10748066Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a projection neural network. In one aspect, a projection neural network is configured to receive a projection network input and to generate a projection network output from the projection network input. The projection neural network includes a sequence of one or more projection layers. Each projection layer has multiple projection layer parameters, and is configured to receive a layer input, apply multiple projection layer functions to the layer input, and generate a layer output by applying the projection layer parameters for the projection layer to the projection function outputs.Type: GrantFiled: May 18, 2018Date of Patent: August 18, 2020Assignee: Google LLCInventor: Sujith Ravi
-
Publication number: 20200250537Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training an image embedding model. In one aspect, a method comprises: obtaining training data comprising a plurality of training examples, wherein each training example comprises: an image pair comprising a first image and a second image; and selection data indicating one or more of: (i) a co-click rate of the image pair, and (ii) a similar-image click rate of the image pair; and using the training data to train an image embedding model having a plurality of image embedding model parameters.Type: ApplicationFiled: February 1, 2019Publication date: August 6, 2020Inventors: Zhen Li, Yi-ting Chen, Yaxi Gao, Da-Cheng Juan, Aleksei Timofeev, Chun-Ta Lu, Futang Peng, Sujith Ravi, Andrew Tomkins, Thomas J. Duerig
-
Publication number: 20200143114Abstract: Implementations are directed to facilitating user device and/or agent device actions during a communication session. An interactive communications system provides outputs, as outlined below, that are tailored to enhance the functionality of the communication session, reduce the number of dialog “turns” of the communications session and/or the number of user inputs to devices involved in the session, and/or otherwise mitigate consumption of network and/or hardware resources during the communication session. In various implementations, the communication session involves user device(s) of a user, agent device(s) of an agent, and the interactive communications system. The interactive communications system can analyze various communications from the user device(s) and/or agent device(s) during a communication session in which the user (via the user device(s)) directs various communications to the agent, and in which the agent (via the agent device(s)) optionally directs various communications to the user.Type: ApplicationFiled: August 22, 2018Publication date: May 7, 2020Inventors: Robin Dua, Andrew Tomkins, Sujith Ravi
-
Publication number: 20200125956Abstract: The present disclosure provides an application development platform and associated software development kits (“SD-Ks”) that provide comprehensive services for generation, deployment, and management of machine-learned models used by computer applications such as, for example, mobile applications executed by a mobile computing device. In particular, the application development platform and SDKs can provide or otherwise leverage a unified, cross-platform application programming interface (“API”) that enables access to all of the different machine learning services needed for full machine learning functionality within the application. In such fashion, developers can have access to a single SDK for all machine learning services.Type: ApplicationFiled: May 21, 2018Publication date: April 23, 2020Inventors: Sujith Ravi, Gaurav Menghani, Prabhu Kaliamoorthi, Yicheng Fan
-
Publication number: 20200042596Abstract: The present disclosure provides projection neural networks and example applications thereof. In particular, the present disclosure provides a number of different architectures for projection neural networks, including two example architectures which can be referred to as: Self-Governing Neural Networks (SGNNs) and Projection Sequence Networks (ProSeqoNets). Each projection neural network can include one or more projection layers that project an input into a different space. For example, each projection layer can use a set of projection functions to project the input into a bit-space, thereby greatly reducing the dimensionality of the input and enabling computation with lower resource usage. As such, the projection neural networks provided herein are highly useful for on-device inference in resource-constrained devices. For example, the provided SGNN and ProSeqoNet architectures are particularly beneficial for on-device inference such as, for example, solving natural language understanding tasks on-device.Type: ApplicationFiled: September 19, 2018Publication date: February 6, 2020Inventors: Sujith Ravi, Zornitsa Kozareva
-
Publication number: 20190394153Abstract: Implementations relate to automatic response suggestions based on images received in messaging applications. In some implementations, a computer-executed method includes detecting a first image included within a first message received at a second device over a communication network from a first device of a first user, and programmatically analyzing the first image to extract a first image content. The method includes retrieving a first semantic concept associated with the first image content, programmatically generating a suggested response to the first message based on the first semantic concept, and transmitting instructions causing rendering of the suggested response in the messaging application as a suggestion to a second user of the second device.Type: ApplicationFiled: September 4, 2019Publication date: December 26, 2019Applicant: Google LLCInventors: John Patrick MCGREGOR, JR., Ryan CASSIDY, Ariel FUXMAN, Vivek RAMAVAJJALA, Sujith RAVI, Sergey NAZAROV, Amit FULAY
-
Patent number: 10430464Abstract: Systems and methods for adding labels to a graph are disclosed. One system includes a plurality of computing devices including processors and memory storing an input graph generated based on a source data set, where an edge represents a similarity measure between two nodes in the input graph, the input graph being distributed across the plurality of computing devices, and some of the nodes are seed nodes associated with one or more training labels from a set of labels, each training label having an associated original weight. The memory may also store instructions that, when executed by the processors, cause the plurality of distributed computing devices to propagate the training labels through the input graph using a sparsity approximation for label propagation, resulting in learned weights for respective node and label pairs, and automatically update the source data set using node and label pairs selected based on the learned weights.Type: GrantFiled: December 21, 2017Date of Patent: October 1, 2019Assignee: GOOGLE LLCInventors: Sujith Ravi, Qiming Diao
-
Patent number: 10412030Abstract: Implementations relate to automatic response suggestions based on images received in messaging applications. In some implementations, a computer-executed method includes detecting a first image included within a first message received at a second device over a communication network from a first device of a first user, and programmatically analyzing the first image to extract a first image content. The method includes retrieving a first semantic concept associated with the first image content, programmatically generating a suggested response to the first message based on the first semantic concept, and transmitting instructions causing rendering of the suggested response in the messaging application as a suggestion to a second user of the second device.Type: GrantFiled: June 8, 2018Date of Patent: September 10, 2019Assignee: Google LLCInventors: John Patrick McGregor, Jr., Ryan Cassidy, Ariel Fuxman, Vivek Ramavajjala, Sujith Ravi, Sergey Nazarov, Amit Fulay
-
Publication number: 20190220708Abstract: A method includes identifying images associated with a user, where the image is identified as at least one of captured by a user device associated with the user, stored on the user device associated with the user, and stored in cloud storage associated with the user. The method also includes for each of the images, determining one or more labels, wherein the one or more labels are based on at least one of metadata and a primary annotation. The method also includes generating a mapping of the one or more labels to one or more confidence scores, wherein the one or more confidence scores indicate an extent to which the one or more labels apply to corresponding images. The method also includes interacting with the user to obtain identifying information that is used to categorize one or more of the images.Type: ApplicationFiled: March 28, 2019Publication date: July 18, 2019Applicant: Google LLCInventors: Robin DUA, Sujith RAVI
-
Patent number: 10248889Abstract: A method includes identifying images associated with a user, where the image is identified as at least one of captured by a user device associated with the user, stored on the user device associated with the user, and stored in cloud storage associated with the user. The method also includes for each of the images, determining one or more labels, wherein the one or more labels are based on at least one of metadata and a primary annotation. The method also includes generating a mapping of the one or more labels to one or more confidence scores, wherein the one or more confidence scores indicate an extent to which the one or more labels apply to corresponding images. The method also includes interacting with the user to obtain identifying information that is used to categorize one or more of the images.Type: GrantFiled: December 12, 2017Date of Patent: April 2, 2019Assignee: Google LLCInventors: Robin Dua, Sujith Ravi
-
Publication number: 20180336472Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a projection neural network. In one aspect, a projection neural network is configured to receive a projection network input and to generate a projection network output from the projection network input. The projection neural network includes a sequence of one or more projection layers. Each projection layer has multiple projection layer parameters, and is configured to receive a layer input, apply multiple projection layer functions to the layer input, and generate a layer output by applying the projection layer parameters for the projection layer to the projection function outputs.Type: ApplicationFiled: May 18, 2018Publication date: November 22, 2018Inventor: Sujith Ravi
-
Publication number: 20180295081Abstract: Implementations relate to automatic response suggestions based on images received in messaging applications. In some implementations, a computer-executed method includes detecting a first image included within a first message received at a second device over a communication network from a first device of a first user, and programmatically analyzing the first image to extract a first image content. The method includes retrieving a first semantic concept associated with the first image content, programmatically generating a suggested response to the first message based on the first semantic concept, and transmitting instructions causing rendering of the suggested response in the messaging application as a suggestion to a second user of the second device.Type: ApplicationFiled: June 8, 2018Publication date: October 11, 2018Applicant: Google LLCInventors: John Patrick MCGREGOR, Jr., Ryan CASSIDY, Ariel FUXMAN, Vivek RAMAVAJJALA, Sujith RAVI, Sergey NAZAROV, Amit FULAY
-
Patent number: 10015124Abstract: Implementations relate to automatic response suggestions based on images received in messaging applications. In some implementations, a computer-executed method includes detecting a first image included within a first message received at a second device over a communication network from a first device of a first user, and programmatically analyzing the first image to extract a first image content. The method includes retrieving a first semantic concept associated with the first image content, programmatically generating a suggested response to the first message based on the first semantic concept, and transmitting instructions causing rendering of the suggested response in the messaging application as a suggestion to a second user of the second device.Type: GrantFiled: September 19, 2017Date of Patent: July 3, 2018Assignee: Google LLCInventors: John Patrick McGregor, Jr., Ryan Cassidy, Ariel Fuxman, Vivek Ramavajjala, Sujith Ravi, Sergey Nazarov, Amit Fulay
-
Publication number: 20180113865Abstract: Methods, systems, apparatus, including computer programs encoded on computer storage medium, to facilitate identification of additional trigger-terms for a structured information card. In one aspect, the method includes actions of accessing data associated with a template for presenting structured information, wherein the accessed data references (i) a label term and (ii) a value. Other actions may include obtaining a candidate label term, identifying one or more entities that are associated with the label term, identifying one or more of the entities that are associated with the candidate label term, and for each particular entity of the one or more entities that are associated with the candidate label term, associating, with the candidate label term, (i) a label term that is associated with the particular entity, and (ii) the value associated with the label term.Type: ApplicationFiled: October 26, 2016Publication date: April 26, 2018Inventors: Marc Alexander Najork, Sujith Ravi, Michael Bendersky, Peter Shao-sen Young, Timothy Youngjin Sohn, Mingyang Zhang, Thomas Nelson, Xuanhui Wang