Patents by Inventor Zornitsa KOZAREVA

Zornitsa KOZAREVA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11934791
    Abstract: The present disclosure provides projection neural networks and example applications thereof. In particular, the present disclosure provides a number of different architectures for projection neural networks, including two example architectures which can be referred to as: Self-Governing Neural Networks (SGNNs) and Projection Sequence Networks (ProSeqoNets). Each projection neural network can include one or more projection layers that project an input into a different space. For example, each projection layer can use a set of projection functions to project the input into a bit-space, thereby greatly reducing the dimensionality of the input and enabling computation with lower resource usage. As such, the projection neural networks provided herein are highly useful for on-device inference in resource-constrained devices. For example, the provided SGNN and ProSeqoNet architectures are particularly beneficial for on-device inference such as, for example, solving natural language understanding tasks on-device.
    Type: Grant
    Filed: August 1, 2022
    Date of Patent: March 19, 2024
    Assignee: GOOGLE LLC
    Inventors: Sujith Ravi, Zornitsa Kozareva
  • Publication number: 20230048218
    Abstract: The present disclosure provides projection neural networks and example applications thereof. In particular, the present disclosure provides a number of different architectures for projection neural networks, including two example architectures which can be referred to as: Self-Governing Neural Networks (SGNNs) and Projection Sequence Networks (ProSeqoNets). Each projection neural network can include one or more projection layers that project an input into a different space. For example, each projection layer can use a set of projection functions to project the input into a bit-space, thereby greatly reducing the dimensionality of the input and enabling computation with lower resource usage. As such, the projection neural networks provided herein are highly useful for on-device inference in resource-constrained devices. For example, the provided SGNN and ProSeqoNet architectures are particularly beneficial for on-device inference such as, for example, solving natural language understanding tasks on-device.
    Type: Application
    Filed: August 1, 2022
    Publication date: February 16, 2023
    Inventors: Sujith Ravi, Zornitsa Kozareva
  • Patent number: 11526680
    Abstract: Systems and methods are provided to pre-train projection networks for use as transferable natural language representation generators. In particular, example pre-training schemes described herein enable learning of transferable deep neural projection representations over randomized locality sensitive hashing (LSH) projections, thereby surmounting the need to store any embedding matrices because the projections can be dynamically computed at inference time.
    Type: Grant
    Filed: February 14, 2020
    Date of Patent: December 13, 2022
    Assignee: GOOGLE LLC
    Inventors: Sujith Ravi, Zornitsa Kozareva, Chinnadhurai Sankar
  • Patent number: 11423233
    Abstract: The present disclosure provides projection neural networks and example applications thereof. In particular, the present disclosure provides a number of different architectures for projection neural networks, including two example architectures which can be referred to as: Self-Governing Neural Networks (SGNNs) and Projection Sequence Networks (ProSeqoNets). Each projection neural network can include one or more projection layers that project an input into a different space. For example, each projection layer can use a set of projection functions to project the input into a bit-space, thereby greatly reducing the dimensionality of the input and enabling computation with lower resource usage. As such, the projection neural networks provided herein are highly useful for on-device inference in resource-constrained devices. For example, the provided SGNN and ProSeqoNet architectures are particularly beneficial for on-device inference such as, for example, solving natural language understanding tasks on-device.
    Type: Grant
    Filed: January 5, 2021
    Date of Patent: August 23, 2022
    Assignee: GOOGLE LLC
    Inventors: Sujith Ravi, Zornitsa Kozareva
  • Patent number: 11216735
    Abstract: A method, implemented on at least one computing device each of which has at least one processor, storage, and a communication platform connected to a network for providing synthetic answers to a personal question is disclosed. A personal question is received from a person. One or more entities are extracted from the personal question. One or more relations are extracted from the personal question. A model is selected based on the personal question. One or more synthetic answers to the personal question are obtained based on the one or more entities, the one or more relations, and the selected model.
    Type: Grant
    Filed: October 5, 2015
    Date of Patent: January 4, 2022
    Assignee: VERIZON MEDIA INC.
    Inventors: Zornitsa Kozareva, Scott Gaffney
  • Publication number: 20210124878
    Abstract: The present disclosure provides projection neural networks and example applications thereof. In particular, the present disclosure provides a number of different architectures for projection neural networks, including two example architectures which can be referred to as: Self-Governing Neural Networks (SGNNs) and Projection Sequence Networks (ProSegoNets). Each projection neural network can include one or more projection layers that project an input into a different space. For example, each projection layer can use a set of projection functions to project the input into a bit-space, thereby greatly reducing the dimensionality of the input and enabling computation with lower resource usage. As such, the projection neural networks provided herein are highly useful for on-device inference in resource-constrained devices. For example, the provided SGNN and ProSegoNet architectures are particularly beneficial for on-device inference such as, for example, solving natural language understanding tasks on-device.
    Type: Application
    Filed: January 5, 2021
    Publication date: April 29, 2021
    Inventors: Sujith Ravi, Zornitsa Kozareva
  • Patent number: 10956929
    Abstract: Systems and methods for generating human readable natural language summary for campaign audience are provided. The system includes a memory storing a database including audience segments and tags related to the audience segments. A computer server is in communication with the memory and the database, the computer server programmed to: obtain campaign delivery feed data related to a plurality of campaigns from at least one advertiser in a preset time period; obtain audience feed data including tag information from a data provider; cluster the tag information to find term frequencies for each term in the tag information; identify human understandable terms from the clustered tag information by removing noisy terms; and generate a human understandable report using the human understandable terms in a timely fashion.
    Type: Grant
    Filed: August 20, 2018
    Date of Patent: March 23, 2021
    Assignee: Verizon Media Inc.
    Inventors: Zornitsa Kozareva, Lin Ma, Rohit Bhatia
  • Patent number: 10885277
    Abstract: The present disclosure provides projection neural networks and example applications thereof. In particular, the present disclosure provides a number of different architectures for projection neural networks, including two example architectures which can be referred to as: Self-Governing Neural Networks (SGNNs) and Projection Sequence Networks (ProSeqoNets). Each projection neural network can include one or more projection layers that project an input into a different space. For example, each projection layer can use a set of projection functions to project the input into a bit-space, thereby greatly reducing the dimensionality of the input and enabling computation with lower resource usage. As such, the projection neural networks provided herein are highly useful for on-device inference in resource-constrained devices. For example, the provided SGNN and ProSeqoNet architectures are particularly beneficial for on-device inference such as, for example, solving natural language understanding tasks on-device.
    Type: Grant
    Filed: September 19, 2018
    Date of Patent: January 5, 2021
    Assignee: Google LLC
    Inventors: Sujith Ravi, Zornitsa Kozareva
  • Publication number: 20200265196
    Abstract: Systems and methods are provided to pre-train projection networks for use as transferable natural language representation generators. In particular, example pre-training schemes described herein enable learning of transferable deep neural projection representations over randomized locality sensitive hashing (LSH) projections, thereby surmounting the need to store any embedding matrices because the projections can be dynamically computed at inference time.
    Type: Application
    Filed: February 14, 2020
    Publication date: August 20, 2020
    Inventors: Sujith Ravi, Zornitsa Kozareva, Chinnadhurai Sankar
  • Patent number: 10728203
    Abstract: A method, implemented on at least one computing device, each of which has at least one processor, storage, and a communication platform connected to a network for classifying a question is disclosed. A question is received from a person. A question pattern is determined. A model selected based on the question is retrieved. Further, a decision is made as to whether the question is a personal question based on the question pattern and the selected model.
    Type: Grant
    Filed: August 20, 2018
    Date of Patent: July 28, 2020
    Assignee: Oath Inc.
    Inventors: Zornitsa Kozareva, Scott Gaffney
  • Publication number: 20200042596
    Abstract: The present disclosure provides projection neural networks and example applications thereof. In particular, the present disclosure provides a number of different architectures for projection neural networks, including two example architectures which can be referred to as: Self-Governing Neural Networks (SGNNs) and Projection Sequence Networks (ProSeqoNets). Each projection neural network can include one or more projection layers that project an input into a different space. For example, each projection layer can use a set of projection functions to project the input into a bit-space, thereby greatly reducing the dimensionality of the input and enabling computation with lower resource usage. As such, the projection neural networks provided herein are highly useful for on-device inference in resource-constrained devices. For example, the provided SGNN and ProSeqoNet architectures are particularly beneficial for on-device inference such as, for example, solving natural language understanding tasks on-device.
    Type: Application
    Filed: September 19, 2018
    Publication date: February 6, 2020
    Inventors: Sujith Ravi, Zornitsa Kozareva
  • Patent number: 10540666
    Abstract: The present teaching relates to updating an intent space and estimating intent based on an intent space. In one example, an initial intent space is obtained. Each intent in the initial intent space is characterized in one or more dimensions. At least one model is received. Each of the at least one model provides features in each of the dimensions and relationship thereof. A new intent associated with an intent in the initial intent space is determined based on the at least one model. Based on the new intent, the initial intent space is updated to derive an updated intent space.
    Type: Grant
    Filed: October 5, 2015
    Date of Patent: January 21, 2020
    Assignee: Oath Inc.
    Inventors: Zornitsa Kozareva, Scott Gaffney
  • Publication number: 20180365728
    Abstract: Systems and methods for generating human readable natural language summary for campaign audience are provided. The system includes a memory storing a database including audience segments and tags related to the audience segments. A computer server is in communication with the memory and the database, the computer server programmed to: obtain campaign delivery feed data related to a plurality of campaigns from at least one advertiser in a preset time period; obtain audience feed data including tag information from a data provider; cluster the tag information to find term frequencies for each term in the tag information; identify human understandable terms from the clustered tag information by removing noisy terms; and generate a human understandable report using the human understandable terms in a timely fashion.
    Type: Application
    Filed: August 20, 2018
    Publication date: December 20, 2018
    Inventors: Zornitsa KOZAREVA, Lin MA, Rohit BHATIA
  • Publication number: 20180359209
    Abstract: A method, implemented on at least one computing device, each of which has at least one processor, storage, and a communication platform connected to a network for classifying a question is disclosed. A question is received from a person. A question pattern is determined. A model selected based on the question is retrieved. Further, a decision is made as to whether the question is a personal question based on the question pattern and the selected model.
    Type: Application
    Filed: August 20, 2018
    Publication date: December 13, 2018
    Inventors: Zornitsa Kozareva, Scott Gaffney
  • Patent number: 10110544
    Abstract: A method, implemented on at least one computing device, each of which has at least one processor, storage, and a communication platform connected to a network for classifying a question is disclosed. A question is received from a person. A question pattern is determined. A model selected based on the question is retrieved. Further, a decision is made as to whether the question is a personal question based on the question pattern and the selected model.
    Type: Grant
    Filed: October 5, 2015
    Date of Patent: October 23, 2018
    Assignee: Oath Inc.
    Inventors: Zornitsa Kozareva, Scott Gaffney
  • Patent number: 9767400
    Abstract: The present teaching relates to generating a card based on intent. In one example, a request is received for generating a card to be provided to a user. Intent of the user with respect to the card is obtained. One or more modules are selected to be put into the card based on the intent. The card is generated based on the selected one or more modules.
    Type: Grant
    Filed: October 5, 2015
    Date of Patent: September 19, 2017
    Assignee: YAHOO HOLDINGS, INC.
    Inventors: Abhay Gupta, Scott Gaffney, Zornitsa Kozareva
  • Publication number: 20170098168
    Abstract: A method, implemented on at least one computing device each of which has at least one processor, storage, and a communication platform connected to a network for providing synthetic answers to a personal question is disclosed. A personal question is received from a person. One or more entities are extracted from the personal question. One or more relations are extracted from the personal question. A model is selected based on the personal question. One or more synthetic answers to the personal question are obtained based on the one or more entities, the one or more relations, and the selected model.
    Type: Application
    Filed: October 5, 2015
    Publication date: April 6, 2017
    Inventors: Zornitsa Kozareva, Scott Gaffney
  • Publication number: 20170099249
    Abstract: A method, implemented on at least one computing device, each of which has at least one processor, storage, and a communication platform connected to a network for classifying a question is disclosed. A question is received from a person. A question pattern is determined. A model selected based on the question is retrieved. Further, a decision is made as to whether the question is a personal question based on the question pattern and the selected model.
    Type: Application
    Filed: October 5, 2015
    Publication date: April 6, 2017
    Inventors: Zornitsa Kozareva, Scott Gaffney
  • Publication number: 20170097966
    Abstract: The present teaching relates to updating an intent space and estimating intent based on an intent space. In one example, an initial intent space is obtained. Each intent in the initial intent space is characterized in one or more dimensions. At least one model is received. Each of the at least one model provides features in each of the dimensions and relationship thereof. A new intent associated with an intent in the initial intent space is determined based on the at least one model. Based on the new intent, the initial intent space is updated to derive an updated intent space.
    Type: Application
    Filed: October 5, 2015
    Publication date: April 6, 2017
    Inventors: Zornitsa Kozareva, Scott Gaffney
  • Publication number: 20170098144
    Abstract: The present teaching relates to generating a card based on intent. In one example, a request is received for generating a card to be provided to a user. Intent of the user with respect to the card is obtained. One or more modules are selected to be put into the card based on the intent. The card is generated based on the selected one or more modules.
    Type: Application
    Filed: October 5, 2015
    Publication date: April 6, 2017
    Inventors: Abhay Gupta, Scott Gaffney, Zornitsa Kozareva