Patents by Inventor Tania KHATTAR

Tania KHATTAR has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11436524
    Abstract: Techniques for hosting machine learning models are described. In some instances, a method of receiving a request to perform an inference using a particular machine learning model; determining a group of hosts to route the request to, the group of hosts to host a plurality of machine learning models including the particular machine learning model; determining a path to the determined group of hosts; determining a particular host of the group of hosts to perform an analysis of the request based on the determined path, the particular host having the particular machine learning model in memory; routing the request to the particular host of the group of hosts; performing inference on the request using the particular host; and providing a result of the inference to a requester is performed.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: September 6, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Nikhil Kandoi, Ganesh Kumar Gella, Rama Krishna Sandeep Pokkunuri, Sudhakar Rao Puvvadi, Stefano Stefani, Kalpesh N. Sutaria, Enrico Sartorello, Tania Khattar
  • Publication number: 20200104750
    Abstract: Techniques for hosting machine learning models are described. In some instances, a method of receiving a request to perform an inference using a particular machine learning model; determining a group of hosts to route the request to, the group of hosts to host a plurality of machine learning models including the particular machine learning model; determining a path to the determined group of hosts; determining a particular host of the group of hosts to perform an analysis of the request based on the determined path, the particular host having the particular machine learning model in memory; routing the request to the particular host of the group of hosts; performing inference on the request using the particular host; and providing a result of the inference to a requester is performed.
    Type: Application
    Filed: September 28, 2018
    Publication date: April 2, 2020
    Inventors: Nikhil KANDOI, Ganesh Kumar GELLA, Rama Krishna Sandeep POKKUNURI, Sudhakar Rao PUVVADI, Stefano STEFANI, Kalpesh N. SUTARIA, Enrico SARTORELLO, Tania KHATTAR