Patents Assigned to Rapt.ai Inc.
  • Publication number: 20190272461
    Abstract: A system and method for dynamically and automatically sharing resources of a coprocessor AI accelerator based on workload changes during training and inference of a plurality of neural networks. The method comprising steps of receiving a plurality of requests from each neural network and high-performance computing applications (HPCs) through a dynamic adaptive scheduler module. The dynamic adaptive scheduler module morphs the received requests into threads, dimensions and memory sizes. The method then receives the morphed requests from the dynamic adaptive scheduler module through client units. Each of the neural network applications is mapped with at least one of the client units on a graphics processing unit (GPU) hosts. The method then receives the morphed requests from the plurality of client units through a plurality of server units. Further, the method receives the morphed request from the plurality of server units through one or more coprocessors.
    Type: Application
    Filed: May 21, 2019
    Publication date: September 5, 2019
    Applicant: Rapt.ai Inc.
    Inventor: Anil Ravindranath
  • Publication number: 20190073127
    Abstract: A system and method for providing a byte addressable memory for a neural network. The method comprises a step of initiating reading and writing input-output (I/O) request of a file through a neural network application. The method then accesses the file through POSIX APIs. The method maps the accessed file to bytes of a primary memory unit by utilizing load/store CPU instructions. The method maps the bytes to a secondary memory unit through an MMU. The method transmits instructions to a persistent memory aware file system with the MMU mappings and then the instructions are transmitted to the persistent unit. The method receives the reading and writing I/O request from the persistent unit through VFIO driver. The method receives the reading and writing I/O request from VFIO driver through DMA. The method then receives the reading and writing I/O request from the DMA through a memory pertaining to coprocessors.
    Type: Application
    Filed: November 5, 2018
    Publication date: March 7, 2019
    Applicant: Rapt.ai Inc.
    Inventor: Anil Ravindranath