Abstract: The present disclosure provides a system and method for utilizing an application programming interface (API) for handling multiple requests/models from various users. The API uses a machine learning (ML) model for processing the various requests and producing a plurality of trained models. The system is resilient to a race condition and incorporates an optimized random access memory (RAM) usage. Further, the system efficiently manages the limited available resources by loading and unloading the machine learning models based on their usage, thus maximizing the throughput of the API.