Abstract: A method for deploying neural network models on resource-constrained devices is provided. The method includes storing a model file that includes a neural network model and determining constraint information associated with deployment of the neural network model on the electronic device. The method further includes determining a partition of the neural network model based on the constraint information and the model file and extracting sub-models from the neural network model based on the partition. The method further includes receiving an input associated with a machine learning task and executing operations for loading a sub-model in a working memory of the electronic device, applying the sub-model on the input to generate an intermediate result, and unloading the sub-model from the working memory. The method further includes executing the operations for a next sub-model to generate an output and rendering the output. The intermediate result is an input for the next sub-model.