Abstract: Provided are a method and computing device for determining an optimal parameter set. The method includes receiving an inference model, a dataset, and a constraint, configuring a set of compression methods and a set of parameters, applying a first compression method and a first parameter related to the first compression method to the inference model through a compression pipeline, determining whether a compressed inference model is generated from the inference model through the compression pipeline, when it is determined that the compressed inference model is not generated, applying a second compression method, and a second parameter to the inference model, following the first compression method, when it is determined that the compressed inference model is generated, transmitting the compressed inference model to the target device, and determining an optimal set of parameters on the basis of the performance of the compressed inference model received from the target device.