Abstract: A method may comprise receiving a first neural network (NN) model including one or more functions; generating a second NN model in a form of directed acyclic graph (DAG) including one or more graph modules by converting the one or more functions; calculating one or more scale values by obtaining maximum and minimum values of parameters input to the one or more graph modules; updating the parameters based on the one or more scale values; and generating a third NN model, in a form of machine code executable on a particular neural processing unit, including the updated parameters.

Abstract: A method may comprise: converting one or more functions or function call instructions of a first neural network (NN) model into one or more graph modules; analyzing a relationship between one or more inputs and one or more outputs of the one or more graph modules; generating a second NN model including the one or more graph modules as one or more nodes of a directed acyclic graph (DAG) by coupling the one or more inputs and outputs of the graph modules based on the relationship; adding one or more markers corresponding to a weight parameter of one or more layers of the second NN model; and updating the one or more markers according to a pruning algorithm that removes at least a portion of the weight parameter.

Abstract: A method may comprise receiving a first neural network (NN) model including one or more functions; generating a second NN model in a form of directed acyclic graph (DAG) including one or more graph modules by converting the one or more functions; calculating one or more scale values by obtaining maximum and minimum values of parameters input to the one or more graph modules; updating the parameters based on the one or more scale values; and generating a third NN model, in a form of machine code executable on a particular neural processing unit, including the updated parameters.

Abstract: Embodiments relate to converting functions or function call instructions of a first neural network (NN) model to graph modules. Relationships between inputs and outputs of the of graphing modules are analyzed and a second NN model in the form of a directed acyclic graph (DAG) using the graph modules corresponding to the first NN model. Markers are added to the graph modules in the second NN model. Calibration data is generated by collecting input values and output values of each of the graph modules by using the markers. A scale value and an offset value applicable to the second NN model is determined. Based on the scale value and the offset value, a third NN model including weight parameters quantized in the form of integers are generated and training is performed to update the weight parameters of the third NN model.

Abstract: A method may comprise receiving a first neural network (NN) model including one or more functions; generating a second NN model in a form of directed acyclic graph (DAG) including one or more graph modules by converting the one or more functions; calculating one or more scale values by obtaining maximum and minimum values of parameters input to the one or more graph modules; updating the parameters based on the one or more scale values; and generating a third NN model, in a form of machine code executable on a particular neural processing unit, including the updated parameters.