Abstract: An execution method of a machine learning model, comprising: generating output and a begin of sentence (BoS) cache of a BoS token using the machine learning model before or after performing model quantization on the machine learning model to generate a quantized model; and executing inference based on the quantized model, and during the inference, input the next token following the BoS token as a first input token and the BoS cache into the quantized model to generate output and cache of the next token, wherein the next token is based on the output of the Bos token or based on an input content.