Abstract: A method of operating an electronic device includes: inputting input data to a neural network (NN) model including layers; determining compression information indicating a compressed degree of a bit width of weights and input values of a target layer, wherein the target layer is a layer among the layers in which an operation is to be performed; compressing the weights and the input values to the bit width based on the compression information; packing the compressed weights and the compressed input values into a vector register; performing an operation between the compressed weights and the compressed input values packed into the vector register; and generating output data of the NN model according to an input of the input data based on a result of the operation between the compressed weights and the compressed input values.