Abstract: In various examples, systems and methods are disclosed herein for dynamically updating a neural network having a plurality of kernels. The system may identify a first subset of kernels from the plurality of kernels in the neural network. The system may then determine the characteristics of each respective kernel in the first subset. The system may then compare the characteristics of the respective kernels in the first subject to a dynamic rule set. In response to the system comparing the characteristics of the respective kernels in the first subset to the dynamic rule set, the system identifies a second subset of the first subset based on the comparing, automatically generates instructions to combine the second subset of kernels, and updates the neural network based on the one or more instructions. The neural network may have a simplified compute graph based on the above dynamic updating systems and methods.