Abstract: Systems and methods for optimizing artificial neural network (ANN) computations based on automatic determination of a batch size are disclosed. An example method may comprise receiving, by an optimization module, an ANN structure associated with the ANN, and generating, based on the ANN structure, a configuration for a computation engine capable of performing computation of the layers of the ANN. The configuration may include information concerning a batch size of one or more layers of the ANN. The batch size of a layer can be determined based on a bandwidth required to read data related to layer, a number of parameters associated with the layer, and a time the layer processes one input dataset from the batch. The batch size of the layer can differ from the batch size of the ANN. The batch size of the layer may differ from a batch size of another layer of ANN.