Abstract: Systems and methods of convolutional neural network compression are provided. For instance, a convolutional neural network can include an input convolutional layer having a plurality of associated input filters and an output convolutional layer having a plurality of associated output filters. The convolutional neural network implements a connection pattern defining connections between the plurality of input filters and the plurality of output filers. The connection pattern specifies that at least one output filter of the plurality of output filters is connected to only a subset of the plurality of input filters.