Abstract: A method and an apparatus for storing data points are provided. The method comprises: receiving the plurality of data points, each data point of the plurality of data points being represented in a floating-point representation; quantizing each one of the first plurality of data points, by: executing, during a first quantization phase: converting each data point of the plurality of data points into a corresponding first data point of a plurality of first data points; executing, during a second quantization phase: applying, to each first data point of the plurality of first data points a clamping function, thereby converting each first data point of the plurality of first data points into a corresponding second data point of a plurality of second data points; and storing the plurality of second points for further calculations instead of the first plurality of data points.

Abstract: Systems and methods for computing a neural network layer of a neural network are described. A float shift inner product operator is described for computing an inner product between a floating point input vector and a weight vector having weight values that are power of two values. An inner product is computed by performing addition on the sign bits and exponent bits of a floating point input element and corresponding weight element.

Abstract: Methods and processors for using a Neural Network (NN) are disclosed. The method includes, during a first iteration, determining a first sub-network of the NN and training the first sub-network. The method includes during a second iteration a second sub-network of the NN and training the second sub-network. The method includes during an inference iteration of the NN, selecting a target sub-network amongst the first sub-network and the second sub-network, and generating an inference output by employing only the target sub-network of the NN on inference data for reducing computational resources of the processor for generating the inference output.