Abstract: Certain aspects of the present disclosure provide techniques and apparatus for machine learning. In an example method, a weight tensor for a layer of a machine learning model is determined, where the weight tensor comprises per-block values in a first precision encoding. The weight tensor is upscaled to a second precision encoding having a higher precision than the first precision encoding to generate an upscaled weight tensor, and an input tensor for the layer of the machine learning model is accessed. An output tensor for the layer of the machine learning model is generated based on multiplying the upscaled weight tensor with the input tensor.