Abstract: Systems, apparatuses and methods may provide for technology that includes a compute-in-memory (CiM) enabled memory array to conduct digital bit-serial multiply and accumulate (MAC) operations on multi-bit input data and weight data stored in the CiM enabled memory array, an adder tree coupled to the CiM enabled memory array, an accumulator coupled to the adder tree, and an input bit selection stage coupled to the CiM enabled memory array, wherein the input bit selection stage restricts serial bit selection on the multi-bit input data to non-zero values during the digital MAC operations.

Abstract: Systems and methods include technology that receives, with a plurality of cores implemented in one or more of configurable logic or fixed-functionality logic, data associated with a workload, and executing, with the plurality of cores, the workload to process the data and generate partial data. The technology stores the partial data into a memory storage that is accessible by the plurality of cores as the workload is being executed.