Abstract: Facilitating efficient processing of transformer based models is provided herein. A low latency processing system includes a transformer having an embedding layer and a Tensor Streaming Processor (TSP) having a Matrix Multiplication module (MXM) and Vector Calculation module (VXM). The TSP is arranged to deterministically process information arranged by the embedding layer and an encoder layer with the associated self-attention mechanism, the information being further modified according to the transformer using a general matrix multiply (GEMM) mapped directly on the MXM and associated accumulator. Further, at least some set of information is processed to parallelize the execution of GEMMs across all MXM planes.