Abstract: A system and method for efficient linear fast attention for vision transformer includes a processor to perform steps of: accessing a machine-learned model including: at least one encoder or one decoder, wherein the encoder is adapted to receive input embeddings to generate an encoded output, the decoder is adapted to receive output embeddings to generate a decoded output; wherein the encoder or the decoder includes an attention network for receiving token embeddings to generate an attention matrix by carrying out the steps of: generating a query, a key, and a value from token embeddings; splitting the query, the key, and the value; generating a global linear attention from the query matrix, generating a sparse blockify attention from the second query matrix, the second key matrix, and the second value matrix; generating attention matrix by concentrating the sparse blockify attention and the global linear attention.