Abstract: A system, method, and apparatus for improved and faster block processing structure for MPEG decoders is presented herein. The decoder receives compressed images at a Huffman decoder. The Huffman decoder decodes the variable length code, resulting in quantized DCT coefficients. The Huffman decoder also records the matrix position of non-zero coefficients. The Huffman decoder provides the quantized DCT coefficients and the matrix positions of the non-zero coefficients to an inverse quantizer. The inverse quantizer uses the non-zero coefficients to access and inverse quantize only the non-zero quantized coefficients. The quantizer provides the coefficients and positions of the non-zero coefficients to an inverse zig-zag scanner. The inverse zig-zag scanner creates an all zero DCT matrix and calculates the positions of the non-zero coefficients in the DCT matrix. The non-zero coefficients are added to the DCT matrix at the calculated positions.