Abstract: Apparatus is disclosed for processing sparse vectors in a tandem or parallel processing environment. Sparce vectors are those vectors stored in memory with their zero-valued operands deleted. They have a corresponding order vector of bits whose state indicates the order of zero and non zero operands in a corresponding expanded vector. The apparatus fetches the order vectors n bits at a time, n corresponding to the number of tandem processors, and counts the number of one bits. This number of operands is then fetched from memory. The apparatus aligns and orders the fetched sparse vector operands, inserts zero operands where appropriate, and forwards the resulting portion of the expanded vector to the tandem processors for processing.