Abstract: The invention provides the apparatus for and method of processing three-dimensional images, efficiently and effectively rendering 3D images three-dimensional. The present invention's method of processing three-dimensional images avoids repetition of matrix calculation, and effectively sets the picture frame's Memory address. Hence, it is suitable for three-dimensional images with real-time image. Furthermore, the invention could further include a variation memory arrangement method and device, which could interlace in the Memory the scanning line of the first and second 3D images. It is then possible to display the first and second 3D image groups on the display screen in an interlaced manner according to the traditional scanning circuit and address-translating circuit. As a result, the left eye and the right eye can view the first and second 3D image groups separately.