Abstract: An image processing apparatus and method for scaling an input image are disclosed. The image processing apparatus includes a buffer module, a scaling unit, and a determining unit. The buffer module includes at least a line buffer for buffering pixel data of the input image. The scaling unit is coupled to the buffer module and includes a plurality of filters having different filter tap numbers, wherein the scaling unit utilizes a target filter having a specific filter tap number selected from the plurality of filters to scale the input image according to the pixel data retrieved from the line buffer. The determining unit is coupled to the scaling unit and utilized for receiving an image processing requirement and setting a pixel precision of the input image and selecting the target filter having the specific filter tap number from the filters in the scaling unit according to the image processing requirement.