Abstract: The present invention is directed to frame-type dependent (FTD) processing in which a different type of processing (including scaling) is performed according to the types (I, B, or P) of pictures or frames being processed. The basis for FTD processing is that errors in B pictures do not propagate to other pictures since decoded B pictures are not used as anchors for the other type of pictures. In other words, since I or P pictures do not depend on B pictures, any errors in a B picture are not spread to any other pictures. Therefore, the present invention puts more memory and processing power to pictures that are most critical to overall video quality.