Abstract: A system and method of performing “on-the-fly” zooming (i.e., while the video display is in-motion) having infinite value scaling is provided to give the user the ability to zoom-up by any amount while viewing. The variable “on-the-fly” zooming function is performed by a user employing a user interface device, such as a mouse, to select a window of random size in a display screen which is playing an in-motion video display. The information obtained by the user interface device is converted into scaling information and base address information and are stored into temporary registers. On the next video synchronization signal, the scaling and base address information are loaded into registers used to perform scaling on the pixel data retrieved from the frame buffer area in the video system. The new base address ensures that the pixel data is retrieved so that only the data within the window is scaled. The retrieved video data is then scaled using the new scaling information.