Abstract: An video data object distribution system for transfer of video data objects includes a network of digital data file servers. The network of digital data file servers communicate with a client system to transfer video data objects. A scheduling apparatus schedules the transfer of the video data objects. A client streaming device within the client begins transfer of a first segment such that the video data object is started streaming of prior to reception of a totality of the first segment. An ordered sequential transfer device orders and sequentially transfers segments of the video data object to the client system. The preemption device allows persistent video data object transfer of video data object without resending the video data objects. A hierarchical caching controller copies segments of any of the video data objects from a central distribution server to any of the network of data file servers.

Abstract: A video distribution system is implemented on a hierarchical parallel processing system that has clusters that are automatically formed from nodes of computer processing systems. Each cluster has a cluster supervising processor or group leader system that controls cluster configuration, fault detection and isolation, and data distribution. The group leader is determined according to a priority determined during the configuring of the hierarchical parallel processing system. The clusters are able to be reconfigured to allow removal and addition of nodes without impact on operation of the parallel processor system. The cluster provide a node status or heartbeat message that which provides detection and isolation of failure of nodes and disk storage devices within a cluster. The nodes within the cluster are able to join or leave a cluster and not affect performance.

Abstract: A method and apparatus to segment video data files within a video distribution system to facilitate the transfer of the video data files from a file server computing system to client computing system within a video distribution system. The data files are fragmented as a function of demand for the data files, size of each data file of the plurality of data files, amount of retention space available on each of the plurality of data storage devices, and available bandwidth for communication with the client computing systems.

Abstract: A method and apparatus to dynamically segment video data files or portions of video data files within a video distribution system to facilitate the transfer of the video data files from a file server computing system to client computing system within a video distribution system. The video data files or portions of the video data files are dynamically fragmented as a function of demand for the video data files, size of each video data file of the plurality of video data files, amount of retention space available on each of the plurality of data storage devices, and available bandwidth for communication with the client computing systems.

Abstract: A method and apparatus for dynamically balancing the loading of video data storage devices facilitates the transfer of video data by acquiring a listing of locations and loading of all segments of a requested video data. Those storage devices containing copies of each segment of the video data having a least loading are selected. If the loading of the storage devices exceed their maximum capacity, the segment is divided into sub-segments and stored to storage devices with minimum loading. The presence of all segments of the requested video data is determined. If there are missing segments of the requested video data, each of those missing segments is assigned a file identification and file location, such that those missing segments are retrieved from a back-up storage device and assigned to data storage devices having the least loading for transfer to a requesting computer system.

Abstract: A method and apparatus for dynamically balancing the loading of data storage facilities is described. A listing is acquired of locations and loading of all segments of a requested data object including all copies of the segments of the requested data object. Those storage devices containing copies of each segment of the data object having a least loading is selected. If the loading of the storage devices is greater than the maximum loading for the storage devices, the segment is designated to be copied. The presence of all segments of the requested data object is determined. If there are missing segments of the requested data object, each of those missing segments is assigned a file identification and file location, such that those missing segments are assigned to data storage devices having the least loading. The missing segments are retrieved from a back-up storage device.