Abstract: In a system for downloading large data sets, when a user downloads a project or other large data set from the file sharing service, the user's computer first determines whether files in the data set are already resident on local storage. Files that are in a locally connected storage device, including network connected storage devices, are copied to the download location specified for the data set to be downloaded. Files that are not in local storage are then downloaded to the download location specified for the data set. Files in local storage are indexed to facilitate matching with files used in the project. Such indexing is based on processing the media data in the media data files to ensure that there is a match. For example, a signature can be generated from a portion of a file, such as a first block of media data from a file. This signature can be added to an index, along with other information about the file, such as metadata from the file, file names or file identifiers and the like.

Abstract: In a system for downloading large data sets, when a user downloads a project or other large data set from the file sharing service, the user's computer first determines whether files in the data set are already resident on local storage. Files that are in a locally connected storage device, including network connected storage devices, are copied to the download location specified for the data set to be downloaded. Files that are not in local storage are then downloaded to the download location specified for the data set. Files in local storage are indexed to facilitate matching with files used in the project. Such indexing is based on processing the media data in the media data files to ensure that there is a match. For example, a signature can be generated from a portion of a file, such as a first block of media data from a file. This signature can be added to an index, along with other information about the file, such as metadata from the file, file names or file identifiers and the like.