Abstract: A backup defect detection system includes a backend and an agent. The backend includes a plurality of file servers backed by a database. The database contains data associated with one or more users. The agent is installed on a user's computing device and in communication with the backend to scan a user's selected folders to determine new or changed files and upload the new or changed files to the backend. The agent is configured to generate one or more logs recording the success or failure type of a file backup and transmit the logs to the backend. The backend is configured to generate a report from the logs, filter and prioritize the report based on a set of user defined importance for each error type and provide the filtered and prioritized report for further action. Related apparatus, systems, techniques and articles are also described.

Abstract: Backing up a data file can be accomplished by processing, in-line and at a first client, a plurality of datablocks taken from the data file. The processing of each datablock includes creating a unique signature of the datablock and determining whether the signature is contained in a database of signatures. Each signature in the database is associated with previously backed up datablocks. The database of signatures includes signatures of previous backed up datablocks that were backed up from at least one other client. Data are transmitted to a remote backup server for backing up the datablock. The transmitted data characterize a link to one of the previously stored datablocks when the signature of the processed datablock is found in the database of signatures. Related apparatus, systems, techniques, and articles are also described.

Abstract: A method of backing up large volumes of data that includes identifying a data file for remote backup; transmitting two or more chunks of the data file in parallel through a communications network to a server to be stored by the server; streaming, compressing, and encrypting prior to transmission each chunk without generating additional data copies for each of the streaming, compressing, and encrypting; detecting an interruption in the transmission a chunk(s); checking the availability and reliability of the communications network; and restarting transmission of the interrupted chunk after a randomized pause period.