Abstract: One or more embodiments of the invention have a cluster manager, or other related component, determine upfront which data node should perform a backup of the asset. This is achieved by running a pre-backup step, either periodically or prior to the reception of a backup request, to determine the preferred node for backup. Once the backup request is received, the cluster manager queries the preferred node, if the preferred node is still the best data node to perform the backup, then that data node performs the backup. If, however, the preferred data node no-longer is the best data node for performing the backup, the current preferred data node will signal the cluster manager with an alternative data node that is best data node to perform the backup and the cluster manager will have that alternative data node perform the backup.

Abstract: A method for managing a block-based backup (BBB) includes: sending a file system parsing request to a file system, in which the file system is backed up in a backup storage as the BBB; obtaining file system metadata, in which the file system metadata is generated and stored in the backup storage in response to the file system parsing request; analyzing the file system metadata to generate an index for each asset of the file system; reordering the index of each asset to generate a reordered index; determining a user access level of a user; identifying assets in the reordered index to obtain a set of permitted assets for the user; providing a graphical user interface (GUI) specifying the set of permitted assets; receiving selected assets among the set of permitted assets via the GUI; and restoring the selected assets from the BBB.

Abstract: A method for managing a full backup includes: generating a BBB of a file system, in which the BBB is a full backup of the file system and is generated using a snapshot of the file system; obtaining, using a MBB mechanism, modified file system metadata from the snapshot; obtaining second modified file system metadata from a second snapshot of the file system, in which the snapshot is generated at a first point in time and the second snapshot is generated at a second point in time; comparing the modified file system metadata and the second modified file system metadata to obtain a list of changed assets; initiating an incremental backup of the list of changed assets, in which the list of changed assets is backed up using a FBB mechanism; and generating a synthetic full backup by combining the full backup and the incremental backup.

Abstract: A method for managing data includes obtaining, by a universal connector, a backup request for an incremental backup of a set of files, in response to the backup request: sending a file extent request to a network attached storage (NAS) server, obtaining, from the NAS server, a set of file extents associated with data of the set of files, performing a block-based analysis on the set of file extents using a stored data block table to determine a subset of data blocks, sending a data access request based on the subset of data blocks, obtaining a response from the NAS server, wherein the response comprises the subset of data blocks, and initiating a backup of the set of files using the subset of data blocks.

Abstract: A method for managing data include obtaining, by a universal connector, a backup request for a set of files, in response to the backup request: performing a batching of file read requests for data associated with the set of files to obtain a set of file read batches, sending the set of file read batches to a network attached storage (NAS) server, obtaining a response for each of the set of file read batches from the NAS server, wherein the response for each of the set of file read batches comprise a portion of the data, wherein at least two responses for the set of file read batches are obtained in parallel, writing the portion of the data to a backup container in parallel with the obtaining, and initiating a backup of the set of files using the backup container after the writing is completed.

Abstract: One or more embodiments of the invention relates to a method of performing a restore, by either allowing a user or administrator to choose a preferred data node for performing a restoration, or by having a data protection manager or similar component of a system dynamically choses a preferred data node for performing a restoration based on predetermined criteria. Such predetermined criteria may include each data node's load and workload as well as the type of backup that was performed to make the backup of the at least one selected asset. This will allow for more efficient restoration, while avoiding overloading when restoring assets from a backup in a data cluster.

Abstract: A method for managing data. The method includes obtaining, by a universal connector, a backup request for a file, in response to the backup request: determining a number of read buffers required by a network attached storage (NAS) server to read data associated with the file, generating a set of file read requests based on the number of read buffers, sending, to the NAS server, a data request for the file that includes the set of file read requests, obtaining a data response from the NAS server, wherein the data response comprises a portion of data associated with the file, populating a data array using the data associated with the file, and initiating a backup of the file using the data array.

Abstract: One or more embodiments of the invention improves upon the traditional method of performing a backup, by having a data protection manager or similar component of the system, determine, when a backup is requested, which backup agent should initially perform the backup. That backup agent may then determine among the other applicable backup agents, which backup types are needed and the order each backup agent performs the backup, when more than one backup agent is appropriate. This will allow for a more efficient backup, while avoiding collisions between two or more backup agents trying to simultaneously back up the same data.

Abstract: A method for managing a block-based backup (BBB) includes: obtaining file system metadata, in which the file system metadata is for a file system on a production host; obtaining application metadata from the production host on which an application is executing; identifying assets in the file system metadata based on the application metadata to generate identified assets; generating a virtual file system for the application using the identified assets, in which the virtual file system does not include assets that are not part of the identified assets; receiving a request from the application to access a selected asset, in which the selected asset is one of the identified assets; and providing, using the file system metadata, access to the application for the selected asset in the BBB.

Abstract: A method for writing a file to a network attached storage (NAS) server, the method that includes receiving, by a universal connector executing in a user space, a write request from an application executing in the user space, where the write request includes a filename, and in response to receiving the write request, allocating a dynamic buffer, where a first size of the dynamic buffer is larger than a second size of the filename, sending a system limitation request to the NAS server, receiving, in response to the system limitation request, system limitations from the NAS server, where the system limitations comprise a filename size limit, validating the filename against the system limitations, and sending, based on the validating, the write request to the NAS server.

Abstract: Techniques described herein relate to a method for improving the performance of discovery in a failover cluster or similar cluster-based system. More specifically, by mapping shared volumes to a cluster client instead of individual data nodes, one or more embodiments of the invention avoid duplicative backups and/or restorations of the same shared assets by the each of the data nodes. To map the one or more shared volumes to a cluster client, the cluster manager and/or data protection manger must determine which of the volumes in the cluster are associated with either an active/passive shared volume or a cluster shared volume (CSV). Therefore, the cluster environments assets may be efficiently mapped and accessed.

Abstract: A method for managing data includes obtaining, a backup request for a set of files, in response to the backup request: performing an initial batching of file read requests for data associated with the set of files to obtain a set of file read batches, sending an initial data request to a network attached storage (NAS) server based on a file read batch of the set of file read batches, obtaining a file read response from the NAS server, making a first determination, based on the file read response, that the NAS server is not able to fully service the file read response based on a resource availability of the NAS server, based on the first determination, adjusting the set of file read batches to obtain an modified set of file read batches, sending the modified set of file read batches to the NAS server, and initiating a backup of the set of files using the copy of the data.

Abstract: One or more embodiments of the invention allows for a better method of choosing a data node for performing a data protection event such as a backup and/or restoration. The one or more embodiments of the invention allows a user or administrator to choose a preferred data node for performing the data protection event or has a data protection manager or similar component of a system dynamically choses a preferred data node for performing the data protection event based on predetermined criteria. Such predetermined criteria may include each data node's load and workload as well as the type of backup that will be or was performed. This will allow for a more efficient backup and/or restoration, while avoiding overloading and collisions.

Abstract: One or more embodiments of the invention may improve the operation of one or more computing devices in a cluster environment. More specifically, by mapping backups of shared volumes to a cluster client instead of individual data nodes, one or more embodiments of the invention avoid duplicative backups and/or restorations of the same shared assets by the each of the data nodes. Further, if a failure occurs to the particular node the backup may have originated from, in accordance with one or more embodiments of the invention, because the method is agnostic with regards to the individual nodes the backup may have originated from, any remaining data node can discover the backup and perform a restoration or incremental backup. This will provide better protection for the clustered nodes while requiring minimal user/administrator input.

Abstract: A method for managing data includes obtaining, by a universal connector, a backup request for backing up a file, in response to the backup request: determining a set of versions associated with the file using a file version table, sending a data access request for each version in the set of versions to a network attached storage (NAS) server, obtaining a response from the NAS server based on the data access request, wherein the response comprises the set of file versions associated with the file, initiating a backup of the file using the set of file versions, updating the file version table based on the backup to obtain an updated file version table.

Abstract: A method for managing data includes obtaining, by a universal connector, a data share request to obtain data from a set of files, in response to the data share request: performing a share scan to obtain attributes associated with each file in the set of files, performing a batching of the set of files to obtain a set of file batches using the attributes and using a batch size threshold, performing a request conversion to generate a set of converted batch requests each corresponding to one of the set of file batches, and initiating a data share of the large set of files by sending the set of converted batch requests to a network attached storage (NAS) server.

Abstract: A method for managing data includes obtaining, by a universal connector, a request for an incremental backup of a set of files, in response to the request: performing a metadata batching of the set of files to obtain a set of file batches, performing a request conversion to generate a set of converted metadata requests each corresponding to one of the set of file batches, obtaining a results array from a network attached storage (NAS) server, wherein the results array comprises metadata for each file in the set of files, performing a metadata comparison with an attributes table stored in the universal connector to determine a subset of files, and initiating an incremental backup of the subset of files by sending the set of converted batch requests to a network attached storage (NAS) server to obtain the subset of files and generating the incremental backup.

Abstract: A configuration file having options for validating backups is received. A request is issued to a copy service to take a snapshot of a volume to be backed up. A determination is made from the configuration file that a backup of the volume is to be validated. A script including code for generating first checksums of data captured by the snapshot is invoked. A backup copy of the volume is created using the snapshot. The backup copy is mounted. The mounted backup copy is read and second checksums of data that has been backed up are generated. The script is allowed to compare the first and second checksums. If any of the first and second checksums do not match, the backup copy is failed.

Abstract: Embodiments of the invention relate to methods and systems for efficiently backing up and restoring assets such as files and folders in the form of slices and streams. In one or more embodiments, assets such as files and folders that are to be backed up are placed in appropriate network slice queues, which are then assigned to network streams. The slices/assets are assigned in such a way that each stream has a similar cost and throughput. The backup is performed, and the streams are stored in their own backup containers until a restoration is needed. Once a restoration is needed, the meta-data for the backup is used to restore the files and folders, forming the asset back to their appropriate locations in the target file-system. This results in efficient use of network resources, while minimizing the amount of work the hosts and/or clients must perform during a backup or restoration.

Abstract: Techniques described herein relate to a method for performing data protection services for data stored in a shared storage. The method may include identifying, by a primary data node, a protection policy event initiating performance of data protection services for data stored in the shared storage used by the primary data node and secondary data nodes; in response to identifying the protection policy event: obtaining primary data node monitoring information associated with the primary data node; obtaining secondary data node monitoring information associated with the secondary data nodes; assigning at least one resource limit to the primary data node and the secondary data nodes based on the primary data node monitoring information and the secondary data node monitoring information; and initiating performance of the data protection services by the primary data node and the secondary data nodes based on the assigned at least one resource limit.